2024-09-10T23:31:54.222 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:31:54.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:31:54.365 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899802' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYSrDmpsCB/puZtKmin0rrMc5AKvtakepEnZmdF0gvYkBNnZkb9iVGZIULUjWJ15TCjTXEq7NziHDiPQVybv1Q= smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCswoehILwfiDldi+HPPdmHmaoQawnyfcqP5JCnnaJMGfShoU72VdTspFkni21Nb5y69aZGTw85WDHv5lXmvkQ= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOf5cgIYMmgGQc6KDo0efUOY/XaWw83HvTGpcOaKCjchMzBb/rqoGqOTeizU2iOcD9zuIl30GRTHzCrQE3IX+n0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:31:54.366 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:31:54.367 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:31:54.367 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:31:54.369 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:31:54.405 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:31:54.406 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:31:54.406 INFO:teuthology.packaging:ref: None 2024-09-10T23:31:54.406 INFO:teuthology.packaging:tag: None 2024-09-10T23:31:54.406 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:31:54.406 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:31:54.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:31:54.561 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:31:54.562 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:31:54.568 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:31:54.568 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:31:54.575 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:31:54.595 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:31:54.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:31:54.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:26:44.213709', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYSrDmpsCB/puZtKmin0rrMc5AKvtakepEnZmdF0gvYkBNnZkb9iVGZIULUjWJ15TCjTXEq7NziHDiPQVybv1Q='} 2024-09-10T23:31:54.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:26:44.212103', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCswoehILwfiDldi+HPPdmHmaoQawnyfcqP5JCnnaJMGfShoU72VdTspFkni21Nb5y69aZGTw85WDHv5lXmvkQ='} 2024-09-10T23:31:54.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:26:44.214924', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOf5cgIYMmgGQc6KDo0efUOY/XaWw83HvTGpcOaKCjchMzBb/rqoGqOTeizU2iOcD9zuIl30GRTHzCrQE3IX+n0='} 2024-09-10T23:31:54.698 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:31:54.704 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:31:54.704 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:31:54.705 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:31:54.705 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:31:54.815 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2722a07be0>, signals=[15]) 2024-09-10T23:31:54.816 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:31:54.821 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:31:54.821 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:31:54.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:31:54.911 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T23:31:54.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:31:54.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T23:31:54.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:31:55.082 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:31:55.088 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-09-10T23:31:55.106 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-09-10T23:31:55.107 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-09-10T23:31:55.164 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:31:55.165 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:31:55.166 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-09-10T23:31:55.195 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-10T23:31:55.214 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-10T23:31:55.214 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:31:55.272 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:31:55.273 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:31:55.273 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-10T23:31:55.304 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-10T23:31:55.323 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-10T23:31:55.323 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-10T23:31:55.381 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:31:55.382 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:31:55.383 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:31:55.383 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:31:55.383 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-10T23:31:55.412 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:31:55.421 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:31:55.427 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:31:55.427 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:31:55.429 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:31:55.431 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:31:55.449 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:31:55.454 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:31:55.455 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:31:55.487 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:31:55.489 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:31:55.535 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:31:55.635 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:31:55.649 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:31:55.650 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.c': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T23:31:55.650 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:31:55.650 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:31:55.651 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:31:55.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:31:55.668 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.668 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:31:55.668 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T23:31:55.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:31:55.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:31:55.670 DEBUG:teuthology.task.kernel:sha1 for mon.c is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.670 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:31:55.670 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-10T23:31:55.671 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:31:55.671 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-10T23:31:55.726 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:31:55.726 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.727 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:31:55.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.742 INFO:teuthology.orchestra.run.smithi189.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:31:55.742 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:31:55.742 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.742 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:31:55.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.744 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.744 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:31:55.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:31:55.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum upgrade -y linux-firmware 2024-09-10T23:31:55.899 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum upgrade -y linux-firmware 2024-09-10T23:31:55.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum upgrade -y linux-firmware 2024-09-10T23:31:59.362 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T23:32:00.119 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.2 MB 00:02 2024-09-10T23:32:01.538 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-10T23:32:02.038 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.2 MB 00:04 2024-09-10T23:32:03.578 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-10T23:32:03.797 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-10T23:32:06.264 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-10T23:32:07.848 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-10T23:32:08.181 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T23:32:08.195 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T23:32:08.852 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-10T23:32:09.649 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-10T23:32:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-10T23:32:10.645 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-10T23:32:11.325 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T23:32:14.458 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-10T23:32:16.067 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-10T23:32:16.655 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-10T23:32:16.656 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-10T23:32:16.656 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-10T23:32:16.766 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:32:16.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:32:16.919 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:32:16.919 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:32:16.921 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi052.front.sepia.ceph.com to complete... 2024-09-10T23:32:17.122 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-10T23:32:18.207 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-10T23:32:18.208 INFO:teuthology.orchestra.run.smithi189.stdout:Nothing to do. 2024-09-10T23:32:18.209 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-10T23:32:18.307 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.c... 2024-09-10T23:32:18.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:32:18.455 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:32:18.455 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:32:18.458 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi189.front.sepia.ceph.com to complete... 2024-09-10T23:32:19.302 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-10T23:32:19.303 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-09-10T23:32:19.303 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-10T23:32:19.419 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:32:19.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:32:19.576 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:32:19.576 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:32:19.578 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi033.front.sepia.ceph.com to complete... 2024-09-10T23:32:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10 23:32:27 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:32:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:FINISHED --2024-09-10 23:32:27-- 2024-09-10T23:32:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:Total wall clock time: 10s 2024-09-10T23:32:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:Downloaded: 1 files, 343M in 10s (34.0 MB/s) 2024-09-10T23:32:27.339 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:32:27.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:32:29.551 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying... ######################################## 2024-09-10T23:32:29.726 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing... ######################################## 2024-09-10T23:32:29.838 INFO:teuthology.orchestra.run.smithi052.stdout:Updating / installing... 2024-09-10T23:32:32.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10 23:32:32 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:32:32.126 INFO:teuthology.orchestra.run.smithi033.stderr:FINISHED --2024-09-10 23:32:32-- 2024-09-10T23:32:32.126 INFO:teuthology.orchestra.run.smithi033.stderr:Total wall clock time: 13s 2024-09-10T23:32:32.127 INFO:teuthology.orchestra.run.smithi033.stderr:Downloaded: 1 files, 343M in 12s (28.4 MB/s) 2024-09-10T23:32:32.130 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:32:32.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:32:34.329 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying... ######################################## 2024-09-10T23:32:34.504 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing... ######################################## 2024-09-10T23:32:34.625 INFO:teuthology.orchestra.run.smithi033.stdout:Updating / installing... 2024-09-10T23:32:38.152 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:32:38.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10 23:32:38 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:32:38.168 INFO:teuthology.orchestra.run.smithi189.stderr:FINISHED --2024-09-10 23:32:38-- 2024-09-10T23:32:38.168 INFO:teuthology.orchestra.run.smithi189.stderr:Total wall clock time: 20s 2024-09-10T23:32:38.168 INFO:teuthology.orchestra.run.smithi189.stderr:Downloaded: 1 files, 343M in 19s (17.8 MB/s) 2024-09-10T23:32:38.171 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.c... 2024-09-10T23:32:38.171 DEBUG:teuthology.orchestra.run.smithi189:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:32:40.269 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying... ######################################## 2024-09-10T23:32:40.521 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing... ######################################## 2024-09-10T23:32:40.624 INFO:teuthology.orchestra.run.smithi189.stdout:Updating / installing... 2024-09-10T23:32:43.059 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:32:48.617 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:33:18.459 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:33:18.460 DEBUG:teuthology.orchestra.run.smithi052:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:33:18.543 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:33:18.544 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:33:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:33:18.546 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:33:18.547 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:33:18.548 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:33:18.549 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:33:18.550 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:33:18.551 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:33:18.552 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:33:18.553 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:33:18.554 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:33:18.555 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:33:18.556 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:33:18.557 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:33:18.558 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:33:18.559 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:33:18.560 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:33:18.561 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:33:18.562 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:33:18.563 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:33:18.564 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:33:18.565 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:33:18.566 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:33:18.567 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:33:18.568 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:33:18.569 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:33:18.571 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:33:18.572 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:33:18.573 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:33:18.574 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:33:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:33:18.576 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:33:18.577 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:33:18.578 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:33:18.579 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:33:18.580 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:33:18.581 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:33:18.582 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:33:18.583 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:33:18.584 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:33:18.585 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:33:18.586 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:33:18.587 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:33:18.588 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:33:18.589 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:33:18.590 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:33:18.591 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:33:18.592 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:33:18.593 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:33:18.594 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:33:18.595 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:33:18.596 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:33:18.597 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:33:18.598 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:33:18.599 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:33:18.600 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:33:18.601 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:33:18.602 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:33:18.603 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:33:18.604 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:33:18.605 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:33:18.606 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:33:18.607 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:33:18.608 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:33:18.609 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:33:18.610 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:33:18.611 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:33:18.612 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:33:18.613 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:33:18.614 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:33:18.615 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:33:18.616 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:33:18.617 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:33:18.618 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:33:18.619 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:33:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:33:18.621 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:33:18.622 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:33:18.623 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:33:18.624 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:33:18.625 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:33:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:33:18.627 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:33:18.628 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:33:18.629 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:33:18.630 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:33:18.631 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:33:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:33:18.633 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:33:18.634 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:33:18.635 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:33:18.636 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:33:18.637 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:33:18.638 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:33:18.639 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:33:18.640 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:33:18.641 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:33:18.642 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:33:18.643 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:33:18.644 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:33:18.645 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:33:18.646 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:33:18.647 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:33:18.648 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:33:18.649 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:33:18.650 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:33:18.651 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:33:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:33:18.653 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:33:18.654 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:33:18.655 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:33:18.656 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:33:18.657 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:33:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:33:18.659 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:33:18.660 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:33:18.661 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:33:18.662 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:33:18.663 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:33:18.664 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:33:18.665 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:33:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:33:18.667 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:33:18.668 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:33:18.669 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:33:18.670 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:33:18.671 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:33:18.672 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:33:18.673 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:33:18.674 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:33:18.675 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:33:18.676 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:33:18.677 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:33:18.678 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:33:18.679 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:33:18.680 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:33:18.681 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:33:18.682 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:33:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:33:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:33:18.685 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:33:18.686 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:33:18.687 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:33:18.688 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:33:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:33:18.690 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:18.694 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.694 DEBUG:teuthology.orchestra.run.smithi052:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:18.718 INFO:teuthology.orchestra.run.smithi052.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: fi 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:18.719 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.720 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T23:33:18.721 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-09-10T23:33:18.796 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-09-10T23:33:18.796 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-09-10T23:33:18.796 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-09-10T23:33:18.796 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 82.el9 2024-09-10T23:33:18.796 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8274670 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-09-10T23:33:18.797 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:33:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:33:18.799 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:33:18.799 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:18.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:33:19.389 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-10T23:33:20.822 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:33:20.867 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-10T23:33:20.869 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-10T23:33:20.884 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.P57KSAWJPM 2024-09-10T23:33:20.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.P57KSAWJPM 2024-09-10T23:33:20.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.P57KSAWJPM 2024-09-10T23:33:21.089 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.P57KSAWJPM is 6KB 2024-09-10T23:33:21.111 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.P57KSAWJPM 2024-09-10T23:33:21.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:33:21.187 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:33:21.187 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:33:21.187 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:33:21.187 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:33:21.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:21.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-10T23:33:23.386 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:33:23.386 DEBUG:teuthology.orchestra.run.smithi033:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:33:23.466 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:33:23.467 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:33:23.468 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:33:23.469 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:33:23.470 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:33:23.471 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:33:23.471 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:33:23.471 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:33:23.472 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:33:23.473 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:33:23.474 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:33:23.475 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:33:23.476 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:33:23.477 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:33:23.478 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:33:23.479 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:33:23.480 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:33:23.481 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:33:23.482 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:33:23.483 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:33:23.484 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:33:23.485 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:33:23.486 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:33:23.487 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:33:23.488 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:33:23.489 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:33:23.490 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:33:23.491 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:33:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:33:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:33:23.494 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:33:23.495 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:33:23.496 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:33:23.497 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:33:23.498 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:33:23.499 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:33:23.500 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:33:23.501 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:33:23.502 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:33:23.503 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:33:23.504 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:33:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:33:23.506 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:33:23.507 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:33:23.508 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:33:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:33:23.510 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:33:23.511 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:33:23.512 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:33:23.513 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:33:23.514 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:33:23.515 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:33:23.516 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:33:23.517 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:33:23.518 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:33:23.519 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:33:23.520 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:33:23.521 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:33:23.522 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:33:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:33:23.524 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:33:23.525 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:33:23.526 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:33:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:33:23.528 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:33:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:33:23.530 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:33:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:33:23.532 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:33:23.533 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:33:23.534 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:33:23.535 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:33:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:33:23.537 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:33:23.538 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:33:23.539 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:33:23.540 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:33:23.541 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:33:23.542 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:33:23.543 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:33:23.544 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:33:23.545 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:33:23.546 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:33:23.547 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:33:23.548 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:33:23.549 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:33:23.550 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:33:23.551 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:33:23.552 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:33:23.553 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:33:23.554 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:33:23.555 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:33:23.556 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:33:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:33:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:33:23.559 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:33:23.560 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:33:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:33:23.562 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:33:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:33:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:33:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:33:23.566 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:33:23.567 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:33:23.568 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:33:23.569 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:33:23.570 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:33:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:33:23.572 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:33:23.573 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:33:23.574 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:33:23.575 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:33:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:33:23.577 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:33:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:33:23.579 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:33:23.580 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:33:23.581 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:33:23.582 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:33:23.583 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:33:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:33:23.585 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:33:23.586 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:33:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:33:23.588 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:33:23.589 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:33:23.590 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:33:23.591 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:33:23.592 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:33:23.593 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:33:23.594 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:33:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:33:23.596 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:33:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:33:23.598 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:33:23.599 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:33:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:33:23.601 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:33:23.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:33:23.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:33:23.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:33:23.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:33:23.602 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:33:23.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:33:23.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:33:23.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:33:23.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:33:23.605 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:33:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:33:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:33:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:33:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:33:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:33:23.607 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:33:23.614 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:33:23.616 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:33:23.617 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:33:23.618 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:33:23.619 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:33:23.620 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:33:23.621 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:33:23.622 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:33:23.623 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:33:23.624 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:33:23.625 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:33:23.626 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:33:23.627 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:33:23.628 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:33:23.629 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:33:23.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:33:23.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:33:23.630 INFO:teuthology.orchestra.run.smithi033.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:23.633 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.633 DEBUG:teuthology.orchestra.run.smithi033:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: fi 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:done 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.657 INFO:teuthology.orchestra.run.smithi033.stdout:fi 2024-09-10T23:33:23.658 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 82.el9 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8274670 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-09-10T23:33:23.731 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-09-10T23:33:23.732 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:33:23.733 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:33:23.733 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:33:23.733 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:23.734 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:33:24.294 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-09-10T23:33:25.678 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:33:25.709 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-09-10T23:33:25.712 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-09-10T23:33:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.k9kdkHYwXZ 2024-09-10T23:33:25.728 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k9kdkHYwXZ 2024-09-10T23:33:25.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.k9kdkHYwXZ 2024-09-10T23:33:25.937 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.k9kdkHYwXZ is 6KB 2024-09-10T23:33:25.986 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.k9kdkHYwXZ 2024-09-10T23:33:26.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:33:26.063 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:33:26.064 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:33:26.064 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:33:26.064 INFO:teuthology.orchestra.run.smithi033.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:33:26.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:26.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-09-10T23:33:27.949 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:33:27.949 DEBUG:teuthology.orchestra.run.smithi189:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:28.035 INFO:teuthology.orchestra.run.smithi189.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.035 INFO:teuthology.orchestra.run.smithi189.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.035 INFO:teuthology.orchestra.run.smithi189.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:33:28.036 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:33:28.037 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:33:28.038 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:33:28.039 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:33:28.040 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:33:28.041 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:33:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:33:28.043 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:33:28.044 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:33:28.045 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:33:28.046 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:33:28.047 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:33:28.048 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:33:28.049 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:33:28.050 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:33:28.051 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:33:28.052 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:33:28.053 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:33:28.054 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:33:28.055 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:33:28.056 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:33:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:33:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:33:28.059 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:33:28.060 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:33:28.061 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:33:28.062 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:33:28.063 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:33:28.064 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:33:28.065 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:33:28.066 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:33:28.067 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:33:28.068 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:33:28.069 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:33:28.070 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:33:28.071 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:33:28.072 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:33:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:33:28.074 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:33:28.075 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:33:28.076 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:33:28.077 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:33:28.078 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:33:28.079 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:33:28.080 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:33:28.081 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:33:28.082 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:33:28.083 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:33:28.084 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:33:28.085 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:33:28.086 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:33:28.087 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:33:28.088 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:33:28.089 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:33:28.090 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:33:28.091 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:33:28.092 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:33:28.093 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:33:28.094 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:33:28.095 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:33:28.096 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:33:28.097 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:33:28.098 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:33:28.099 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:33:28.100 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:33:28.101 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:33:28.102 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:33:28.103 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:33:28.104 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:33:28.105 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:33:28.106 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:33:28.107 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:33:28.108 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:33:28.109 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:33:28.110 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:33:28.111 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:33:28.112 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:33:28.113 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:33:28.114 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:33:28.115 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:33:28.116 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:33:28.117 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:33:28.118 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:33:28.119 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:33:28.120 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:33:28.121 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:33:28.122 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:33:28.123 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:33:28.124 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:33:28.125 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:33:28.126 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:33:28.127 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:33:28.128 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:33:28.129 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:33:28.130 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:33:28.131 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:33:28.132 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:33:28.133 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:33:28.134 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:33:28.135 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:33:28.136 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:33:28.137 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:33:28.138 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:33:28.139 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:33:28.140 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:33:28.141 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:33:28.142 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:33:28.143 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:33:28.144 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:33:28.145 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:33:28.146 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:33:28.147 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:33:28.148 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:33:28.149 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:33:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:33:28.151 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:33:28.152 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:33:28.153 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:33:28.154 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:33:28.155 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:33:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:33:28.157 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:33:28.158 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:33:28.159 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:33:28.160 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:33:28.161 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:33:28.162 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:33:28.163 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:33:28.164 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:33:28.165 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:33:28.166 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:33:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:33:28.168 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:33:28.169 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:33:28.170 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:33:28.171 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:33:28.172 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:33:28.173 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:33:28.174 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:33:28.175 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:33:28.176 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:33:28.177 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:33:28.178 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:33:28.179 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:33:28.180 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:33:28.181 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:33:28.182 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:33:28.183 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:33:28.184 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:33:28.185 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:33:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:28.189 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.190 DEBUG:teuthology.orchestra.run.smithi189:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:28.213 INFO:teuthology.orchestra.run.smithi189.stdout: fi 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:done 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.214 INFO:teuthology.orchestra.run.smithi189.stdout:fi 2024-09-10T23:33:28.215 DEBUG:teuthology.orchestra.run.smithi189:> sudo rpm -qi grub2-tools 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Name : grub2-tools 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Epoch : 1 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Version : 2.06 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Release : 82.el9 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: x86_64 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Group : Unspecified 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Size : 8274670 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:License : GPLv3+ 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:33:28.289 INFO:teuthology.orchestra.run.smithi189.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:Packager : builder@centos.org 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:Vendor : CentOS 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:Summary : Support tools for GRUB. 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:Description : 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:hardware devices. 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:33:28.290 INFO:teuthology.orchestra.run.smithi189.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:33:28.291 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:33:28.291 INFO:teuthology.task.kernel:Updating grub on smithi189 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:28.291 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:33:28.888 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-09-10T23:33:30.227 INFO:teuthology.orchestra.run.smithi189.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:33:30.253 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-09-10T23:33:30.255 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T23:33:30.271 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.djSdMpM0VL 2024-09-10T23:33:30.272 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.djSdMpM0VL 2024-09-10T23:33:30.338 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.djSdMpM0VL 2024-09-10T23:33:30.472 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.djSdMpM0VL is 6KB 2024-09-10T23:33:30.521 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.djSdMpM0VL 2024-09-10T23:33:30.536 DEBUG:teuthology.orchestra.run.smithi189:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:33:30.603 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:33:30.603 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:33:30.603 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:33:30.603 INFO:teuthology.orchestra.run.smithi189.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:33:30.605 DEBUG:teuthology.orchestra.run.smithi189:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:33:30.766 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-09-10T23:33:51.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T23:33:51.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:33:51.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:33:56.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T23:33:56.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:33:56.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:00.773 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-10T23:34:00.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:34:00.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:09.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-09-10T23:34:14.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-10T23:34:18.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:34:18.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:19.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-10T23:34:23.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:34:23.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:28.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:34:28.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:31.297 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-10T23:34:41.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-10T23:34:43.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:34:43.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:53.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:34:53.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:34:57.053 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-09-10T23:35:12.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:35:12.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:35:12.778 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-10T23:35:13.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:35:13.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:35:13.238 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-09-10T23:35:13.272 INFO:teuthology.orchestra.run.smithi033.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:13.272 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:13.272 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:35:13.272 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:35:14.273 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T23:35:14.274 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:35:14.486 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-09-10T23:35:14.536 DEBUG:teuthology.parallel:result is None 2024-09-10T23:35:18.745 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:35:30.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:35:30.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:35:31.217 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T23:35:31.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:35:31.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:35:31.714 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T23:35:31.748 INFO:teuthology.orchestra.run.smithi052.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:31.748 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:31.749 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:35:31.749 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:35:32.749 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T23:35:32.749 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:35:32.846 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-10T23:35:32.877 DEBUG:teuthology.parallel:result is None 2024-09-10T23:35:43.310 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:35:58.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:35:58.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:35:58.756 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T23:35:59.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:35:59.290 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:35:59.290 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-10T23:35:59.329 INFO:teuthology.orchestra.run.smithi189.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:59.329 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:35:59.329 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:35:59.329 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:36:00.330 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-10T23:36:00.330 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:36:00.456 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-09-10T23:36:00.490 DEBUG:teuthology.parallel:result is None 2024-09-10T23:36:00.490 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:36:00.498 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:36:00.499 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:36:00.503 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:36:00.507 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:36:00.544 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:36:00.556 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:36:00.570 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:36:00.570 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:36:00.582 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:36:00.586 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:36:00.636 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:36:00.648 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:36:00.648 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:36:00.653 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:36:00.672 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:36:00.720 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.739 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.743 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.751 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.762 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.774 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:36:00.777 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:36:00.788 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:36:00.789 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:36:00.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:36:00.797 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:36:00.851 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:36:00.867 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:36:00.867 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:36:00.871 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:36:00.875 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:36:00.909 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.139 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:01.211 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:01.273 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:36:01.273 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:36:01.327 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.508 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:01.576 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:01.643 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:36:01.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:36:01.697 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.773 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:36:01.879 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:01.952 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:36:02.014 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:36:02.014 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:36:02.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-09-10T23:36:02.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-10T23:36:02.077 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-10T23:36:02.155 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:36:02.159 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:36:02.189 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:36:02.636 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:36:02.644 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:36:02.644 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:36:02.662 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:36:02.677 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:36:02.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-09-10T23:36:02.792 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-09-10T23:36:02.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-10T23:36:02.904 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-10T23:36:02.905 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-10T23:36:03.000 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-10T23:36:03.004 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:36:03.004 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-09-10T23:36:03.053 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-09-10T23:36:03.054 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-10T23:36:03.093 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-10T23:36:03.094 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-10T23:36:03.138 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-10T23:36:03.139 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:36:03.139 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:36:03.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:36:03.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:36:03.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:36:03.257 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:36:03.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:36:03.315 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:36:03.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:36:03.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:36:03.447 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:36:03.510 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:36:03.522 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T23:36:03.525 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T23:36:03.660 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:36:03.675 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:36:03.676 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi052.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:40:48.878 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-10T23:40:48.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:40:48.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:48.983 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-09-10T23:40:49.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-09-10T23:40:49.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:40:49.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:49.211 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T23:40:49.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T23:40:49.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:40:49.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:40:49.451 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T23:40:49.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T23:40:49.565 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:40:49.577 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:40:49.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:40:49.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:40:49.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:40:49.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:40:49.586 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:40:49.587 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:40:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:40:49.649 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:40:49.668 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:40:49.673 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:40:49.681 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:40:49.698 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:40:49.725 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-09-10T23:40:49.733 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-10T23:40:49.750 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-09-10T23:40:49.751 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-10T23:40:49.758 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-10T23:40:49.774 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-10T23:40:49.780 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:40:49.787 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:40:49.803 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:40:49.809 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:40:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:40:49.832 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:40:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.913 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.919 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:40:49.925 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:40:49.926 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-10T23:40:49.926 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.926 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.926 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.926 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.927 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:40:49.933 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:40:49.933 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-10T23:40:49.933 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.933 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.933 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.934 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:40:49.935 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:40:49.943 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:40:49.944 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:40:49.944 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:40:49.944 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:40:49.949 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:40:49.949 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:40:49.950 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:40:49.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:49.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:40:49.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:49.954 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T23:40:49.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:40:50.113 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:40:50.113 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:40:50.125 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:40:50.125 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:40:50.136 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T23:40:50.136 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T23:40:50.346 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:40:50.346 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:40:50.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:40:50.354 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:40:50.354 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:40:50.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:40:50.375 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:40:50.375 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:40:50.375 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:40:50.407 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:40:50.408 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:40:50.413 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:40:50.413 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:40:50.435 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T23:40:50.435 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:40:50.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:40:50.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:40:50.533 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:40:50.587 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:40:50.591 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:40:50.612 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:40:50.642 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-09-10T23:40:50.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-09-10T23:40:50.647 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-10T23:40:50.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-10T23:40:50.667 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-10T23:40:50.670 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-10T23:40:50.926 INFO:teuthology.orchestra.run.smithi033.stdout:45 files removed 2024-09-10T23:40:50.928 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-10T23:40:50.953 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-10T23:40:50.959 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:40:50.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:40:50.990 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T23:40:51.924 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 152 kB/s | 84 kB 00:00 2024-09-10T23:40:51.947 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 151 kB/s | 84 kB 00:00 2024-09-10T23:40:51.971 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 139 kB/s | 84 kB 00:00 2024-09-10T23:40:52.497 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 47 kB/s | 24 kB 00:00 2024-09-10T23:40:52.513 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 49 kB/s | 24 kB 00:00 2024-09-10T23:40:52.592 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2024-09-10T23:40:53.014 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-09-10T23:40:53.022 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-09-10T23:40:53.117 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-09-10T23:40:54.705 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T23:40:54.892 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T23:40:55.114 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-10T23:40:56.590 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-10T23:40:56.785 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-10T23:40:57.098 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-10T23:41:01.182 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-10T23:41:02.327 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-10T23:41:02.891 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-10T23:41:03.058 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-10T23:41:03.954 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T23:41:03.986 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-10T23:41:04.683 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 19 kB 00:00 2024-09-10T23:41:05.057 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T23:41:05.595 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T23:41:10.509 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-10T23:41:11.804 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-10T23:41:11.926 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-10T23:41:13.131 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:13.131 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:13.143 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:41:13.144 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:41:13.145 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:41:13.146 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:41:13.148 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:41:13.150 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:41:13.151 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:41:13.220 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-09-10T23:41:13.244 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-09-10T23:41:13.244 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-09-10T23:41:13.244 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-09-10T23:41:13.244 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-09-10T23:41:13.244 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:41:13.245 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:41:13.246 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:41:13.247 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:41:13.248 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:41:13.249 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:41:13.250 INFO:teuthology.orchestra.run.smithi033.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:41:13.251 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:41:13.252 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:41:13.253 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:41:13.254 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:41:13.255 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:41:13.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:41:13.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-09-10T23:41:13.258 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-09-10T23:41:13.259 INFO:teuthology.orchestra.run.smithi033.stdout:Install 149 Packages 2024-09-10T23:41:13.259 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 8 Packages 2024-09-10T23:41:13.259 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:41:13.259 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 240 M 2024-09-10T23:41:13.259 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-09-10T23:41:13.870 INFO:teuthology.orchestra.run.smithi033.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-10T23:41:14.061 INFO:teuthology.orchestra.run.smithi033.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-10T23:41:14.136 INFO:teuthology.orchestra.run.smithi033.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-10T23:41:14.312 INFO:teuthology.orchestra.run.smithi033.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 9.6 MB/s | 5.5 MB 00:00 2024-09-10T23:41:14.368 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.368 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.378 INFO:teuthology.orchestra.run.smithi033.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 9.9 MB/s | 2.4 MB 00:00 2024-09-10T23:41:14.380 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:41:14.381 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.382 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:41:14.383 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.385 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:41:14.387 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.388 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.391 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.392 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.406 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T23:41:14.407 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T23:41:14.408 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T23:41:14.409 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.411 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T23:41:14.414 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.415 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T23:41:14.445 INFO:teuthology.orchestra.run.smithi033.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-10T23:41:14.457 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-10T23:41:14.482 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-10T23:41:14.485 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T23:41:14.485 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:41:14.486 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:41:14.487 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:41:14.488 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-10T23:41:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:41:14.490 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:41:14.491 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:41:14.492 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:41:14.493 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:41:14.494 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:41:14.495 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:41:14.496 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:41:14.497 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-10T23:41:14.498 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T23:41:14.499 INFO:teuthology.orchestra.run.smithi052.stdout:Install 149 Packages 2024-09-10T23:41:14.499 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 8 Packages 2024-09-10T23:41:14.499 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:41:14.499 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 240 M 2024-09-10T23:41:14.499 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T23:41:14.509 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T23:41:14.510 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T23:41:14.511 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T23:41:14.512 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T23:41:14.513 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:41:14.514 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:41:14.514 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:41:14.514 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:41:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:41:14.518 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:41:14.519 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:41:14.520 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:41:14.521 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:41:14.522 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:41:14.523 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-10T23:41:14.524 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T23:41:14.525 INFO:teuthology.orchestra.run.smithi189.stdout:Install 149 Packages 2024-09-10T23:41:14.525 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-10T23:41:14.525 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:41:14.525 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 240 M 2024-09-10T23:41:14.525 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-10T23:41:14.754 INFO:teuthology.orchestra.run.smithi033.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-10T23:41:14.996 INFO:teuthology.orchestra.run.smithi033.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-10T23:41:15.038 INFO:teuthology.orchestra.run.smithi033.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 610 kB/s | 25 kB 00:00 2024-09-10T23:41:15.196 INFO:teuthology.orchestra.run.smithi189.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-10T23:41:15.505 INFO:teuthology.orchestra.run.smithi033.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 16 MB/s | 17 MB 00:01 2024-09-10T23:41:15.587 INFO:teuthology.orchestra.run.smithi189.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.3 MB/s | 900 kB 00:00 2024-09-10T23:41:15.654 INFO:teuthology.orchestra.run.smithi189.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T23:41:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-10T23:41:15.680 INFO:teuthology.orchestra.run.smithi033.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.3 MB/s | 225 kB 00:00 2024-09-10T23:41:15.705 INFO:teuthology.orchestra.run.smithi033.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 544 kB/s | 27 kB 00:00 2024-09-10T23:41:15.706 INFO:teuthology.orchestra.run.smithi052.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-10T23:41:15.731 INFO:teuthology.orchestra.run.smithi033.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 633 kB/s | 32 kB 00:00 2024-09-10T23:41:15.764 INFO:teuthology.orchestra.run.smithi033.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 755 kB 00:00 2024-09-10T23:41:15.790 INFO:teuthology.orchestra.run.smithi033.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T23:41:15.815 INFO:teuthology.orchestra.run.smithi033.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:41:15.849 INFO:teuthology.orchestra.run.smithi033.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.4 MB/s | 507 kB 00:00 2024-09-10T23:41:15.907 INFO:teuthology.orchestra.run.smithi052.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.4 MB/s | 900 kB 00:00 2024-09-10T23:41:15.951 INFO:teuthology.orchestra.run.smithi033.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 444 kB/s | 45 kB 00:00 2024-09-10T23:41:15.998 INFO:teuthology.orchestra.run.smithi052.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.5 MB/s | 145 kB 00:00 2024-09-10T23:41:16.058 INFO:teuthology.orchestra.run.smithi033.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.3 MB/s | 143 kB 00:00 2024-09-10T23:41:16.175 INFO:teuthology.orchestra.run.smithi033.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.4 MB/s | 161 kB 00:00 2024-09-10T23:41:16.329 INFO:teuthology.orchestra.run.smithi189.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.5 MB/s | 2.4 MB 00:00 2024-09-10T23:41:16.383 INFO:teuthology.orchestra.run.smithi033.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 9.7 MB/s | 5.5 MB 00:00 2024-09-10T23:41:16.390 INFO:teuthology.orchestra.run.smithi052.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 6.7 MB/s | 5.5 MB 00:00 2024-09-10T23:41:16.434 INFO:teuthology.orchestra.run.smithi033.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-10T23:41:16.492 INFO:teuthology.orchestra.run.smithi033.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-10T23:41:16.503 INFO:teuthology.orchestra.run.smithi052.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.7 MB/s | 2.4 MB 00:00 2024-09-10T23:41:16.559 INFO:teuthology.orchestra.run.smithi033.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.3 MB/s | 85 kB 00:00 2024-09-10T23:41:16.591 INFO:teuthology.orchestra.run.smithi052.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-09-10T23:41:16.676 INFO:teuthology.orchestra.run.smithi033.stdout:(26/157): python3-rados-19.3.0-4854.g8f219c47.e 641 kB/s | 321 kB 00:00 2024-09-10T23:41:16.679 INFO:teuthology.orchestra.run.smithi189.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 4.4 MB/s | 1.5 MB 00:00 2024-09-10T23:41:16.885 INFO:teuthology.orchestra.run.smithi033.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 9.8 MB/s | 3.2 MB 00:00 2024-09-10T23:41:16.910 INFO:teuthology.orchestra.run.smithi033.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 730 kB/s | 171 kB 00:00 2024-09-10T23:41:16.969 INFO:teuthology.orchestra.run.smithi033.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 410 kB/s | 34 kB 00:00 2024-09-10T23:41:16.994 INFO:teuthology.orchestra.run.smithi033.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T23:41:17.071 INFO:teuthology.orchestra.run.smithi189.stdout:(6/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.6 MB/s | 5.5 MB 00:02 2024-09-10T23:41:17.141 INFO:teuthology.orchestra.run.smithi052.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 7.5 MB/s | 4.8 MB 00:00 2024-09-10T23:41:18.027 INFO:teuthology.orchestra.run.smithi033.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 7.1 MB/s | 7.4 MB 00:01 2024-09-10T23:41:18.136 INFO:teuthology.orchestra.run.smithi033.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.6 MB/s | 291 kB 00:00 2024-09-10T23:41:18.328 INFO:teuthology.orchestra.run.smithi033.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 10 MB/s | 14 MB 00:01 2024-09-10T23:41:18.353 INFO:teuthology.orchestra.run.smithi033.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 227 kB/s | 49 kB 00:00 2024-09-10T23:41:18.387 INFO:teuthology.orchestra.run.smithi033.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 282 kB/s | 16 kB 00:00 2024-09-10T23:41:18.421 INFO:teuthology.orchestra.run.smithi033.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T23:41:18.463 INFO:teuthology.orchestra.run.smithi033.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 10 MB/s | 783 kB 00:00 2024-09-10T23:41:18.479 INFO:teuthology.orchestra.run.smithi033.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 313 kB/s | 18 kB 00:00 2024-09-10T23:41:18.524 INFO:teuthology.orchestra.run.smithi052.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 8.9 MB/s | 17 MB 00:01 2024-09-10T23:41:18.579 INFO:teuthology.orchestra.run.smithi189.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 4.8 MB 00:01 2024-09-10T23:41:18.658 INFO:teuthology.orchestra.run.smithi052.stdout:(9/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 7.2 MB/s | 11 MB 00:01 2024-09-10T23:41:18.683 INFO:teuthology.orchestra.run.smithi052.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 159 kB/s | 25 kB 00:00 2024-09-10T23:41:18.742 INFO:teuthology.orchestra.run.smithi052.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.8 MB/s | 225 kB 00:00 2024-09-10T23:41:18.801 INFO:teuthology.orchestra.run.smithi052.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 465 kB/s | 27 kB 00:00 2024-09-10T23:41:18.851 INFO:teuthology.orchestra.run.smithi052.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 640 kB/s | 32 kB 00:00 2024-09-10T23:41:18.920 INFO:teuthology.orchestra.run.smithi052.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 755 kB 00:00 2024-09-10T23:41:18.973 INFO:teuthology.orchestra.run.smithi052.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-10T23:41:18.981 INFO:teuthology.orchestra.run.smithi033.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 13 MB/s | 50 MB 00:03 2024-09-10T23:41:19.019 INFO:teuthology.orchestra.run.smithi052.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:41:19.064 INFO:teuthology.orchestra.run.smithi033.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 133 kB/s | 80 kB 00:00 2024-09-10T23:41:19.077 INFO:teuthology.orchestra.run.smithi052.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T23:41:19.082 INFO:teuthology.orchestra.run.smithi189.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 5.3 MB/s | 22 MB 00:04 2024-09-10T23:41:19.150 INFO:teuthology.orchestra.run.smithi189.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 387 kB/s | 25 kB 00:00 2024-09-10T23:41:19.151 INFO:teuthology.orchestra.run.smithi033.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-10T23:41:19.179 INFO:teuthology.orchestra.run.smithi033.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-10T23:41:19.233 INFO:teuthology.orchestra.run.smithi033.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-10T23:41:19.260 INFO:teuthology.orchestra.run.smithi033.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-10T23:41:19.284 INFO:teuthology.orchestra.run.smithi033.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T23:41:19.308 INFO:teuthology.orchestra.run.smithi033.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T23:41:19.374 INFO:teuthology.orchestra.run.smithi033.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T23:41:19.411 INFO:teuthology.orchestra.run.smithi052.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-10T23:41:19.461 INFO:teuthology.orchestra.run.smithi052.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 910 kB/s | 45 kB 00:00 2024-09-10T23:41:19.483 INFO:teuthology.orchestra.run.smithi033.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-10T23:41:19.548 INFO:teuthology.orchestra.run.smithi052.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.6 MB/s | 143 kB 00:00 2024-09-10T23:41:19.603 INFO:teuthology.orchestra.run.smithi052.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.9 MB/s | 161 kB 00:00 2024-09-10T23:41:19.662 INFO:teuthology.orchestra.run.smithi052.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 5.4 MB/s | 321 kB 00:00 2024-09-10T23:41:19.720 INFO:teuthology.orchestra.run.smithi052.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T23:41:19.770 INFO:teuthology.orchestra.run.smithi052.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 2.0 MB/s | 99 kB 00:00 2024-09-10T23:41:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T23:41:19.941 INFO:teuthology.orchestra.run.smithi033.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-10T23:41:20.050 INFO:teuthology.orchestra.run.smithi052.stdout:(26/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 14 MB/s | 3.2 MB 00:00 2024-09-10T23:41:20.051 INFO:teuthology.orchestra.run.smithi033.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-10T23:41:20.096 INFO:teuthology.orchestra.run.smithi052.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.4 MB/s | 171 kB 00:00 2024-09-10T23:41:20.147 INFO:teuthology.orchestra.run.smithi052.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 685 kB/s | 34 kB 00:00 2024-09-10T23:41:20.205 INFO:teuthology.orchestra.run.smithi052.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:41:20.217 INFO:teuthology.orchestra.run.smithi033.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-10T23:41:20.253 INFO:teuthology.orchestra.run.smithi033.stdout:(52/157): automake-1.16.2-8.el9.noarch.rpm 731 kB/s | 689 kB 00:00 2024-09-10T23:41:20.325 INFO:teuthology.orchestra.run.smithi033.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-10T23:41:20.351 INFO:teuthology.orchestra.run.smithi033.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-10T23:41:20.426 INFO:teuthology.orchestra.run.smithi033.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-10T23:41:20.451 INFO:teuthology.orchestra.run.smithi033.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-10T23:41:20.543 INFO:teuthology.orchestra.run.smithi033.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T23:41:20.569 INFO:teuthology.orchestra.run.smithi033.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T23:41:20.648 INFO:teuthology.orchestra.run.smithi189.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 5.3 MB/s | 11 MB 00:02 2024-09-10T23:41:20.648 INFO:teuthology.orchestra.run.smithi052.stdout:(30/157): ceph-common-19.3.0-4854.g8f219c47.el9 4.3 MB/s | 22 MB 00:05 2024-09-10T23:41:20.652 INFO:teuthology.orchestra.run.smithi033.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T23:41:20.703 INFO:teuthology.orchestra.run.smithi033.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.6 MB/s | 3.0 MB 00:00 2024-09-10T23:41:20.747 INFO:teuthology.orchestra.run.smithi189.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.2 MB/s | 225 kB 00:00 2024-09-10T23:41:20.770 INFO:teuthology.orchestra.run.smithi033.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-10T23:41:20.811 INFO:teuthology.orchestra.run.smithi033.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-10T23:41:20.814 INFO:teuthology.orchestra.run.smithi189.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 406 kB/s | 27 kB 00:00 2024-09-10T23:41:20.881 INFO:teuthology.orchestra.run.smithi189.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 477 kB/s | 32 kB 00:00 2024-09-10T23:41:20.892 INFO:teuthology.orchestra.run.smithi033.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-10T23:41:20.920 INFO:teuthology.orchestra.run.smithi033.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 316 kB/s | 47 kB 00:00 2024-09-10T23:41:20.946 INFO:teuthology.orchestra.run.smithi033.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-10T23:41:21.004 INFO:teuthology.orchestra.run.smithi033.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T23:41:21.029 INFO:teuthology.orchestra.run.smithi033.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-10T23:41:21.048 INFO:teuthology.orchestra.run.smithi189.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.4 MB/s | 755 kB 00:00 2024-09-10T23:41:21.098 INFO:teuthology.orchestra.run.smithi189.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-10T23:41:21.148 INFO:teuthology.orchestra.run.smithi189.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T23:41:21.165 INFO:teuthology.orchestra.run.smithi052.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 15 MB/s | 14 MB 00:00 2024-09-10T23:41:21.215 INFO:teuthology.orchestra.run.smithi052.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T23:41:21.246 INFO:teuthology.orchestra.run.smithi033.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-10T23:41:21.265 INFO:teuthology.orchestra.run.smithi052.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 991 kB/s | 49 kB 00:00 2024-09-10T23:41:21.265 INFO:teuthology.orchestra.run.smithi189.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.2 MB/s | 507 kB 00:00 2024-09-10T23:41:21.380 INFO:teuthology.orchestra.run.smithi033.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-10T23:41:21.497 INFO:teuthology.orchestra.run.smithi033.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-10T23:41:21.572 INFO:teuthology.orchestra.run.smithi033.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 7.9 MB/s | 4.9 MB 00:00 2024-09-10T23:41:21.649 INFO:teuthology.orchestra.run.smithi189.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 17 MB 00:04 2024-09-10T23:41:21.699 INFO:teuthology.orchestra.run.smithi189.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 911 kB/s | 45 kB 00:00 2024-09-10T23:41:21.705 INFO:teuthology.orchestra.run.smithi033.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-10T23:41:21.757 INFO:teuthology.orchestra.run.smithi052.stdout:(34/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 16 MB/s | 50 MB 00:03 2024-09-10T23:41:21.758 INFO:teuthology.orchestra.run.smithi189.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.4 MB/s | 143 kB 00:00 2024-09-10T23:41:21.774 INFO:teuthology.orchestra.run.smithi052.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 32 kB/s | 16 kB 00:00 2024-09-10T23:41:21.808 INFO:teuthology.orchestra.run.smithi189.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-10T23:41:21.833 INFO:teuthology.orchestra.run.smithi052.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.7 MB/s | 285 kB 00:00 2024-09-10T23:41:21.866 INFO:teuthology.orchestra.run.smithi052.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 8.3 MB/s | 783 kB 00:00 2024-09-10T23:41:21.872 INFO:teuthology.orchestra.run.smithi033.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-10T23:41:21.898 INFO:teuthology.orchestra.run.smithi033.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-09-10T23:41:21.900 INFO:teuthology.orchestra.run.smithi189.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.4 MB/s | 321 kB 00:00 2024-09-10T23:41:21.908 INFO:teuthology.orchestra.run.smithi052.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 242 kB/s | 18 kB 00:00 2024-09-10T23:41:21.967 INFO:teuthology.orchestra.run.smithi189.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T23:41:22.015 INFO:teuthology.orchestra.run.smithi033.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-10T23:41:22.017 INFO:teuthology.orchestra.run.smithi189.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 2.0 MB/s | 99 kB 00:00 2024-09-10T23:41:22.093 INFO:teuthology.orchestra.run.smithi189.stdout:(25/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 6.7 MB/s | 5.5 MB 00:00 2024-09-10T23:41:22.118 INFO:teuthology.orchestra.run.smithi189.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 850 kB/s | 85 kB 00:00 2024-09-10T23:41:22.119 INFO:teuthology.orchestra.run.smithi052.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 5.0 MB/s | 7.4 MB 00:01 2024-09-10T23:41:22.140 INFO:teuthology.orchestra.run.smithi033.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T23:41:22.150 INFO:teuthology.orchestra.run.smithi052.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-10T23:41:22.168 INFO:teuthology.orchestra.run.smithi189.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.4 MB/s | 171 kB 00:00 2024-09-10T23:41:22.210 INFO:teuthology.orchestra.run.smithi189.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 822 kB/s | 34 kB 00:00 2024-09-10T23:41:22.232 INFO:teuthology.orchestra.run.smithi033.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-10T23:41:22.257 INFO:teuthology.orchestra.run.smithi033.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-10T23:41:22.267 INFO:teuthology.orchestra.run.smithi052.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-10T23:41:22.269 INFO:teuthology.orchestra.run.smithi189.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T23:41:22.309 INFO:teuthology.orchestra.run.smithi052.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-10T23:41:22.349 INFO:teuthology.orchestra.run.smithi033.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-09-10T23:41:22.359 INFO:teuthology.orchestra.run.smithi052.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 799 kB/s | 191 kB 00:00 2024-09-10T23:41:22.374 INFO:teuthology.orchestra.run.smithi033.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-10T23:41:22.385 INFO:teuthology.orchestra.run.smithi052.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T23:41:22.418 INFO:teuthology.orchestra.run.smithi052.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T23:41:22.460 INFO:teuthology.orchestra.run.smithi052.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-10T23:41:22.467 INFO:teuthology.orchestra.run.smithi033.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T23:41:22.486 INFO:teuthology.orchestra.run.smithi052.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T23:41:22.492 INFO:teuthology.orchestra.run.smithi033.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-10T23:41:22.494 INFO:teuthology.orchestra.run.smithi189.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.9 MB/s | 3.2 MB 00:00 2024-09-10T23:41:22.536 INFO:teuthology.orchestra.run.smithi052.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-10T23:41:22.626 INFO:teuthology.orchestra.run.smithi033.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-10T23:41:22.628 INFO:teuthology.orchestra.run.smithi052.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-09-10T23:41:22.654 INFO:teuthology.orchestra.run.smithi052.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 916 kB/s | 107 kB 00:00 2024-09-10T23:41:22.695 INFO:teuthology.orchestra.run.smithi052.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-10T23:41:22.737 INFO:teuthology.orchestra.run.smithi052.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 199 kB/s | 22 kB 00:00 2024-09-10T23:41:22.742 INFO:teuthology.orchestra.run.smithi033.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-10T23:41:22.762 INFO:teuthology.orchestra.run.smithi052.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-10T23:41:22.813 INFO:teuthology.orchestra.run.smithi052.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2024-09-10T23:41:22.843 INFO:teuthology.orchestra.run.smithi033.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-10T23:41:22.855 INFO:teuthology.orchestra.run.smithi052.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-10T23:41:22.910 INFO:teuthology.orchestra.run.smithi033.stdout:(86/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-09-10T23:41:22.930 INFO:teuthology.orchestra.run.smithi052.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-10T23:41:22.935 INFO:teuthology.orchestra.run.smithi033.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 401 kB/s | 77 kB 00:00 2024-09-10T23:41:22.955 INFO:teuthology.orchestra.run.smithi052.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-10T23:41:22.960 INFO:teuthology.orchestra.run.smithi033.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-09-10T23:41:22.988 INFO:teuthology.orchestra.run.smithi052.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T23:41:23.031 INFO:teuthology.orchestra.run.smithi052.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-09-10T23:41:23.052 INFO:teuthology.orchestra.run.smithi033.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T23:41:23.064 INFO:teuthology.orchestra.run.smithi052.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-10T23:41:23.077 INFO:teuthology.orchestra.run.smithi033.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T23:41:23.161 INFO:teuthology.orchestra.run.smithi033.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-10T23:41:23.182 INFO:teuthology.orchestra.run.smithi052.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-10T23:41:23.207 INFO:teuthology.orchestra.run.smithi033.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 416 kB/s | 54 kB 00:00 2024-09-10T23:41:23.228 INFO:teuthology.orchestra.run.smithi189.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-10T23:41:23.248 INFO:teuthology.orchestra.run.smithi052.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 133 kB/s | 24 kB 00:00 2024-09-10T23:41:23.290 INFO:teuthology.orchestra.run.smithi052.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 441 kB/s | 47 kB 00:00 2024-09-10T23:41:23.311 INFO:teuthology.orchestra.run.smithi189.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.4 MB/s | 291 kB 00:00 2024-09-10T23:41:23.320 INFO:teuthology.orchestra.run.smithi033.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 369 kB/s | 42 kB 00:00 2024-09-10T23:41:23.341 INFO:teuthology.orchestra.run.smithi052.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-10T23:41:23.362 INFO:teuthology.orchestra.run.smithi189.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 994 kB/s | 49 kB 00:00 2024-09-10T23:41:23.366 INFO:teuthology.orchestra.run.smithi052.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-10T23:41:23.403 INFO:teuthology.orchestra.run.smithi189.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 397 kB/s | 16 kB 00:00 2024-09-10T23:41:23.404 INFO:teuthology.orchestra.run.smithi033.stdout:(94/157): python3-protobuf-3.14.0-13.el9.noarch 546 kB/s | 269 kB 00:00 2024-09-10T23:41:23.416 INFO:teuthology.orchestra.run.smithi052.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-10T23:41:23.454 INFO:teuthology.orchestra.run.smithi033.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 330 kB/s | 44 kB 00:00 2024-09-10T23:41:23.470 INFO:teuthology.orchestra.run.smithi189.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T23:41:23.483 INFO:teuthology.orchestra.run.smithi052.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-10T23:41:23.529 INFO:teuthology.orchestra.run.smithi033.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-10T23:41:23.563 INFO:teuthology.orchestra.run.smithi033.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-10T23:41:23.588 INFO:teuthology.orchestra.run.smithi189.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 6.5 MB/s | 783 kB 00:00 2024-09-10T23:41:23.663 INFO:teuthology.orchestra.run.smithi033.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-10T23:41:23.688 INFO:teuthology.orchestra.run.smithi033.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-10T23:41:23.750 INFO:teuthology.orchestra.run.smithi052.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-10T23:41:23.772 INFO:teuthology.orchestra.run.smithi033.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-10T23:41:23.805 INFO:teuthology.orchestra.run.smithi033.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 821 kB/s | 96 kB 00:00 2024-09-10T23:41:23.825 INFO:teuthology.orchestra.run.smithi052.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-10T23:41:23.867 INFO:teuthology.orchestra.run.smithi052.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-09-10T23:41:23.881 INFO:teuthology.orchestra.run.smithi033.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-09-10T23:41:23.892 INFO:teuthology.orchestra.run.smithi052.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T23:41:23.923 INFO:teuthology.orchestra.run.smithi033.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 383 kB/s | 45 kB 00:00 2024-09-10T23:41:23.926 INFO:teuthology.orchestra.run.smithi052.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-10T23:41:23.984 INFO:teuthology.orchestra.run.smithi052.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T23:41:24.007 INFO:teuthology.orchestra.run.smithi033.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-10T23:41:24.026 INFO:teuthology.orchestra.run.smithi052.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-10T23:41:24.066 INFO:teuthology.orchestra.run.smithi033.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T23:41:24.105 INFO:teuthology.orchestra.run.smithi189.stdout:(37/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 10 MB/s | 50 MB 00:04 2024-09-10T23:41:24.107 INFO:teuthology.orchestra.run.smithi033.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-10T23:41:24.133 INFO:teuthology.orchestra.run.smithi189.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 34 kB/s | 18 kB 00:00 2024-09-10T23:41:24.133 INFO:teuthology.orchestra.run.smithi052.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 580 kB/s | 61 kB 00:00 2024-09-10T23:41:24.149 INFO:teuthology.orchestra.run.smithi033.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2024-09-10T23:41:24.191 INFO:teuthology.orchestra.run.smithi033.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-10T23:41:24.202 INFO:teuthology.orchestra.run.smithi052.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.4 MB/s | 245 kB 00:00 2024-09-10T23:41:24.230 INFO:teuthology.orchestra.run.smithi189.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 640 kB/s | 80 kB 00:00 2024-09-10T23:41:24.258 INFO:teuthology.orchestra.run.smithi033.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-09-10T23:41:24.309 INFO:teuthology.orchestra.run.smithi033.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 977 kB/s | 49 kB 00:00 2024-09-10T23:41:24.319 INFO:teuthology.orchestra.run.smithi052.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-10T23:41:24.337 INFO:teuthology.orchestra.run.smithi033.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T23:41:24.344 INFO:teuthology.orchestra.run.smithi052.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-10T23:41:24.384 INFO:teuthology.orchestra.run.smithi033.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-10T23:41:24.403 INFO:teuthology.orchestra.run.smithi052.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 308 kB/s | 26 kB 00:00 2024-09-10T23:41:24.406 INFO:teuthology.orchestra.run.smithi189.stdout:(40/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 6.6 MB/s | 14 MB 00:02 2024-09-10T23:41:24.431 INFO:teuthology.orchestra.run.smithi189.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 956 kB/s | 191 kB 00:00 2024-09-10T23:41:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-10T23:41:24.453 INFO:teuthology.orchestra.run.smithi052.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-10T23:41:24.464 INFO:teuthology.orchestra.run.smithi189.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-10T23:41:24.478 INFO:teuthology.orchestra.run.smithi052.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T23:41:24.493 INFO:teuthology.orchestra.run.smithi033.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:41:24.506 INFO:teuthology.orchestra.run.smithi189.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T23:41:24.548 INFO:teuthology.orchestra.run.smithi189.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-10T23:41:24.560 INFO:teuthology.orchestra.run.smithi033.stdout:(115/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T23:41:24.562 INFO:teuthology.orchestra.run.smithi052.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-10T23:41:24.573 INFO:teuthology.orchestra.run.smithi189.stdout:(45/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-10T23:41:24.599 INFO:teuthology.orchestra.run.smithi189.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-10T23:41:24.610 INFO:teuthology.orchestra.run.smithi033.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 372 kB/s | 43 kB 00:00 2024-09-10T23:41:24.632 INFO:teuthology.orchestra.run.smithi189.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T23:41:24.658 INFO:teuthology.orchestra.run.smithi189.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T23:41:24.660 INFO:teuthology.orchestra.run.smithi033.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-09-10T23:41:24.670 INFO:teuthology.orchestra.run.smithi052.stdout:(83/157): postgresql-server-13.16-1.el9.x86_64. 7.2 MB/s | 5.8 MB 00:00 2024-09-10T23:41:24.696 INFO:teuthology.orchestra.run.smithi052.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-10T23:41:24.711 INFO:teuthology.orchestra.run.smithi033.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 141 kB/s | 14 kB 00:00 2024-09-10T23:41:24.730 INFO:teuthology.orchestra.run.smithi052.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T23:41:24.755 INFO:teuthology.orchestra.run.smithi052.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T23:41:24.769 INFO:teuthology.orchestra.run.smithi033.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-09-10T23:41:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-10T23:41:24.803 INFO:teuthology.orchestra.run.smithi033.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-10T23:41:24.828 INFO:teuthology.orchestra.run.smithi033.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T23:41:24.862 INFO:teuthology.orchestra.run.smithi033.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:41:24.864 INFO:teuthology.orchestra.run.smithi052.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-10T23:41:24.906 INFO:teuthology.orchestra.run.smithi052.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-10T23:41:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-10T23:41:24.965 INFO:teuthology.orchestra.run.smithi052.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-10T23:41:24.990 INFO:teuthology.orchestra.run.smithi052.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-10T23:41:25.015 INFO:teuthology.orchestra.run.smithi052.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-10T23:41:25.029 INFO:teuthology.orchestra.run.smithi033.stdout:(123/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.7 MB/s | 16 MB 00:01 2024-09-10T23:41:25.040 INFO:teuthology.orchestra.run.smithi052.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-10T23:41:25.071 INFO:teuthology.orchestra.run.smithi033.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 692 kB/s | 144 kB 00:00 2024-09-10T23:41:25.074 INFO:teuthology.orchestra.run.smithi052.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-10T23:41:25.099 INFO:teuthology.orchestra.run.smithi052.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T23:41:25.113 INFO:teuthology.orchestra.run.smithi033.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-10T23:41:25.125 INFO:teuthology.orchestra.run.smithi189.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-10T23:41:25.133 INFO:teuthology.orchestra.run.smithi052.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-10T23:41:25.158 INFO:teuthology.orchestra.run.smithi052.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-10T23:41:25.171 INFO:teuthology.orchestra.run.smithi033.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 180 kB/s | 18 kB 00:00 2024-09-10T23:41:25.200 INFO:teuthology.orchestra.run.smithi052.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-10T23:41:25.213 INFO:teuthology.orchestra.run.smithi033.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-09-10T23:41:25.225 INFO:teuthology.orchestra.run.smithi052.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-10T23:41:25.241 INFO:teuthology.orchestra.run.smithi189.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-10T23:41:25.255 INFO:teuthology.orchestra.run.smithi033.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-09-10T23:41:25.259 INFO:teuthology.orchestra.run.smithi052.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T23:41:25.297 INFO:teuthology.orchestra.run.smithi033.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-09-10T23:41:25.301 INFO:teuthology.orchestra.run.smithi052.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-10T23:41:25.326 INFO:teuthology.orchestra.run.smithi052.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-09-10T23:41:25.339 INFO:teuthology.orchestra.run.smithi033.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-10T23:41:25.359 INFO:teuthology.orchestra.run.smithi189.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 907 kB/s | 689 kB 00:00 2024-09-10T23:41:25.364 INFO:teuthology.orchestra.run.smithi033.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:41:25.407 INFO:teuthology.orchestra.run.smithi033.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-10T23:41:25.440 INFO:teuthology.orchestra.run.smithi033.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T23:41:25.459 INFO:teuthology.orchestra.run.smithi189.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-10T23:41:25.482 INFO:teuthology.orchestra.run.smithi033.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 397 kB/s | 16 kB 00:00 2024-09-10T23:41:25.484 INFO:teuthology.orchestra.run.smithi189.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-10T23:41:25.546 INFO:teuthology.orchestra.run.smithi033.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-09-10T23:41:25.551 INFO:teuthology.orchestra.run.smithi189.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-10T23:41:25.575 INFO:teuthology.orchestra.run.smithi033.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-09-10T23:41:25.593 INFO:teuthology.orchestra.run.smithi189.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-10T23:41:25.625 INFO:teuthology.orchestra.run.smithi033.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 358 kB/s | 28 kB 00:00 2024-09-10T23:41:25.652 INFO:teuthology.orchestra.run.smithi052.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T23:41:25.660 INFO:teuthology.orchestra.run.smithi189.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-10T23:41:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-09-10T23:41:25.710 INFO:teuthology.orchestra.run.smithi033.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-10T23:41:25.710 INFO:teuthology.orchestra.run.smithi189.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T23:41:25.735 INFO:teuthology.orchestra.run.smithi033.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-10T23:41:25.743 INFO:teuthology.orchestra.run.smithi052.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.6 MB/s | 548 kB 00:00 2024-09-10T23:41:25.776 INFO:teuthology.orchestra.run.smithi033.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 537 kB/s | 36 kB 00:00 2024-09-10T23:41:25.794 INFO:teuthology.orchestra.run.smithi052.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 6.2 MB/s | 309 kB 00:00 2024-09-10T23:41:25.802 INFO:teuthology.orchestra.run.smithi033.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T23:41:25.811 INFO:teuthology.orchestra.run.smithi052.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-10T23:41:25.811 INFO:teuthology.orchestra.run.smithi189.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-10T23:41:25.828 INFO:teuthology.orchestra.run.smithi189.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-10T23:41:25.852 INFO:teuthology.orchestra.run.smithi033.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.0 MB/s | 2.0 MB 00:01 2024-09-10T23:41:25.877 INFO:teuthology.orchestra.run.smithi033.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-10T23:41:25.903 INFO:teuthology.orchestra.run.smithi033.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T23:41:25.944 INFO:teuthology.orchestra.run.smithi189.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-09-10T23:41:25.970 INFO:teuthology.orchestra.run.smithi033.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-09-10T23:41:25.986 INFO:teuthology.orchestra.run.smithi189.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-10T23:41:26.003 INFO:teuthology.orchestra.run.smithi033.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-10T23:41:26.011 INFO:teuthology.orchestra.run.smithi052.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-10T23:41:26.028 INFO:teuthology.orchestra.run.smithi052.stdout:(109/157): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-10T23:41:26.045 INFO:teuthology.orchestra.run.smithi033.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-09-10T23:41:26.053 INFO:teuthology.orchestra.run.smithi189.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-10T23:41:26.070 INFO:teuthology.orchestra.run.smithi052.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-09-10T23:41:26.095 INFO:teuthology.orchestra.run.smithi189.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-10T23:41:26.103 INFO:teuthology.orchestra.run.smithi052.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-10T23:41:26.104 INFO:teuthology.orchestra.run.smithi033.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T23:41:26.128 INFO:teuthology.orchestra.run.smithi052.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-09-10T23:41:26.179 INFO:teuthology.orchestra.run.smithi189.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-10T23:41:26.212 INFO:teuthology.orchestra.run.smithi189.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T23:41:26.243 INFO:teuthology.orchestra.run.smithi052.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-10T23:41:26.288 INFO:teuthology.orchestra.run.smithi189.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-10T23:41:26.296 INFO:teuthology.orchestra.run.smithi052.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 10 MB/s | 548 kB 00:00 2024-09-10T23:41:26.313 INFO:teuthology.orchestra.run.smithi052.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T23:41:26.326 INFO:teuthology.orchestra.run.smithi033.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.5 MB 00:00 2024-09-10T23:41:26.347 INFO:teuthology.orchestra.run.smithi052.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 966 kB/s | 32 kB 00:00 2024-09-10T23:41:26.372 INFO:teuthology.orchestra.run.smithi052.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-10T23:41:26.414 INFO:teuthology.orchestra.run.smithi052.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 839 kB 00:00 2024-09-10T23:41:26.473 INFO:teuthology.orchestra.run.smithi052.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-10T23:41:26.506 INFO:teuthology.orchestra.run.smithi052.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-10T23:41:26.530 INFO:teuthology.orchestra.run.smithi033.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.7 MB/s | 3.2 MB 00:00 2024-09-10T23:41:26.548 INFO:teuthology.orchestra.run.smithi052.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-09-10T23:41:26.580 INFO:teuthology.orchestra.run.smithi033.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 5.0 MB/s | 2.3 MB 00:00 2024-09-10T23:41:26.582 INFO:teuthology.orchestra.run.smithi052.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-10T23:41:26.615 INFO:teuthology.orchestra.run.smithi052.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T23:41:26.638 INFO:teuthology.orchestra.run.smithi033.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-10T23:41:26.641 INFO:teuthology.orchestra.run.smithi052.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-10T23:41:26.666 INFO:teuthology.orchestra.run.smithi052.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-10T23:41:26.689 INFO:teuthology.orchestra.run.smithi033.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 257 kB/s | 41 kB 00:00 2024-09-10T23:41:26.691 INFO:teuthology.orchestra.run.smithi052.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-10T23:41:26.717 INFO:teuthology.orchestra.run.smithi052.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-10T23:41:26.746 INFO:teuthology.orchestra.run.smithi189.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 9.3 MB/s | 4.9 MB 00:00 2024-09-10T23:41:26.749 INFO:teuthology.orchestra.run.smithi052.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 613 kB/s | 20 kB 00:00 2024-09-10T23:41:26.789 INFO:teuthology.orchestra.run.smithi033.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 3.9 MB/s | 1.8 MB 00:00 2024-09-10T23:41:26.816 INFO:teuthology.orchestra.run.smithi052.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-09-10T23:41:26.880 INFO:teuthology.orchestra.run.smithi189.stdout:(68/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-10T23:41:26.881 INFO:teuthology.orchestra.run.smithi033.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.6 MB/s | 1.4 MB 00:00 2024-09-10T23:41:26.883 INFO:teuthology.orchestra.run.smithi052.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-09-10T23:41:26.925 INFO:teuthology.orchestra.run.smithi052.stdout:(131/157): protobuf-compiler-3.14.0-13.el9.x86_ 540 kB/s | 863 kB 00:01 2024-09-10T23:41:26.947 INFO:teuthology.orchestra.run.smithi189.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-10T23:41:26.967 INFO:teuthology.orchestra.run.smithi052.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-10T23:41:26.992 INFO:teuthology.orchestra.run.smithi052.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-09-10T23:41:27.006 INFO:teuthology.orchestra.run.smithi189.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-10T23:41:27.017 INFO:teuthology.orchestra.run.smithi052.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 733 kB/s | 16 kB 00:00 2024-09-10T23:41:27.043 INFO:teuthology.orchestra.run.smithi052.stdout:(135/157): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-09-10T23:41:27.064 INFO:teuthology.orchestra.run.smithi189.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T23:41:27.068 INFO:teuthology.orchestra.run.smithi052.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T23:41:27.093 INFO:teuthology.orchestra.run.smithi052.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-10T23:41:27.118 INFO:teuthology.orchestra.run.smithi052.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T23:41:27.143 INFO:teuthology.orchestra.run.smithi052.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-10T23:41:27.169 INFO:teuthology.orchestra.run.smithi052.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T23:41:27.194 INFO:teuthology.orchestra.run.smithi052.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T23:41:27.220 INFO:teuthology.orchestra.run.smithi052.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T23:41:27.239 INFO:teuthology.orchestra.run.smithi033.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-09-10T23:41:27.244 INFO:teuthology.orchestra.run.smithi052.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 992 kB/s | 74 kB 00:00 2024-09-10T23:41:27.246 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:41:27.246 INFO:teuthology.orchestra.run.smithi033.stdout:Total 17 MB/s | 240 MB 00:13 2024-09-10T23:41:27.281 INFO:teuthology.orchestra.run.smithi189.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-10T23:41:27.303 INFO:teuthology.orchestra.run.smithi052.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T23:41:27.328 INFO:teuthology.orchestra.run.smithi052.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-09-10T23:41:27.354 INFO:teuthology.orchestra.run.smithi052.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-10T23:41:27.387 INFO:teuthology.orchestra.run.smithi052.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T23:41:27.406 INFO:teuthology.orchestra.run.smithi189.stdout:(73/157): postgresql-contrib-13.16-1.el9.x86_64 1.7 MB/s | 910 kB 00:00 2024-09-10T23:41:27.432 INFO:teuthology.orchestra.run.smithi189.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 582 kB/s | 87 kB 00:00 2024-09-10T23:41:27.438 INFO:teuthology.orchestra.run.smithi052.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-09-10T23:41:27.488 INFO:teuthology.orchestra.run.smithi052.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T23:41:27.570 INFO:teuthology.orchestra.run.smithi189.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 443 kB/s | 61 kB 00:00 2024-09-10T23:41:27.666 INFO:teuthology.orchestra.run.smithi189.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 8.8 MB/s | 5.8 MB 00:00 2024-09-10T23:41:27.691 INFO:teuthology.orchestra.run.smithi189.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-10T23:41:27.705 INFO:teuthology.orchestra.run.smithi052.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-10T23:41:27.763 INFO:teuthology.orchestra.run.smithi052.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.2 MB/s | 3.5 MB 00:00 2024-09-10T23:41:27.791 INFO:teuthology.orchestra.run.smithi189.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-10T23:41:27.816 INFO:teuthology.orchestra.run.smithi189.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-10T23:41:27.839 INFO:teuthology.orchestra.run.smithi052.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 6.6 MB/s | 2.3 MB 00:00 2024-09-10T23:41:27.897 INFO:teuthology.orchestra.run.smithi052.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-10T23:41:27.923 INFO:teuthology.orchestra.run.smithi052.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 256 kB/s | 41 kB 00:00 2024-09-10T23:41:27.923 INFO:teuthology.orchestra.run.smithi189.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 145 kB/s | 19 kB 00:00 2024-09-10T23:41:27.950 INFO:teuthology.orchestra.run.smithi189.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T23:41:27.998 INFO:teuthology.orchestra.run.smithi052.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-10T23:41:28.042 INFO:teuthology.orchestra.run.smithi189.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 294 kB/s | 35 kB 00:00 2024-09-10T23:41:28.073 INFO:teuthology.orchestra.run.smithi052.stdout:(156/157): NetworkManager-libnm-1.49.90-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-09-10T23:41:28.167 INFO:teuthology.orchestra.run.smithi189.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T23:41:28.249 INFO:teuthology.orchestra.run.smithi052.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.3 MB/s | 2.4 MB 00:00 2024-09-10T23:41:28.254 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:41:28.254 INFO:teuthology.orchestra.run.smithi052.stdout:Total 17 MB/s | 240 MB 00:13 2024-09-10T23:41:28.293 INFO:teuthology.orchestra.run.smithi189.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-10T23:41:28.410 INFO:teuthology.orchestra.run.smithi189.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 661 kB/s | 77 kB 00:00 2024-09-10T23:41:28.527 INFO:teuthology.orchestra.run.smithi189.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-10T23:41:28.652 INFO:teuthology.orchestra.run.smithi189.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-10T23:41:28.769 INFO:teuthology.orchestra.run.smithi189.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T23:41:28.928 INFO:teuthology.orchestra.run.smithi189.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.2 MB/s | 5.1 MB 00:00 2024-09-10T23:41:28.983 INFO:teuthology.orchestra.run.smithi189.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-10T23:41:29.045 INFO:teuthology.orchestra.run.smithi189.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-10T23:41:29.095 INFO:teuthology.orchestra.run.smithi189.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 477 kB/s | 54 kB 00:00 2024-09-10T23:41:29.212 INFO:teuthology.orchestra.run.smithi189.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-09-10T23:41:29.332 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-09-10T23:41:29.387 INFO:teuthology.orchestra.run.smithi189.stdout:(94/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-10T23:41:29.413 INFO:teuthology.orchestra.run.smithi189.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 221 kB/s | 44 kB 00:00 2024-09-10T23:41:29.504 INFO:teuthology.orchestra.run.smithi189.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-10T23:41:29.530 INFO:teuthology.orchestra.run.smithi189.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-10T23:41:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-09-10T23:41:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-09-10T23:41:29.614 INFO:teuthology.orchestra.run.smithi189.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-10T23:41:29.655 INFO:teuthology.orchestra.run.smithi189.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-10T23:41:29.731 INFO:teuthology.orchestra.run.smithi189.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 494 kB/s | 58 kB 00:00 2024-09-10T23:41:29.786 INFO:teuthology.orchestra.run.smithi189.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 735 kB/s | 96 kB 00:00 2024-09-10T23:41:29.856 INFO:teuthology.orchestra.run.smithi189.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 508 kB/s | 64 kB 00:00 2024-09-10T23:41:29.906 INFO:teuthology.orchestra.run.smithi189.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 374 kB/s | 45 kB 00:00 2024-09-10T23:41:29.932 INFO:teuthology.orchestra.run.smithi189.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-10T23:41:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T23:41:30.042 INFO:teuthology.orchestra.run.smithi189.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 5.9 MB/s | 309 kB 00:00 2024-09-10T23:41:30.082 INFO:teuthology.orchestra.run.smithi189.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-10T23:41:30.108 INFO:teuthology.orchestra.run.smithi189.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 296 kB/s | 19 kB 00:00 2024-09-10T23:41:30.142 INFO:teuthology.orchestra.run.smithi189.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T23:41:30.167 INFO:teuthology.orchestra.run.smithi189.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-10T23:41:30.192 INFO:teuthology.orchestra.run.smithi189.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T23:41:30.226 INFO:teuthology.orchestra.run.smithi189.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T23:41:30.276 INFO:teuthology.orchestra.run.smithi189.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T23:41:30.327 INFO:teuthology.orchestra.run.smithi189.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T23:41:30.347 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-10T23:41:30.368 INFO:teuthology.orchestra.run.smithi189.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-10T23:41:30.411 INFO:teuthology.orchestra.run.smithi189.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 774 kB/s | 32 kB 00:00 2024-09-10T23:41:30.436 INFO:teuthology.orchestra.run.smithi189.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-10T23:41:30.478 INFO:teuthology.orchestra.run.smithi189.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T23:41:30.520 INFO:teuthology.orchestra.run.smithi189.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.5 MB/s | 358 kB 00:00 2024-09-10T23:41:30.550 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-10T23:41:30.550 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-10T23:41:30.587 INFO:teuthology.orchestra.run.smithi189.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-10T23:41:30.612 INFO:teuthology.orchestra.run.smithi189.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-10T23:41:30.645 INFO:teuthology.orchestra.run.smithi189.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T23:41:30.679 INFO:teuthology.orchestra.run.smithi189.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T23:41:30.704 INFO:teuthology.orchestra.run.smithi189.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-10T23:41:30.748 INFO:teuthology.orchestra.run.smithi189.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 409 kB/s | 18 kB 00:00 2024-09-10T23:41:30.780 INFO:teuthology.orchestra.run.smithi189.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 733 kB/s | 23 kB 00:00 2024-09-10T23:41:30.805 INFO:teuthology.orchestra.run.smithi189.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-10T23:41:30.830 INFO:teuthology.orchestra.run.smithi189.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 801 kB/s | 20 kB 00:00 2024-09-10T23:41:30.889 INFO:teuthology.orchestra.run.smithi189.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-09-10T23:41:30.914 INFO:teuthology.orchestra.run.smithi189.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T23:41:30.939 INFO:teuthology.orchestra.run.smithi189.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T23:41:30.973 INFO:teuthology.orchestra.run.smithi189.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T23:41:31.006 INFO:teuthology.orchestra.run.smithi189.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T23:41:31.048 INFO:teuthology.orchestra.run.smithi189.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-10T23:41:31.073 INFO:teuthology.orchestra.run.smithi189.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-10T23:41:31.132 INFO:teuthology.orchestra.run.smithi189.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-10T23:41:31.157 INFO:teuthology.orchestra.run.smithi189.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 827 kB/s | 90 kB 00:00 2024-09-10T23:41:31.183 INFO:teuthology.orchestra.run.smithi189.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-10T23:41:31.208 INFO:teuthology.orchestra.run.smithi189.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T23:41:31.233 INFO:teuthology.orchestra.run.smithi189.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-10T23:41:31.258 INFO:teuthology.orchestra.run.smithi189.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T23:41:31.292 INFO:teuthology.orchestra.run.smithi189.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-10T23:41:31.317 INFO:teuthology.orchestra.run.smithi189.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T23:41:31.343 INFO:teuthology.orchestra.run.smithi189.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T23:41:31.368 INFO:teuthology.orchestra.run.smithi189.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-10T23:41:31.402 INFO:teuthology.orchestra.run.smithi189.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-10T23:41:31.427 INFO:teuthology.orchestra.run.smithi189.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T23:41:31.502 INFO:teuthology.orchestra.run.smithi189.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T23:41:31.961 INFO:teuthology.orchestra.run.smithi189.stdout:(149/157): librados2-19.3.0-4854.g8f219c47.el9. 6.5 MB/s | 3.5 MB 00:00 2024-09-10T23:41:32.128 INFO:teuthology.orchestra.run.smithi189.stdout:(150/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:03 2024-09-10T23:41:32.141 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-09-10T23:41:32.142 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-09-10T23:41:32.195 INFO:teuthology.orchestra.run.smithi189.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 4.7 MB/s | 3.2 MB 00:00 2024-09-10T23:41:32.279 INFO:teuthology.orchestra.run.smithi189.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-10T23:41:32.304 INFO:teuthology.orchestra.run.smithi189.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-10T23:41:32.329 INFO:teuthology.orchestra.run.smithi189.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 4.8 MB/s | 249 kB 00:00 2024-09-10T23:41:32.379 INFO:teuthology.orchestra.run.smithi189.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 7.2 MB/s | 1.8 MB 00:00 2024-09-10T23:41:32.438 INFO:teuthology.orchestra.run.smithi189.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-10T23:41:32.471 INFO:teuthology.orchestra.run.smithi189.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-10T23:41:32.476 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:41:32.476 INFO:teuthology.orchestra.run.smithi189.stdout:Total 13 MB/s | 240 MB 00:17 2024-09-10T23:41:33.140 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-10T23:41:33.141 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-10T23:41:34.540 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-10T23:41:34.722 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-10T23:41:34.723 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-10T23:41:37.237 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-10T23:41:37.238 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-10T23:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-09-10T23:41:39.436 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:41:39.527 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:41:39.595 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:41:39.638 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:41:39.678 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:41:39.896 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:41:40.154 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-10T23:41:40.295 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:41:40.401 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:41:40.413 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:41:40.520 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:40.659 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:41:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:40.707 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:41:40.747 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:41:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:40.818 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:41:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:41:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:41:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:41:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:41:41.215 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:41:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:41.321 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:41.476 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:41.495 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:41.503 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:41.522 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:41.687 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:41.724 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:41:41.763 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:41:41.948 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:41.996 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:41:42.060 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:41:42.085 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:42.122 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:42.227 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:42.261 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:42.343 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:42.354 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:41:42.370 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:42.409 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:42.487 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:42.578 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:42.673 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:42.881 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:43.045 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:41:43.066 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:41:43.087 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:41:43.163 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:41:43.211 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:43.247 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:41:43.307 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:41:43.311 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:43.345 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:41:43.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:41:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:41:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:41:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:41:43.600 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:41:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:41:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:41:43.766 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:41:43.812 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:41:43.831 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:41:43.871 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:41:43.892 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:41:43.940 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:41:43.957 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:41:43.967 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:41:44.016 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:41:44.062 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:41:44.070 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:41:44.092 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-10T23:41:44.121 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:41:44.125 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:41:44.163 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:41:44.196 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:41:44.223 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:41:44.293 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T23:41:44.313 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:41:44.392 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:41:44.415 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:41:44.425 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:41:44.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:41:44.491 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:41:44.525 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T23:41:44.565 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:41:44.636 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:41:44.685 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T23:41:44.690 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:41:44.717 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:41:44.728 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T23:41:44.760 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T23:41:44.810 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:41:44.827 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T23:41:44.862 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:41:44.958 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:41:45.150 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:41:45.161 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:41:45.214 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T23:41:45.217 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:41:45.319 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:45.343 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:41:45.385 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:41:45.455 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:41:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:41:45.501 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:41:45.520 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:45.554 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:41:45.630 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:41:45.667 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:41:45.732 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T23:41:45.773 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:41:45.862 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:41:45.890 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:41:45.965 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T23:41:45.981 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:41:45.992 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:41:46.022 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T23:41:46.026 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:41:46.059 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:41:46.071 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:41:46.082 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:46.109 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:41:46.144 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:41:46.171 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:41:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:41:46.192 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:41:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:41:46.307 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T23:41:46.326 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:41:46.335 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:46.366 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:41:46.373 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T23:41:46.392 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:41:46.412 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:41:46.453 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:41:46.462 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:41:46.580 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:41:46.637 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:46.642 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:41:46.657 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:41:46.706 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:41:46.742 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:41:46.749 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:41:46.779 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:41:46.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:41:46.856 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T23:41:46.875 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:41:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:41:46.915 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:41:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:41:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:41:46.986 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:41:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:41:47.032 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T23:41:47.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:41:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:41:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:41:47.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:41:47.269 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:47.297 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:41:47.353 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:41:47.357 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:41:47.426 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:41:47.465 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:41:47.487 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:41:47.502 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:41:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:41:47.548 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:41:47.587 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:41:47.589 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:41:47.606 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:47.624 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:41:47.627 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:41:47.652 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:41:47.658 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:41:47.692 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:41:47.736 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:41:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:41:47.808 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:41:47.897 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T23:41:47.912 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:41:47.968 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:41:47.976 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:41:48.004 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:41:48.026 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:41:48.063 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T23:41:48.063 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:41:48.097 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T23:41:48.105 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:41:48.133 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:41:48.143 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T23:41:48.180 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:41:48.222 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:41:48.233 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T23:41:48.252 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:41:48.286 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T23:41:48.289 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:41:48.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:41:48.333 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T23:41:48.357 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:41:48.387 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T23:41:48.401 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:41:48.426 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T23:41:48.441 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:41:48.460 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T23:41:48.553 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T23:41:48.554 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:41:48.613 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T23:41:48.624 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:41:48.660 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:41:48.672 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T23:41:48.718 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T23:41:48.786 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:41:48.801 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T23:41:48.836 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T23:41:48.857 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:41:48.879 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T23:41:48.907 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T23:41:48.989 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T23:41:49.051 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T23:41:49.143 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T23:41:49.164 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:41:49.220 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:41:49.254 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:41:49.342 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T23:41:49.376 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:41:49.405 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T23:41:49.438 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:41:49.491 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:41:49.600 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:41:49.639 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:41:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:41:49.887 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:41:49.909 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:41:49.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:41:49.942 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:41:50.016 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:41:50.065 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:41:50.075 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T23:41:50.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:41:50.180 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T23:41:50.198 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:41:50.215 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T23:41:50.269 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T23:41:50.307 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T23:41:50.316 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:41:50.359 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T23:41:50.362 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:41:50.570 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T23:41:50.613 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:41:50.635 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T23:41:50.642 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:41:50.742 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:41:50.749 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T23:41:50.828 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T23:41:50.878 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:41:50.912 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T23:41:50.952 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T23:41:50.988 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T23:41:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:41:51.047 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T23:41:51.104 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T23:41:51.149 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T23:41:51.199 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T23:41:51.373 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T23:41:51.452 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T23:41:51.487 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T23:41:51.587 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:41:51.603 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T23:41:51.663 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T23:41:51.712 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T23:41:51.734 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:41:51.771 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T23:41:51.807 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T23:41:51.937 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T23:41:52.112 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T23:41:52.174 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T23:41:52.202 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T23:41:52.279 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T23:41:52.326 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T23:41:52.367 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T23:41:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T23:41:52.438 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T23:41:52.487 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T23:41:52.531 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T23:41:52.563 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T23:41:52.663 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T23:41:52.674 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:41:52.714 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T23:41:52.750 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T23:41:52.784 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:41:52.820 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:41:52.873 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T23:41:52.886 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:41:52.946 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T23:41:53.264 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:41:53.322 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:53.388 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:41:53.454 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:53.479 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:41:53.495 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:41:53.536 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:41:53.553 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:41:53.575 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:41:53.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T23:41:53.906 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T23:41:53.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T23:41:53.941 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:41:53.994 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T23:41:54.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T23:41:54.122 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:41:54.150 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:54.159 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:54.176 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T23:41:54.184 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:41:54.233 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:41:54.250 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:54.277 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:41:54.301 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T23:41:54.358 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T23:41:54.596 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T23:41:54.630 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T23:41:54.724 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T23:41:54.807 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:41:54.839 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:54.930 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:54.957 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:41:55.548 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T23:41:55.719 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T23:41:56.988 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:57.031 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:57.286 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T23:41:57.412 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T23:41:57.445 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T23:41:57.469 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T23:41:57.623 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:57.662 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:57.704 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:57.752 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:41:57.823 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T23:41:57.881 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:57.895 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:41:57.896 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:41:57.896 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:41:57.896 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:41:57.976 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T23:41:58.012 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T23:41:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:41:58.069 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T23:41:58.373 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:41:58.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:41:58.545 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:41:58.546 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:41:58.546 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:41:58.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:41:58.591 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:41:58.632 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T23:41:58.667 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:58.757 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T23:41:58.785 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T23:42:01.368 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:42:01.416 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:42:02.063 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T23:42:02.103 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:42:02.237 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T23:42:02.237 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:42:02.237 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:42:02.237 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:02.287 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-09-10T23:42:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-09-10T23:42:11.343 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-09-10T23:42:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:11.592 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:11.592 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:42:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:11.818 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:42:11.818 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-10T23:42:11.818 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-10T23:42:11.819 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:12.042 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:12.077 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:12.078 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:12.078 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:42:12.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:13.284 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:13.343 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:13.343 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:13.343 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:42:13.344 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:13.344 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:13.344 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:13.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:13.660 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:13.661 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:42:13.661 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:13.661 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:13.661 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:13.778 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:13.838 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:14.095 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:14.147 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:14.147 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:14.147 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:42:14.148 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:14.148 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:14.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:14.244 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:14.245 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:14.245 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:42:14.245 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:14.245 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:14.245 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:14.377 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:42:14.439 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:42:14.512 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:42:14.679 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:14.731 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:42:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:14.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:14.773 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:42:14.831 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:42:14.864 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:42:14.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:42:14.926 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:42:14.998 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:42:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-10T23:42:15.175 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-10T23:42:15.176 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-10T23:42:15.176 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:15.216 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:42:15.264 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:42:15.266 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:42:15.326 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:42:15.336 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:42:15.379 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:42:15.390 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:15.414 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:42:15.426 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T23:42:15.426 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:15.426 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T23:42:15.426 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:15.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:42:15.720 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:42:15.775 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:42:15.836 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:42:15.873 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:42:15.987 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:16.020 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:16.062 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:42:16.179 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:42:16.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:16.347 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:16.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:16.441 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:42:16.532 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:42:16.570 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:17.051 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:42:17.108 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:17.359 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:17.409 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T23:42:17.409 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:17.410 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:42:17.410 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:17.410 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:42:17.410 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:17.926 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:42:17.977 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:18.101 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T23:42:18.161 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T23:42:18.226 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T23:42:18.480 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T23:42:18.538 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T23:42:18.626 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T23:42:18.749 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T23:42:18.938 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T23:42:19.136 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T23:42:19.177 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T23:42:19.203 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T23:42:19.963 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:20.014 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T23:42:20.053 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T23:42:20.073 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:20.135 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T23:42:20.139 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:20.167 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:20.433 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:20.517 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:21.490 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:21.677 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:42:21.709 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:21.777 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:21.778 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:42:21.778 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:21.778 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:21.870 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:42:22.057 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:42:22.082 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:42:22.086 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:22.139 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:22.222 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:22.333 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:42:22.433 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:42:23.172 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:42:23.212 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:23.264 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:23.363 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.363 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:42:23.363 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:23.529 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:42:23.572 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:23.625 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:23.681 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:23.732 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:23.732 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.732 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:42:23.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:23.790 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:23.812 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:23.842 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:23.855 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:23.906 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:23.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:24.224 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:24.276 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:25.000 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T23:42:25.039 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:25.191 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T23:42:25.376 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T23:42:25.416 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:25.467 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T23:42:25.468 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:25.468 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:42:25.468 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:25.468 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:42:25.468 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:25.525 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:25.551 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T23:42:25.658 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T23:42:25.728 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T23:42:26.793 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T23:42:26.841 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:42:26.895 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:26.956 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:26.998 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T23:42:26.998 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:26.998 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:42:26.998 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:27.054 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:42:27.107 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:27.463 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:27.514 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T23:42:27.514 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:42:27.515 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:42:27.515 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:27.515 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:42:27.515 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:29.328 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:42:29.369 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:42:29.413 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:42:29.450 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:42:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:42:29.732 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:42:29.733 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:42:29.782 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:42:29.788 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:42:29.821 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:42:29.840 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:42:29.860 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:42:29.877 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:42:29.895 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:42:29.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:42:30.164 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:42:30.218 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:42:30.248 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:42:30.287 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:42:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:42:30.694 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:30.767 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:30.809 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:31.033 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:31.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:31.120 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:32.182 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:42:32.322 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:42:32.391 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:42:32.494 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:42:32.508 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:42:32.543 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:42:32.576 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:42:32.608 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:42:32.621 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:42:32.621 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:32.664 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T23:42:32.668 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:42:32.718 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T23:42:32.761 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T23:42:32.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:42:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:32.799 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T23:42:32.834 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T23:42:32.841 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:42:32.877 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:42:32.887 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:32.912 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:42:32.914 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:42:32.914 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:32.928 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:32.928 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:33.030 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:33.030 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:33.078 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T23:42:33.131 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T23:42:33.147 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:33.161 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T23:42:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:42:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:33.209 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T23:42:33.253 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T23:42:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:33.615 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:33.616 INFO:teuthology.orchestra.run.smithi033.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:42:33.616 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:33.830 INFO:teuthology.orchestra.run.smithi052.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:42:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:34.065 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:34.107 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T23:42:35.400 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T23:42:35.522 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T23:42:35.579 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T23:42:35.703 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T23:42:35.749 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T23:42:35.775 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T23:42:35.842 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T23:42:35.842 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:36.002 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T23:42:36.002 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:36.144 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T23:42:36.200 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T23:42:36.216 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:36.217 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:36.463 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T23:42:36.463 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:36.606 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T23:42:36.680 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:36.890 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:36.891 INFO:teuthology.orchestra.run.smithi189.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:42:36.891 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:40.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:42:40.330 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:42:40.331 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:42:40.332 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:42:40.333 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:42:40.345 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:42:40.346 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:42:40.347 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:42:40.348 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:42:40.349 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:42:40.350 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:42:40.351 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:42:40.352 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:42:40.353 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:42:40.354 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:42:40.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:42:40.386 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:42:40.387 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:42:40.388 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:42:40.389 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:42:40.389 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:42:40.389 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:42:40.389 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:42:40.401 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:42:40.401 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:42:40.401 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:42:40.401 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:42:40.401 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:42:40.402 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:42:40.403 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:42:40.404 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:42:40.405 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:42:40.406 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:42:40.407 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:42:40.408 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:42:40.409 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:42:40.410 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:42:40.411 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:42:40.412 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:42:42.602 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.603 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:42:42.604 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.605 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.606 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:42:42.607 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.608 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:42:42.609 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:42:42.610 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:42:42.611 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:42:42.612 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:42:42.613 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.614 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:42:42.615 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:42:42.616 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:42:42.617 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:42:42.617 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:42:42.617 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.693 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.694 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.695 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:42:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:42:42.697 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:42:42.698 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:42:42.699 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:42:42.700 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:42:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:42:42.702 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:42:42.703 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.704 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:42:42.705 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:42:42.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:42:42.706 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-09-10T23:42:43.191 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T23:42:43.192 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T23:42:43.193 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T23:42:43.194 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T23:42:43.195 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T23:42:43.196 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T23:42:43.197 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T23:42:43.198 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T23:42:43.199 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T23:42:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T23:42:43.201 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T23:42:43.202 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T23:42:43.203 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T23:42:43.204 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T23:42:43.218 DEBUG:teuthology.parallel:result is None 2024-09-10T23:42:43.523 DEBUG:teuthology.parallel:result is None 2024-09-10T23:42:45.477 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T23:42:45.477 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:45.477 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-10T23:42:45.477 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T23:42:45.478 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.479 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.480 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.481 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.482 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:42:45.483 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.484 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T23:42:45.485 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:42:45.486 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:42:45.487 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:42:45.488 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:42:45.489 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:42:45.490 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:42:45.491 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-10T23:42:46.239 DEBUG:teuthology.parallel:result is None 2024-09-10T23:42:46.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:46.399 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:42:46.446 INFO:teuthology.orchestra.run.smithi033.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.447 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.447 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:42:46.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:46.601 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:42:46.651 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.651 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.651 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:42:46.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:46.797 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:42:46.846 INFO:teuthology.orchestra.run.smithi189.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.846 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T23:42:46.846 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T23:42:46.848 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:42:46.849 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:42:46.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:42:46.912 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:42:46.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:42:46.976 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:42:46.976 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:42:47.039 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:42:47.039 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:42:47.039 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:42:47.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:42:47.191 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:42:47.191 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:42:47.252 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:42:47.351 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:42:47.351 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:42:47.409 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:42:47.540 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:42:47.541 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:42:47.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:42:47.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:42:47.714 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:42:47.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:42:47.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:42:47.873 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:42:47.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:42:47.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:42:48.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:42:48.026 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:42:48.026 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:42:48.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:42:48.164 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:42:48.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:42:48.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:42:48.323 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:42:48.323 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:42:48.381 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:42:48.477 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:42:48.902 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T23:42:48.902 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:48.903 INFO:tasks.cephadm:Cluster fsid is 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:42:48.903 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:42:48.903 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.33', 'mon.b': '172.21.15.52', 'mon.c': '172.21.15.189'} 2024-09-10T23:42:48.904 INFO:tasks.cephadm:First mon is mon.a on smithi033 2024-09-10T23:42:48.904 INFO:tasks.cephadm:First mgr is x 2024-09-10T23:42:48.904 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:42:48.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-09-10T23:42:48.967 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2024-09-10T23:42:49.030 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-10T23:42:49.089 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T23:42:49.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:49.238 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:42:49.380 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:42:49.382 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:42:49.382 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:42:49.382 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:49.830 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:42 /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:49.831 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.246 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:42 /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.247 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.664 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 23:42 /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.664 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.706 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.748 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:42:50.800 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T23:42:50.801 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:42:50.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:42:50.809 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T23:42:52.888 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:42:52.944 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:42:52.971 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-10T23:43:25.773 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-10T23:43:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:43:28.717 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T23:43:28.718 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T23:43:28.750 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-09-10T23:43:28.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2024-09-10T23:43:28.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-10T23:43:28.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-09-10T23:43:28.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2024-09-10T23:43:29.048 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-10T23:43:29.105 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:43:29.106 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T23:43:29.106 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T23:43:29.106 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:43:29.106 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T23:43:29.107 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T23:43:29.108 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-10T23:43:29.109 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:43:29.109 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:43:29.147 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 63242646-6fce-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T23:43:29.148 DEBUG:teuthology.orchestra.run.smithi033:mon.a> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T23:43:29.192 DEBUG:teuthology.orchestra.run.smithi033:mgr.x> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T23:43:29.237 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:43:29.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 63242646-6fce-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:43:29.502 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:43:29.502 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.33', '--skip-admin-label'] 2024-09-10T23:43:29.502 INFO:teuthology.orchestra.run.smithi033.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:43:29.502 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying podman|docker is present... 2024-09-10T23:43:29.547 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:43:29.548 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying lvm2 is present... 2024-09-10T23:43:29.548 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying time synchronization is in place... 2024-09-10T23:43:29.562 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:43:29.562 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:43:29.574 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:43:29.574 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:43:29.588 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-09-10T23:43:29.600 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-09-10T23:43:29.600 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:43:29.600 INFO:teuthology.orchestra.run.smithi033.stdout:Repeating the final host check... 2024-09-10T23:43:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:43:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:43:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl is present 2024-09-10T23:43:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:lvcreate is present 2024-09-10T23:43:29.666 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:43:29.667 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:43:29.679 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:43:29.679 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:43:29.692 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-09-10T23:43:29.705 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-09-10T23:43:29.705 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:43:29.705 INFO:teuthology.orchestra.run.smithi033.stdout:Host looks OK 2024-09-10T23:43:29.705 INFO:teuthology.orchestra.run.smithi033.stdout:Cluster fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:Acquiring lock 140609928213360 on /run/cephadm/63242646-6fce-11ef-bcea-c7b262605968.lock 2024-09-10T23:43:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:Lock 140609928213360 acquired on /run/cephadm/63242646-6fce-11ef-bcea-c7b262605968.lock 2024-09-10T23:43:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 3300 ... 2024-09-10T23:43:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 6789 ... 2024-09-10T23:43:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:Base mon IP(s) is [172.21.15.33:3300, 172.21.15.33:6789], mon addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-10T23:43:29.713 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.33 metric 100 2024-09-10T23:43:29.713 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-09-10T23:43:29.719 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:43:29.719 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T23:43:29.719 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-10T23:43:29.725 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:43:29.725 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:43:29.725 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:43:29.725 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T23:43:29.726 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-10T23:43:29.726 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:43:29.726 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-09-10T23:43:29.726 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-09-10T23:43:29.726 INFO:teuthology.orchestra.run.smithi033.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:43:29.727 INFO:teuthology.orchestra.run.smithi033.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:43:29.728 INFO:teuthology.orchestra.run.smithi033.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:43:30.323 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T23:43:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:43:42.154 INFO:teuthology.orchestra.run.smithi033.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:43:42.155 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T23:43:42.155 INFO:teuthology.orchestra.run.smithi033.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:43:43.383 INFO:teuthology.orchestra.run.smithi033.stdout:stat: stdout 167 167 2024-09-10T23:43:43.383 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial keys... 2024-09-10T23:43:44.571 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCv2eBmX1a5LxAAZkBT0rV/1XjNliLk+JQ6JA== 2024-09-10T23:43:45.747 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCw2eBm7mPyOBAAv3siJLOS1CCj9iXZUAhlNQ== 2024-09-10T23:43:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCy2eBmoyW+GxAAgFBGHrA2UPVBgSPGPJ3Ljg== 2024-09-10T23:43:47.180 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial monmap... 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool for a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: set fsid to 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:43:48.261 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:43:48.262 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mon... 2024-09-10T23:43:49.393 INFO:teuthology.orchestra.run.smithi033.stdout:create mon.a on 2024-09-10T23:43:49.704 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:43:49.932 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:43:50.223 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-63242646-6fce-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968.target. 2024-09-10T23:43:50.224 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-63242646-6fce-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968.target. 2024-09-10T23:43:50.550 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a 2024-09-10T23:43:50.550 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T23:43:50.813 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968.target.wants/ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968@.service. 2024-09-10T23:43:51.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 podman[30213]: 2024-09-10 23:43:51.074470513 +0000 UTC m=+0.027538306 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:43:51.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 podman[30213]: 2024-09-10 23:43:51.503555785 +0000 UTC m=+0.456623576 container create 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T23:43:51.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 podman[30213]: 2024-09-10 23:43:51.725450963 +0000 UTC m=+0.678518780 container init 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-10T23:43:51.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 podman[30213]: 2024-09-10 23:43:51.732706767 +0000 UTC m=+0.685774559 container start 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T23:43:51.859 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:43:51.860 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-10T23:43:51.873 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:43:51.876 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:43:51.876 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-10T23:43:51.876 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:43:51.877 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon to start... 2024-09-10T23:43:51.877 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon... 2024-09-10T23:43:52.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 ceph-mon[30231]: mkfs 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:52.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 ceph-mon[30231]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:43:52.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 bash[30213]: 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 2024-09-10T23:43:52.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:51 smithi033 systemd[1]: Started Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: monmap epoch 1 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: last_changed 2024-09-10T23:43:47.592910+0000 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:43:53.197 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: min_mon_release 19 (squid) 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: election_strategy: 1 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: fsmap 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: mgrmap e1: no daemons active 2024-09-10T23:43:53.198 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:52 smithi033 ceph-mon[30231]: from='client.? 172.21.15.33:0/273717401' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T23:43:53.204 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:43:53.204 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout id: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:53.204 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:43:53.204 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.67858s) 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:mon is available 2024-09-10T23:43:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:43:54.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:53 smithi033 ceph-mon[30231]: from='client.? 172.21.15.33:0/214104207' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:43:54.397 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:43:54.398 INFO:teuthology.orchestra.run.smithi033.stdout:Generating new minimal ceph.conf... 2024-09-10T23:43:54.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:54 smithi033 ceph-mon[30231]: from='client.? 172.21.15.33:0/214104207' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:43:55.534 INFO:teuthology.orchestra.run.smithi033.stdout:Restarting the monitor... 2024-09-10T23:43:55.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:55 smithi033 systemd[1]: Stopping Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:43:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:55 smithi033 ceph-mon[30231]: from='client.? 172.21.15.33:0/2597748239' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:43:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:55 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a[30227]: 2024-09-10T23:43:55.891+0000 7f9f9a800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:43:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:55 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a[30227]: 2024-09-10T23:43:55.891+0000 7f9f9a800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:43:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:55 smithi033 podman[30471]: 2024-09-10 23:43:55.922372212 +0000 UTC m=+0.158391221 container died 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T23:43:57.156 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:56 smithi033 podman[30471]: 2024-09-10 23:43:56.838078008 +0000 UTC m=+1.074097011 container cleanup 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T23:43:57.156 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:56 smithi033 bash[30471]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a 2024-09-10T23:43:57.156 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 podman[30484]: 2024-09-10 23:43:57.047122792 +0000 UTC m=+1.117778113 container remove 4442c40c5f94625032b6b68ab34fae6ff5836bc8a6512c60e40851cda839ad45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T23:43:57.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T23:43:57.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 systemd[1]: Stopped Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:43:57.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.262s CPU time. 2024-09-10T23:43:57.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 systemd[1]: Starting Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:43:57.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 podman[30575]: 2024-09-10 23:43:57.527778519 +0000 UTC m=+0.027807948 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:43:57.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 podman[30575]: 2024-09-10 23:43:57.623119175 +0000 UTC m=+0.123148603 container create 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T23:43:57.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 podman[30575]: 2024-09-10 23:43:57.884445147 +0000 UTC m=+0.384474594 container init 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:43:57.976 INFO:teuthology.orchestra.run.smithi033.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 podman[30575]: 2024-09-10 23:43:57.890895654 +0000 UTC m=+0.390925084 container start 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: pidfile_write: ignore empty --pid-file 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: load: jerasure load: lrc 2024-09-10T23:43:58.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Git sha 0 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: DB SUMMARY 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: DB Session ID: UJ1YFDTJ3FD2ESY97JCS 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:43:58.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95489 ; 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.env: 0x55b65e058180 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.info_log: 0x55b66f6256e0 2024-09-10T23:43:58.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.statistics: (nil) 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.use_fsync: 0 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:43:58.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.db_log_dir: 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.wal_dir: 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:43:58.167 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.write_buffer_manager: 0x55b66f629b80 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:43:58.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.unordered_write: 0 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.row_cache: None 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.wal_filter: None 2024-09-10T23:43:58.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.wal_compression: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:43:58.170 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:43:58.171 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_open_files: -1 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:43:58.172 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Compression algorithms supported: 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kZSTD supported: 0 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:43:58.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.merge_operator: 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_filter: None 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b66f625300) 2024-09-10T23:43:58.174 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_type: 0 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_index_type: 0 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_shortening: 1 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: checksum: 4 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: no_block_cache: 0 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache: 0x55b66f619610 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:43:58.175 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_options: 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: capacity : 536870912 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_shard_bits : 4 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: strict_capacity_limit : 0 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_compressed: (nil) 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: persistent_cache: (nil) 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size: 4096 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size_deviation: 10 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_restart_interval: 16 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_block_restart_interval: 1 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: metadata_block_size: 4096 2024-09-10T23:43:58.176 INFO:journalctl@ceph.mon.a.smithi033.stdout: partition_filters: 0 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: use_delta_encoding: 1 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: filter_policy: bloomfilter 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: whole_key_filtering: 1 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: verify_compression: 0 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: format_version: 5 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_index_compression: 1 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_align: 0 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: max_auto_readahead_size: 262144 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: prepopulate_block_cache: 0 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:43:58.177 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression: NoCompression 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.num_levels: 7 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:43:58.178 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:43:58.179 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:43:58.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:43:58.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:43:58.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.ttl: 2592000 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:43:58.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 57b886cf-6778-490a-b0f2-9673fd4cd2dc 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011837933586, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:43:58.184 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011837935182, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91549, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 291, "table_properties": {"data_size": 89590, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11722, "raw_average_key_size": 47, "raw_value_size": 82930, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 246, "num_filter_entries": 246, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726011837, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "57b886cf-6778-490a-b0f2-9673fd4cd2dc", "db_session_id": "UJ1YFDTJ3FD2ESY97JCS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011837935362, "job": 1, "event": "recovery_finished"} 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b66f64ae00 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: DB pointer 0x55b66f74a000 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** DB Stats ** 2024-09-10T23:43:58.185 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:43:58.186 INFO:journalctl@ceph.mon.a.smithi033.stdout: L0 2/0 91.26 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Sum 2/0 91.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 84.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 84.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:43:58.187 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative compaction: 0.00 GB write, 15.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval compaction: 0.00 GB write, 15.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache BinnedLRUCache@0x55b66f619610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???) e1 preinit fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).mds e1 new map 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).mds e1 print_map 2024-09-10T23:43:58.188 INFO:journalctl@ceph.mon.a.smithi033.stdout: e1 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: btime 2024-09-10T23:43:51:794915+0000 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: legacy client fscid: -1 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout: No filesystems configured 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 bash[30575]: 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff 2024-09-10T23:43:58.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 systemd[1]: Started Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: monmap epoch 1 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: last_changed 2024-09-10T23:43:47.592910+0000 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: min_mon_release 19 (squid) 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: election_strategy: 1 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: fsmap 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:43:58.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:57 smithi033 ceph-mon[30593]: mgrmap e1: no daemons active 2024-09-10T23:43:59.264 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:43:59.299 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:43:59.300 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mgr... 2024-09-10T23:43:59.300 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:43:59.301 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:43:59.695 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x 2024-09-10T23:43:59.695 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T23:43:59.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:43:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2630475597' entity='client.admin' 2024-09-10T23:43:59.955 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968.target.wants/ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-63242646-6fce-11ef-bcea-c7b262605968@.service. 2024-09-10T23:44:00.276 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:43:59 smithi033 systemd[1]: Starting Ceph mgr.x for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:44:00.572 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 podman[30814]: 2024-09-10 23:44:00.204568479 +0000 UTC m=+0.027344047 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:44:00.572 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 podman[30814]: 2024-09-10 23:44:00.318647265 +0000 UTC m=+0.141422832 container create d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T23:44:00.572 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 podman[30814]: 2024-09-10 23:44:00.571314651 +0000 UTC m=+0.394090219 container init d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T23:44:00.691 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:44:00.691 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-10T23:44:00.704 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:44:00.704 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:44:00.705 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-10T23:44:00.705 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:44:00.721 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:44:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-10T23:44:00.735 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:44:00.735 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:44:00.735 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-10T23:44:00.736 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T23:44:00.736 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr to start... 2024-09-10T23:44:00.736 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr... 2024-09-10T23:44:00.877 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 podman[30814]: 2024-09-10 23:44:00.577457638 +0000 UTC m=+0.400233221 container start d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T23:44:00.877 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 bash[30814]: d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 2024-09-10T23:44:00.877 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:00 smithi033 systemd[1]: Started Ceph mgr.x for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:44:01.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:01 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1838271664' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:44:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:44:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:44:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:44:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:43:51:794915+0000", 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:44:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:43:51.795782+0000", 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:44:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:44:05.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:04 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2330541643' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:44:05.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:05.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:05.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:44:05.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:44:05.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:05.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:44:05.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:44:05.490 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.490 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:44:05.490 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:43:51:794915+0000", 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:44:05.491 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:43:51.795782+0000", 2024-09-10T23:44:05.492 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:05.493 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:05.493 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:44:05.493 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:05.493 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: Activating manager daemon x 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: mgrmap e2: x(active, starting, since 0.00451116s) 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: Manager daemon x is now available 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:44:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' 2024-09-10T23:44:07.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:44:07.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' 2024-09-10T23:44:07.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:06 smithi033 ceph-mon[30593]: from='mgr.14100 172.21.15.33:0/2333611858' entity='mgr.x' 2024-09-10T23:44:08.983 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:08 smithi033 ceph-mon[30593]: mgrmap e3: x(active, since 1.01s) 2024-09-10T23:44:08.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:08 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2355792073' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T23:44:08.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:08.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:08.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:44:08.991 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-10T23:44:08.992 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:44:08.993 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:44:08.997 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T23:43:51:794915+0000", 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.998 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:43:51.795782+0000", 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:08.999 INFO:teuthology.orchestra.run.smithi033.stdout:mgr is available 2024-09-10T23:44:10.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:09 smithi033 ceph-mon[30593]: mgrmap e4: x(active, since 2s) 2024-09-10T23:44:10.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:09 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3442884955' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-09-10T23:44:10.433 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:44:10.434 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling cephadm module... 2024-09-10T23:44:11.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:11 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3822461941' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T23:44:11.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ignoring --setuser ceph since I am not root 2024-09-10T23:44:11.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ignoring --setgroup ceph since I am not root 2024-09-10T23:44:12.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:12 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3822461941' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:44:12.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:12 smithi033 ceph-mon[30593]: mgrmap e5: x(active, since 4s) 2024-09-10T23:44:13.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:13 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/515657891' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:44:13.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-09-10T23:44:13.655 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 5... 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: Active manager daemon x restarted 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: Activating manager daemon x 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: mgrmap e6: x(active, starting, since 0.00371793s) 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:44:18.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:44:18.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:44:18.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:17 smithi033 ceph-mon[30593]: Manager daemon x is now available 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 5 is available 2024-09-10T23:44:19.382 INFO:teuthology.orchestra.run.smithi033.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:44:19.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: mgrmap e7: x(active, since 1.00612s) 2024-09-10T23:44:19.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:19.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:19.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:44:19.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:19.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:19.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:19.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:19.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:44:19.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:19 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:44:21.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-mon[30593]: mgrmap e8: x(active, since 2s) 2024-09-10T23:44:21.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-mon[30593]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:21.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:21.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:22.019 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:44:21.659+0000 7f1afc400640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:44:21] ENGINE Error in HTTPServer.serve 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: Traceback (most recent call last): 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._connections.run(self.expiration_interval) 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._run(expiration_interval) 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: s = self.context.wrap_socket( 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:44:22.020 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: return self.sslsocket_class._create( 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self.do_handshake() 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._sslobj.do_handshake() 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:44:22.021 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:44:22.338 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:22 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:22.343 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:44:22.343 INFO:teuthology.orchestra.run.smithi033.stdout:Generating ssh key... 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:21] ENGINE Bus STARTING 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:21] ENGINE Serving on https://172.21.15.33:7150 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:21] ENGINE Error in HTTPServer.serve 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:44:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:44:23.527 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:21] ENGINE Serving on http://172.21.15.33:8765 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:21] ENGINE Bus STARTED 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: Generating public/private rsa key pair. 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: Your identification has been saved in /tmp/tmp8vmnm5au/key 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: Your public key has been saved in /tmp/tmp8vmnm5au/key.pub 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: The key fingerprint is: 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: SHA256:0KsytWTAi4wvgosrEQQgPS/aA8at8I84jKYseK+LsUI ceph-63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: The key's randomart image is: 2024-09-10T23:44:23.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: +---[RSA 3072]----+ 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |*. | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |..o. . | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |o .oo . . | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |+=.o.o . . | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |+*+.. + S | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |+E+ + o | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |Xo.+o o | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |%Oo .o | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: |&=o+. | 2024-09-10T23:44:23.529 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: +----[SHA256]-----+ 2024-09-10T23:44:24.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:24 smithi033 ceph-mon[30593]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:24 smithi033 ceph-mon[30593]: Generating ssh key... 2024-09-10T23:44:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:24 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:24 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:25.342 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:44:25.342 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:44:25.342 INFO:teuthology.orchestra.run.smithi033.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:44:25.357 INFO:teuthology.orchestra.run.smithi033.stdout:Adding host smithi033... 2024-09-10T23:44:25.608 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:25 smithi033 ceph-mon[30593]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:26 smithi033 ceph-mon[30593]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:28.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:28 smithi033 ceph-mon[30593]: Deploying cephadm binary to smithi033 2024-09-10T23:44:31.356 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Added host 'smithi033' with addr '172.21.15.33' 2024-09-10T23:44:31.356 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mon service... 2024-09-10T23:44:31.948 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:31 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:31.948 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:31 smithi033 ceph-mon[30593]: Added host smithi033 2024-09-10T23:44:31.948 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:31 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:44:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mgr service... 2024-09-10T23:44:33.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:33 smithi033 ceph-mon[30593]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:33.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:33 smithi033 ceph-mon[30593]: Saving service mon spec with placement count:5 2024-09-10T23:44:33.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:33 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:34.824 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:44:35.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:34 smithi033 ceph-mon[30593]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:35.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:34 smithi033 ceph-mon[30593]: Saving service mgr spec with placement count:2 2024-09-10T23:44:35.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:34 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:36.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:36 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:36 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:36 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4118830973' entity='client.admin' 2024-09-10T23:44:38.494 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling the dashboard module... 2024-09-10T23:44:38.561 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:38 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4051926555' entity='client.admin' 2024-09-10T23:44:38.561 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:38 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:39.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:39 smithi033 ceph-mon[30593]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:44:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:40 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1062924807' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T23:44:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:40 smithi033 ceph-mon[30593]: from='mgr.14118 172.21.15.33:0/1712354282' entity='mgr.x' 2024-09-10T23:44:40.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ignoring --setuser ceph since I am not root 2024-09-10T23:44:40.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ignoring --setgroup ceph since I am not root 2024-09-10T23:44:41.414 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:41 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1062924807' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:44:41.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:41 smithi033 ceph-mon[30593]: mgrmap e9: x(active, since 22s) 2024-09-10T23:44:42.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3791428337' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T23:44:43.279 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-09-10T23:44:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 9... 2024-09-10T23:44:47.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: Active manager daemon x restarted 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: Activating manager daemon x 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: mgrmap e10: x(active, starting, since 0.00439304s) 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T23:44:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:46 smithi033 ceph-mon[30593]: Manager daemon x is now available 2024-09-10T23:44:48.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:44:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T23:44:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T23:44:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:47 smithi033 ceph-mon[30593]: mgrmap e11: x(active, since 1.0073s) 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:44:48.193+0000 7fd7c0600640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:23:44:48] ENGINE Error in HTTPServer.serve 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: Traceback (most recent call last): 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._connections.run(self.expiration_interval) 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._run(expiration_interval) 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:44:48.414 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: s = self.context.wrap_socket( 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: return self.sslsocket_class._create( 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self.do_handshake() 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: self._sslobj.do_handshake() 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:44:48.415 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 9 is available 2024-09-10T23:44:48.420 INFO:teuthology.orchestra.run.smithi033.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T23:44:49.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:48] ENGINE Bus STARTING 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:48] ENGINE Serving on https://172.21.15.33:7150 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:48] ENGINE Error in HTTPServer.serve 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T23:44:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:48] ENGINE Serving on http://172.21.15.33:8765 2024-09-10T23:44:49.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:48 smithi033 ceph-mon[30593]: [10/Sep/2024:23:44:48] ENGINE Bus STARTED 2024-09-10T23:44:50.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:49 smithi033 ceph-mon[30593]: mgrmap e12: x(active, since 2s) 2024-09-10T23:44:50.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:49 smithi033 ceph-mon[30593]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:50.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:49 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:44:52.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:44:53.250 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUPip280qXat9U7UNZ0Z06xzDLumQwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIzNDQ1MloXDTM0\nMDkxMTIzNDQ1MlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjMzMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAvhenDhOiHXIitmDYWGCVgZadoj1yPUT2kItR\nftv15WFqLtJv1Z5Qz674iUYbwSkrJDH9j3kZqC6ZnZsRS1ioLoRhViGmlkOBSiKb\nQeVsHPGeWbNlxJI/iiykCRKNIWEX/u1vLetdnvy0ZY+fKnhhOjLTBON4996qXRLs\nUVUxXDW8XyFKBChs/mWEaVwJ0Lc2ZKi6zoOctOAVeCxS1Jv+j4+zdgHdLllIjttt\n7fvn/Xkco/qSdsT8r/1U8mQCFD3Sla0Wy2F2aYUaZwoSGi/ufZRzmOYGMeHTRXl7\nCAv/DDMkWR4JAD/B7AEdaBCJASFZwZ05dcGooIO06u2fXHMv+qrqH7suGXMjGjMU\nQd392XSP/SQUFJggJQxa/buHyODtS4cOAhl0D+LppHZcFEd64IGJHldOVW6UF9bN\nWcO+Kb/gtr/FEWLRMKFfkbfAnnBllrs4M45BXTFrT0arRgTekZhbGhbwlWJaaB9V\nuctTxoTFidPN4btMzhXydkocX3lKrjGK0uvpoEPGyfgN756KHAiEND+jJWE4Dxgo\ntNoaQ4Yh3PHexzT8bC2KfsZVkbJBI+kfaqNGvirmyuVD7DOHEAN6hqP6ZovMWE/I\nnFe9tc2VoC/4cnUmgnn4iL0V+gXtC44ujE1sc84EM01t0oRWZg1BwsJYmOkiVBwO\nbcqbUjsCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDMzghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPITAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAl\nG2qPb/pg4T8TqB8T6SZna2vMn34ln8DOXgSq6fYHZpyCEBfshO9A6ySQlzUaP1gU\nbxD5/7e8ndUlBIOBSkNCIveopWEcwJI+y2Kg7uTuxErTasa6z147CV8QxhfJhAkO\nh5t3sYLIMl3ImYsI85CWaZDT/6KhowHNeC9baJv0xs/MzfB/clZHW/2oq/YYq0TB\nqm6CWaPK5niliqa1BEMlbQj2pZkosAVNX6JfE6m4TCcXZbrMuHZPls0loR/flQnQ\nF+eO/CioMPZ6+l3mb3o2d9o4VgDOiHsOGFU8BczriEuxCgOwCHvSyEOqky80/3Ch\n+UJr/ZD9h7LCx9HKNr4UB6MSWSqY0ZwdZtXali86/xDTrKF4it49TCgGWWpav+nI\nRKjnfSxYRp5xg1UgIf8b/k2SLc2JgzcviWXVQy6LKSjZiLpyYEDub21oE91jdHjK\nRXZM09J6qnka5w8/cIgEGQvCTvVGprY+k8FT5MhS5d9NC7c+7sJg6CN5R9ELZZp3\nrPId85AAoMMjG2tLjnO3kxQqby7oZuU2C0n8f00OyaOk60oReKXhAhFAVecrO9+r\nNgC5pCHTl4JMTp2Do7es0rML0Klf3eL1pSDycfh/36ji40uCgJF0wPjUqEe7JlUd\nq1QVK58WqKRg1RBxKoomnaKeG/+dkkJWHKjrkdsb1g==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAvhenDhOiHXIitmDYWGCVgZadoj1yPUT2kItRftv15WFqLtJv\n1Z5Qz674iUYbwSkrJDH9j3kZqC6ZnZsRS1ioLoRhViGmlkOBSiKbQeVsHPGeWbNl\nxJI/iiykCRKNIWEX/u1vLetdnvy0ZY+fKnhhOjLTBON4996qXRLsUVUxXDW8XyFK\nBChs/mWEaVwJ0Lc2ZKi6zoOctOAVeCxS1Jv+j4+zdgHdLllIjttt7fvn/Xkco/qS\ndsT8r/1U8mQCFD3Sla0Wy2F2aYUaZwoSGi/ufZRzmOYGMeHTRXl7CAv/DDMkWR4J\nAD/B7AEdaBCJASFZwZ05dcGooIO06u2fXHMv+qrqH7suGXMjGjMUQd392XSP/SQU\nFJggJQxa/buHyODtS4cOAhl0D+LppHZcFEd64IGJHldOVW6UF9bNWcO+Kb/gtr/F\nEWLRMKFfkbfAnnBllrs4M45BXTFrT0arRgTekZhbGhbwlWJaaB9VuctTxoTFidPN\n4btMzhXydkocX3lKrjGK0uvpoEPGyfgN756KHAiEND+jJWE4DxgotNoaQ4Yh3PHe\nxzT8bC2KfsZVkbJBI+kfaqNGvirmyuVD7DOHEAN6hqP6ZovMWE/InFe9tc2VoC/4\ncnUmgnn4iL0V+gXtC44ujE1sc84EM01t0oRWZg1BwsJYmOkiVBwObcqbUjsCAwEA\nAQKCAgA4IrD9GbQqoO16UUAiXSdZdPqJEj89s7NifRnsbhWADxP1zsQi39U6d4/C\nrhb9JGSulCquZ1M51MUdg1EIoJ5N2l8KOfbBch7ony6dN5yFMZ8TG0TG1293JPau\nDTHrNQqKiGBoPZTQogy93ztgJduEfcTOMUSkYjeKM8/gttlUQzQlHaYHc064k48W\nNA1b+vbPo/pCiSBKU9BTRDeTvJtgls2m4CcKjGg+c7NTb6wTMORR0mnVNBfw+s1O\npVTt2FHrTImqNtZqk9l3q0QsQpJZuHCoqukSav9iiVzZQ/2mAyZNQO7kiW+Be9TM\nyfFDia9BW2ZADZf4Ctzu8Yw5l3SHvTOYuPG8vEhuE/yRaVwhyY1Fv4cy+0nTzOBg\n9iB64t4AB4RqTItfJhcPRcAGX8d40exEYTdGBp34jVyY2t/n/MeigEzfju9Qfy+0\negUrIG1Tk7YJQ7fNOU/fw+N2H/U8JukemApd+5H4Z5ND0AYvyoB4lLbLq8aA607+\nlaP5bu+AinW2jXkoV6fK7+q7qw6gIA1nOXBCKllxCuD6wfp6mDyB7gI0QPAkUz8y\nex+Pe1IwU4zBNl6XtDjagaykdM7yxNJjxvuWj/MH4ykSTnkLibRiHirSMPPw01Z2\n2GZvWpNGX3m/hRROcwTNNUWj98Vs4/7h7TNwa2EoL9/3chonkQKCAQEA91StbRLZ\nhJtt5fDkfg1ySrKrwBbErWJ/QCPSVBzYKbpeKJcDBNXEcLneI+WEnBGVbsqkD3gO\nlGs2DQ2RLns63lZ5SoqgTHdNhNEKhXaPOMHyNpj9eui+nLkSUD7Opv3H4eqsYnJg\nLrkg1igiZvcVXVBMrkQS+8euoVgO3JNQ9VUaMYU6B9X5GgeCuukWWmWvCD686DTN\nkZoHETd15kNNFjv7j4PWSMPFLJ8xTH2dl6xfxiYKI6v2cjqI7uTAU6mGsiEU+42p\nl5oM1wS3x0ylSAVpNVUbTKmwo01NBYDOH6QTqBvcL/ezJk4Ej/BUBjbS7cL7eb5r\nyXUVOliYpXY2awKCAQEAxMFepEqRq9xbnTquASLsfQ8A3RvJ1EGmsBkQ0rUZvjRW\nWyieafXfOZ9q1Fc/+Cjma1kNGbJ6z8NKuzd4bk80GugKLOotvCkZHqhCnXUNwtO7\nQXoq70D7h5EK4SaXZftY88PoYdPnA6d4JC2lUR2vU4P8jBtK7X8srB0j5jdoke2w\nLOLvJvIu2qT7CeDRcC+uF3V8OX9K8856kuBs3AAeik/ls+osKRv3AWbTTUC6UhoE\n1F4/PG5Qjnnj//kXqCHZZo0VSOdPlnbvVR4PH5X9O4yorRKDd4iq/EcVt1B/RCjT\ndcTsTYcDSpe/4P0Js26RUzs2hsYOovWgRqQtGCkncQKCAQEAqKQWND8cDa0lPBoK\n0mA8w+4b6bgcltSIS6WhLjUUty8aMLb3Gf7gGLTDYNqIlxnuOEL3poyH9G89xZyw\nl27y7tMrlMX9EuZt9tfKQsJaWar0ioG6pGm6PoZ6lDifE4ILHmGy9NVj+7fDSgLH\noklrSdsMze4gu4il6+FtEL1qAD3sxENBFEKzvSnN28A+u5iFxitxByup11Oc6gJU\n45KUJ0ry9iJApBDIiupo5Ozp3ZdtHmClnTkNq0l6QNm8wc7fxumDsxoevv4NLzdK\nUBxUvkziNbk4CgfSJyb4E36GDVEFDiUg95v/jWi496Q4xpvvKqs+aP6L5CtvM/9g\n5cE6zQKCAQBdE8kM2YXeEml4kNjeCsJrStyyvMGW2tPa/JCbzTZ3Z1Tu3OFL6ReH\nr+WevAO0Bs0yPTdYT7mPbah9tnkPXgKdM+YUZ1fpalvKx/hzentfDkDIcd27vzb+\nY9wMtO/sO6JR9vyIwvDHJsNMAhfxrqRRUt/2+7ZPcdkVNtfTwaSDXDj6kwRlnS4T\nGvbzLlqFwtiNmnOA07oGakhMEUUOMjRAZBmbKg1oCSWpkRYmtpct3ccpG8i4cstD\nC2CTqCfLzu+Edvt5uItK98qyrnyjCZZ5REpLTbXJp2qT26DnTnpWKSYX0WekKVmi\nQPVxnuKm8ohnIlziFvG3n5EJugLnKhjRAoIBAQDrdT6ULk1r4xRy9/7TBslvbIUQ\n62s1saiRba71cEQnqwNMayi392sydIoI6mL8wvS8oIiL/OO5mD6efL9HVmtEdZt9\nkS/zaYso8GmmgkZ70UrYtPBBnsuTHQ1YZhH52ESQZZ+RkNg8vuZxocEFedTEv9IG\nsKNRNLo+gJmwctqnFgXrRb5h8Ux87k9vkwyMcym1/bPJE5QmHUcS4m+bJZG2cCCR\nP/t0rG81enCBu33Ay5xaBlU09ikOPvH1b7BtPjJAKjbEPBhR+ThDg0KllL9uXRou\nQZ48rD+NQKQf8WHmxx7JUPw0qaO7ZwA+wUplnHVmAzbZRL1wsXZCuYaHrMle\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T23:44:54.722 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T23:44:55.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:55 smithi033 ceph-mon[30593]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:44:56.221 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T23:44:56.221 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial admin user... 2024-09-10T23:44:56.743 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:56 smithi033 ceph-mon[30593]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:56.743 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:56 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:44:58.028 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Bruqh0ey4qt5CWmNfigMBuHtecv.Ry77YTRQmQO0iYM2q5iCr4rWm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726011897, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:44:58.029 INFO:teuthology.orchestra.run.smithi033.stdout:Fetching dashboard port number... 2024-09-10T23:44:58.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:58 smithi033 ceph-mon[30593]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:44:58.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:44:59.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:44:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2391325790' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T23:44:59.442 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:44:59.461 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:44:59.461 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-09-10T23:44:59.474 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:44:59.475 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-09-10T23:44:59.475 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-09-10T23:44:59.475 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph Dashboard is now available at: 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: URL: https://smithi033.front.sepia.ceph.com:8443/ 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: User: admin 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: Password: xe7czunszs 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:44:59.477 INFO:teuthology.orchestra.run.smithi033.stdout:Saving cluster configuration to /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config directory 2024-09-10T23:45:00.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:00 smithi033 ceph-mon[30593]: mgrmap e13: x(active, since 12s) 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: ceph telemetry on 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:For more information see: 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:Bootstrap complete. 2024-09-10T23:45:01.043 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:45:01.043 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:01.043 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:45:01.079 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:45:01.079 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:01.079 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:45:01.155 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:45:01.155 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:01.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T23:45:01.252 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:45:01.252 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:01.252 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:45:01.327 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:45:01.327 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:45:01.450 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:01.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:45:01.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:01 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/415217538' entity='client.admin' 2024-09-10T23:45:01.568 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:01.594 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:45:01.687 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mR5B+D+HwmRIbWvIW26nJHc7F9taNI6SazqYCykju9sX1Thea1qC9/WhemRhBsil1k3+q/h0U6XncFXdylfp+aTVPqRb7bx4LCK6k3IuJt/3ynxz0t6tgc2tNmi+wLO9d4gbSF63IDF1He865ElNsq1oATLOKwu1qf0K8yWOKJVg6VDHhH0pLO0FpnrCkNEbx79XYXCVBrTGfFgxjEsxQ0khevCkERadZIjVzVz2AmGTwzN1Gjsi/PZ34ZXoNNQNRoWXpjxLhjmW+PlmF3mn3gZ9qzTeTitjrRp1C9M4GidLbiJlS1YkyEbWK4b2/ZHAd1Vz4uoHfidniS6lBUMAAh8BW7Y9aEm26r438/IeZuFDus6+qjL6O148sy+zG4+AUCk0JssHa505tHiOotdwdVg7rqmXuJKoTAQVYHP6e6VN8Qhy07sZ+TpFVaOvmuqCZcJrb6ETCraqnL0e9p0BO6epWfNTTQwlsLvSEWEfGsQugCMmlS8K9jxhMdYmATU= ceph-63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:01.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:45:02.090 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:03.993 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:45:03.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:45:04.149 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:03 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3195081348' entity='client.admin' 2024-09-10T23:45:04.599 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:06.694 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:06 smithi033 ceph-mon[30593]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:06.695 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:06.892 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi052 2024-09-10T23:45:06.892 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:45:06.892 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:45:06.931 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:45:06.932 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:07.009 INFO:tasks.cephadm:Adding host smithi052 to orchestrator... 2024-09-10T23:45:07.009 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch host add smithi052 2024-09-10T23:45:07.400 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:07.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:07.818 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-10T23:45:07.818 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:07 smithi033 ceph-mon[30593]: Updating smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:09.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:09.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: Updating smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:10.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:09 smithi033 ceph-mon[30593]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:10 smithi033 ceph-mon[30593]: Deploying cephadm binary to smithi052 2024-09-10T23:45:12.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:11 smithi033 ceph-mon[30593]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:12.863 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi052' with addr '172.21.15.52' 2024-09-10T23:45:13.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: Added host smithi052 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:14.832 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:14.833 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}] 2024-09-10T23:45:15.541 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-10T23:45:15.541 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:45:15.541 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:45:15.581 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:45:15.581 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:15.657 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-10T23:45:15.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-10T23:45:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:16.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:15 smithi033 ceph-mon[30593]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:16.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:15 smithi033 ceph-mon[30593]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:16.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:18.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:17 smithi033 ceph-mon[30593]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:18.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:17 smithi033 ceph-mon[30593]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:19.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: Deploying cephadm binary to smithi189 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:20.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:19 smithi033 ceph-mon[30593]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:20.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:19 smithi033 ceph-mon[30593]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:19 smithi033 ceph-mon[30593]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:21.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:20 smithi033 ceph-mon[30593]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:21.324 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-10T23:45:22.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: Added host smithi189 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:22.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:23.156 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:45:23.156 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-10T23:45:23.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:23 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:23.911 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:45:23.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:45:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:24.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:24 smithi033 ceph-mon[30593]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:24.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:24 smithi033 ceph-mon[30593]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:24.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:24 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:25.422 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-09-10T23:45:25.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:25 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:45:26.103 INFO:tasks.cephadm:Adding mon.a on smithi033 2024-09-10T23:45:26.104 INFO:tasks.cephadm:Adding mon.b on smithi052 2024-09-10T23:45:26.104 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-10T23:45:26.104 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c' 2024-09-10T23:45:26.514 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:45:26.617 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:45:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:26 smithi033 ceph-mon[30593]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:26 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:45:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:26 smithi033 ceph-mon[30593]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:27.438 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-10T23:45:28.641 DEBUG:teuthology.orchestra.run.smithi052:mon.b> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T23:45:28.646 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T23:45:28.650 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:45:28.650 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:29.061 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:45:29.149 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:29.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:29 smithi033 ceph-mon[30593]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:30.041 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:45:30.041 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","modified":"2024-09-10T23:43:47.592910Z","created":"2024-09-10T23:43:47.592910Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:45:30.041 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-10T23:45:30.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/4151351492' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:30 smithi033 ceph-mon[30593]: Deploying daemon mon.c on smithi189 2024-09-10T23:45:31.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:31 smithi033 ceph-mon[30593]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:31.923 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:45:31.923 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:45:33.154 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:34.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:33 smithi033 ceph-mon[30593]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:35.140 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:45:35.140 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","modified":"2024-09-10T23:43:47.592910Z","created":"2024-09-10T23:43:47.592910Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:45:35.140 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-10T23:45:36.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:35 smithi033 ceph-mon[30593]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:36.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:35 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/1768492934' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:36.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 podman[33981]: 2024-09-10 23:45:36.745865926 +0000 UTC m=+0.361841650 container start 8d5288a513d74082a0f264436ea6efe208a0c7a79d49bf8004c93cdbe9d18541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:45:37.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pidfile_write: ignore empty --pid-file 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: load: jerasure load: lrc 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Git sha 0 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: DB SUMMARY 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: DB Session ID: F4XHW1FNIMWZXSPVGEVA 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:45:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.env: 0x55d109b30180 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:45:37.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.info_log: 0x55d1321f36e0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.statistics: (nil) 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.use_fsync: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:45:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:45:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:45:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:45:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.db_log_dir: 2024-09-10T23:45:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.wal_dir: 2024-09-10T23:45:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.write_buffer_manager: 0x55d1321f7b80 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:45:37.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.unordered_write: 0 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:45:37.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.row_cache: None 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.wal_filter: None 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.wal_compression: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:45:37.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:45:37.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_open_files: -1 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Compression algorithms supported: 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kZSTD supported: 0 2024-09-10T23:45:37.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.merge_operator: 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_filter: None 2024-09-10T23:45:37.093 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d1321f3300) 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_type: 0 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_index_type: 0 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_shortening: 1 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: checksum: 4 2024-09-10T23:45:37.094 INFO:journalctl@ceph.mon.c.smithi189.stdout: no_block_cache: 0 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache: 0x55d1321e7610 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_options: 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: capacity : 536870912 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_shard_bits : 4 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: strict_capacity_limit : 0 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_compressed: (nil) 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: persistent_cache: (nil) 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size: 4096 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size_deviation: 10 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_restart_interval: 16 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_block_restart_interval: 1 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: metadata_block_size: 4096 2024-09-10T23:45:37.095 INFO:journalctl@ceph.mon.c.smithi189.stdout: partition_filters: 0 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: use_delta_encoding: 1 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: filter_policy: bloomfilter 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: whole_key_filtering: 1 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: verify_compression: 0 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: format_version: 5 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_index_compression: 1 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_align: 0 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: max_auto_readahead_size: 262144 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: prepopulate_block_cache: 0 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:45:37.096 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression: NoCompression 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.num_levels: 7 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:45:37.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:45:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:45:37.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:45:37.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:45:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.ttl: 2592000 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:45:37.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b566e5d4-b8d4-454e-8939-cef4f1827222 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011936788824, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011936789548, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726011936, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b566e5d4-b8d4-454e-8939-cef4f1827222", "db_session_id": "F4XHW1FNIMWZXSPVGEVA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011936789811, "job": 1, "event": "recovery_finished"} 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d132218e00 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: DB pointer 0x55d132318000 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:45:37.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** DB Stats ** 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:45:37.104 INFO:journalctl@ceph.mon.c.smithi189.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:45:37.105 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache BinnedLRUCache@0x55d1321e7610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-10T23:45:37.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: starting mon.c rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(???) e0 preinit fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: e1 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: btime 2024-09-10T23:43:51:794915+0000 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: legacy client fscid: -1 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout: No filesystems configured 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:45:37.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Added host smithi052 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:37.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Deploying cephadm binary to smithi189 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Added host smithi189 2024-09-10T23:45:37.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/4151351492' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: Deploying daemon mon.c on smithi189 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/1768492934' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 ceph-mon[34000]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 bash[33981]: 8d5288a513d74082a0f264436ea6efe208a0c7a79d49bf8004c93cdbe9d18541 2024-09-10T23:45:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:36 smithi189 systemd[1]: Started Ceph mon.c for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:45:37.284 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:45:37.284 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:45:37.643 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:45:42.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: mon.a calling monitor election 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: mon.c calling monitor election 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: monmap epoch 2 2024-09-10T23:45:42.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: last_changed 2024-09-10T23:45:36.830518+0000 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: min_mon_release 19 (squid) 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: election_strategy: 1 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: fsmap 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: mgrmap e13: x(active, since 55s) 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: overall HEALTH_OK 2024-09-10T23:45:42.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:42.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: mon.a calling monitor election 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: mon.c calling monitor election 2024-09-10T23:45:42.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: monmap epoch 2 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: last_changed 2024-09-10T23:45:36.830518+0000 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: min_mon_release 19 (squid) 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: election_strategy: 1 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: fsmap 2024-09-10T23:45:42.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: mgrmap e13: x(active, since 55s) 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: overall HEALTH_OK 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:42.912 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:45:42.912 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","modified":"2024-09-10T23:45:36.830518Z","created":"2024-09-10T23:43:47.592910Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:45:42.913 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-10T23:45:43.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:42 smithi033 ceph-mon[30593]: Deploying daemon mon.b on smithi052 2024-09-10T23:45:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:42 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:43.297 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:42 smithi189 ceph-mon[34000]: Deploying daemon mon.b on smithi052 2024-09-10T23:45:43.297 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:42 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:44.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:43 smithi033 ceph-mon[30593]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:44.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/734717067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:44.277 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:45:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:45:43.831+0000 7fd800c00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T23:45:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:43 smithi189 ceph-mon[34000]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/734717067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:44.642 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:45:44.643 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:45:45.002 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:45:45.796 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:45:45.796 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","modified":"2024-09-10T23:45:36.830518Z","created":"2024-09-10T23:43:47.592910Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:45:45.796 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-10T23:45:46.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:45 smithi189 ceph-mon[34000]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:46.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:45 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/3296359192' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:46.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:45 smithi033 ceph-mon[30593]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:46.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:45 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/3296359192' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:47.045 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 podman[33508]: 2024-09-10 23:45:47.038037197 +0000 UTC m=+0.362522738 container init d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:45:47.045 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 podman[33508]: 2024-09-10 23:45:47.044499283 +0000 UTC m=+0.368984825 container start d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:45:47.450 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T23:45:47.450 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pidfile_write: ignore empty --pid-file 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: load: jerasure load: lrc 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Git sha 0 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T23:45:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: DB SUMMARY 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: DB Session ID: UCEPFWMZAZMPJLDE9AJG 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:45:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.env: 0x556cc94c5180 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.info_log: 0x556cdb9756e0 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.statistics: (nil) 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.use_fsync: 0 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:45:47.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.db_log_dir: 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.wal_dir: 2024-09-10T23:45:47.459 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:45:47.461 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.write_buffer_manager: 0x556cdb979b80 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.unordered_write: 0 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:45:47.462 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.row_cache: None 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.wal_filter: None 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.wal_compression: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:45:47.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:45:47.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_open_files: -1 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:45:47.465 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Compression algorithms supported: 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kZSTD supported: 0 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:45:47.466 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.merge_operator: 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_filter: None 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556cdb975300) 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:45:47.467 INFO:journalctl@ceph.mon.b.smithi052.stdout: index_type: 0 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: data_block_index_type: 0 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: index_shortening: 1 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: checksum: 4 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: no_block_cache: 0 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_cache: 0x556cdb969610 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_cache_options: 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: capacity : 536870912 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: num_shard_bits : 4 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: strict_capacity_limit : 0 2024-09-10T23:45:47.468 INFO:journalctl@ceph.mon.b.smithi052.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_cache_compressed: (nil) 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: persistent_cache: (nil) 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_size: 4096 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_size_deviation: 10 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_restart_interval: 16 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: index_block_restart_interval: 1 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: metadata_block_size: 4096 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: partition_filters: 0 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: use_delta_encoding: 1 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: filter_policy: bloomfilter 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: whole_key_filtering: 1 2024-09-10T23:45:47.469 INFO:journalctl@ceph.mon.b.smithi052.stdout: verify_compression: 0 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: format_version: 5 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: enable_index_compression: 1 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: block_align: 0 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: max_auto_readahead_size: 262144 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: prepopulate_block_cache: 0 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression: NoCompression 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:45:47.470 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.num_levels: 7 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:45:47.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:45:47.472 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:45:47.473 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:45:47.474 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:45:47.475 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.ttl: 2592000 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:45:47.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 036ebd18-2bd0-428f-b890-3d55356342bb 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011947088154, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011947088893, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726011947, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "036ebd18-2bd0-428f-b890-3d55356342bb", "db_session_id": "UCEPFWMZAZMPJLDE9AJG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:45:47.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726011947089154, "job": 1, "event": "recovery_finished"} 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556cdb99ae00 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: DB pointer 0x556cdba9a000 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: ** DB Stats ** 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:45:47.478 INFO:journalctl@ceph.mon.b.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:45:47.479 INFO:journalctl@ceph.mon.b.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Cumulative compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Interval compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:45:47.480 INFO:journalctl@ceph.mon.b.smithi052.stdout: Block cache BinnedLRUCache@0x556cdb969610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: using public_addr v2:172.21.15.52:0/0 -> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: starting mon.b rank -1 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(???) e0 preinit fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 bash[33508]: d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout: e1 2024-09-10T23:45:47.481 INFO:journalctl@ceph.mon.b.smithi052.stdout: btime 2024-09-10T23:43:51:794915+0000 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout: legacy client fscid: -1 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout: No filesystems configured 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:45:47.482 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Added host smithi052 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:47.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Deploying cephadm binary to smithi189 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Added host smithi189 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3574447048' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T23:45:47.486 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/4151351492' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Deploying daemon mon.c on smithi189 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.487 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/1768492934' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.a calling monitor election 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.c calling monitor election 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: monmap epoch 2 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: last_changed 2024-09-10T23:45:36.830518+0000 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: min_mon_release 19 (squid) 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: election_strategy: 1 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: fsmap 2024-09-10T23:45:47.489 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mgrmap e13: x(active, since 55s) 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: overall HEALTH_OK 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: Deploying daemon mon.b on smithi052 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/734717067' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:47.490 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/3296359192' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:47.491 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 ceph-mon[33526]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-09-10T23:45:47.491 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:47 smithi052 systemd[1]: Started Ceph mon.b for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:45:47.811 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: mon.a calling monitor election 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: mon.c calling monitor election 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: mon.b calling monitor election 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: monmap epoch 3 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: last_changed 2024-09-10T23:45:47.131846+0000 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: min_mon_release 19 (squid) 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: election_strategy: 1 2024-09-10T23:45:52.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: fsmap 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: mgrmap e13: x(active, since 65s) 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: overall HEALTH_OK 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.458 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: mon.a calling monitor election 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: mon.c calling monitor election 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: mon.b calling monitor election 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: monmap epoch 3 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: last_changed 2024-09-10T23:45:47.131846+0000 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: min_mon_release 19 (squid) 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: election_strategy: 1 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:52.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: fsmap 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: mgrmap e13: x(active, since 65s) 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: overall HEALTH_OK 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: mon.a calling monitor election 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:45:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: mon.c calling monitor election 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: mon.b calling monitor election 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: monmap epoch 3 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: last_changed 2024-09-10T23:45:47.131846+0000 2024-09-10T23:45:52.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: created 2024-09-10T23:43:47.592910+0000 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: min_mon_release 19 (squid) 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: election_strategy: 1 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: fsmap 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: mgrmap e13: x(active, since 65s) 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: overall HEALTH_OK 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:53.111 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:45:53.111 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","modified":"2024-09-10T23:45:47.131846Z","created":"2024-09-10T23:43:47.592910Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T23:45:53.111 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-10T23:45:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/1087054865' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:53.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:53.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/1087054865' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:53.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:53.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:45:53.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/1087054865' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T23:45:53.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:54.453 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:45:54.453 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:54.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:45:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:55.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:55.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-10T23:45:55.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:55.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:55.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:55.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:55.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:55.692 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:55.692 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-09-10T23:45:55.692 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:45:55.692 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-10T23:45:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi033:/etc/ceph/ceph.conf 2024-09-10T23:45:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T23:45:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T23:45:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: Updating smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:55.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:55.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:55.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:56.352 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:56 smithi033 ceph-mon[30593]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:56.352 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:56 smithi033 ceph-mon[30593]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:45:56.352 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:56 smithi033 ceph-mon[30593]: Reconfiguring daemon mon.a on smithi033 2024-09-10T23:45:56.352 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:56 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3247377955' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:56 smithi189 ceph-mon[34000]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:56 smithi189 ceph-mon[34000]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:45:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:56 smithi189 ceph-mon[34000]: Reconfiguring daemon mon.a on smithi033 2024-09-10T23:45:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:56 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3247377955' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:56 smithi052 ceph-mon[33526]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:56 smithi052 ceph-mon[33526]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T23:45:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:56 smithi052 ceph-mon[33526]: Reconfiguring daemon mon.a on smithi033 2024-09-10T23:45:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:56 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3247377955' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:56.991 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:45:56.992 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:56.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:45:57.054 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:45:57.054 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:57.152 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:45:57.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:45:57.217 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:45:57.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:57.315 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:45:57.343 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:45:57.406 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:45:57.407 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:45:57.504 INFO:tasks.cephadm:Adding mgr.x on smithi033 2024-09-10T23:45:57.505 INFO:tasks.cephadm:Adding mgr.y on smithi052 2024-09-10T23:45:57.505 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-10T23:45:57.505 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi033=x;smithi052=y;smithi189=z' 2024-09-10T23:45:57.904 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:58.416 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:58.416 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.416 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.416 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.417 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:58.417 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:58.417 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:58.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:45:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:45:58.743 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-10T23:45:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:59 smithi189 ceph-mon[34000]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:45:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:59 smithi189 ceph-mon[34000]: Reconfiguring daemon mon.b on smithi052 2024-09-10T23:45:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:45:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:59.412 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:59 smithi052 ceph-mon[33526]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:45:59.412 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:59 smithi052 ceph-mon[33526]: Reconfiguring daemon mon.b on smithi052 2024-09-10T23:45:59.413 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:45:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:59.419 DEBUG:teuthology.orchestra.run.smithi052:mgr.y> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T23:45:59.424 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T23:45:59.428 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:45:59.428 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:45:59.433 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:45:59.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:45:59.477 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:45:59.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:45:59.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:59 smithi033 ceph-mon[30593]: Reconfiguring mon.b (monmap changed)... 2024-09-10T23:45:59.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:59 smithi033 ceph-mon[30593]: Reconfiguring daemon mon.b on smithi052 2024-09-10T23:45:59.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:45:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:45:59.487 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:45:59.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:45:59.532 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:45:59.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:45:59.580 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:45:59.580 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:45:59.627 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:45:59.627 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:45:59.673 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:45:59.673 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:45:59.722 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T23:45:59.722 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T23:45:59.778 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T23:45:59.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T23:45:59.834 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T23:45:59.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T23:45:59.888 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T23:45:59.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T23:45:59.940 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:45:59.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:45:59.999 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:45:59.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:46:00.061 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:46:00.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:46:00.075 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:00.082 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:46:00.082 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:46:00.138 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:46:00.138 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:46:00.196 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:46:00.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:46:00.258 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:46:00.258 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:46:00.259 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:00.292 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:00.292 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: Saving service mgr spec with placement smithi033=x;smithi052=y;smithi189=z;count:3 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:46:00.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:00.301 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:46:00.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:46:00.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: Saving service mgr spec with placement smithi033=x;smithi052=y;smithi189=z;count:3 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:46:00.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:00.358 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:46:00.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:46:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:00.411 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:46:00.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:46:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: Saving service mgr spec with placement smithi033=x;smithi052=y;smithi189=z;count:3 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T23:46:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:00.479 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T23:46:00.479 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi033') 2024-09-10T23:46:01.195 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:01 smithi033 ceph-mon[30593]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:46:01.195 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:01 smithi033 ceph-mon[30593]: Reconfiguring daemon mon.c on smithi189 2024-09-10T23:46:01.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:01 smithi052 ceph-mon[33526]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:46:01.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:01 smithi052 ceph-mon[33526]: Reconfiguring daemon mon.c on smithi189 2024-09-10T23:46:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:01 smithi189 ceph-mon[34000]: Reconfiguring mon.c (monmap changed)... 2024-09-10T23:46:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:01 smithi189 ceph-mon[34000]: Reconfiguring daemon mon.c on smithi189 2024-09-10T23:46:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: Deploying daemon mgr.z on smithi189 2024-09-10T23:46:02.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:02 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3411134318' entity='client.admin' 2024-09-10T23:46:02.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:02.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: Deploying daemon mgr.z on smithi189 2024-09-10T23:46:02.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:02 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3411134318' entity='client.admin' 2024-09-10T23:46:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: Deploying daemon mgr.z on smithi189 2024-09-10T23:46:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:02 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3411134318' entity='client.admin' 2024-09-10T23:46:02.459 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:02.460 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:02.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.501+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1944606827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0103430 msgr2=0x7f9eb0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.501+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1944606827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0103430 0x7f9eb0109db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009cd0 tx=0x7f9ea802a910 comp rx=0 tx=0).stop 2024-09-10T23:46:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.501+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1944606827 shutdown_connections 2024-09-10T23:46:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.501+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1944606827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0103430 0x7f9eb0109db0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.502+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1944606827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0102a70 0x7f9eb0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.502+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1944606827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0101910 0x7f9eb0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.502+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1944606827 >> 172.21.15.33:0/1944606827 conn(0x7f9eb00fd1e0 msgr2=0x7f9eb00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:02.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.504+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1944606827 shutdown_connections 2024-09-10T23:46:02.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.504+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1944606827 wait complete. 2024-09-10T23:46:02.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.505+0000 7f9eb7e00640 1 Processor -- start 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.505+0000 7f9eb7e00640 1 -- start start 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0102a70 0x7f9eb01047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0103430 0x7f9eb0105420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb010b840 con 0x7f9eb0103430 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb010b6c0 con 0x7f9eb0102a70 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb010b9c0 con 0x7f9eb0101910 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:32980/0 (socket says 172.21.15.33:32980) 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.506+0000 7f9eb5400640 1 -- 172.21.15.33:0/1126063786 learned_addr learned my addr 172.21.15.33:0/1126063786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:02.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb4a00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0102a70 0x7f9eb01047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb5400640 1 -- 172.21.15.33:0/1126063786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0102a70 msgr2=0x7f9eb01047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb5400640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0102a70 0x7f9eb01047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb5400640 1 -- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0103430 msgr2=0x7f9eb0105420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb5400640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0103430 0x7f9eb0105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.507+0000 7f9eb5400640 1 -- 172.21.15.33:0/1126063786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb0105cc0 con 0x7f9eb0101910 2024-09-10T23:46:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.508+0000 7f9eb5400640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c920 tx=0x7f9e9c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.509+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c007c70 con 0x7f9eb0101910 2024-09-10T23:46:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.509+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(22 keys) ==== 970+0+0 (secure 0 0 0) 0x7f9e9c007e10 con 0x7f9eb0101910 2024-09-10T23:46:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.509+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c018660 con 0x7f9eb0101910 2024-09-10T23:46:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.510+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb0105fb0 con 0x7f9eb0101910 2024-09-10T23:46:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.510+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb01066e0 con 0x7f9eb0101910 2024-09-10T23:46:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.512+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb0106210 con 0x7f9eb0101910 2024-09-10T23:46:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.514+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f9e9c00f450 con 0x7f9eb0101910 2024-09-10T23:46:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.514+0000 7f9eae000640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 0x7f9e98041a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.514+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9e9c053ee0 con 0x7f9eb0101910 2024-09-10T23:46:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.515+0000 7f9eb4a00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 0x7f9e98041a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:02.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.517+0000 7f9eb4a00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 0x7f9e98041a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4006fd0 tx=0x7f9ea4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:02.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.520+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9e9c014030 con 0x7f9eb0101910 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2f403f5c0 msgr2=0x7fc2f4041a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2f403f5c0 0x7fc2f4041a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc300009bd0 tx=0x7fc300005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc30c1043b0 msgr2=0x7fc30c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc30c1043b0 0x7fc30c1991d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc30400eaa0 tx=0x7fc30400ef60 comp rx=0 tx=0).stop 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 shutdown_connections 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2f403f5c0 0x7fc2f4041a80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc30c1043b0 0x7fc30c1991d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc30c1039f0 0x7fc30c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 --2- 172.21.15.33:0/1995241880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc30c102890 0x7fc30c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 >> 172.21.15.33:0/1995241880 conn(0x7fc30c0fe180 msgr2=0x7fc30c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 shutdown_connections 2024-09-10T23:46:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.264+0000 7fc312000640 1 -- 172.21.15.33:0/1995241880 wait complete. 2024-09-10T23:46:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.726+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f9eb002e5c0 con 0x7f9eb0101910 2024-09-10T23:46:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.737+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 7 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f9e9c00d6e0 con 0x7f9eb0101910 2024-09-10T23:46:02.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.737+0000 7f9eae000640 1 -- 172.21.15.33:0/1126063786 <== mon.1 v2:172.21.15.189:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f9eb002e5c0 con 0x7f9eb0101910 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 msgr2=0x7f9e98041a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 0x7f9e98041a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4006fd0 tx=0x7f9ea4008040 comp rx=0 tx=0).stop 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 msgr2=0x7f9eb0104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c920 tx=0x7f9e9c00cde0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 shutdown_connections 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9e9803f550 0x7f9e98041a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb0103430 0x7f9eb0105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb0102a70 0x7f9eb01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 --2- 172.21.15.33:0/1126063786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9eb0101910 0x7f9eb0104190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:02.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.739+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 >> 172.21.15.33:0/1126063786 conn(0x7f9eb00fd1e0 msgr2=0x7f9eb00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:02.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.740+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 shutdown_connections 2024-09-10T23:46:02.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:02.740+0000 7f9eb7e00640 1 -- 172.21.15.33:0/1126063786 wait complete. 2024-09-10T23:46:03.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:03 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1995241880' entity='client.admin' 2024-09-10T23:46:03.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:03 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:03.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:03 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1995241880' entity='client.admin' 2024-09-10T23:46:03.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:03 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:03.663 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi033') 2024-09-10T23:46:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:03 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1995241880' entity='client.admin' 2024-09-10T23:46:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:03 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:03.742 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:03 smithi189 systemd[1]: Starting Ceph mgr.z for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:46:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:04 smithi189 ceph-mon[34000]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:04.332 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 podman[35559]: 2024-09-10 23:46:03.954140318 +0000 UTC m=+0.026894003 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:46:04.332 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 podman[35559]: 2024-09-10 23:46:04.092928502 +0000 UTC m=+0.165682185 container create 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:46:04.638 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:04 smithi033 ceph-mon[30593]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:04 smithi052 ceph-mon[33526]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 -- 172.21.15.33:0/3489792039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 msgr2=0x7fe3c4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 --2- 172.21.15.33:0/3489792039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4102c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009930 tx=0x7fe3b802a420 comp rx=0 tx=0).stop 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 -- 172.21.15.33:0/3489792039 shutdown_connections 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 --2- 172.21.15.33:0/3489792039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c41043b0 0x7fe3c410ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 --2- 172.21.15.33:0/3489792039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 --2- 172.21.15.33:0/3489792039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4102c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.637+0000 7fe3caa00640 1 -- 172.21.15.33:0/3489792039 >> 172.21.15.33:0/3489792039 conn(0x7fe3c40fe180 msgr2=0x7fe3c41005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:04.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.638+0000 7fe3caa00640 1 -- 172.21.15.33:0/3489792039 shutdown_connections 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.638+0000 7fe3caa00640 1 -- 172.21.15.33:0/3489792039 wait complete. 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 Processor -- start 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 -- start start 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:04.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c41043b0 0x7fe3c4075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c410e170 con 0x7fe3c4102890 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c410dff0 con 0x7fe3c41039f0 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.639+0000 7fe3caa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c410e2f0 con 0x7fe3c41043b0 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54008/0 (socket says 172.21.15.33:54008) 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 -- 172.21.15.33:0/1622297196 learned_addr learned my addr 172.21.15.33:0/1622297196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c8c00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 -- 172.21.15.33:0/1622297196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c41043b0 msgr2=0x7fe3c4075a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c41043b0 0x7fe3c4075a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 -- 172.21.15.33:0/1622297196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 msgr2=0x7fe3c4075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.640+0000 7fe3c9600640 1 -- 172.21.15.33:0/1622297196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c4076340 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3c9600640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009900 tx=0x7fe3b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3c8c00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b803f070 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fe3b8003a40 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8035030 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41a2980 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.641+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a2e80 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.642+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c4102c90 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.643+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fe3b80035f0 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.644+0000 7fe3c2000640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 0x7fe3ac041a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.644+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe3b8074590 con 0x7fe3c4102890 2024-09-10T23:46:04.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.644+0000 7fe3c8c00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 0x7fe3ac041a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:04.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.645+0000 7fe3c8c00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 0x7fe3ac041a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fc0 tx=0x7fe3b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:04.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.650+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3b8036260 con 0x7fe3c4102890 2024-09-10T23:46:04.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.715+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fe3b8039850 con 0x7fe3c4102890 2024-09-10T23:46:04.832 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 podman[35559]: 2024-09-10 23:46:04.353617989 +0000 UTC m=+0.426371676 container init 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T23:46:04.832 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 podman[35559]: 2024-09-10 23:46:04.35968783 +0000 UTC m=+0.432441516 container start 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T23:46:04.832 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 ceph-mgr[35578]: -- 172.21.15.189:0/2740540678 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557866a690e0 con 0x557866a47400 2024-09-10T23:46:04.832 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 bash[35559]: 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb 2024-09-10T23:46:04.832 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 23:46:04 smithi189 systemd[1]: Started Ceph mgr.z for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:46:04.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.875+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe3c4063d50 con 0x7fe3c4102890 2024-09-10T23:46:04.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.879+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fe3b803b980 con 0x7fe3c4102890 2024-09-10T23:46:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.880+0000 7fe3c2000640 1 -- 172.21.15.33:0/1622297196 <== mon.0 v2:172.21.15.33:3300/0 9 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3b8039ce0 con 0x7fe3c4102890 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 msgr2=0x7fe3ac041a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 0x7fe3ac041a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fc0 tx=0x7fe3b0005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 msgr2=0x7fe3c4076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009900 tx=0x7fe3b80045e0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 shutdown_connections 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3ac03f5c0 0x7fe3ac041a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c41043b0 0x7fe3c4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c41039f0 0x7fe3c4075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 --2- 172.21.15.33:0/1622297196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c4102890 0x7fe3c4076cd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.881+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 >> 172.21.15.33:0/1622297196 conn(0x7fe3c40fe180 msgr2=0x7fe3c4106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.882+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 shutdown_connections 2024-09-10T23:46:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.882+0000 7fe3caa00640 1 -- 172.21.15.33:0/1622297196 wait complete. 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 -- 172.21.15.33:0/2664802060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4106550 msgr2=0x7f46e4111210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 --2- 172.21.15.33:0/2664802060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4106550 0x7f46e4111210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009ca0 tx=0x7f46dc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 -- 172.21.15.33:0/2664802060 shutdown_connections 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 --2- 172.21.15.33:0/2664802060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4106550 0x7f46e4111210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 --2- 172.21.15.33:0/2664802060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 0x7f46e4075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 --2- 172.21.15.33:0/2664802060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e4076f80 0x7f46e40755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.487+0000 7f46eb000640 1 -- 172.21.15.33:0/2664802060 >> 172.21.15.33:0/2664802060 conn(0x7f46e40fe320 msgr2=0x7f46e4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.488+0000 7f46eb000640 1 -- 172.21.15.33:0/2664802060 shutdown_connections 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.488+0000 7f46eb000640 1 -- 172.21.15.33:0/2664802060 wait complete. 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.488+0000 7f46eb000640 1 Processor -- start 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 -- start start 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 0x7f46e419f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e41a03a0 0x7f46e41a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4114980 con 0x7f46e4076f80 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4114800 con 0x7f46e41a03a0 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46eb000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4114b00 con 0x7f46e4075b20 2024-09-10T23:46:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46db400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46db400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53996/0 (socket says 172.21.15.33:53996) 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46db400640 1 -- 172.21.15.33:0/2205652431 learned_addr learned my addr 172.21.15.33:0/2205652431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.489+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 0x7f46e419f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46e9000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e41a03a0 0x7f46e41a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 -- 172.21.15.33:0/2205652431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 msgr2=0x7f46e419f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 0x7f46e419f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 -- 172.21.15.33:0/2205652431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e41a03a0 msgr2=0x7f46e41a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e41a03a0 0x7f46e41a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 -- 172.21.15.33:0/2205652431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e41a1020 con 0x7f46e4076f80 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46db400640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00e9f0 tx=0x7f46cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00cd80 con 0x7f46e4076f80 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f46cc005470 con 0x7f46e4076f80 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e41a7440 con 0x7f46e4076f80 2024-09-10T23:46:05.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc004e60 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.490+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e41a78f0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.492+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e4075fa0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.492+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f46cc005020 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.492+0000 7f46e1600640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 0x7f46c80419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.492+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f46cc0541e0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.492+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 0x7f46c80419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.493+0000 7f46e3e00640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 0x7f46c80419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009bd0 tx=0x7f46d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.497+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f46cc01b160 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.711+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f46e402e5c0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.714+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f46cc01ccb0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.715+0000 7f46e1600640 1 -- 172.21.15.33:0/2205652431 <== mon.0 v2:172.21.15.33:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f46cc0046c0 con 0x7f46e4076f80 2024-09-10T23:46:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.718+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 msgr2=0x7f46c80419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.718+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 0x7f46c80419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009bd0 tx=0x7f46d4005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.718+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 msgr2=0x7f46e419f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.718+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00e9f0 tx=0x7f46cc00edf0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 shutdown_connections 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f46c803f510 0x7f46c80419d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46e41a03a0 0x7f46e41a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e4076f80 0x7f46e419f760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 --2- 172.21.15.33:0/2205652431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46e4075b20 0x7f46e419f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 >> 172.21.15.33:0/2205652431 conn(0x7f46e40fe320 msgr2=0x7f46e4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 shutdown_connections 2024-09-10T23:46:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:04.719+0000 7f46eb000640 1 -- 172.21.15.33:0/2205652431 wait complete. 2024-09-10T23:46:05.784 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.784 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: Deploying daemon mgr.y on smithi052 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2205652431' entity='client.admin' 2024-09-10T23:46:05.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1622297196' entity='client.admin' 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: Deploying daemon mgr.y on smithi052 2024-09-10T23:46:05.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:05.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2205652431' entity='client.admin' 2024-09-10T23:46:05.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1622297196' entity='client.admin' 2024-09-10T23:46:06.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: Deploying daemon mgr.y on smithi052 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2205652431' entity='client.admin' 2024-09-10T23:46:06.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1622297196' entity='client.admin' 2024-09-10T23:46:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.079 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.097 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.101 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.103 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi033') 2024-09-10T23:46:07.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-09-10T23:46:07.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-09-10T23:46:07.120 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi033') 2024-09-10T23:46:07.199 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.210 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.580 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 systemd[1]: Starting Ceph mgr.y for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 -- 172.21.15.33:0/539259587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c106760 msgr2=0x7fe00c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 --2- 172.21.15.33:0/539259587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c106760 0x7fe00c10d0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe004009930 tx=0x7fe00402a420 comp rx=0 tx=0).stop 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 -- 172.21.15.33:0/539259587 shutdown_connections 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 --2- 172.21.15.33:0/539259587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c106760 0x7fe00c10d0e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 --2- 172.21.15.33:0/539259587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c105da0 0x7fe00c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 --2- 172.21.15.33:0/539259587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 -- 172.21.15.33:0/539259587 >> 172.21.15.33:0/539259587 conn(0x7fe00c100510 msgr2=0x7fe00c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.847+0000 7fe011200640 1 -- 172.21.15.33:0/539259587 shutdown_connections 2024-09-10T23:46:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.848+0000 7fe011200640 1 -- 172.21.15.33:0/539259587 wait complete. 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 Processor -- start 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 -- start start 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 0x7fe00c19b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c106760 0x7fe00c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1107c0 con 0x7fe00c105da0 2024-09-10T23:46:07.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c110640 con 0x7fe00c104c40 2024-09-10T23:46:07.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.849+0000 7fe011200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c110940 con 0x7fe00c106760 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe001400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 0x7fe00c19b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43866/0 (socket says 172.21.15.33:43866) 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 -- 172.21.15.33:0/2488990164 learned_addr learned my addr 172.21.15.33:0/2488990164 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe00a800640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c106760 0x7fe00c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 -- 172.21.15.33:0/2488990164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c106760 msgr2=0x7fe00c19c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c106760 0x7fe00c19c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 -- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 msgr2=0x7fe00c19b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 0x7fe00c19b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe009e00640 1 -- 172.21.15.33:0/2488990164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c19ca10 con 0x7fe00c104c40 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.850+0000 7fe001400640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 0x7fe00c19b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe009e00640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00cce0 tx=0x7fdffc00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc004b20 con 0x7fe00c104c40 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdffc004cc0 con 0x7fe00c104c40 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c19cd00 con 0x7fe00c104c40 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00f6b0 con 0x7fe00c104c40 2024-09-10T23:46:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.851+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c1a33e0 con 0x7fe00c104c40 2024-09-10T23:46:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.852+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c10bfc0 con 0x7fe00c104c40 2024-09-10T23:46:07.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.852+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fdffc00f850 con 0x7fe00c104c40 2024-09-10T23:46:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.853+0000 7fe003400640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 0x7fdff00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.853+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdffc053e90 con 0x7fe00c104c40 2024-09-10T23:46:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.853+0000 7fe001400640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 0x7fdff00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:07.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.854+0000 7fe001400640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 0x7fdff00419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009fc0 tx=0x7fdff4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:07.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:07.858+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdffc014030 con 0x7fe00c104c40 2024-09-10T23:46:07.863 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:07 smithi052 ceph-mon[33526]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:07.863 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 podman[34659]: 2024-09-10 23:46:07.483237278 +0000 UTC m=+0.027436646 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:46:07.863 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 podman[34659]: 2024-09-10 23:46:07.614070027 +0000 UTC m=+0.158269384 container create 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:46:07.863 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 podman[34659]: 2024-09-10 23:46:07.816592902 +0000 UTC m=+0.360792272 container init 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:46:07.863 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 podman[34659]: 2024-09-10 23:46:07.822822189 +0000 UTC m=+0.367021548 container start 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T23:46:07.913 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.920 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.920 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.924 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.928 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.932 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:07.937 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:08.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:07 smithi033 ceph-mon[30593]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:08.020 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:08.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:07 smithi189 ceph-mon[34000]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:08.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.136+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe00c063d80 con 0x7fe00c104c40 2024-09-10T23:46:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.141+0000 7fe003400640 1 -- 172.21.15.33:0/2488990164 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7fdffc005520 con 0x7fe00c104c40 2024-09-10T23:46:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 msgr2=0x7fdff00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 0x7fdff00419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009fc0 tx=0x7fdff4005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 msgr2=0x7fe00c19aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00cce0 tx=0x7fdffc00a620 comp rx=0 tx=0).stop 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 shutdown_connections 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdff003f510 0x7fdff00419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe00c106760 0x7fe00c19c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe00c105da0 0x7fe00c19b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 --2- 172.21.15.33:0/2488990164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00c104c40 0x7fe00c19aee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 >> 172.21.15.33:0/2488990164 conn(0x7fe00c100510 msgr2=0x7fe00c109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 shutdown_connections 2024-09-10T23:46:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:08.143+0000 7fe011200640 1 -- 172.21.15.33:0/2488990164 wait complete. 2024-09-10T23:46:08.205 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 ceph-mgr[34678]: -- 172.21.15.52:0/1950826000 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d0b0a30e0 con 0x560d0b080800 2024-09-10T23:46:08.205 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 bash[34659]: 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 2024-09-10T23:46:08.205 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 23:46:07 smithi052 systemd[1]: Started Ceph mgr.y for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:46:09.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.190 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:09.191 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:09.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:09.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:09.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 -- 172.21.15.33:0/3529117236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0103b80 msgr2=0x7f3db0104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 --2- 172.21.15.33:0/3529117236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0103b80 0x7f3db0104000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009930 tx=0x7f3d9c02a420 comp rx=0 tx=0).stop 2024-09-10T23:46:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 -- 172.21.15.33:0/3529117236 shutdown_connections 2024-09-10T23:46:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 --2- 172.21.15.33:0/3529117236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 0x7f3db010aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 --2- 172.21.15.33:0/3529117236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0103b80 0x7f3db0104000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 --2- 172.21.15.33:0/3529117236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0102a20 0x7f3db0102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.634+0000 7f3db7e00640 1 -- 172.21.15.33:0/3529117236 >> 172.21.15.33:0/3529117236 conn(0x7f3db00fe2f0 msgr2=0x7f3db0100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.635+0000 7f3db7e00640 1 -- 172.21.15.33:0/3529117236 shutdown_connections 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.635+0000 7f3db7e00640 1 -- 172.21.15.33:0/3529117236 wait complete. 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.635+0000 7f3db7e00640 1 Processor -- start 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 -- start start 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 0x7f3db019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 0x7f3db019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010e580 con 0x7f3db0102a20 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010e400 con 0x7f3db0103b80 2024-09-10T23:46:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3db010e700 con 0x7f3db0104540 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54068/0 (socket says 172.21.15.33:54068) 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db5400640 1 -- 172.21.15.33:0/4090976010 learned_addr learned my addr 172.21.15.33:0/4090976010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db5e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 0x7f3db019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.636+0000 7f3db4a00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 0x7f3db019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 -- 172.21.15.33:0/4090976010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 msgr2=0x7f3db019c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 0x7f3db019c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 -- 172.21.15.33:0/4090976010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 msgr2=0x7f3db019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 0x7f3db019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 -- 172.21.15.33:0/4090976010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db019caa0 con 0x7f3db0102a20 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db4a00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 0x7f3db019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:09.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db5400640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9f0 tx=0x7f3da400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400cd80 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3da40108c0 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db019cd90 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40187c0 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.637+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01a3470 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.638+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db01a3640 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.639+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f3da4010430 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.639+0000 7f3dae000640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 0x7f3d980419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.639+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3da4054280 con 0x7f3db0102a20 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.639+0000 7f3db4a00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 0x7f3d980419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.640+0000 7f3db4a00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 0x7f3d980419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c006010 tx=0x7f3d9c005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.644+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3da40189a0 con 0x7f3db0102a20 2024-09-10T23:46:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.844+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3db01a3930 con 0x7f3db0102a20 2024-09-10T23:46:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.849+0000 7f3dae000640 1 -- 172.21.15.33:0/4090976010 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7f3da4010d50 con 0x7f3db0102a20 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 msgr2=0x7f3d980419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 0x7f3d980419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c006010 tx=0x7f3d9c005720 comp rx=0 tx=0).stop 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 msgr2=0x7f3db019af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9f0 tx=0x7f3da400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 shutdown_connections 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3d9803f510 0x7f3d980419d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3db0104540 0x7f3db019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db0103b80 0x7f3db019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 --2- 172.21.15.33:0/4090976010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db0102a20 0x7f3db019af70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 >> 172.21.15.33:0/4090976010 conn(0x7f3db00fe2f0 msgr2=0x7f3db0109440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 shutdown_connections 2024-09-10T23:46:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.852+0000 7f3db7e00640 1 -- 172.21.15.33:0/4090976010 wait complete. 2024-09-10T23:46:10.689 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4090976010' entity='client.admin' 2024-09-10T23:46:10.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:10.691 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:10.691 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4090976010' entity='client.admin' 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4090976010' entity='client.admin' 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T23:46:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:11.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 -- 172.21.15.33:0/2892448437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 msgr2=0x7f6f48107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/2892448437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f48107aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009900 tx=0x7f6f3c02a400 comp rx=0 tx=0).stop 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 -- 172.21.15.33:0/2892448437 shutdown_connections 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/2892448437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f4810a990 0x7f6f4810ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/2892448437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f48107fe0 0x7f6f4810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/2892448437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f48107aa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.304+0000 7f6f4fe00640 1 -- 172.21.15.33:0/2892448437 >> 172.21.15.33:0/2892448437 conn(0x7f6f480fd210 msgr2=0x7f6f480ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.305+0000 7f6f4fe00640 1 -- 172.21.15.33:0/2892448437 shutdown_connections 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.305+0000 7f6f4fe00640 1 -- 172.21.15.33:0/2892448437 wait complete. 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 Processor -- start 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 -- start start 2024-09-10T23:46:11.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f48107fe0 0x7f6f4819b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4810a990 0x7f6f4819c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6f48110770 con 0x7f6f4806bf30 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f481105f0 con 0x7f6f4810a990 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6f481108f0 con 0x7f6f48107fe0 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57268/0 (socket says 172.21.15.33:57268) 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4d400640 1 -- 172.21.15.33:0/224715708 learned_addr learned my addr 172.21.15.33:0/224715708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4de00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4810a990 0x7f6f4819c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.306+0000 7f6f4ca00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f48107fe0 0x7f6f4819b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 -- 172.21.15.33:0/224715708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f48107fe0 msgr2=0x7f6f4819b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:11.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f48107fe0 0x7f6f4819b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 -- 172.21.15.33:0/224715708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4810a990 msgr2=0x7f6f4819c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4810a990 0x7f6f4819c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 -- 172.21.15.33:0/224715708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4819ca60 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4d400640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009a20 tx=0x7f6f3c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c03f030 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f3c003a80 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4819ccf0 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.307+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c035070 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.308+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f481a3260 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.309+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f6f3c03ba10 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.309+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f480fed00 con 0x7f6f4806bf30 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.309+0000 7f6f46000640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 0x7f6f300419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:11.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.309+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6f3c0747b0 con 0x7f6f4806bf30 2024-09-10T23:46:11.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.309+0000 7f6f4ca00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 0x7f6f300419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:11.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.310+0000 7f6f4ca00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 0x7f6f300419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48103660 tx=0x7f6f34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:11.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.314+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6f3c03bd30 con 0x7f6f4806bf30 2024-09-10T23:46:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.424+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f6f3c0035f0 con 0x7f6f4806bf30 2024-09-10T23:46:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.519+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f6f4802e5c0 con 0x7f6f4806bf30 2024-09-10T23:46:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.525+0000 7f6f46000640 1 -- 172.21.15.33:0/224715708 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f6f3c055310 con 0x7f6f4806bf30 2024-09-10T23:46:11.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 msgr2=0x7f6f300419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 0x7f6f300419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48103660 tx=0x7f6f34005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 msgr2=0x7f6f4819af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009a20 tx=0x7f6f3c0040c0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 shutdown_connections 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6f3003f510 0x7f6f300419d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4810a990 0x7f6f4819c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f48107fe0 0x7f6f4819b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 --2- 172.21.15.33:0/224715708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f4806bf30 0x7f6f4819af30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.527+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 >> 172.21.15.33:0/224715708 conn(0x7f6f480fd210 msgr2=0x7f6f48108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.528+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 shutdown_connections 2024-09-10T23:46:11.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.528+0000 7f6f4fe00640 1 -- 172.21.15.33:0/224715708 wait complete. 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: Reconfiguring daemon mgr.x on smithi033 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: Standby manager daemon z started 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:46:11.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:11 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: Reconfiguring daemon mgr.x on smithi033 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: Standby manager daemon z started 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:46:11.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:11 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: Reconfiguring daemon mgr.x on smithi033 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: Standby manager daemon z started 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T23:46:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:11 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.189:0/3076767655' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.652+0000 7f5d44800640 1 -- 172.21.15.33:0/819763962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c104c40 msgr2=0x7f5d3c105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.652+0000 7f5d44800640 1 --2- 172.21.15.33:0/819763962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c104c40 0x7f5d3c105040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009930 tx=0x7f5d3002a420 comp rx=0 tx=0).stop 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.652+0000 7f5d44800640 1 -- 172.21.15.33:0/819763962 shutdown_connections 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 --2- 172.21.15.33:0/819763962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c106760 0x7f5d3c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 --2- 172.21.15.33:0/819763962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c105da0 0x7f5d3c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 --2- 172.21.15.33:0/819763962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c104c40 0x7f5d3c105040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 -- 172.21.15.33:0/819763962 >> 172.21.15.33:0/819763962 conn(0x7f5d3c100550 msgr2=0x7f5d3c102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:12.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 -- 172.21.15.33:0/819763962 shutdown_connections 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.653+0000 7f5d44800640 1 -- 172.21.15.33:0/819763962 wait complete. 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 Processor -- start 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 -- start start 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c104c40 0x7f5d3c19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c106760 0x7f5d3c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c110770 con 0x7f5d3c106760 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1105f0 con 0x7f5d3c105da0 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.654+0000 7f5d44800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1108f0 con 0x7f5d3c104c40 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60372/0 (socket says 172.21.15.33:60372) 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d42800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c106760 0x7f5d3c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 -- 172.21.15.33:0/2637146571 learned_addr learned my addr 172.21.15.33:0/2637146571 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c104c40 0x7f5d3c19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 -- 172.21.15.33:0/2637146571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c104c40 msgr2=0x7f5d3c19af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c104c40 0x7f5d3c19af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 -- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c106760 msgr2=0x7f5d3c19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c106760 0x7f5d3c19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 -- 172.21.15.33:0/2637146571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19ca80 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.655+0000 7f5d41400640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9f0 tx=0x7f5d2c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.656+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00cd80 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.656+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d2c0054b0 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.656+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19cd70 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.656+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c010430 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.656+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1a3450 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.657+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c10c0e0 con 0x7f5d3c105da0 2024-09-10T23:46:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.659+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f5d2c005020 con 0x7f5d3c105da0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.660+0000 7f5d36a00640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 0x7f5d2407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.660+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5d2c09c290 con 0x7f5d3c105da0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.660+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 0x7f5d2407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.661+0000 7f5d41e00640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 0x7f5d2407c870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d30000c00 tx=0x7f5d30005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.665+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5d2c064f60 con 0x7f5d3c105da0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.861+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f5d3c02e5c0 con 0x7f5d3c105da0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.869+0000 7f5d36a00640 1 -- 172.21.15.33:0/2637146571 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f5d2c064860 con 0x7f5d3c105da0 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 msgr2=0x7f5d2407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 0x7f5d2407c870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d30000c00 tx=0x7f5d30005720 comp rx=0 tx=0).stop 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 msgr2=0x7f5d3c19b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9f0 tx=0x7f5d2c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 shutdown_connections 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2407a3b0 0x7f5d2407c870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d3c106760 0x7f5d3c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d3c105da0 0x7f5d3c19b5a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 --2- 172.21.15.33:0/2637146571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d3c104c40 0x7f5d3c19af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.871+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 >> 172.21.15.33:0/2637146571 conn(0x7f5d3c100550 msgr2=0x7f5d3c1092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.872+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 shutdown_connections 2024-09-10T23:46:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.872+0000 7f5d44800640 1 -- 172.21.15.33:0/2637146571 wait complete. 2024-09-10T23:46:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 -- 172.21.15.33:0/1103386006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc1065c0 msgr2=0x7fecdc10cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 --2- 172.21.15.33:0/1103386006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc1065c0 0x7fecdc10cf40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009cd0 tx=0x7fecd402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 -- 172.21.15.33:0/1103386006 shutdown_connections 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 --2- 172.21.15.33:0/1103386006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc1065c0 0x7fecdc10cf40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 --2- 172.21.15.33:0/1103386006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc105c00 0x7fecdc106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 --2- 172.21.15.33:0/1103386006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc104aa0 0x7fecdc104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 -- 172.21.15.33:0/1103386006 >> 172.21.15.33:0/1103386006 conn(0x7fecdc100370 msgr2=0x7fecdc1027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 -- 172.21.15.33:0/1103386006 shutdown_connections 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.970+0000 7fece2800640 1 -- 172.21.15.33:0/1103386006 wait complete. 2024-09-10T23:46:12.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.971+0000 7fece2800640 1 Processor -- start 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.971+0000 7fece2800640 1 -- start start 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 0x7fecdc19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc1065c0 0x7fecdc19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc110600 con 0x7fecdc105c00 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc110480 con 0x7fecdc104aa0 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece2800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc110780 con 0x7fecdc1065c0 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 0x7fecdc19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60380/0 (socket says 172.21.15.33:60380) 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 -- 172.21.15.33:0/2127396861 learned_addr learned my addr 172.21.15.33:0/2127396861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1e00640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc1065c0 0x7fecdc19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 -- 172.21.15.33:0/2127396861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc1065c0 msgr2=0x7fecdc19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc1065c0 0x7fecdc19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 -- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 msgr2=0x7fecdc19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 0x7fecdc19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece1400640 1 -- 172.21.15.33:0/2127396861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc19c740 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.972+0000 7fece0a00640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 0x7fecdc19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fece1400640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecd000d950 tx=0x7fecd000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0017030 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc19ca30 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecd0004020 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd00055d0 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.973+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc1a3110 con 0x7fecdc104aa0 2024-09-10T23:46:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.974+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc104ea0 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.976+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7fecd0009a30 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.976+0000 7fecda000640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 0x7fecc407c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.977+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fecd009b8a0 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.977+0000 7fece0a00640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 0x7fecc407c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.977+0000 7fece0a00640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 0x7fecc407c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009f40 tx=0x7fecc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:11.981+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fecd00644b0 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.190+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fecdc063d50 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.197+0000 7fecda000640 1 -- 172.21.15.33:0/2127396861 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7fecd0063db0 con 0x7fecdc104aa0 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 msgr2=0x7fecc407c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 0x7fecc407c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009f40 tx=0x7fecc8005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 msgr2=0x7fecdc19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecd000d950 tx=0x7fecd000de10 comp rx=0 tx=0).stop 2024-09-10T23:46:12.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 shutdown_connections 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fecc407a450 0x7fecc407c910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecdc1065c0 0x7fecdc19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecdc105c00 0x7fecdc19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 --2- 172.21.15.33:0/2127396861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecdc104aa0 0x7fecdc19ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 >> 172.21.15.33:0/2127396861 conn(0x7fecdc100370 msgr2=0x7fecdc108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 shutdown_connections 2024-09-10T23:46:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:12.200+0000 7fece2800640 1 -- 172.21.15.33:0/2127396861 wait complete. 2024-09-10T23:46:12.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:12.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: mgrmap e14: x(active, since 84s), standbys: z 2024-09-10T23:46:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:46:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/224715708' entity='client.admin' 2024-09-10T23:46:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:12 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:12.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: mgrmap e14: x(active, since 84s), standbys: z 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/224715708' entity='client.admin' 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:12 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: mgrmap e14: x(active, since 84s), standbys: z 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/224715708' entity='client.admin' 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:12 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:13.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 -- 172.21.15.33:0/2482408039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc1065c0 msgr2=0x7fcdbc10cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2482408039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc10cf40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009cd0 tx=0x7fcdb402a8f0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 -- 172.21.15.33:0/2482408039 shutdown_connections 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2482408039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc10cf40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2482408039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc105c00 0x7fcdbc106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2482408039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 -- 172.21.15.33:0/2482408039 >> 172.21.15.33:0/2482408039 conn(0x7fcdbc100370 msgr2=0x7fcdbc1027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 -- 172.21.15.33:0/2482408039 shutdown_connections 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.189+0000 7fcdc2600640 1 -- 172.21.15.33:0/2482408039 wait complete. 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 Processor -- start 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 -- start start 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc105c00 0x7fcdbc19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc110600 con 0x7fcdbc105c00 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc110480 con 0x7fcdbc104aa0 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.190+0000 7fcdc2600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc110780 con 0x7fcdbc1065c0 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43892/0 (socket says 172.21.15.33:43892) 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 -- 172.21.15.33:0/2311297728 learned_addr learned my addr 172.21.15.33:0/2311297728 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1c00640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdbbe00640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc105c00 0x7fcdbc19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 -- 172.21.15.33:0/2311297728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 msgr2=0x7fcdbc19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 -- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc105c00 msgr2=0x7fcdbc19b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc105c00 0x7fcdbc19b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1200640 1 -- 172.21.15.33:0/2311297728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc19c760 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.191+0000 7fcdc1c00640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdc1200640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d950 tx=0x7fcdb000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0017070 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdb0009c30 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000f620 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc19ca50 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.192+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1a3130 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.193+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc19ccb0 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.193+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fcdb0010460 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.194+0000 7fcdb9600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 0x7fcda4041a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.194+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcdb0053940 con 0x7fcdbc104aa0 2024-09-10T23:46:13.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.194+0000 7fcdbbe00640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 0x7fcda4041a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.195+0000 7fcdbbe00640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 0x7fcda4041a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009bd0 tx=0x7fcda8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.199+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcdb0009de0 con 0x7fcdbc104aa0 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.403+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fcdbc10bd50 con 0x7fcdbc104aa0 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.410+0000 7fcdb9600640 1 -- 172.21.15.33:0/2311297728 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7fcdbc10bd50 con 0x7fcdbc104aa0 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.412+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 msgr2=0x7fcda4041a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.412+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 0x7fcda4041a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009bd0 tx=0x7fcda8005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.412+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 msgr2=0x7fcdbc19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.412+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d950 tx=0x7fcdb000de10 comp rx=0 tx=0).stop 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 shutdown_connections 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcda403f5c0 0x7fcda4041a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcdbc1065c0 0x7fcdbc19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdbc105c00 0x7fcdbc19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 --2- 172.21.15.33:0/2311297728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdbc104aa0 0x7fcdbc19ac30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 >> 172.21.15.33:0/2311297728 conn(0x7fcdbc100370 msgr2=0x7fcdbc108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:13.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 shutdown_connections 2024-09-10T23:46:13.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:09.413+0000 7fcdc2600640 1 -- 172.21.15.33:0/2311297728 wait complete. 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 -- 172.21.15.33:0/2832433132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 msgr2=0x7f8a10104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 --2- 172.21.15.33:0/2832433132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a10104ea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009930 tx=0x7f8a0002a420 comp rx=0 tx=0).stop 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 -- 172.21.15.33:0/2832433132 shutdown_connections 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 --2- 172.21.15.33:0/2832433132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 0x7f8a1010cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 --2- 172.21.15.33:0/2832433132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 0x7f8a10106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 --2- 172.21.15.33:0/2832433132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a10104ea0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 -- 172.21.15.33:0/2832433132 >> 172.21.15.33:0/2832433132 conn(0x7f8a10100370 msgr2=0x7f8a101027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 -- 172.21.15.33:0/2832433132 shutdown_connections 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.627+0000 7f8a0f200640 1 -- 172.21.15.33:0/2832433132 wait complete. 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 Processor -- start 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 -- start start 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 0x7f8a1019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 0x7f8a1019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10110620 con 0x7f8a10104aa0 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a101104a0 con 0x7f8a10105c00 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8a101107a0 con 0x7f8a101065c0 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57316/0 (socket says 172.21.15.33:57316) 2024-09-10T23:46:13.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0de00640 1 -- 172.21.15.33:0/1551068535 learned_addr learned my addr 172.21.15.33:0/1551068535 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.628+0000 7f8a0d400640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 0x7f8a1019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0e800640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 0x7f8a1019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 -- 172.21.15.33:0/1551068535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 msgr2=0x7f8a1019bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 0x7f8a1019bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 -- 172.21.15.33:0/1551068535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 msgr2=0x7f8a1019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 0x7f8a1019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 -- 172.21.15.33:0/1551068535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1019c800 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a0de00640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005ab0 tx=0x7f8a00003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.629+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0003f070 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.630+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a00031b10 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.630+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00035030 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.630+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1019ca90 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.630+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a101a3000 con 0x7f8a10104aa0 2024-09-10T23:46:13.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.631+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1010bdc0 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.632+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f8a00031680 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.633+0000 7f8a06a00640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 0x7f89f407c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.633+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a000bc940 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.633+0000 7f8a0d400640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 0x7f89f407c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.634+0000 7f8a0d400640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 0x7f89f407c910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009bd0 tx=0x7f89fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.637+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a00084f00 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.841+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f8a10063dc0 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.846+0000 7f8a06a00640 1 -- 172.21.15.33:0/1551068535 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v22)=0 v22) ==== 127+0+0 (secure 0 0 0) 0x7f8a00089930 con 0x7f8a10104aa0 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 msgr2=0x7f89f407c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 0x7f89f407c910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009bd0 tx=0x7f89fc005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 msgr2=0x7f8a1019acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:13.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005ab0 tx=0x7f8a00003c10 comp rx=0 tx=0).stop 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 shutdown_connections 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f89f407a450 0x7f89f407c910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a101065c0 0x7f8a1019bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a10105c00 0x7f8a1019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 --2- 172.21.15.33:0/1551068535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a10104aa0 0x7f8a1019acd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.849+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 >> 172.21.15.33:0/1551068535 conn(0x7f8a10100370 msgr2=0x7f8a10108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.850+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 shutdown_connections 2024-09-10T23:46:13.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.850+0000 7f8a0f200640 1 -- 172.21.15.33:0/1551068535 wait complete. 2024-09-10T23:46:14.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 -- 172.21.15.33:0/3808738611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 msgr2=0x7f37a0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 --2- 172.21.15.33:0/3808738611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a0100b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3790009900 tx=0x7f379002a410 comp rx=0 tx=0).stop 2024-09-10T23:46:14.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 -- 172.21.15.33:0/3808738611 shutdown_connections 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 --2- 172.21.15.33:0/3808738611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0108850 0x7f37a010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 --2- 172.21.15.33:0/3808738611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0101080 0x7f37a0108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 --2- 172.21.15.33:0/3808738611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a0100b40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 -- 172.21.15.33:0/3808738611 >> 172.21.15.33:0/3808738611 conn(0x7f37a00fc530 msgr2=0x7f37a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 -- 172.21.15.33:0/3808738611 shutdown_connections 2024-09-10T23:46:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.381+0000 7f37a5c00640 1 -- 172.21.15.33:0/3808738611 wait complete. 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.382+0000 7f37a5c00640 1 Processor -- start 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 -- start start 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0101080 0x7f37a019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 0x7f37a019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f37a010e580 con 0x7f37a0100740 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37a010e400 con 0x7f37a0108850 2024-09-10T23:46:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f37a5c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37a010e700 con 0x7f37a0101080 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f379ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f379ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57328/0 (socket says 172.21.15.33:57328) 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f379ea00640 1 -- 172.21.15.33:0/2755773071 learned_addr learned my addr 172.21.15.33:0/2755773071 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f379f400640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 0x7f37a019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.383+0000 7f3796000640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0101080 0x7f37a019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 -- 172.21.15.33:0/2755773071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0101080 msgr2=0x7f37a019b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0101080 0x7f37a019b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 -- 172.21.15.33:0/2755773071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 msgr2=0x7f37a019c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 0x7f37a019c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 -- 172.21.15.33:0/2755773071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a019ca20 con 0x7f37a0100740 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379f400640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 0x7f37a019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f379ea00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3790031460 tx=0x7f3790003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379003f070 con 0x7f37a0100740 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3790031ba0 con 0x7f37a0100740 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790035030 con 0x7f37a0100740 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.384+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a019ccb0 con 0x7f37a0100740 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.385+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a01a3220 con 0x7f37a0100740 2024-09-10T23:46:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.386+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a01a3510 con 0x7f37a0100740 2024-09-10T23:46:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.387+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f379003b460 con 0x7f37a0100740 2024-09-10T23:46:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.388+0000 7f3797e00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 0x7f378407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.388+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37900bcce0 con 0x7f37a0100740 2024-09-10T23:46:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.388+0000 7f3796000640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 0x7f378407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.389+0000 7f3796000640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 0x7f378407c870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37880095f0 tx=0x7f3788005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:14.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.392+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3790085320 con 0x7f37a0100740 2024-09-10T23:46:14.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2802892073' entity='client.admin' 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1551068535' entity='client.admin' 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: Standby manager daemon y started 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:46:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:14 smithi033 ceph-mon[30593]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:14.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 -- 172.21.15.33:0/2380343068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4105da0 msgr2=0x7fd8d4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 --2- 172.21.15.33:0/2380343068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4105da0 0x7fd8d4106220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009930 tx=0x7fd8bc02a420 comp rx=0 tx=0).stop 2024-09-10T23:46:14.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 -- 172.21.15.33:0/2380343068 shutdown_connections 2024-09-10T23:46:14.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 --2- 172.21.15.33:0/2380343068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4106760 0x7fd8d410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 --2- 172.21.15.33:0/2380343068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4105da0 0x7fd8d4106220 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 --2- 172.21.15.33:0/2380343068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4104c40 0x7fd8d4105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 -- 172.21.15.33:0/2380343068 >> 172.21.15.33:0/2380343068 conn(0x7fd8d4100510 msgr2=0x7fd8d4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:14.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 -- 172.21.15.33:0/2380343068 shutdown_connections 2024-09-10T23:46:14.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.569+0000 7fd8dac00640 1 -- 172.21.15.33:0/2380343068 wait complete. 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.570+0000 7fd8dac00640 1 Processor -- start 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.570+0000 7fd8dac00640 1 -- start start 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.570+0000 7fd8dac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8dac00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4105da0 0x7fd8d419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8dac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4106760 0x7fd8d419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8dac00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41107c0 con 0x7fd8d4105da0 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8dac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4110640 con 0x7fd8d4104c40 2024-09-10T23:46:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8dac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4110940 con 0x7fd8d4106760 2024-09-10T23:46:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8cb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4105da0 0x7fd8d419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60446/0 (socket says 172.21.15.33:60446) 2024-09-10T23:46:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 -- 172.21.15.33:0/541980584 learned_addr learned my addr 172.21.15.33:0/541980584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d8c00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4106760 0x7fd8d419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 -- 172.21.15.33:0/541980584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4106760 msgr2=0x7fd8d419c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4106760 0x7fd8d419c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 -- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4105da0 msgr2=0x7fd8d419b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4105da0 0x7fd8d419b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.571+0000 7fd8d3e00640 1 -- 172.21.15.33:0/541980584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d419ca50 con 0x7fd8d4104c40 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8d3e00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d770 tx=0x7fd8c400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4017070 con 0x7fd8d4104c40 2024-09-10T23:46:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8c40054b0 con 0x7fd8d4104c40 2024-09-10T23:46:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4004c60 con 0x7fd8d4104c40 2024-09-10T23:46:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d419cd40 con 0x7fd8d4104c40 2024-09-10T23:46:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.572+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d41a3420 con 0x7fd8d4104c40 2024-09-10T23:46:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.573+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d410bff0 con 0x7fd8d4104c40 2024-09-10T23:46:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.575+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7fd8c4004e00 con 0x7fd8d4104c40 2024-09-10T23:46:14.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.576+0000 7fd8d1600640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 0x7fd8b807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:14.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.576+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd8c409b830 con 0x7fd8d4104c40 2024-09-10T23:46:14.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.576+0000 7fd8cb400640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 0x7fd8b807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:14.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.577+0000 7fd8cb400640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 0x7fd8b807c870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc005ab0 tx=0x7fd8bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.581+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8c4063e70 con 0x7fd8d4104c40 2024-09-10T23:46:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.595+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f37a01a3b20 con 0x7f37a0100740 2024-09-10T23:46:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.599+0000 7f3797e00640 1 -- 172.21.15.33:0/2755773071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v23)=0 v23) ==== 117+0+0 (secure 0 0 0) 0x7f3790089d50 con 0x7f37a0100740 2024-09-10T23:46:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 msgr2=0x7f378407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 0x7f378407c870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37880095f0 tx=0x7f3788005f90 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 msgr2=0x7f37a019aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3790031460 tx=0x7f3790003c10 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 shutdown_connections 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f378407a3b0 0x7f378407c870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37a0108850 0x7f37a019c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a0101080 0x7f37a019b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 --2- 172.21.15.33:0/2755773071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37a0100740 0x7f37a019aef0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.602+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 >> 172.21.15.33:0/2755773071 conn(0x7f37a00fc530 msgr2=0x7f37a00fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.603+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 shutdown_connections 2024-09-10T23:46:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.603+0000 7f37a5c00640 1 -- 172.21.15.33:0/2755773071 wait complete. 2024-09-10T23:46:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2802892073' entity='client.admin' 2024-09-10T23:46:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1551068535' entity='client.admin' 2024-09-10T23:46:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: Standby manager daemon y started 2024-09-10T23:46:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:46:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:46:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:14 smithi052 ceph-mon[33526]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.782+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fd8d402e5c0 con 0x7fd8d4104c40 2024-09-10T23:46:14.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.788+0000 7fd8d1600640 1 -- 172.21.15.33:0/541980584 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7fd8d402e5c0 con 0x7fd8d4104c40 2024-09-10T23:46:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 msgr2=0x7fd8b807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 0x7fd8b807c870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc005ab0 tx=0x7fd8bc005a20 comp rx=0 tx=0).stop 2024-09-10T23:46:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 msgr2=0x7fd8d419af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400d770 tx=0x7fd8c400dc30 comp rx=0 tx=0).stop 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 shutdown_connections 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8b807a3b0 0x7fd8b807c870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8d4106760 0x7fd8d419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d4105da0 0x7fd8d419b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 --2- 172.21.15.33:0/541980584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8d4104c40 0x7fd8d419af20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 >> 172.21.15.33:0/541980584 conn(0x7fd8d4100510 msgr2=0x7fd8d41091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 shutdown_connections 2024-09-10T23:46:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:14.790+0000 7fd8dac00640 1 -- 172.21.15.33:0/541980584 wait complete. 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2802892073' entity='client.admin' 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1551068535' entity='client.admin' 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: Standby manager daemon y started 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T23:46:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:14 smithi189 ceph-mon[34000]: from='mgr.? 172.21.15.52:0/3646370069' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T23:46:15.906 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:15 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2755773071' entity='client.admin' 2024-09-10T23:46:15.907 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:15 smithi033 ceph-mon[30593]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:15.907 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:15 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:15.907 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:15 smithi033 ceph-mon[30593]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-09-10T23:46:15.907 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:46:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:15 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2755773071' entity='client.admin' 2024-09-10T23:46:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:15 smithi052 ceph-mon[33526]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:15 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:15 smithi052 ceph-mon[33526]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-09-10T23:46:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:46:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:15 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2755773071' entity='client.admin' 2024-09-10T23:46:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:15 smithi189 ceph-mon[34000]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:15 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:15 smithi189 ceph-mon[34000]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-09-10T23:46:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T23:46:16.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 -- 172.21.15.33:0/1525797644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474106760 msgr2=0x7f347410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 --2- 172.21.15.33:0/1525797644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474106760 0x7f347410d0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f346c009930 tx=0x7f346c02a420 comp rx=0 tx=0).stop 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 -- 172.21.15.33:0/1525797644 shutdown_connections 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 --2- 172.21.15.33:0/1525797644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474106760 0x7f347410d0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 --2- 172.21.15.33:0/1525797644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474105da0 0x7f3474106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 --2- 172.21.15.33:0/1525797644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474104c40 0x7f3474105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 -- 172.21.15.33:0/1525797644 >> 172.21.15.33:0/1525797644 conn(0x7f3474100510 msgr2=0x7f3474102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 -- 172.21.15.33:0/1525797644 shutdown_connections 2024-09-10T23:46:16.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.812+0000 7f347be00640 1 -- 172.21.15.33:0/1525797644 wait complete. 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.813+0000 7f347be00640 1 Processor -- start 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.813+0000 7f347be00640 1 -- start start 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.813+0000 7f347be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474104c40 0x7f347419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.813+0000 7f347be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.813+0000 7f347be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 0x7f347419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f347be00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3474110750 con 0x7f3474105da0 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f347be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34741105d0 con 0x7f3474106760 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f347be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34741108d0 con 0x7f3474104c40 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57354/0 (socket says 172.21.15.33:57354) 2024-09-10T23:46:16.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 -- 172.21.15.33:0/4005938927 learned_addr learned my addr 172.21.15.33:0/4005938927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3479400640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474104c40 0x7f347419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3479e00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 0x7f347419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 -- 172.21.15.33:0/4005938927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474104c40 msgr2=0x7f347419aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474104c40 0x7f347419aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 -- 172.21.15.33:0/4005938927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 msgr2=0x7f347419c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 0x7f347419c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3478a00640 1 -- 172.21.15.33:0/4005938927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347419ca00 con 0x7f3474105da0 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.814+0000 7f3479e00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 0x7f347419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:16.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f3478a00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f346000d950 tx=0x7f346000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460017030 con 0x7f3474105da0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3460004020 con 0x7f3474105da0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347419ccf0 con 0x7f3474105da0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600055d0 con 0x7f3474105da0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.815+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34741a33d0 con 0x7f3474105da0 2024-09-10T23:46:16.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.816+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347410bfc0 con 0x7f3474105da0 2024-09-10T23:46:16.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.819+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f3460009a30 con 0x7f3474105da0 2024-09-10T23:46:16.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.821+0000 7f3472000640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 0x7f345c0b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:16.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.821+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f34600e3870 con 0x7f3474105da0 2024-09-10T23:46:16.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.821+0000 7f3479400640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 0x7f345c0b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:16.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.822+0000 7f3479400640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 0x7f345c0b7810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3468005fd0 tx=0x7f3468009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:16.825+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34600ac360 con 0x7f3474105da0 2024-09-10T23:46:17.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.029+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f3474063d50 con 0x7f3474105da0 2024-09-10T23:46:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.033+0000 7f3472000640 1 -- 172.21.15.33:0/4005938927 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v25)=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f34600abc60 con 0x7f3474105da0 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 msgr2=0x7f345c0b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 0x7f345c0b7810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3468005fd0 tx=0x7f3468009760 comp rx=0 tx=0).stop 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 msgr2=0x7f347419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f346000d950 tx=0x7f346000de10 comp rx=0 tx=0).stop 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 shutdown_connections 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f345c0b5350 0x7f345c0b7810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106760 0x7f347419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3474105da0 0x7f347419b520 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 --2- 172.21.15.33:0/4005938927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3474104c40 0x7f347419aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 >> 172.21.15.33:0/4005938927 conn(0x7f3474100510 msgr2=0x7f3474109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 shutdown_connections 2024-09-10T23:46:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.036+0000 7f347be00640 1 -- 172.21.15.33:0/4005938927 wait complete. 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 -- 172.21.15.33:0/101930734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 msgr2=0x7f06e4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 --2- 172.21.15.33:0/101930734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e4106220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009930 tx=0x7f06cc02a420 comp rx=0 tx=0).stop 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 -- 172.21.15.33:0/101930734 shutdown_connections 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 --2- 172.21.15.33:0/101930734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 0x7f06e410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 --2- 172.21.15.33:0/101930734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e4106220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 --2- 172.21.15.33:0/101930734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 0x7f06e4105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 -- 172.21.15.33:0/101930734 >> 172.21.15.33:0/101930734 conn(0x7f06e4100510 msgr2=0x7f06e4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 -- 172.21.15.33:0/101930734 shutdown_connections 2024-09-10T23:46:17.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.488+0000 7f06e9400640 1 -- 172.21.15.33:0/101930734 wait complete. 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 Processor -- start 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 -- start start 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 0x7f06e419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 0x7f06e419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4110770 con 0x7f06e4105da0 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41105f0 con 0x7f06e4104c40 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.489+0000 7f06e9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41108f0 con 0x7f06e4106760 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57308/0 (socket says 172.21.15.33:57308) 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 -- 172.21.15.33:0/2802892073 learned_addr learned my addr 172.21.15.33:0/2802892073 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:17.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06e2800640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 0x7f06e419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06e3200640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 0x7f06e419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 -- 172.21.15.33:0/2802892073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 msgr2=0x7f06e419c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 0x7f06e419c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 -- 172.21.15.33:0/2802892073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 msgr2=0x7f06e419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 0x7f06e419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.490+0000 7f06dbe00640 1 -- 172.21.15.33:0/2802892073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e419ca50 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06dbe00640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009a50 tx=0x7f06cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc03f030 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06cc003a80 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e419cce0 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc035070 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.491+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41a3250 con 0x7f06e4105da0 2024-09-10T23:46:17.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.492+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e410c060 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.493+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f06cc03bcb0 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.494+0000 7f06db400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 0x7f06c807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.494+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f06cc0bca30 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.494+0000 7f06e2800640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 0x7f06c807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.495+0000 7f06e2800640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 0x7f06c807c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005d00 tx=0x7f06d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.498+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f06cc084ff0 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.706+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f06e4063d50 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.710+0000 7f06db400640 1 -- 172.21.15.33:0/2802892073 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f06cc089a20 con 0x7f06e4105da0 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 msgr2=0x7f06c807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 0x7f06c807c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005d00 tx=0x7f06d400b410 comp rx=0 tx=0).stop 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 msgr2=0x7f06e419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009a50 tx=0x7f06cc004270 comp rx=0 tx=0).stop 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 shutdown_connections 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06c807a3b0 0x7f06c807c870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4106760 0x7f06e419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06e4105da0 0x7f06e419b570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 --2- 172.21.15.33:0/2802892073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4104c40 0x7f06e419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 >> 172.21.15.33:0/2802892073 conn(0x7f06e4100510 msgr2=0x7f06e4109230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 shutdown_connections 2024-09-10T23:46:17.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:13.713+0000 7f06e9400640 1 -- 172.21.15.33:0/2802892073 wait complete. 2024-09-10T23:46:17.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 -- 172.21.15.33:0/1742360454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 msgr2=0x7ff04c079e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 --2- 172.21.15.33:0/1742360454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c079e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff044009ca0 tx=0x7ff04402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 -- 172.21.15.33:0/1742360454 shutdown_connections 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 --2- 172.21.15.33:0/1742360454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c079e80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 --2- 172.21.15.33:0/1742360454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 --2- 172.21.15.33:0/1742360454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 0x7ff04c077e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 -- 172.21.15.33:0/1742360454 >> 172.21.15.33:0/1742360454 conn(0x7ff04c100370 msgr2=0x7ff04c1027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 -- 172.21.15.33:0/1742360454 shutdown_connections 2024-09-10T23:46:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.657+0000 7ff052e00640 1 -- 172.21.15.33:0/1742360454 wait complete. 2024-09-10T23:46:17.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.658+0000 7ff052e00640 1 Processor -- start 2024-09-10T23:46:17.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.658+0000 7ff052e00640 1 -- start start 2024-09-10T23:46:17.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 0x7ff04c19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c114a00 con 0x7ff04c079530 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c114880 con 0x7ff04c078b70 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c114b80 con 0x7ff04c077a10 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff051000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57378/0 (socket says 172.21.15.33:57378) 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff052400640 1 -- 172.21.15.33:0/3679377635 learned_addr learned my addr 172.21.15.33:0/3679377635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.659+0000 7ff051a00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 0x7ff04c19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 -- 172.21.15.33:0/3679377635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 msgr2=0x7ff04c19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 0x7ff04c19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 -- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 msgr2=0x7ff04c1a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 -- 172.21.15.33:0/3679377635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c1a0b30 con 0x7ff04c078b70 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff052400640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff051000640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c19f650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e9f0 tx=0x7ff03800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03800ccc0 con 0x7ff04c078b70 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c1a0e20 con 0x7ff04c078b70 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0380108c0 con 0x7ff04c078b70 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380187e0 con 0x7ff04c078b70 2024-09-10T23:46:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.660+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c1a7500 con 0x7ff04c078b70 2024-09-10T23:46:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.662+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c111560 con 0x7ff04c078b70 2024-09-10T23:46:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.664+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7ff038010430 con 0x7ff04c078b70 2024-09-10T23:46:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.665+0000 7ff04a000640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 0x7ff0340b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.665+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff0380e41d0 con 0x7ff04c078b70 2024-09-10T23:46:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.665+0000 7ff051a00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 0x7ff0340b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.666+0000 7ff051a00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 0x7ff0340b77b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff040005d00 tx=0x7ff04000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:17.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.670+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff0380ac670 con 0x7ff04c078b70 2024-09-10T23:46:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.867+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7ff04c063d50 con 0x7ff04c078b70 2024-09-10T23:46:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.873+0000 7ff04a000640 1 -- 172.21.15.33:0/3679377635 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7ff0380b10a0 con 0x7ff04c078b70 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 msgr2=0x7ff0340b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 0x7ff0340b77b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff040005d00 tx=0x7ff04000b410 comp rx=0 tx=0).stop 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 msgr2=0x7ff04c19f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c19f650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e9f0 tx=0x7ff03800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 shutdown_connections 2024-09-10T23:46:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0340b52f0 0x7ff0340b77b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff04c079530 0x7ff04c1a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff04c078b70 0x7ff04c19f650 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 --2- 172.21.15.33:0/3679377635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff04c077a10 0x7ff04c19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 >> 172.21.15.33:0/3679377635 conn(0x7ff04c100370 msgr2=0x7ff04c101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 shutdown_connections 2024-09-10T23:46:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:17.875+0000 7ff052e00640 1 -- 172.21.15.33:0/3679377635 wait complete. 2024-09-10T23:46:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:17.962 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:18.061 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:18 smithi033 ceph-mon[30593]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:18.061 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:18 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4005938927' entity='client.admin' 2024-09-10T23:46:18.061 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:18 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' 2024-09-10T23:46:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:18 smithi189 ceph-mon[34000]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:18 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4005938927' entity='client.admin' 2024-09-10T23:46:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:18 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' 2024-09-10T23:46:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:18 smithi052 ceph-mon[33526]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:18.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:18 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4005938927' entity='client.admin' 2024-09-10T23:46:18.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:18 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 -- 172.21.15.33:0/703695964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918105da0 msgr2=0x7fb918106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 --2- 172.21.15.33:0/703695964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918105da0 0x7fb918106220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb904009930 tx=0x7fb90402a420 comp rx=0 tx=0).stop 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 -- 172.21.15.33:0/703695964 shutdown_connections 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 --2- 172.21.15.33:0/703695964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918106760 0x7fb91810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 --2- 172.21.15.33:0/703695964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918105da0 0x7fb918106220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 --2- 172.21.15.33:0/703695964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 0x7fb918105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.079+0000 7fb920000640 1 -- 172.21.15.33:0/703695964 >> 172.21.15.33:0/703695964 conn(0x7fb918100510 msgr2=0x7fb918102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.080+0000 7fb920000640 1 -- 172.21.15.33:0/703695964 shutdown_connections 2024-09-10T23:46:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.080+0000 7fb920000640 1 -- 172.21.15.33:0/703695964 wait complete. 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.080+0000 7fb920000640 1 Processor -- start 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 -- start start 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 0x7fb91819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918105da0 0x7fb91819b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181107a0 con 0x7fb918106760 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb918110620 con 0x7fb918105da0 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb920000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb918110920 con 0x7fb918104c40 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb91e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb91e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57422/0 (socket says 172.21.15.33:57422) 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb91e000640 1 -- 172.21.15.33:0/202623370 learned_addr learned my addr 172.21.15.33:0/202623370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.081+0000 7fb91d600640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 0x7fb91819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.082+0000 7fb91cc00640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918105da0 0x7fb91819b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 -- 172.21.15.33:0/202623370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 msgr2=0x7fb91819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 0x7fb91819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 -- 172.21.15.33:0/202623370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918105da0 msgr2=0x7fb91819b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918105da0 0x7fb91819b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 -- 172.21.15.33:0/202623370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91819ca50 con 0x7fb918106760 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb91e000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb91000e970 tx=0x7fb91000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91000ccc0 con 0x7fb918106760 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb91000ce60 con 0x7fb918106760 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910010430 con 0x7fb918106760 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91819cd40 con 0x7fb918106760 2024-09-10T23:46:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.083+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9181a3420 con 0x7fb918106760 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.085+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91810bfc0 con 0x7fb918106760 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.088+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fb910004ef0 con 0x7fb918106760 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.090+0000 7fb916000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 0x7fb9000b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.090+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb9100e4330 con 0x7fb918106760 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.091+0000 7fb91d600640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 0x7fb9000b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.092+0000 7fb91d600640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 0x7fb9000b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb90c005fd0 tx=0x7fb90c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.094+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb9100ace60 con 0x7fb918106760 2024-09-10T23:46:19.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.290+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fb918063d50 con 0x7fb918106760 2024-09-10T23:46:19.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.294+0000 7fb916000640 1 -- 172.21.15.33:0/202623370 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fb9100ac760 con 0x7fb918106760 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 msgr2=0x7fb9000b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 0x7fb9000b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb90c005fd0 tx=0x7fb90c009500 comp rx=0 tx=0).stop 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 msgr2=0x7fb91819c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb91000e970 tx=0x7fb91000ed70 comp rx=0 tx=0).stop 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 shutdown_connections 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9000b5250 0x7fb9000b7710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb918106760 0x7fb91819c1b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb918105da0 0x7fb91819b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.296+0000 7fb920000640 1 --2- 172.21.15.33:0/202623370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb918104c40 0x7fb91819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.297+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 >> 172.21.15.33:0/202623370 conn(0x7fb918100510 msgr2=0x7fb918109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.297+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 shutdown_connections 2024-09-10T23:46:19.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:19.297+0000 7fb920000640 1 -- 172.21.15.33:0/202623370 wait complete. 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 -- 172.21.15.33:0/1688054676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 msgr2=0x7f7258075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 --2- 172.21.15.33:0/1688054676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f7258075580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7248009900 tx=0x7f724802a410 comp rx=0 tx=0).stop 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 -- 172.21.15.33:0/1688054676 shutdown_connections 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 --2- 172.21.15.33:0/1688054676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 0x7f725810cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 --2- 172.21.15.33:0/1688054676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 0x7f7258075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 --2- 172.21.15.33:0/1688054676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f7258075580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 -- 172.21.15.33:0/1688054676 >> 172.21.15.33:0/1688054676 conn(0x7f72580fe180 msgr2=0x7f72581005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 -- 172.21.15.33:0/1688054676 shutdown_connections 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.494+0000 7f725ca00640 1 -- 172.21.15.33:0/1688054676 wait complete. 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.495+0000 7f725ca00640 1 Processor -- start 2024-09-10T23:46:19.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 -- start start 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 0x7f725819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 0x7f725819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7258110630 con 0x7f7258076f20 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72581104b0 con 0x7f725810a820 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f725ca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72581107b0 con 0x7f7258075ac0 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f724fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f724fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57398/0 (socket says 172.21.15.33:57398) 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.496+0000 7f724fe00640 1 -- 172.21.15.33:0/3931187396 learned_addr learned my addr 172.21.15.33:0/3931187396 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f7257400640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 0x7f725819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f7257e00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 0x7f725819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 -- 172.21.15.33:0/3931187396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 msgr2=0x7f725819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 0x7f725819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 -- 172.21.15.33:0/3931187396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 msgr2=0x7f725819bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 0x7f725819bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 -- 172.21.15.33:0/3931187396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725819c7b0 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f724fe00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f724000d770 tx=0x7f724000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240017070 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72400054b0 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240004c60 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.497+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725819caa0 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.498+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72581a3180 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.499+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7258109630 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.501+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f7240004e00 con 0x7f7258076f20 2024-09-10T23:46:19.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.503+0000 7f7254c00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 0x7f723c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.503+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72400e39f0 con 0x7f7258076f20 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.503+0000 7f7257400640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 0x7f723c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.504+0000 7f7257400640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 0x7f723c0b7830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7248006010 tx=0x7f7248031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.506+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f72400ac4e0 con 0x7f7258076f20 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.702+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7258063d50 con 0x7f7258076f20 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.706+0000 7f7254c00640 1 -- 172.21.15.33:0/3931187396 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f72400abde0 con 0x7f7258076f20 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 msgr2=0x7f723c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 0x7f723c0b7830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7248006010 tx=0x7f7248031400 comp rx=0 tx=0).stop 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 msgr2=0x7f725819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f724000d770 tx=0x7f724000dc30 comp rx=0 tx=0).stop 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 shutdown_connections 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f723c0b5370 0x7f723c0b7830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f725810a820 0x7f725819bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258076f20 0x7f725819b2d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 --2- 172.21.15.33:0/3931187396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7258075ac0 0x7f725819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 >> 172.21.15.33:0/3931187396 conn(0x7f72580fe180 msgr2=0x7f7258106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 shutdown_connections 2024-09-10T23:46:19.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:18.709+0000 7f725ca00640 1 -- 172.21.15.33:0/3931187396 wait complete. 2024-09-10T23:46:19.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:19 smithi033 ceph-mon[30593]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:19.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:19 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3931187396' entity='client.admin' 2024-09-10T23:46:19.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:19 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/202623370' entity='client.admin' 2024-09-10T23:46:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:19 smithi189 ceph-mon[34000]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:19 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3931187396' entity='client.admin' 2024-09-10T23:46:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:19 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/202623370' entity='client.admin' 2024-09-10T23:46:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:19 smithi052 ceph-mon[33526]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:19 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3931187396' entity='client.admin' 2024-09-10T23:46:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:19 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/202623370' entity='client.admin' 2024-09-10T23:46:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 -- 172.21.15.33:0/2036903906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 msgr2=0x7f0f44104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 --2- 172.21.15.33:0/2036903906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f44104ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009930 tx=0x7f0f3802a420 comp rx=0 tx=0).stop 2024-09-10T23:46:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 -- 172.21.15.33:0/2036903906 shutdown_connections 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 --2- 172.21.15.33:0/2036903906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 0x7f0f4410cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 --2- 172.21.15.33:0/2036903906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 0x7f0f44106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 --2- 172.21.15.33:0/2036903906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f44104ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 -- 172.21.15.33:0/2036903906 >> 172.21.15.33:0/2036903906 conn(0x7f0f44100370 msgr2=0x7f0f441027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 -- 172.21.15.33:0/2036903906 shutdown_connections 2024-09-10T23:46:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.509+0000 7f0f49e00640 1 -- 172.21.15.33:0/2036903906 wait complete. 2024-09-10T23:46:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.510+0000 7f0f49e00640 1 Processor -- start 2024-09-10T23:46:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.510+0000 7f0f49e00640 1 -- start start 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 0x7f0f4419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 0x7f0f4419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44110630 con 0x7f0f44104aa0 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441104b0 con 0x7f0f441065c0 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441107b0 con 0x7f0f44105c00 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f48a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f48a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54382/0 (socket says 172.21.15.33:54382) 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f48a00640 1 -- 172.21.15.33:0/1277703734 learned_addr learned my addr 172.21.15.33:0/1277703734 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f43e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 0x7f0f4419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.511+0000 7f0f49400640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 0x7f0f4419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 -- 172.21.15.33:0/1277703734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 msgr2=0x7f0f4419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 0x7f0f4419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 -- 172.21.15.33:0/1277703734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 msgr2=0x7f0f4419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 0x7f0f4419bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 -- 172.21.15.33:0/1277703734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4419c7d0 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f48a00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009a50 tx=0x7f0f38032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3803f030 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f38003a80 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4419ca60 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38035070 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.512+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f441a31a0 con 0x7f0f44104aa0 2024-09-10T23:46:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.513+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f44104ea0 con 0x7f0f44104aa0 2024-09-10T23:46:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.516+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f0f380035f0 con 0x7f0f44104aa0 2024-09-10T23:46:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.518+0000 7f0f41600640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 0x7f0f2c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.518+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f38105040 con 0x7f0f44104aa0 2024-09-10T23:46:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.518+0000 7f0f43e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 0x7f0f2c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:21.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.519+0000 7f0f43e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 0x7f0f2c0b7830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009990 tx=0x7f0f30009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.520+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f380cdb30 con 0x7f0f44104aa0 2024-09-10T23:46:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.719+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f0f4402e5c0 con 0x7f0f44104aa0 2024-09-10T23:46:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.723+0000 7f0f41600640 1 -- 172.21.15.33:0/1277703734 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f0f380d62e0 con 0x7f0f44104aa0 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 msgr2=0x7f0f2c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 0x7f0f2c0b7830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009990 tx=0x7f0f30009110 comp rx=0 tx=0).stop 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 msgr2=0x7f0f4419aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009a50 tx=0x7f0f38032f90 comp rx=0 tx=0).stop 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 shutdown_connections 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f2c0b5370 0x7f0f2c0b7830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f441065c0 0x7f0f4419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f44105c00 0x7f0f4419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 --2- 172.21.15.33:0/1277703734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f44104aa0 0x7f0f4419aca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:21.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 >> 172.21.15.33:0/1277703734 conn(0x7f0f44100370 msgr2=0x7f0f44108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:21.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 shutdown_connections 2024-09-10T23:46:21.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:21.726+0000 7f0f49e00640 1 -- 172.21.15.33:0/1277703734 wait complete. 2024-09-10T23:46:22.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:21 smithi033 ceph-mon[30593]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:22.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:21 smithi189 ceph-mon[34000]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:22.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:21 smithi052 ceph-mon[33526]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:22.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1277703734' entity='client.admin' 2024-09-10T23:46:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1034561296' entity='client.admin' 2024-09-10T23:46:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1277703734' entity='client.admin' 2024-09-10T23:46:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1034561296' entity='client.admin' 2024-09-10T23:46:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1277703734' entity='client.admin' 2024-09-10T23:46:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1034561296' entity='client.admin' 2024-09-10T23:46:23.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:23 smithi033 ceph-mon[30593]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:24.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:23 smithi052 ceph-mon[33526]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:24.081 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:23 smithi189 ceph-mon[34000]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:24.160 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi033') 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 -- 172.21.15.33:0/600134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 msgr2=0x7fe28c10cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 --2- 172.21.15.33:0/600134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c10cc70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe284009ca0 tx=0x7fe28402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 -- 172.21.15.33:0/600134157 shutdown_connections 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 --2- 172.21.15.33:0/600134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c10cc70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 --2- 172.21.15.33:0/600134157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 0x7fe28c075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 --2- 172.21.15.33:0/600134157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 0x7fe28c075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 -- 172.21.15.33:0/600134157 >> 172.21.15.33:0/600134157 conn(0x7fe28c0fe180 msgr2=0x7fe28c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.282+0000 7fe28be00640 1 -- 172.21.15.33:0/600134157 shutdown_connections 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.283+0000 7fe28be00640 1 -- 172.21.15.33:0/600134157 wait complete. 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.283+0000 7fe28be00640 1 Processor -- start 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 -- start start 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 0x7fe28c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 0x7fe28c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1105e0 con 0x7fe28c10a820 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c110460 con 0x7fe28c075ac0 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c110760 con 0x7fe28c076f20 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54400/0 (socket says 172.21.15.33:54400) 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28b400640 1 -- 172.21.15.33:0/1034561296 learned_addr learned my addr 172.21.15.33:0/1034561296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe28aa00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 0x7fe28c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.284+0000 7fe282000640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 0x7fe28c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 -- 172.21.15.33:0/1034561296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 msgr2=0x7fe28c19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 0x7fe28c19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 -- 172.21.15.33:0/1034561296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 msgr2=0x7fe28c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 0x7fe28c19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 -- 172.21.15.33:0/1034561296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c19c7a0 con 0x7fe28c10a820 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28b400640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe284031040 tx=0x7fe284003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284004040 con 0x7fe28c10a820 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe284004670 con 0x7fe28c10a820 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c19ca30 con 0x7fe28c10a820 2024-09-10T23:46:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.285+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284030cf0 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.286+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c1a3170 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.287+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c075f40 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.288+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fe2840041e0 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.290+0000 7fe283e00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 0x7fe2700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.290+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe284105280 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.290+0000 7fe28aa00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 0x7fe2700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.291+0000 7fe28aa00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 0x7fe2700b7830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bbe0 tx=0x7fe27c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.294+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe2840cdd70 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.492+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fe28c063d50 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.496+0000 7fe283e00640 1 -- 172.21.15.33:0/1034561296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7fe2840cd670 con 0x7fe28c10a820 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 msgr2=0x7fe2700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 0x7fe2700b7830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bbe0 tx=0x7fe27c00b390 comp rx=0 tx=0).stop 2024-09-10T23:46:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 msgr2=0x7fe28c19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe284031040 tx=0x7fe284003ba0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 shutdown_connections 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe2700b5370 0x7fe2700b7830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe28c10a820 0x7fe28c19bf00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe28c076f20 0x7fe28c19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 --2- 172.21.15.33:0/1034561296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c075ac0 0x7fe28c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 >> 172.21.15.33:0/1034561296 conn(0x7fe28c0fe180 msgr2=0x7fe28c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 shutdown_connections 2024-09-10T23:46:24.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:22.499+0000 7fe28be00640 1 -- 172.21.15.33:0/1034561296 wait complete. 2024-09-10T23:46:25.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 -- 172.21.15.33:0/2749063253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664077a10 msgr2=0x7f7664077e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 --2- 172.21.15.33:0/2749063253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664077a10 0x7f7664077e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7654009900 tx=0x7f765402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 -- 172.21.15.33:0/2749063253 shutdown_connections 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 --2- 172.21.15.33:0/2749063253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664079530 0x7f7664079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 --2- 172.21.15.33:0/2749063253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f7664078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 --2- 172.21.15.33:0/2749063253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664077a10 0x7f7664077e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 -- 172.21.15.33:0/2749063253 >> 172.21.15.33:0/2749063253 conn(0x7f7664100370 msgr2=0x7f76641027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 -- 172.21.15.33:0/2749063253 shutdown_connections 2024-09-10T23:46:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.472+0000 7f7669800640 1 -- 172.21.15.33:0/2749063253 wait complete. 2024-09-10T23:46:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.473+0000 7f7669800640 1 Processor -- start 2024-09-10T23:46:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 -- start start 2024-09-10T23:46:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664077a10 0x7f766419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f766419f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7664114a00 con 0x7f7664079530 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7664114880 con 0x7f7664077a10 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7669800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7664114b80 con 0x7f7664078b70 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7668e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7668e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54414/0 (socket says 172.21.15.33:54414) 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7668e00640 1 -- 172.21.15.33:0/1235915067 learned_addr learned my addr 172.21.15.33:0/1235915067 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7663e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664077a10 0x7f766419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.474+0000 7f7663400640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f766419f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 -- 172.21.15.33:0/1235915067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 msgr2=0x7f766419f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f766419f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 -- 172.21.15.33:0/1235915067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664077a10 msgr2=0x7f766419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664077a10 0x7f766419f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 -- 172.21.15.33:0/1235915067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76641a0b90 con 0x7f7664079530 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7663400640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f766419f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:25.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7668e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c00eb10 tx=0x7f765c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c004b20 con 0x7f7664079530 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f765c004cc0 con 0x7f7664079530 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c010690 con 0x7f7664079530 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.475+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76641a0e80 con 0x7f7664079530 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.476+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76641a7560 con 0x7f7664079530 2024-09-10T23:46:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.477+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7664111560 con 0x7f7664079530 2024-09-10T23:46:25.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.479+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f765c005000 con 0x7f7664079530 2024-09-10T23:46:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.480+0000 7f7660c00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 0x7f76480b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.481+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f765c0e46a0 con 0x7f7664079530 2024-09-10T23:46:25.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.481+0000 7f7663e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 0x7f76480b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:25.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.481+0000 7f7663e00640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 0x7f76480b78b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7654005ab0 tx=0x7f7654005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:25.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.482+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f765c056220 con 0x7f7664079530 2024-09-10T23:46:25.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.678+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f766402e5c0 con 0x7f7664079530 2024-09-10T23:46:25.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.682+0000 7f7660c00640 1 -- 172.21.15.33:0/1235915067 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f765c0ad190 con 0x7f7664079530 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 msgr2=0x7f76480b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 0x7f76480b78b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7654005ab0 tx=0x7f7654005a20 comp rx=0 tx=0).stop 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 msgr2=0x7f76641a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c00eb10 tx=0x7f765c00c2d0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 shutdown_connections 2024-09-10T23:46:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f76480b53f0 0x7f76480b78b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7664079530 0x7f76641a02f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7664078b70 0x7f766419f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 --2- 172.21.15.33:0/1235915067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7664077a10 0x7f766419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 >> 172.21.15.33:0/1235915067 conn(0x7f7664100370 msgr2=0x7f7664101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 shutdown_connections 2024-09-10T23:46:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:25.685+0000 7f7669800640 1 -- 172.21.15.33:0/1235915067 wait complete. 2024-09-10T23:46:26.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:25 smithi033 ceph-mon[30593]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:26.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:25 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1235915067' entity='client.admin' 2024-09-10T23:46:26.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:25 smithi189 ceph-mon[34000]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:26.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:25 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1235915067' entity='client.admin' 2024-09-10T23:46:26.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:25 smithi052 ceph-mon[33526]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:26.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:25 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1235915067' entity='client.admin' 2024-09-10T23:46:27.934 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:27 smithi033 ceph-mon[30593]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:27 smithi189 ceph-mon[34000]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:28.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:27 smithi052 ceph-mon[33526]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:28.494 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.494 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.494 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '63242646-6fce-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-09-10T23:46:28.496 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:46:28.496 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:46:28.496 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:46:28.532 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:46:28.533 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-09-10T23:46:28.608 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-10 23:45:05.149058099 +0000 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-10 23:40:20.222203679 +0000 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-10 23:40:20.223203663 +0000 2024-09-10T23:46:28.609 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-10 23:40:20.222203679 +0000 2024-09-10T23:46:28.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:46:28.703 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-10T23:46:28.704 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-10T23:46:28.704 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000273543 s, 1.9 MB/s 2024-09-10T23:46:28.706 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:46:28.744 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-10 23:45:05.196057350 +0000 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-10 23:40:20.724195618 +0000 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-10 23:40:20.724195618 +0000 2024-09-10T23:46:28.818 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-10 23:40:20.724195618 +0000 2024-09-10T23:46:28.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:46:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-10T23:46:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-10T23:46:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000291647 s, 1.8 MB/s 2024-09-10T23:46:28.913 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:46:28.949 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-10 23:45:05.243056601 +0000 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-10 23:40:21.221187636 +0000 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-10 23:40:21.221187636 +0000 2024-09-10T23:46:29.026 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-10 23:40:21.221187636 +0000 2024-09-10T23:46:29.027 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:46:29.121 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-10T23:46:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-10T23:46:29.122 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000286725 s, 1.8 MB/s 2024-09-10T23:46:29.124 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:46:29.167 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-09-10T23:46:29.244 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:46:29.244 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:29.244 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-10T23:46:29.244 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:29.245 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:29.245 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-09-10 23:45:05.289055868 +0000 2024-09-10T23:46:29.245 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-09-10 23:40:21.687180153 +0000 2024-09-10T23:46:29.245 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-09-10 23:40:21.687180153 +0000 2024-09-10T23:46:29.245 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-09-10 23:40:21.687180153 +0000 2024-09-10T23:46:29.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:46:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-09-10T23:46:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-09-10T23:46:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00025823 s, 2.0 MB/s 2024-09-10T23:46:29.340 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:46:29.377 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T23:46:29.377 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:46:29.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:46:29.413 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 23:46:07.149802959 +0000 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 23:40:25.235179717 +0000 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 23:40:25.235179717 +0000 2024-09-10T23:46:29.491 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 23:40:25.235179717 +0000 2024-09-10T23:46:29.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:46:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T23:46:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T23:46:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00018111 s, 2.8 MB/s 2024-09-10T23:46:29.590 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:46:29.628 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-10T23:46:29.703 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:46:29.703 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:29.703 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 23:46:07.150802946 +0000 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 23:40:25.687173973 +0000 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 23:40:25.687173973 +0000 2024-09-10T23:46:29.704 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 23:40:25.687173973 +0000 2024-09-10T23:46:29.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:46:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T23:46:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T23:46:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00018134 s, 2.8 MB/s 2024-09-10T23:46:29.799 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:46:29.837 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-10T23:46:29.913 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:46:29.913 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:29.913 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 23:46:07.151802933 +0000 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 23:40:26.204167402 +0000 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 23:40:26.204167402 +0000 2024-09-10T23:46:29.914 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 23:40:26.204167402 +0000 2024-09-10T23:46:29.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:46:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T23:46:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T23:46:30.007 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000178313 s, 2.9 MB/s 2024-09-10T23:46:30.010 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:46:30.047 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 23:46:07.152802921 +0000 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 23:40:26.687161263 +0000 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 23:40:26.687161263 +0000 2024-09-10T23:46:30.123 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 23:40:26.687161263 +0000 2024-09-10T23:46:30.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:46:30.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T23:46:30.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T23:46:30.217 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.0001932 s, 2.7 MB/s 2024-09-10T23:46:30.219 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:46:30.255 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T23:46:30.255 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:46:30.291 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:46:30.292 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-10T23:46:30.366 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:46:30.366 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:30.366 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-10T23:46:30.366 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 23:46:03.635365861 +0000 2024-09-10T23:46:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 23:40:19.684044445 +0000 2024-09-10T23:46:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 23:40:19.684044445 +0000 2024-09-10T23:46:30.367 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 23:40:19.684044445 +0000 2024-09-10T23:46:30.367 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:46:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.456 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:30.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.462 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T23:46:30.462 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T23:46:30.462 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000282485 s, 1.8 MB/s 2024-09-10T23:46:30.465 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:46:30.502 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:46:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:30.577 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:46:30.577 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 23:46:03.636365841 +0000 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 23:40:20.147035159 +0000 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 23:40:20.147035159 +0000 2024-09-10T23:46:30.578 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 23:40:20.147035159 +0000 2024-09-10T23:46:30.578 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:46:30.670 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T23:46:30.670 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T23:46:30.671 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000311789 s, 1.6 MB/s 2024-09-10T23:46:30.673 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:46:30.709 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 23:46:03.636365841 +0000 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 23:40:20.618025712 +0000 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 23:40:20.618025712 +0000 2024-09-10T23:46:30.784 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 23:40:20.618025712 +0000 2024-09-10T23:46:30.785 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:46:30.876 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T23:46:30.876 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T23:46:30.876 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000304182 s, 1.7 MB/s 2024-09-10T23:46:30.879 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:46:30.915 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-10T23:46:30.990 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:46:30.990 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 23:46:03.637365822 +0000 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 23:40:21.060016847 +0000 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 23:40:21.060016847 +0000 2024-09-10T23:46:30.991 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 23:40:21.060016847 +0000 2024-09-10T23:46:30.991 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:46:31.082 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T23:46:31.082 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T23:46:31.083 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000310473 s, 1.6 MB/s 2024-09-10T23:46:31.085 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:46:31.122 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-09-10T23:46:31.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:46:31.500 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:32.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:32 smithi033 ceph-mon[30593]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:32 smithi052 ceph-mon[33526]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:32.572 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:32 smithi189 ceph-mon[34000]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:34 smithi052 ceph-mon[33526]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:34 smithi033 ceph-mon[30593]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:34.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:34 smithi189 ceph-mon[34000]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:34.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:46:34.625 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-09-10T23:46:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 -- 172.21.15.33:0/4169209661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 msgr2=0x7f665c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 --2- 172.21.15.33:0/4169209661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c10d0e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6654009930 tx=0x7f665402a420 comp rx=0 tx=0).stop 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 -- 172.21.15.33:0/4169209661 shutdown_connections 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 --2- 172.21.15.33:0/4169209661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c10d0e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 --2- 172.21.15.33:0/4169209661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 --2- 172.21.15.33:0/4169209661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 0x7f665c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 -- 172.21.15.33:0/4169209661 >> 172.21.15.33:0/4169209661 conn(0x7f665c100510 msgr2=0x7f665c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:46:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 -- 172.21.15.33:0/4169209661 shutdown_connections 2024-09-10T23:46:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.525+0000 7f6660e00640 1 -- 172.21.15.33:0/4169209661 wait complete. 2024-09-10T23:46:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.526+0000 7f6660e00640 1 Processor -- start 2024-09-10T23:46:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.526+0000 7f6660e00640 1 -- start start 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.526+0000 7f6660e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 0x7f665c19ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6660e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6660e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6660e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f665c1107c0 con 0x7f665c106760 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6660e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f665c110640 con 0x7f665c105da0 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6660e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f665c110940 con 0x7f665c104c40 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42226/0 (socket says 172.21.15.33:42226) 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 -- 172.21.15.33:0/1911023591 learned_addr learned my addr 172.21.15.33:0/1911023591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6659e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 0x7f665c19ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6651400640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 -- 172.21.15.33:0/1911023591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 msgr2=0x7f665c19ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 0x7f665c19ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 -- 172.21.15.33:0/1911023591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 msgr2=0x7f665c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f665a800640 1 -- 172.21.15.33:0/1911023591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c19c970 con 0x7f665c106760 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.527+0000 7f6651400640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f665a800640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6654005ab0 tx=0x7f6654003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665403f070 con 0x7f665c106760 2024-09-10T23:46:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6654031d10 con 0x7f665c106760 2024-09-10T23:46:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c19cc00 con 0x7f665c106760 2024-09-10T23:46:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654035030 con 0x7f665c106760 2024-09-10T23:46:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.528+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1a3340 con 0x7f665c106760 2024-09-10T23:46:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.529+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c105040 con 0x7f665c106760 2024-09-10T23:46:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.531+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f6654031880 con 0x7f665c106760 2024-09-10T23:46:35.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.533+0000 7f6653400640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 0x7f66400b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:46:35.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.533+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6654104ad0 con 0x7f665c106760 2024-09-10T23:46:35.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.533+0000 7f6659e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 0x7f66400b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:46:35.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.534+0000 7f6659e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 0x7f66400b7790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f664c005fd0 tx=0x7f664c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:46:35.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.537+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6654106e20 con 0x7f665c106760 2024-09-10T23:46:35.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:46:35.744+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f665c063590 con 0x7f66400b52d0 2024-09-10T23:46:36.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:36 smithi033 ceph-mon[30593]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:36.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:46:36.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:46:36.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:36 smithi052 ceph-mon[33526]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:46:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:46:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:36 smithi189 ceph-mon[34000]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:46:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:46:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:37.348 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:37 smithi033 ceph-mon[30593]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:37.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:37 smithi052 ceph-mon[33526]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:37 smithi189 ceph-mon[34000]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:46:38.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:38 smithi052 ceph-mon[33526]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:38.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:38 smithi033 ceph-mon[30593]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:38 smithi189 ceph-mon[34000]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:39.239 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:39 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"} : dispatch 2024-09-10T23:46:39.239 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:39 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"}]': finished 2024-09-10T23:46:39.239 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:39 smithi033 ceph-mon[30593]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:46:39.239 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:39 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:46:39.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:39 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"} : dispatch 2024-09-10T23:46:39.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:39 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"}]': finished 2024-09-10T23:46:39.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:39 smithi052 ceph-mon[33526]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:46:39.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:39 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:46:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:39 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"} : dispatch 2024-09-10T23:46:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:39 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2942690837' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "770a7315-b2b7-4916-8b58-841896f5c42d"}]': finished 2024-09-10T23:46:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:39 smithi189 ceph-mon[34000]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T23:46:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:39 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:46:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:40 smithi052 ceph-mon[33526]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:40 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1317793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:46:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:40 smithi033 ceph-mon[30593]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:40 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1317793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:46:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:40 smithi189 ceph-mon[34000]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:40 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1317793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:46:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:42 smithi052 ceph-mon[33526]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:42.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:42 smithi033 ceph-mon[30593]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:42 smithi189 ceph-mon[34000]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:44 smithi052 ceph-mon[33526]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:44.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:44 smithi033 ceph-mon[30593]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:44 smithi189 ceph-mon[34000]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:46.288 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:46 smithi033 ceph-mon[30593]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:46.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:46 smithi052 ceph-mon[33526]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:46 smithi189 ceph-mon[34000]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:48 smithi052 ceph-mon[33526]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:46:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:48.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:48 smithi033 ceph-mon[30593]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:46:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:48 smithi189 ceph-mon[34000]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T23:46:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:46:49.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:49 smithi052 ceph-mon[33526]: Deploying daemon osd.0 on smithi033 2024-09-10T23:46:49.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:49 smithi033 ceph-mon[30593]: Deploying daemon osd.0 on smithi033 2024-09-10T23:46:49.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:49 smithi189 ceph-mon[34000]: Deploying daemon osd.0 on smithi033 2024-09-10T23:46:50.260 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:50 smithi033 ceph-mon[30593]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:50.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:50 smithi052 ceph-mon[33526]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:50 smithi189 ceph-mon[34000]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:52 smithi052 ceph-mon[33526]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:52 smithi033 ceph-mon[30593]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:52 smithi189 ceph-mon[34000]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:54 smithi052 ceph-mon[33526]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:54.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:54 smithi033 ceph-mon[30593]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:54 smithi189 ceph-mon[34000]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:56 smithi052 ceph-mon[33526]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:56 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:56 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:56.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:56 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:56.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:56 smithi033 ceph-mon[30593]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:56.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:56 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:56.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:56 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:56.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:56 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:56 smithi189 ceph-mon[34000]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:56 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:46:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:56 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:56 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:46:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:46:58 smithi052 ceph-mon[33526]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:46:58 smithi033 ceph-mon[30593]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:46:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:46:58 smithi189 ceph-mon[34000]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:01.413 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-09-10T23:47:01.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.412+0000 7f6653400640 1 -- 172.21.15.33:0/1911023591 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f665c063590 con 0x7f66400b52d0 2024-09-10T23:47:01.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.414+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 msgr2=0x7f66400b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.414+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 0x7f66400b7790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f664c005fd0 tx=0x7f664c009680 comp rx=0 tx=0).stop 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 msgr2=0x7f665c19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6654005ab0 tx=0x7f6654003cd0 comp rx=0 tx=0).stop 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 shutdown_connections 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66400b52d0 0x7f66400b7790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:01.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f665c106760 0x7f665c19c0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f665c105da0 0x7f665c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 --2- 172.21.15.33:0/1911023591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f665c104c40 0x7f665c19ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 >> 172.21.15.33:0/1911023591 conn(0x7f665c100510 msgr2=0x7f665c1090a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 shutdown_connections 2024-09-10T23:47:01.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:47:01.415+0000 7f6660e00640 1 -- 172.21.15.33:0/1911023591 wait complete. 2024-09-10T23:47:02.204 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:47:02.208 INFO:tasks.cephadm:Deploying osd.1 on smithi052 with /dev/vg_nvme/lv_4... 2024-09-10T23:47:02.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:47:02.418 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:02 smithi033 ceph-mon[30593]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:02.418 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:02.418 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:02 smithi033 ceph-mon[30593]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:47:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:02 smithi052 ceph-mon[33526]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:02 smithi052 ceph-mon[33526]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:47:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:02 smithi189 ceph-mon[34000]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:02 smithi189 ceph-mon[34000]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T23:47:02.586 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:47:03.596 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:03 smithi052 ceph-mon[33526]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:47:03.596 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:03 smithi052 ceph-mon[33526]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:47:03.596 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:03 smithi052 ceph-mon[33526]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:47:03.596 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:03.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-mon[30593]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:47:03.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-mon[30593]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:47:03.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-mon[30593]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:47:03.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:03.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:03 smithi189 ceph-mon[34000]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:47:03.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:03 smithi189 ceph-mon[34000]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:47:03.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:03 smithi189 ceph-mon[34000]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:47:03.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.006 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0[46718]: 2024-09-10T23:47:03.915+0000 7fc690e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:47:04.006 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:47:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0[46718]: 2024-09-10T23:47:03.928+0000 7fc686e00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:47:04.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:04.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:47:04.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:47:04.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.700 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.700 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:04 smithi033 ceph-mon[30593]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:04 smithi052 ceph-mon[33526]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:04 smithi189 ceph-mon[34000]: from='osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245]' entity='osd.0' 2024-09-10T23:47:05.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:47:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:47:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] boot 2024-09-10T23:47:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:47:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:05.722 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:47:05.722 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:47:05.722 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:05.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] boot 2024-09-10T23:47:05.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:47:05.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:05.746 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:47:05.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: osd.0 [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] boot 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T23:47:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T23:47:06.169 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:47:06.617 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:06 smithi052 ceph-mon[33526]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:06.617 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:06 smithi052 ceph-mon[33526]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.736+0000 7f7296e00640 1 -- 172.21.15.52:0/3340169486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 msgr2=0x7f7290104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.736+0000 7f7296e00640 1 --2- 172.21.15.52:0/3340169486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f7290104010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f727c009930 tx=0x7f727c02a420 comp rx=0 tx=0).stop 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 -- 172.21.15.52:0/3340169486 shutdown_connections 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 --2- 172.21.15.52:0/3340169486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 0x7f729010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 --2- 172.21.15.52:0/3340169486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f7290104010 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 --2- 172.21.15.52:0/3340169486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f7290102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 -- 172.21.15.52:0/3340169486 >> 172.21.15.52:0/3340169486 conn(0x7f72900fe320 msgr2=0x7f7290100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 -- 172.21.15.52:0/3340169486 shutdown_connections 2024-09-10T23:47:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.737+0000 7f7296e00640 1 -- 172.21.15.52:0/3340169486 wait complete. 2024-09-10T23:47:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 Processor -- start 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 -- start start 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f729019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 0x7f729019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f729010e5c0 con 0x7f7290102a30 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f729010e440 con 0x7f7290103b90 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7296e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f729010e740 con 0x7f7290104550 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f728f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f728f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39062/0 (socket says 172.21.15.52:39062) 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f728f400640 1 -- 172.21.15.52:0/785573724 learned_addr learned my addr 172.21.15.52:0/785573724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T23:47:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f728fe00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f729019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.738+0000 7f7294e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 0x7f729019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 -- 172.21.15.52:0/785573724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 msgr2=0x7f729019c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 0x7f729019c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 -- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 msgr2=0x7f729019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f729019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 -- 172.21.15.52:0/785573724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729019caa0 con 0x7f7290103b90 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728fe00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f729019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728f400640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f727c009a50 tx=0x7f727c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.739+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c03f030 con 0x7f7290103b90 2024-09-10T23:47:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.740+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f727c003a80 con 0x7f7290103b90 2024-09-10T23:47:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.740+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729019cd30 con 0x7f7290103b90 2024-09-10T23:47:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.740+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c035070 con 0x7f7290103b90 2024-09-10T23:47:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.740+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901a3470 con 0x7f7290103b90 2024-09-10T23:47:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.741+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72901a3640 con 0x7f7290103b90 2024-09-10T23:47:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.743+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f727c03bbf0 con 0x7f7290103b90 2024-09-10T23:47:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.744+0000 7f728cc00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 0x7f72740b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.744+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f727c104bd0 con 0x7f7290103b90 2024-09-10T23:47:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.745+0000 7f728fe00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 0x7f72740b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.745+0000 7f728fe00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 0x7f72740b7810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7280009fc0 tx=0x7f7280005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.749+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f727c0cce10 con 0x7f7290103b90 2024-09-10T23:47:06.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:06 smithi033 ceph-mon[30593]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:06 smithi033 ceph-mon[30593]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:47:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:06 smithi189 ceph-mon[34000]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:47:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:06 smithi189 ceph-mon[34000]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:47:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:06.951+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7290076aa0 con 0x7f72740b5350 2024-09-10T23:47:07.773 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi033 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 17094M 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:07.774 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi033 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 17094M 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:07.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:07.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:07.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:07.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi033 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 17094M 2024-09-10T23:47:07.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:09 smithi033 ceph-mon[30593]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:10.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:09 smithi189 ceph-mon[34000]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:10.191 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:09 smithi052 ceph-mon[33526]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/2753264458' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"}]': finished 2024-09-10T23:47:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:47:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/3352226120' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/2753264458' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"}]': finished 2024-09-10T23:47:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:47:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:11.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/3352226120' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/2753264458' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"} : dispatch 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb29230e-70a8-47b9-bcb0-615a6af7ac0e"}]': finished 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/3352226120' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:12.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:11 smithi052 ceph-mon[33526]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:12.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:11 smithi033 ceph-mon[30593]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:11 smithi189 ceph-mon[34000]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:14.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:13 smithi052 ceph-mon[33526]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:14.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:13 smithi033 ceph-mon[30593]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:13 smithi189 ceph-mon[34000]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:16.197 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:15 smithi052 ceph-mon[33526]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:15 smithi033 ceph-mon[30593]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:15 smithi189 ceph-mon[34000]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:18.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:17 smithi052 ceph-mon[33526]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:18.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:17 smithi033 ceph-mon[30593]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:17 smithi189 ceph-mon[34000]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:47:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:47:19.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:19.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T23:47:19.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:19 smithi052 ceph-mon[33526]: Deploying daemon osd.1 on smithi052 2024-09-10T23:47:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:19 smithi052 ceph-mon[33526]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:20.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:19 smithi033 ceph-mon[30593]: Deploying daemon osd.1 on smithi052 2024-09-10T23:47:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:19 smithi033 ceph-mon[30593]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:19 smithi189 ceph-mon[34000]: Deploying daemon osd.1 on smithi052 2024-09-10T23:47:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:19 smithi189 ceph-mon[34000]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:22.076 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:21 smithi052 ceph-mon[33526]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:22.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:21 smithi033 ceph-mon[30593]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:22.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:21 smithi189 ceph-mon[34000]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:23 smithi052 ceph-mon[33526]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:24.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:23 smithi033 ceph-mon[30593]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:23 smithi189 ceph-mon[34000]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:25.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:25 smithi052 ceph-mon[33526]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:26.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:25 smithi033 ceph-mon[30593]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:25 smithi189 ceph-mon[34000]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:27.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:27.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:27.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:27.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:27.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:27.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:27.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:27.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:27.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:28.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:27 smithi052 ceph-mon[33526]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:28.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:27 smithi033 ceph-mon[30593]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:27 smithi189 ceph-mon[34000]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:31.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.709+0000 7f728cc00640 1 -- 172.21.15.52:0/785573724 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7290076aa0 con 0x7f72740b5350 2024-09-10T23:47:31.712 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 1 on host 'smithi052' 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 msgr2=0x7f72740b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 0x7f72740b7810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7280009fc0 tx=0x7f7280005f90 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 msgr2=0x7f729019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f727c009a50 tx=0x7f727c004270 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 shutdown_connections 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f72740b5350 0x7f72740b7810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7290104550 0x7f729019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290103b90 0x7f729019b5c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 --2- 172.21.15.52:0/785573724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7290102a30 0x7f729019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 >> 172.21.15.52:0/785573724 conn(0x7f72900fe320 msgr2=0x7f7290075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:31.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 shutdown_connections 2024-09-10T23:47:31.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:47:31.712+0000 7f7296e00640 1 -- 172.21.15.52:0/785573724 wait complete. 2024-09-10T23:47:32.448 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:32 smithi052 ceph-mon[33526]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:32.448 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:32 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:32.448 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:32 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.448 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:32 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.486 DEBUG:teuthology.orchestra.run.smithi052:osd.1> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T23:47:32.491 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-10T23:47:32.491 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:47:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:32 smithi033 ceph-mon[30593]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:32 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:32 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:32 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:32 smithi189 ceph-mon[34000]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:32.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:32 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:32.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:32 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:32 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:32.705 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:47:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-10T23:47:32.688+0000 7fbc5462e640 -1 osd.1 0 log_to_monitors true 2024-09-10T23:47:32.848 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:47:33.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:33 smithi189 ceph-mon[34000]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:33.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:33 smithi189 ceph-mon[34000]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:33.383 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:33 smithi052 ceph-mon[33526]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:33.384 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:33 smithi052 ceph-mon[33526]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:33.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:33 smithi033 ceph-mon[30593]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:33.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:33 smithi033 ceph-mon[30593]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:34 smithi189 ceph-mon[34000]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:34.430 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-10T23:47:34.209+0000 7fbc4f200640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:47:34.430 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-10T23:47:34.214+0000 7fbc4a200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:47:34.430 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:34.430 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:47:34.430 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:34.431 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:47:34.431 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:34.431 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:34 smithi052 ceph-mon[33526]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: from='osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:34 smithi033 ceph-mon[30593]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:47:35.466 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:35 smithi189 ceph-mon[34000]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:47:35.466 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:35 smithi189 ceph-mon[34000]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:47:35.466 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.466 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:35 smithi033 ceph-mon[30593]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:47:35.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:35 smithi033 ceph-mon[30593]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:47:35.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:35 smithi052 ceph-mon[33526]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:47:35.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:35 smithi052 ceph-mon[33526]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T23:47:35.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:35.757 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:47:35.790 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-10T23:47:36.181 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:47:36.476 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:47:36.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:47:36.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:36.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] boot 2024-09-10T23:47:36.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:47:36.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:36.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:47:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:47:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] boot 2024-09-10T23:47:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:47:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:36.657 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:47:36.657 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:47:36.658 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:47:36.658 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: osd.1 [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] boot 2024-09-10T23:47:36.658 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T23:47:36.658 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T23:47:36.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 -- 172.21.15.189:0/1277015787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37881065c0 msgr2=0x7f378810cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 --2- 172.21.15.189:0/1277015787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37881065c0 0x7f378810cf40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3780009d00 tx=0x7f378002a910 comp rx=0 tx=0).stop 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 -- 172.21.15.189:0/1277015787 shutdown_connections 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 --2- 172.21.15.189:0/1277015787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37881065c0 0x7f378810cf40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 --2- 172.21.15.189:0/1277015787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788105c00 0x7f3788106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 --2- 172.21.15.189:0/1277015787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3788104aa0 0x7f3788104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 -- 172.21.15.189:0/1277015787 >> 172.21.15.189:0/1277015787 conn(0x7f3788100370 msgr2=0x7f37881027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 -- 172.21.15.189:0/1277015787 shutdown_connections 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.701+0000 7f378e200640 1 -- 172.21.15.189:0/1277015787 wait complete. 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.702+0000 7f378e200640 1 Processor -- start 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 -- start start 2024-09-10T23:47:36.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 0x7f378819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 0x7f378819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3788110600 con 0x7f3788104aa0 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3788110480 con 0x7f37881065c0 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3788110780 con 0x7f3788105c00 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f377fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 0x7f378819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 0x7f378819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 0x7f378819acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.189:48736/0 (socket says 172.21.15.189:48736) 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f377fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37562/0 (socket says 172.21.15.189:37562) 2024-09-10T23:47:36.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.703+0000 7f378ce00640 1 -- 172.21.15.189:0/776121499 learned_addr learned my addr 172.21.15.189:0/776121499 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 -- 172.21.15.189:0/776121499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 msgr2=0x7f378819bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 0x7f378819bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 -- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 msgr2=0x7f378819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 0x7f378819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 -- 172.21.15.189:0/776121499 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378819c820 con 0x7f3788105c00 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f378d800640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 0x7f378819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.704+0000 7f377fe00640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f377000e9f0 tx=0x7f377000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.706+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377000ccc0 con 0x7f3788105c00 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.706+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37700108c0 con 0x7f3788105c00 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.706+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37700187e0 con 0x7f3788105c00 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.706+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378819cb10 con 0x7f3788105c00 2024-09-10T23:47:36.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.706+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37881a31f0 con 0x7f3788105c00 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.707+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37881a33c0 con 0x7f3788105c00 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.709+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f3770010430 con 0x7f3788105c00 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.711+0000 7f3786000640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 0x7f376c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.712+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f37700e45b0 con 0x7f3788105c00 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.712+0000 7f378ce00640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 0x7f376c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.713+0000 7f378ce00640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 0x7f376c0b7830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3778009c90 tx=0x7f3778005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:47:36.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.715+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37700ac5d0 con 0x7f3788105c00 2024-09-10T23:47:36.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:47:36.916+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3788107620 con 0x7f376c0b5370 2024-09-10T23:47:37.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:37.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:37.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:47:37.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:37.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:47:37.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:47:37.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:38.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:38 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi052 2024-09-10T23:47:38.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:38 smithi189 ceph-mon[34000]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:38.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:38 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 17094M 2024-09-10T23:47:38.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:38 smithi189 ceph-mon[34000]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:38.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:38 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi052 2024-09-10T23:47:38.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:38 smithi033 ceph-mon[30593]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:38 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 17094M 2024-09-10T23:47:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:38 smithi033 ceph-mon[30593]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:38 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi052 2024-09-10T23:47:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:38 smithi052 ceph-mon[33526]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:38 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 17094M 2024-09-10T23:47:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:38 smithi052 ceph-mon[33526]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/2967283660' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"}]': finished 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:47:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/2967283660' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"}]': finished 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:47:40.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:47:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/2967283660' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"} : dispatch 2024-09-10T23:47:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d681ac2c-445f-4d58-9e24-1dbdf6f3eb27"}]': finished 2024-09-10T23:47:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T23:47:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:47:41.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:41 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/304662107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:41 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/304662107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:41 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/304662107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:47:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:42 smithi033 ceph-mon[30593]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:42 smithi189 ceph-mon[34000]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:42.607 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:42 smithi052 ceph-mon[33526]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:44.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:44 smithi033 ceph-mon[30593]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:44 smithi189 ceph-mon[34000]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:44 smithi052 ceph-mon[33526]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:46 smithi033 ceph-mon[30593]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:46.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:46 smithi189 ceph-mon[34000]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:46.603 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:46 smithi052 ceph-mon[33526]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:48.423 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:48 smithi189 ceph-mon[34000]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:48.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:48 smithi033 ceph-mon[30593]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:48 smithi052 ceph-mon[33526]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:50.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:50 smithi033 ceph-mon[30593]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:47:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:50 smithi033 ceph-mon[30593]: Deploying daemon osd.2 on smithi189 2024-09-10T23:47:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:50 smithi189 ceph-mon[34000]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:47:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:50 smithi189 ceph-mon[34000]: Deploying daemon osd.2 on smithi189 2024-09-10T23:47:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:50 smithi052 ceph-mon[33526]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T23:47:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:47:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:50 smithi052 ceph-mon[33526]: Deploying daemon osd.2 on smithi189 2024-09-10T23:47:52.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:52 smithi033 ceph-mon[30593]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:52 smithi189 ceph-mon[34000]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:52 smithi052 ceph-mon[33526]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:54 smithi189 ceph-mon[34000]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:54.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:54 smithi033 ceph-mon[30593]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:54 smithi052 ceph-mon[33526]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:56 smithi189 ceph-mon[34000]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:56.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:56 smithi033 ceph-mon[30593]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:56 smithi052 ceph-mon[33526]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:58.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:58 smithi189 ceph-mon[34000]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:58.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:58.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:58.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:47:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:58 smithi052 ceph-mon[33526]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:58.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:47:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:58 smithi033 ceph-mon[30593]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:47:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:47:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:47:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:47:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:00.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:00 smithi189 ceph-mon[34000]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:00 smithi052 ceph-mon[33526]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:00 smithi033 ceph-mon[30593]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:01 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:01 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:01 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:01 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:01 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:01 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:01 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:01 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:01.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:01 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:01.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:01 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:01 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:01 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:01.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:01 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:01.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:01 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:01.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:01 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:02 smithi052 ceph-mon[33526]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:02 smithi033 ceph-mon[30593]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:02 smithi189 ceph-mon[34000]: pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:03.036 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.036+0000 7f3786000640 1 -- 172.21.15.189:0/776121499 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3788107620 con 0x7f376c0b5370 2024-09-10T23:48:03.037 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.038+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 msgr2=0x7f376c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 0x7f376c0b7830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3778009c90 tx=0x7f3778005f90 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 msgr2=0x7f378819b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f377000e9f0 tx=0x7f377000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 shutdown_connections 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f376c0b5370 0x7f376c0b7830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37881065c0 0x7f378819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3788105c00 0x7f378819b340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 --2- 172.21.15.189:0/776121499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3788104aa0 0x7f378819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 >> 172.21.15.189:0/776121499 conn(0x7f3788100370 msgr2=0x7f3788106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:03.040 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 shutdown_connections 2024-09-10T23:48:03.041 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:48:03.039+0000 7f378e200640 1 -- 172.21.15.189:0/776121499 wait complete. 2024-09-10T23:48:03.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:03.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:03.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:03.719 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T23:48:03.723 INFO:tasks.cephadm:Deploying osd.3 on smithi033 with /dev/vg_nvme/lv_3... 2024-09-10T23:48:03.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:48:03.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:03.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:03.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:04.093 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:04.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:04 smithi033 ceph-mon[30593]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:04 smithi033 ceph-mon[30593]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:04 smithi033 ceph-mon[30593]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:04 smithi189 ceph-mon[34000]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:04 smithi189 ceph-mon[34000]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:04 smithi189 ceph-mon[34000]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:04 smithi052 ceph-mon[33526]: pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:04 smithi052 ceph-mon[33526]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:04 smithi052 ceph-mon[33526]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T23:48:05.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-mon[34000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:48:05.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-mon[34000]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:05.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-mon[34000]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:48:05.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:05.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-mon[34000]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:05.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:05 smithi033 ceph-mon[30593]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:48:05.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:05 smithi033 ceph-mon[30593]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:05.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:05 smithi033 ceph-mon[30593]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:48:05.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:05.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:05 smithi033 ceph-mon[30593]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:05 smithi052 ceph-mon[33526]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T23:48:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:05 smithi052 ceph-mon[33526]: from='osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:05 smithi052 ceph-mon[33526]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T23:48:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:05.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:05 smithi052 ceph-mon[33526]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:48:06.135 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2[39081]: 2024-09-10T23:48:05.885+0000 7f59d9600640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:48:06.135 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2[39081]: 2024-09-10T23:48:05.897+0000 7f59cf600640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:06 smithi189 ceph-mon[34000]: from='osd.2 ' entity='osd.2' 2024-09-10T23:48:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:48:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:48:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:06 smithi052 ceph-mon[33526]: from='osd.2 ' entity='osd.2' 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:06 smithi033 ceph-mon[30593]: from='osd.2 ' entity='osd.2' 2024-09-10T23:48:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:48:07.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] boot 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:07.687 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] boot 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:48:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:48:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: osd.2 [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] boot 2024-09-10T23:48:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T23:48:07.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T23:48:07.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:07.848 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 -- 172.21.15.33:0/3722518475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7098102880 msgr2=0x7f7098102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 --2- 172.21.15.33:0/3722518475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7098102880 0x7f7098102c80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f708c009930 tx=0x7f708c02a420 comp rx=0 tx=0).stop 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 -- 172.21.15.33:0/3722518475 shutdown_connections 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 --2- 172.21.15.33:0/3722518475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 0x7f709810ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 --2- 172.21.15.33:0/3722518475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70981039e0 0x7f7098103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 --2- 172.21.15.33:0/3722518475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7098102880 0x7f7098102c80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 -- 172.21.15.33:0/3722518475 >> 172.21.15.33:0/3722518475 conn(0x7f70980fe150 msgr2=0x7f7098100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 -- 172.21.15.33:0/3722518475 shutdown_connections 2024-09-10T23:48:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.476+0000 7f709ea00640 1 -- 172.21.15.33:0/3722518475 wait complete. 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.477+0000 7f709ea00640 1 Processor -- start 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 -- start start 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 0x7f7098075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 0x7f7098075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f709810e460 con 0x7f70981039e0 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f709810e2e0 con 0x7f70981043a0 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f709810e5e0 con 0x7f7098102880 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.478+0000 7f709cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 0x7f7098075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33534/0 (socket says 172.21.15.33:33534) 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 -- 172.21.15.33:0/1355818615 learned_addr learned my addr 172.21.15.33:0/1355818615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709e000640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 0x7f7098075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 -- 172.21.15.33:0/1355818615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 msgr2=0x7f7098075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 0x7f7098075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 -- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 msgr2=0x7f7098075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 0x7f7098075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 -- 172.21.15.33:0/1355818615 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7098076340 con 0x7f7098102880 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709cc00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 0x7f7098075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.479+0000 7f709d600640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f708c005ab0 tx=0x7f708c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.480+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c03f070 con 0x7f7098102880 2024-09-10T23:48:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.480+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f708c031b00 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.480+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c035030 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.480+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70981a2b60 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.480+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70981a3060 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.481+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7098109b30 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.483+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f708c03bb70 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.484+0000 7f7096000640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 0x7f70800b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.484+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f708c1050d0 con 0x7f7098102880 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.484+0000 7f709cc00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 0x7f70800b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.485+0000 7f709cc00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 0x7f70800b78b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7084009fc0 tx=0x7f7084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.486+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f708c0ccd60 con 0x7f7098102880 2024-09-10T23:48:08.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:48:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:08.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:08.691+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7098063590 con 0x7f70800b53f0 2024-09-10T23:48:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:48:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T23:48:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T23:48:08.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T23:48:09.275 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:08 smithi033 sudo[51551]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:08 smithi033 sudo[51551]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:08 smithi033 sudo[51551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:08 smithi033 sudo[51551]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51554]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51554]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51554]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.455 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42227]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42227]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42227]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42230]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42230]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42230]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42707]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42707]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42710]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42710]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.516 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42710]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42713]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42713]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42713]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42716]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.517 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 sudo[42716]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51610]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51610]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.681 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51610]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51613]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51613]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 sudo[51613]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi189 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 17089M 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:09.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:09.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi189 2024-09-10T23:48:09.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 17089M 2024-09-10T23:48:09.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:09.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:09.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42233]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T23:48:09.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42233]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42233]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 sudo[42236]: pam_unix(sudo:session): session closed for user root 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi189 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 17089M 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T23:48:09.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:09.958 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:10 smithi033 ceph-mon[30593]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:48:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:10 smithi189 ceph-mon[34000]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:48:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: pgmap v110: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T23:48:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:10 smithi052 ceph-mon[33526]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T23:48:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:11.532+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f708c0c8fd0 con 0x7f7098102880 2024-09-10T23:48:11.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:11 smithi033 ceph-mon[30593]: pgmap v113: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:11 smithi189 ceph-mon[34000]: pgmap v113: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:11.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:11 smithi052 ceph-mon[33526]: pgmap v113: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:12.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:48:12.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: Cluster is now healthy 2024-09-10T23:48:12.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-10T23:48:12.692 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"} : dispatch 2024-09-10T23:48:12.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"}]': finished 2024-09-10T23:48:12.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:48:12.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: Cluster is now healthy 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"} : dispatch 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"}]': finished 2024-09-10T23:48:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:48:12.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: Cluster is now healthy 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"} : dispatch 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3645433881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7e5a213-1488-4280-81e2-70d506b36fb2"}]': finished 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T23:48:12.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:13.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:13 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3280820083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:13.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:13 smithi189 ceph-mon[34000]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:13 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3280820083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:13 smithi052 ceph-mon[33526]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:13 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3280820083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:13 smithi033 ceph-mon[30593]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:16.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:15 smithi033 ceph-mon[30593]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:16.055 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:15 smithi189 ceph-mon[34000]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:16.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:15 smithi052 ceph-mon[33526]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:18.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:17 smithi033 ceph-mon[30593]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:18.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:17 smithi189 ceph-mon[34000]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:18.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:17 smithi052 ceph-mon[33526]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:19 smithi033 ceph-mon[30593]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:19 smithi189 ceph-mon[34000]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:19 smithi052 ceph-mon[33526]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:22.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:21 smithi033 ceph-mon[30593]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:22.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:21 smithi189 ceph-mon[34000]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:22.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:21 smithi052 ceph-mon[33526]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:22.896 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:48:22.896 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:22.896 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:22 smithi033 ceph-mon[30593]: Deploying daemon osd.3 on smithi033 2024-09-10T23:48:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:48:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:22 smithi189 ceph-mon[34000]: Deploying daemon osd.3 on smithi033 2024-09-10T23:48:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T23:48:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:22 smithi052 ceph-mon[33526]: Deploying daemon osd.3 on smithi033 2024-09-10T23:48:24.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:23 smithi033 ceph-mon[30593]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:23 smithi189 ceph-mon[34000]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:23 smithi052 ceph-mon[33526]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:25.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:25 smithi033 ceph-mon[30593]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:26.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:25 smithi189 ceph-mon[34000]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:26.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:25 smithi052 ceph-mon[33526]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:27 smithi189 ceph-mon[34000]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:28.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:27 smithi052 ceph-mon[33526]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:28.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:27 smithi033 ceph-mon[30593]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:30.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:29 smithi033 ceph-mon[30593]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:30.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:29 smithi189 ceph-mon[34000]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:30.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:29 smithi052 ceph-mon[33526]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:30 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:31.082 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:30 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:31.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:31.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:31.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:30 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:32 smithi189 ceph-mon[34000]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:32 smithi052 ceph-mon[33526]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:32.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:32 smithi033 ceph-mon[30593]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:34.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.101+0000 7f7096000640 1 -- 172.21.15.33:0/1355818615 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7098063590 con 0x7f70800b53f0 2024-09-10T23:48:35.104 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 3 on host 'smithi033' 2024-09-10T23:48:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 msgr2=0x7f70800b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 0x7f70800b78b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7084009fc0 tx=0x7f7084005f90 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 msgr2=0x7f7098076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f708c005ab0 tx=0x7f708c003b90 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 shutdown_connections 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f70800b53f0 0x7f70800b78b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70981043a0 0x7f7098075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70981039e0 0x7f7098075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 --2- 172.21.15.33:0/1355818615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7098102880 0x7f7098076cd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 >> 172.21.15.33:0/1355818615 conn(0x7f70980fe150 msgr2=0x7f7098106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.104+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 shutdown_connections 2024-09-10T23:48:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:48:35.105+0000 7f709ea00640 1 -- 172.21.15.33:0/1355818615 wait complete. 2024-09-10T23:48:35.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:35.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:35.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.500 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:48:35.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:35.879 DEBUG:teuthology.orchestra.run.smithi033:osd.3> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T23:48:35.883 INFO:tasks.cephadm:Deploying osd.4 on smithi052 with /dev/vg_nvme/lv_3... 2024-09-10T23:48:35.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:48:36.107 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 10 23:48:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-10T23:48:35.955+0000 7f2e7d448640 -1 osd.3 0 log_to_monitors true 2024-09-10T23:48:36.256 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:48:36.447 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:36 smithi033 ceph-mon[30593]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:36.447 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:36 smithi033 ceph-mon[30593]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:48:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:36 smithi052 ceph-mon[33526]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:36 smithi052 ceph-mon[33526]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:48:36.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:36 smithi189 ceph-mon[34000]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:36.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:36 smithi189 ceph-mon[34000]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:48:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-mon[30593]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:48:37.439 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:37 smithi052 ceph-mon[33526]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:48:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:37 smithi189 ceph-mon[34000]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T23:48:37.908 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-10T23:48:37.698+0000 7f2e78600640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:48:37.908 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 10 23:48:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-10T23:48:37.716+0000 7f2e6dc00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:48:38.309 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:38.309 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.309 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.309 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' 2024-09-10T23:48:38.310 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] boot 2024-09-10T23:48:38.310 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:48:38.310 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] boot 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:48:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: from='osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774]' entity='osd.3' 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: osd.3 [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] boot 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T23:48:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T23:48:39.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:39 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:48:39.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:39 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:48:39.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:39 smithi033 ceph-mon[30593]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:48:39.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:39 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:48:39.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:39 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:48:39.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:39 smithi052 ceph-mon[33526]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:48:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:39 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:48:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:39 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:48:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:39 smithi189 ceph-mon[34000]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T23:48:39.830 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:48:39.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2024-09-10T23:48:40.237 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:48:40.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:40 smithi033 ceph-mon[30593]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:40 smithi033 ceph-mon[30593]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:48:40.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:40 smithi052 ceph-mon[33526]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:40.542 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:40 smithi052 ceph-mon[33526]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:48:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:40 smithi189 ceph-mon[34000]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:40 smithi189 ceph-mon[34000]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T23:48:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 -- 172.21.15.52:0/2479574939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 msgr2=0x7f0f5c10aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 --2- 172.21.15.52:0/2479574939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c10aed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009cd0 tx=0x7f0f5402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 -- 172.21.15.52:0/2479574939 shutdown_connections 2024-09-10T23:48:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 --2- 172.21.15.52:0/2479574939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c10aed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 --2- 172.21.15.52:0/2479574939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c103b90 0x7f0f5c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 --2- 172.21.15.52:0/2479574939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c102a30 0x7f0f5c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 -- 172.21.15.52:0/2479574939 >> 172.21.15.52:0/2479574939 conn(0x7f0f5c0fe320 msgr2=0x7f0f5c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:48:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 -- 172.21.15.52:0/2479574939 shutdown_connections 2024-09-10T23:48:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.800+0000 7f0f61a00640 1 -- 172.21.15.52:0/2479574939 wait complete. 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.801+0000 7f0f61a00640 1 Processor -- start 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.801+0000 7f0f61a00640 1 -- start start 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.801+0000 7f0f61a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 0x7f0f5c198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f61a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c103b90 0x7f0f5c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f61a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f61a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10e560 con 0x7f0f5c103b90 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f61a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10e3e0 con 0x7f0f5c104550 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f61a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10e6e0 con 0x7f0f5c102a30 2024-09-10T23:48:40.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 0x7f0f5c198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38030/0 (socket says 172.21.15.52:38030) 2024-09-10T23:48:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 0x7f0f5c198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.52:59244/0 (socket says 172.21.15.52:59244) 2024-09-10T23:48:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 -- 172.21.15.52:0/3055888333 learned_addr learned my addr 172.21.15.52:0/3055888333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T23:48:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5a000640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c103b90 0x7f0f5c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 -- 172.21.15.52:0/3055888333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 msgr2=0x7f0f5c198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 0x7f0f5c198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 -- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c103b90 msgr2=0x7f0f5c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.802+0000 7f0f5b400640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c103b90 0x7f0f5c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f5b400640 1 -- 172.21.15.52:0/3055888333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c19a810 con 0x7f0f5c104550 2024-09-10T23:48:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f5b400640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097b0 tx=0x7f0f54003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54004040 con 0x7f0f5c104550 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f54004670 con 0x7f0f5c104550 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c19aaa0 con 0x7f0f5c104550 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54030dd0 con 0x7f0f5c104550 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.803+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c075550 con 0x7f0f5c104550 2024-09-10T23:48:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.805+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c102e30 con 0x7f0f5c104550 2024-09-10T23:48:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.807+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0f54030070 con 0x7f0f5c104550 2024-09-10T23:48:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.809+0000 7f0f53400640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 0x7f0f400b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:48:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.809+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f0f5402e030 con 0x7f0f5c104550 2024-09-10T23:48:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.810+0000 7f0f5aa00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 0x7f0f400b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:48:40.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.810+0000 7f0f5aa00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 0x7f0f400b79c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c010d80 tx=0x7f0f4c012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:48:40.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:40.813+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f54004820 con 0x7f0f5c104550 2024-09-10T23:48:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:48:41.020+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0f5c063590 con 0x7f0f400b5500 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi033 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 8547M 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:41.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:41.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:41.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:41.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi033 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 8547M 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:41.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:41.619 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi033 2024-09-10T23:48:41.619 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 8547M 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:48:41.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:48:41.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:48:41.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:48:41.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:42 smithi033 ceph-mon[30593]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:42 smithi033 ceph-mon[30593]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:42 smithi189 ceph-mon[34000]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:42 smithi189 ceph-mon[34000]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:42.638 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:42 smithi052 ceph-mon[33526]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:42.638 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:42 smithi052 ceph-mon[33526]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:48:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:44 smithi052 ceph-mon[33526]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T23:48:44.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:44 smithi033 ceph-mon[30593]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T23:48:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:44 smithi189 ceph-mon[34000]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/2313707180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"}]': finished 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:48:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:45 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/2511956166' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/2313707180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"}]': finished 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:48:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:45 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/2511956166' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/2313707180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"} : dispatch 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a411ce7d-b2de-4483-bad6-22a7514a2712"}]': finished 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:48:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:45 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/2511956166' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:48:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:46 smithi033 ceph-mon[30593]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:48:46.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:46 smithi189 ceph-mon[34000]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:48:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:46 smithi052 ceph-mon[33526]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:48:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:48 smithi033 ceph-mon[30593]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T23:48:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:48 smithi189 ceph-mon[34000]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T23:48:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:48 smithi052 ceph-mon[33526]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T23:48:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:50 smithi033 ceph-mon[30593]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T23:48:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:50 smithi189 ceph-mon[34000]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T23:48:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:50 smithi052 ceph-mon[33526]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T23:48:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:52 smithi052 ceph-mon[33526]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:48:52.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:52 smithi033 ceph-mon[30593]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:48:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:52 smithi189 ceph-mon[34000]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:48:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:54 smithi033 ceph-mon[30593]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:48:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:54 smithi189 ceph-mon[34000]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:48:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:54.668 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:54 smithi052 ceph-mon[33526]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:54.668 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T23:48:54.668 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:48:55.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:55 smithi189 ceph-mon[34000]: Deploying daemon osd.4 on smithi052 2024-09-10T23:48:55.625 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:55 smithi052 ceph-mon[33526]: Deploying daemon osd.4 on smithi052 2024-09-10T23:48:55.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:55 smithi033 ceph-mon[30593]: Deploying daemon osd.4 on smithi052 2024-09-10T23:48:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:56 smithi189 ceph-mon[34000]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:56.649 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:56 smithi052 ceph-mon[33526]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:56.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:56 smithi033 ceph-mon[30593]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:58.423 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:48:58 smithi052 ceph-mon[33526]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:48:58 smithi033 ceph-mon[30593]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:48:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:48:58 smithi189 ceph-mon[34000]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:00 smithi189 ceph-mon[34000]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:00.700 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:00 smithi052 ceph-mon[33526]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:00 smithi033 ceph-mon[30593]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:02 smithi052 ceph-mon[33526]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:02 smithi189 ceph-mon[34000]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:02 smithi033 ceph-mon[30593]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:03.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:03.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:03.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:03.680 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:03.680 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:03.680 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:03.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:03.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:03.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:04.565 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:04 smithi052 ceph-mon[33526]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:04 smithi189 ceph-mon[34000]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:04.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:04 smithi033 ceph-mon[30593]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:06.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:06.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.026+0000 7f0f53400640 1 -- 172.21.15.52:0/3055888333 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f5c063590 con 0x7f0f400b5500 2024-09-10T23:49:07.028 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 4 on host 'smithi052' 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 msgr2=0x7f0f400b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 0x7f0f400b79c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c010d80 tx=0x7f0f4c012040 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 msgr2=0x7f0f5c199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097b0 tx=0x7f0f54003ba0 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 shutdown_connections 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f400b5500 0x7f0f400b79c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c104550 0x7f0f5c199f70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5c103b90 0x7f0f5c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 --2- 172.21.15.52:0/3055888333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f5c102a30 0x7f0f5c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 >> 172.21.15.52:0/3055888333 conn(0x7f0f5c0fe320 msgr2=0x7f0f5c106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 shutdown_connections 2024-09-10T23:49:07.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:49:07.029+0000 7f0f61a00640 1 -- 172.21.15.52:0/3055888333 wait complete. 2024-09-10T23:49:07.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:07.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:07.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:07.806 DEBUG:teuthology.orchestra.run.smithi052:osd.4> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T23:49:07.811 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-10T23:49:07.811 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:49:08.184 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:49:08.318 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 23:49:08 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-10T23:49:08.228+0000 7f734de0b640 -1 osd.4 0 log_to_monitors true 2024-09-10T23:49:08.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:08 smithi189 ceph-mon[34000]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:08.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:08 smithi189 ceph-mon[34000]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:08.594 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:08 smithi189 ceph-mon[34000]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:08 smithi052 ceph-mon[33526]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:08 smithi052 ceph-mon[33526]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:08 smithi052 ceph-mon[33526]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:08 smithi033 ceph-mon[30593]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:08 smithi033 ceph-mon[30593]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:08 smithi033 ceph-mon[30593]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T23:49:09.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:09 smithi189 ceph-mon[34000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:49:09.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:09 smithi189 ceph-mon[34000]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:49:09.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:09.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:09 smithi189 ceph-mon[34000]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:09.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:09 smithi189 ceph-mon[34000]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:09.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-mon[33526]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:49:09.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-mon[33526]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:49:09.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:09.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-mon[33526]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:09.620 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-mon[33526]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:09.621 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-10T23:49:09.354+0000 7f7348a00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:49:09.621 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 23:49:09 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-10T23:49:09.361+0000 7f7343a00640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:49:09.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:09 smithi033 ceph-mon[30593]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T23:49:09.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:09 smithi033 ceph-mon[30593]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T23:49:09.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:09.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:09 smithi033 ceph-mon[30593]: from='osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:09.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:09 smithi033 ceph-mon[30593]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:49:10.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:10 smithi189 ceph-mon[34000]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:10.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:10 smithi189 ceph-mon[34000]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:49:10.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:10 smithi189 ceph-mon[34000]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:49:10.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:10.564 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:10 smithi052 ceph-mon[33526]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:10 smithi052 ceph-mon[33526]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:49:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:10 smithi052 ceph-mon[33526]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:49:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:10 smithi033 ceph-mon[30593]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:10 smithi033 ceph-mon[30593]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:49:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:10 smithi033 ceph-mon[30593]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T23:49:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:11.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:11 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:49:11.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:11 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:49:11.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:11 smithi052 ceph-mon[33526]: osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] boot 2024-09-10T23:49:11.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:11 smithi052 ceph-mon[33526]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:49:11.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:11.523 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:11 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:49:11.524 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:11 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:49:11.524 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:11 smithi189 ceph-mon[34000]: osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] boot 2024-09-10T23:49:11.524 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:11 smithi189 ceph-mon[34000]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:49:11.524 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:11.622 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:49:11.653 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-10T23:49:11.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:11 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:49:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:11 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:49:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:11 smithi033 ceph-mon[30593]: osd.4 [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] boot 2024-09-10T23:49:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:11 smithi033 ceph-mon[30593]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T23:49:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T23:49:12.021 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.478 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:12.479 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:12.479 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 -- 172.21.15.189:0/1328982091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25041065c0 msgr2=0x7f250410cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:12.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 --2- 172.21.15.189:0/1328982091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25041065c0 0x7f250410cf40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009d00 tx=0x7f24fc02a910 comp rx=0 tx=0).stop 2024-09-10T23:49:12.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 -- 172.21.15.189:0/1328982091 shutdown_connections 2024-09-10T23:49:12.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 --2- 172.21.15.189:0/1328982091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25041065c0 0x7f250410cf40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:12.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 --2- 172.21.15.189:0/1328982091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 0x7f2504106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 --2- 172.21.15.189:0/1328982091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2504104aa0 0x7f2504104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 -- 172.21.15.189:0/1328982091 >> 172.21.15.189:0/1328982091 conn(0x7f2504100370 msgr2=0x7f25041027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 -- 172.21.15.189:0/1328982091 shutdown_connections 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.589+0000 7f2503200640 1 -- 172.21.15.189:0/1328982091 wait complete. 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.590+0000 7f2503200640 1 Processor -- start 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.590+0000 7f2503200640 1 -- start start 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 0x7f250419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 0x7f250419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110600 con 0x7f2504105c00 2024-09-10T23:49:12.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110480 con 0x7f25041065c0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2503200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110780 con 0x7f2504104aa0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:35810/0 (socket says 172.21.15.189:35810) 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 -- 172.21.15.189:0/3757721486 learned_addr learned my addr 172.21.15.189:0/3757721486 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2502800640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 0x7f250419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f24fbe00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 0x7f250419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 -- 172.21.15.189:0/3757721486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 msgr2=0x7f250419be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 0x7f250419be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 -- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 msgr2=0x7f250419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 0x7f250419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2501e00640 1 -- 172.21.15.189:0/3757721486 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250419c710 con 0x7f2504104aa0 2024-09-10T23:49:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.591+0000 7f2502800640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 0x7f250419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f2501e00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c920 tx=0x7f24f400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007c70 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24f4007e10 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4018710 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250419ca00 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.592+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a30e0 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.593+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250419cc60 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.595+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f24f400f450 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.596+0000 7f24faa00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 0x7f24e80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.597+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f24f40e4d40 con 0x7f2504104aa0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.597+0000 7f24fbe00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 0x7f24e80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.598+0000 7f24fbe00640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 0x7f24e80b78d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bbe0 tx=0x7f24ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:12.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.601+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f24f4014030 con 0x7f2504104aa0 2024-09-10T23:49:12.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:12.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:12.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:12.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:12.794+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2504063590 con 0x7f24e80b5410 2024-09-10T23:49:13.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:13 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi052 2024-09-10T23:49:13.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:13 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 8547M 2024-09-10T23:49:13.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:13.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:13.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:13.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:13 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi052 2024-09-10T23:49:13.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:13 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 8547M 2024-09-10T23:49:13.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:13.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:13.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:13.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:13 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi052 2024-09-10T23:49:13.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:13 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 8547M 2024-09-10T23:49:13.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:13.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:13.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:14 smithi189 ceph-mon[34000]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:14 smithi189 ceph-mon[34000]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:14 smithi052 ceph-mon[33526]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:14 smithi052 ceph-mon[33526]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:14 smithi033 ceph-mon[30593]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:14 smithi033 ceph-mon[30593]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/2530019821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"}]': finished 2024-09-10T23:49:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:49:16.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/2530019821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"}]': finished 2024-09-10T23:49:16.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:49:16.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/2530019821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"} : dispatch 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2091d686-673d-429d-935b-6516891b8d6a"}]': finished 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T23:49:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:17.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:17 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/1354343676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:17.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:17 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/1354343676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:17.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:17 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/1354343676' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:18 smithi052 ceph-mon[33526]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:18.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:18 smithi033 ceph-mon[30593]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:18 smithi189 ceph-mon[34000]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:20.671 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:20 smithi189 ceph-mon[34000]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:20 smithi052 ceph-mon[33526]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:20 smithi033 ceph-mon[30593]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:22.662 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:22 smithi189 ceph-mon[34000]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:22 smithi052 ceph-mon[33526]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:22.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:22 smithi033 ceph-mon[30593]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:24 smithi052 ceph-mon[33526]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:24.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:24 smithi189 ceph-mon[34000]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:24.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:24 smithi033 ceph-mon[30593]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:25.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:49:25.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:25.756 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:49:25.756 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:25.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T23:49:25.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:26 smithi189 ceph-mon[34000]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:26 smithi189 ceph-mon[34000]: Deploying daemon osd.5 on smithi189 2024-09-10T23:49:26.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:26 smithi033 ceph-mon[30593]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:26.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:26 smithi033 ceph-mon[30593]: Deploying daemon osd.5 on smithi189 2024-09-10T23:49:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:26 smithi052 ceph-mon[33526]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:26 smithi052 ceph-mon[33526]: Deploying daemon osd.5 on smithi189 2024-09-10T23:49:28.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:28 smithi052 ceph-mon[33526]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:28.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:28 smithi189 ceph-mon[34000]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:28 smithi033 ceph-mon[30593]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:30.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:30 smithi052 ceph-mon[33526]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:30 smithi033 ceph-mon[30593]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:30 smithi189 ceph-mon[34000]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:32.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:32 smithi189 ceph-mon[34000]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:32.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:32 smithi052 ceph-mon[33526]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:32 smithi033 ceph-mon[30593]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:33.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:33.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:33.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:33.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:33.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:33.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:33.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:33.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:33.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:34 smithi052 ceph-mon[33526]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:34.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:34 smithi033 ceph-mon[30593]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:34.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:34 smithi189 ceph-mon[34000]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:36 smithi189 ceph-mon[34000]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:36 smithi052 ceph-mon[33526]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:36 smithi033 ceph-mon[30593]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:37.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:37.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:37.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.176+0000 7f24faa00640 1 -- 172.21.15.189:0/3757721486 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2504063590 con 0x7f24e80b5410 2024-09-10T23:49:38.178 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 msgr2=0x7f24e80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 0x7f24e80b78d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bbe0 tx=0x7f24ec00b390 comp rx=0 tx=0).stop 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 msgr2=0x7f250419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f24f400c920 tx=0x7f24f400cde0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 shutdown_connections 2024-09-10T23:49:38.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24e80b5410 0x7f24e80b78d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25041065c0 0x7f250419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2504105c00 0x7f250419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 --2- 172.21.15.189:0/3757721486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2504104aa0 0x7f250419abe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.179+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 >> 172.21.15.189:0/3757721486 conn(0x7f2504100370 msgr2=0x7f2504108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.180+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 shutdown_connections 2024-09-10T23:49:38.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:49:38.180+0000 7f2503200640 1 -- 172.21.15.189:0/3757721486 wait complete. 2024-09-10T23:49:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:38 smithi052 ceph-mon[33526]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:38 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:38 smithi033 ceph-mon[30593]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:38 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:38 smithi189 ceph-mon[34000]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:49:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:38 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:38.967 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T23:49:38.971 INFO:tasks.cephadm:Deploying osd.6 on smithi033 with /dev/vg_nvme/lv_2... 2024-09-10T23:49:38.972 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:49:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:39.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:39 smithi189 ceph-mon[34000]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:39.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:39 smithi189 ceph-mon[34000]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:39.541 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 23:49:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-10T23:49:39.214+0000 7f62a2623640 -1 osd.5 0 log_to_monitors true 2024-09-10T23:49:39.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:39 smithi033 ceph-mon[30593]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:39.690 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:39 smithi033 ceph-mon[30593]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:39.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:39 smithi052 ceph-mon[33526]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:39.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:39 smithi052 ceph-mon[33526]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T23:49:40.642 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-10T23:49:40.453+0000 7f629d200640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:49:40.642 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-10T23:49:40.465+0000 7f6298200640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:40 smithi189 ceph-mon[34000]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:49:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:49:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:40 smithi052 ceph-mon[33526]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T23:49:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: from='osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T23:49:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:40.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:40 smithi033 ceph-mon[30593]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:49:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:49:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:49:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] boot 2024-09-10T23:49:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:49:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] boot 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:49:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: osd.5 [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] boot 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T23:49:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T23:49:42.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:42 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:49:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:42 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:49:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:42 smithi052 ceph-mon[33526]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:42.730 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:42 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:49:42.731 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:42 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:49:42.731 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:42 smithi189 ceph-mon[34000]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:42 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:49:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:42 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:49:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:42 smithi033 ceph-mon[30593]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T23:49:43.074 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:49:43.105 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-09-10T23:49:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:49:43.537 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:49:43.537 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.537 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:43.538 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T23:49:43.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:49:43.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:49:44.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 -- 172.21.15.33:0/2782395332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105c00 msgr2=0x7f7204106080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 --2- 172.21.15.33:0/2782395332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105c00 0x7f7204106080 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009930 tx=0x7f71f002a420 comp rx=0 tx=0).stop 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 -- 172.21.15.33:0/2782395332 shutdown_connections 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 --2- 172.21.15.33:0/2782395332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 0x7f720410cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 --2- 172.21.15.33:0/2782395332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204105c00 0x7f7204106080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 --2- 172.21.15.33:0/2782395332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204104aa0 0x7f7204104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 -- 172.21.15.33:0/2782395332 >> 172.21.15.33:0/2782395332 conn(0x7f7204100370 msgr2=0x7f72041027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 -- 172.21.15.33:0/2782395332 shutdown_connections 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.095+0000 7f720aa00640 1 -- 172.21.15.33:0/2782395332 wait complete. 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 Processor -- start 2024-09-10T23:49:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 -- start start 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204105c00 0x7f720419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 0x7f720419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7204110680 con 0x7f7204104aa0 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7204110500 con 0x7f72041065c0 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.097+0000 7f720aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7204110800 con 0x7f7204105c00 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44598/0 (socket says 172.21.15.33:44598) 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 -- 172.21.15.33:0/44193486 learned_addr learned my addr 172.21.15.33:0/44193486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f720a000640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 0x7f720419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7208c00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204105c00 0x7f720419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 -- 172.21.15.33:0/44193486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204105c00 msgr2=0x7f720419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204105c00 0x7f720419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 -- 172.21.15.33:0/44193486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 msgr2=0x7f720419bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 0x7f720419bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 -- 172.21.15.33:0/44193486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720419c830 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.098+0000 7f7209600640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f71f800b4a0 tx=0x7f71f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.099+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f8014070 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.099+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720419cb20 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.099+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71f8010aa0 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.099+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f8017b70 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.099+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72041a3200 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.100+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720410bdc0 con 0x7f7204104aa0 2024-09-10T23:49:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.102+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f71f8010610 con 0x7f7204104aa0 2024-09-10T23:49:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.104+0000 7f7202000640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 0x7f71ec0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:49:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.104+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7f71f80e44f0 con 0x7f7204104aa0 2024-09-10T23:49:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.104+0000 7f7208c00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 0x7f71ec0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:49:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.105+0000 7f7208c00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 0x7f71ec0b78d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005ab0 tx=0x7f71f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:49:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.106+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f71f80abb80 con 0x7f7204104aa0 2024-09-10T23:49:44.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:49:44.314+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7204063590 con 0x7f71ec0b5410 2024-09-10T23:49:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi189 2024-09-10T23:49:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T23:49:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:49:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:44.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi189 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi189 2024-09-10T23:49:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T23:49:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T23:49:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:49:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:49:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:45 smithi033 ceph-mon[30593]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:45.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:45 smithi189 ceph-mon[34000]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:45.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:45 smithi052 ceph-mon[33526]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:49:46.642 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:46 smithi033 ceph-mon[30593]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:46 smithi189 ceph-mon[34000]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:46.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:46 smithi052 ceph-mon[33526]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:47.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:47 smithi033 ceph-mon[30593]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:49:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:47 smithi189 ceph-mon[34000]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:49:47.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:47 smithi052 ceph-mon[33526]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:49:48.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:48 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"} : dispatch 2024-09-10T23:49:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:48 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"}]': finished 2024-09-10T23:49:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:48 smithi033 ceph-mon[30593]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:49:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:49:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:48 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2748218268' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:48 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"} : dispatch 2024-09-10T23:49:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:48 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"}]': finished 2024-09-10T23:49:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:48 smithi189 ceph-mon[34000]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:49:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:49:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:48 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2748218268' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:48 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"} : dispatch 2024-09-10T23:49:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:48 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/631913461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9a4975-39c8-4996-94a0-a0b119b61b99"}]': finished 2024-09-10T23:49:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:48 smithi052 ceph-mon[33526]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T23:49:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:49:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:48 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2748218268' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:49:49.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:49 smithi033 ceph-mon[30593]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T23:49:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:49 smithi189 ceph-mon[34000]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T23:49:49.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:49 smithi052 ceph-mon[33526]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T23:49:52.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:51 smithi033 ceph-mon[30593]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:49:52.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:51 smithi189 ceph-mon[34000]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:49:52.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:51 smithi052 ceph-mon[33526]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:49:54.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:53 smithi189 ceph-mon[34000]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:49:54.188 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:53 smithi033 ceph-mon[30593]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:49:54.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:53 smithi052 ceph-mon[33526]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T23:49:55.892 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:55 smithi033 ceph-mon[30593]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:49:56.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:55 smithi189 ceph-mon[34000]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:49:56.210 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:55 smithi052 ceph-mon[33526]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:49:58.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:57 smithi033 ceph-mon[30593]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:57 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:49:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:57 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:57 smithi033 ceph-mon[30593]: Deploying daemon osd.6 on smithi033 2024-09-10T23:49:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:57 smithi189 ceph-mon[34000]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:57 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:49:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:57 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:57 smithi189 ceph-mon[34000]: Deploying daemon osd.6 on smithi033 2024-09-10T23:49:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:57 smithi052 ceph-mon[33526]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:49:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:57 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T23:49:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:57 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:49:58.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:57 smithi052 ceph-mon[33526]: Deploying daemon osd.6 on smithi033 2024-09-10T23:50:00.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:49:59 smithi033 ceph-mon[30593]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:00.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:49:59 smithi189 ceph-mon[34000]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:00.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:49:59 smithi052 ceph-mon[33526]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:00 smithi189 ceph-mon[34000]: overall HEALTH_OK 2024-09-10T23:50:01.102 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:00 smithi033 ceph-mon[30593]: overall HEALTH_OK 2024-09-10T23:50:01.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:00 smithi052 ceph-mon[33526]: overall HEALTH_OK 2024-09-10T23:50:01.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:01 smithi033 ceph-mon[30593]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:02.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:01 smithi189 ceph-mon[34000]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:02.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:01 smithi052 ceph-mon[33526]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:03 smithi033 ceph-mon[30593]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:03 smithi189 ceph-mon[34000]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:04.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:03 smithi052 ceph-mon[33526]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:06.068 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:05 smithi033 ceph-mon[30593]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:06.068 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:06.068 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:06.068 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:05 smithi189 ceph-mon[34000]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:06.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:06.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:06.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:06.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:05 smithi052 ceph-mon[33526]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:08.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:07 smithi189 ceph-mon[34000]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:08.177 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:07 smithi033 ceph-mon[30593]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:08.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:07 smithi052 ceph-mon[33526]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.977+0000 7f7202000640 1 -- 172.21.15.33:0/44193486 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7204063590 con 0x7f71ec0b5410 2024-09-10T23:50:09.979 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 6 on host 'smithi033' 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.979+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 msgr2=0x7f71ec0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.979+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 0x7f71ec0b78d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005ab0 tx=0x7f71f0005a20 comp rx=0 tx=0).stop 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.979+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 msgr2=0x7f720419ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.979+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f71f800b4a0 tx=0x7f71f800b960 comp rx=0 tx=0).stop 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.979+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 shutdown_connections 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f71ec0b5410 0x7f71ec0b78d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72041065c0 0x7f720419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:09.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7204105c00 0x7f720419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 --2- 172.21.15.33:0/44193486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7204104aa0 0x7f720419ad00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 >> 172.21.15.33:0/44193486 conn(0x7f7204100370 msgr2=0x7f7204108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 shutdown_connections 2024-09-10T23:50:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:50:09.980+0000 7f720aa00640 1 -- 172.21.15.33:0/44193486 wait complete. 2024-09-10T23:50:10.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:09 smithi052 ceph-mon[33526]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:09 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:09 smithi033 ceph-mon[30593]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:09 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:09 smithi189 ceph-mon[34000]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:09 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:10.853 DEBUG:teuthology.orchestra.run.smithi033:osd.6> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T23:50:10.857 INFO:tasks.cephadm:Deploying osd.7 on smithi052 with /dev/vg_nvme/lv_2... 2024-09-10T23:50:10.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:50:11.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.245 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:11.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:11.916 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 10 23:50:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-10T23:50:11.662+0000 7f7feba1b640 -1 osd.6 0 log_to_monitors true 2024-09-10T23:50:12.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:11 smithi033 ceph-mon[30593]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:12.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:11 smithi033 ceph-mon[30593]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:50:12.303 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:11 smithi052 ceph-mon[33526]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:12.303 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:11 smithi052 ceph-mon[33526]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:50:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:11 smithi189 ceph-mon[34000]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:11 smithi189 ceph-mon[34000]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T23:50:13.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-10T23:50:13.005+0000 7f7fe6600640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:50:13.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-10T23:50:13.020+0000 7f7fe1600640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:50:13.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:12 smithi033 ceph-mon[30593]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:50:13.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:12 smithi033 ceph-mon[30593]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:50:13.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:12 smithi033 ceph-mon[30593]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:50:13.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:13.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:12 smithi033 ceph-mon[30593]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:50:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:12 smithi189 ceph-mon[34000]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:50:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:12 smithi189 ceph-mon[34000]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:50:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:12 smithi189 ceph-mon[34000]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:50:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:12 smithi189 ceph-mon[34000]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:50:13.361 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:12 smithi052 ceph-mon[33526]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T23:50:13.361 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:12 smithi052 ceph-mon[33526]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T23:50:13.361 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:12 smithi052 ceph-mon[33526]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:50:13.361 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:13.362 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:12 smithi052 ceph-mon[33526]: from='osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:50:14.017 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:13 smithi052 ceph-mon[33526]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:14.017 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:13 smithi052 ceph-mon[33526]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:50:14.017 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.018 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-mon[30593]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-mon[30593]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:50:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:13 smithi189 ceph-mon[34000]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:13 smithi189 ceph-mon[34000]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T23:50:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:14.957 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:50:14.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2024-09-10T23:50:15.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:50:15.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] boot 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] boot 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:15.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: osd.6 [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] boot 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:15.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:15.367 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:50:16.061 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi033 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 5698M 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:16.062 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi033 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 5698M 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:16.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:16.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 -- 172.21.15.52:0/3510787757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 msgr2=0x7f3de8105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 --2- 172.21.15.52:0/3510787757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de8105040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009930 tx=0x7f3dd802a440 comp rx=0 tx=0).stop 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 -- 172.21.15.52:0/3510787757 shutdown_connections 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 --2- 172.21.15.52:0/3510787757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8106760 0x7f3de810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 --2- 172.21.15.52:0/3510787757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8105da0 0x7f3de8106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 --2- 172.21.15.52:0/3510787757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de8105040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 -- 172.21.15.52:0/3510787757 >> 172.21.15.52:0/3510787757 conn(0x7f3de8100510 msgr2=0x7f3de8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:16.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 -- 172.21.15.52:0/3510787757 shutdown_connections 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.290+0000 7f3def200640 1 -- 172.21.15.52:0/3510787757 wait complete. 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.291+0000 7f3def200640 1 Processor -- start 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 -- start start 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8105da0 0x7f3de819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 0x7f3de819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3de81107a0 con 0x7f3de8104c40 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3de8110620 con 0x7f3de8106760 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3def200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3de8110920 con 0x7f3de8105da0 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3ded200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 0x7f3de819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3de7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3de7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.52:43834/0 (socket says 172.21.15.52:43834) 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3de7e00640 1 -- 172.21.15.52:0/1664627052 learned_addr learned my addr 172.21.15.52:0/1664627052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.292+0000 7f3de7400640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8105da0 0x7f3de819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 -- 172.21.15.52:0/1664627052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8105da0 msgr2=0x7f3de819b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8105da0 0x7f3de819b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 -- 172.21.15.52:0/1664627052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 msgr2=0x7f3de819c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 0x7f3de819c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 -- 172.21.15.52:0/1664627052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de819ca80 con 0x7f3de8104c40 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3ded200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 0x7f3de819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de7e00640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8005ab0 tx=0x7f3dd8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd803f070 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dd8031b10 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de819cd10 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8035030 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.293+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de81a3450 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.294+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de8105040 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.297+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3dd8031680 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.299+0000 7f3de4c00640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 0x7f3dcc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.299+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f3dd8105c20 con 0x7f3de8104c40 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.299+0000 7f3de7400640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 0x7f3dcc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.300+0000 7f3de7400640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 0x7f3dcc0b7820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009bd0 tx=0x7f3dd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.301+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3dd80cd750 con 0x7f3de8104c40 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi033 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 5698M 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:16.506+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3de8063590 con 0x7f3dcc0b5360 2024-09-10T23:50:17.266 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:17.266 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:17.266 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:17.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:17.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:17.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:17.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:17.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:17.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:18.142 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:18 smithi052 ceph-mon[33526]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:18.142 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:18 smithi052 ceph-mon[33526]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:18.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:18 smithi033 ceph-mon[30593]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:18.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:18 smithi033 ceph-mon[30593]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:18 smithi189 ceph-mon[34000]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:18 smithi189 ceph-mon[34000]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/3271144411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"}]': finished 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:50:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:20 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/3271144411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"}]': finished 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:50:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:20 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/3271144411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"} : dispatch 2024-09-10T23:50:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "266fe9b2-62df-4671-81b3-100dc5abd315"}]': finished 2024-09-10T23:50:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T23:50:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:20 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:21.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:21 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/3637848254' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:21.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:21 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/3637848254' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:21.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:21 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/3637848254' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:22.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:22 smithi189 ceph-mon[34000]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:22.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:22 smithi052 ceph-mon[33526]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:22 smithi033 ceph-mon[30593]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:24 smithi189 ceph-mon[34000]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:24.337 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:24 smithi052 ceph-mon[33526]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:24 smithi033 ceph-mon[30593]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:26.328 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:26 smithi033 ceph-mon[30593]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:26.329 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:26 smithi052 ceph-mon[33526]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:26 smithi189 ceph-mon[34000]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:28.125 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:28 smithi052 ceph-mon[33526]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:28.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:28 smithi033 ceph-mon[30593]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:28 smithi189 ceph-mon[34000]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:29.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:50:29.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:29.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:50:29.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:29.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T23:50:29.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:30 smithi189 ceph-mon[34000]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:30 smithi189 ceph-mon[34000]: Deploying daemon osd.7 on smithi052 2024-09-10T23:50:30.413 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:30 smithi052 ceph-mon[33526]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:30.413 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:30 smithi052 ceph-mon[33526]: Deploying daemon osd.7 on smithi052 2024-09-10T23:50:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:30 smithi033 ceph-mon[30593]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:30 smithi033 ceph-mon[30593]: Deploying daemon osd.7 on smithi052 2024-09-10T23:50:32.266 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:32 smithi052 ceph-mon[33526]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:32 smithi189 ceph-mon[34000]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:32.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:32 smithi033 ceph-mon[30593]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:34 smithi189 ceph-mon[34000]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:34 smithi052 ceph-mon[33526]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:34 smithi033 ceph-mon[30593]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:36.112 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:36 smithi052 ceph-mon[33526]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:36 smithi189 ceph-mon[34000]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:36.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:36 smithi033 ceph-mon[30593]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:37.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:37.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:37.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:37.354 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:37.354 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:37.354 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:37.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:38.329 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:38 smithi033 ceph-mon[30593]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:38 smithi189 ceph-mon[34000]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:38.353 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:38 smithi052 ceph-mon[33526]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:40 smithi189 ceph-mon[34000]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:40.382 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:40 smithi052 ceph-mon[33526]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:40 smithi033 ceph-mon[30593]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:40.956 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 7 on host 'smithi052' 2024-09-10T23:50:40.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.955+0000 7f3de4c00640 1 -- 172.21.15.52:0/1664627052 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3de8063590 con 0x7f3dcc0b5360 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.957+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 msgr2=0x7f3dcc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.957+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 0x7f3dcc0b7820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009bd0 tx=0x7f3dd4005f90 comp rx=0 tx=0).stop 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 msgr2=0x7f3de819af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8005ab0 tx=0x7f3dd8003c10 comp rx=0 tx=0).stop 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 shutdown_connections 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3dcc0b5360 0x7f3dcc0b7820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:40.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3de8106760 0x7f3de819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de8105da0 0x7f3de819b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 --2- 172.21.15.52:0/1664627052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de8104c40 0x7f3de819af50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 >> 172.21.15.52:0/1664627052 conn(0x7f3de8100510 msgr2=0x7f3de8109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 shutdown_connections 2024-09-10T23:50:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:50:40.958+0000 7f3def200640 1 -- 172.21.15.52:0/1664627052 wait complete. 2024-09-10T23:50:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:41.796 DEBUG:teuthology.orchestra.run.smithi052:osd.7> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T23:50:41.800 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-10T23:50:41.801 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T23:50:42.176 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:42.540 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:42 smithi052 ceph-mon[33526]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:42 smithi189 ceph-mon[34000]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:42 smithi033 ceph-mon[30593]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:43.203 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 23:50:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-10T23:50:42.805+0000 7efcd3849640 -1 osd.7 0 log_to_monitors true 2024-09-10T23:50:43.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:43 smithi052 ceph-mon[33526]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:43.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:43 smithi052 ceph-mon[33526]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:43.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:43 smithi189 ceph-mon[34000]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:43.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:43 smithi189 ceph-mon[34000]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:43 smithi033 ceph-mon[30593]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:43 smithi033 ceph-mon[30593]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T23:50:44.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:44.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:50:44.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:44.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:50:44.567 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:44.568 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:44 smithi189 ceph-mon[34000]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:44.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:44.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:50:44.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:44.652 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:50:44.652 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:44.652 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-mon[33526]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:44.652 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-10T23:50:44.310+0000 7efcce000640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:50:44.652 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 23:50:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-10T23:50:44.321+0000 7efcc9000640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: from='osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:44 smithi033 ceph-mon[30593]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:50:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:50:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:50:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] boot 2024-09-10T23:50:45.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:50:45.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] boot 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:50:45.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.665 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:50:45.701 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-10T23:50:45.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: osd.7 [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] boot 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T23:50:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T23:50:46.075 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:46.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:46 smithi189 ceph-mon[34000]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 -- 172.21.15.189:0/2131963175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c7806b6e0 msgr2=0x7f8c781033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/2131963175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c7806b6e0 0x7f8c781033e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009860 tx=0x7f8c6c02a340 comp rx=0 tx=0).stop 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 -- 172.21.15.189:0/2131963175 shutdown_connections 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/2131963175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78106520 0x7f8c781069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/2131963175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c78103970 0x7f8c78105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/2131963175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c7806b6e0 0x7f8c781033e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 -- 172.21.15.189:0/2131963175 >> 172.21.15.189:0/2131963175 conn(0x7f8c780fd1e0 msgr2=0x7f8c780ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:50:46.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 -- 172.21.15.189:0/2131963175 shutdown_connections 2024-09-10T23:50:46.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.684+0000 7f8c7fc00640 1 -- 172.21.15.189:0/2131963175 wait complete. 2024-09-10T23:50:46.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 Processor -- start 2024-09-10T23:50:46.687 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 -- start start 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7806b6e0 0x7f8c7819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c78106520 0x7f8c781a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78114b20 con 0x7f8c78103970 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c781149a0 con 0x7f8c7806b6e0 2024-09-10T23:50:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.686+0000 7f8c7fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78114ca0 con 0x7f8c78106520 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c7dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c78106520 0x7f8c781a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.189:43274/0 (socket says 172.21.15.189:43274) 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 -- 172.21.15.189:0/3611111225 learned_addr learned my addr 172.21.15.189:0/3611111225 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c7d200640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7806b6e0 0x7f8c7819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 -- 172.21.15.189:0/3611111225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c78106520 msgr2=0x7f8c781a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c78106520 0x7f8c781a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 -- 172.21.15.189:0/3611111225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7806b6e0 msgr2=0x7f8c7819f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7806b6e0 0x7f8c7819f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:50:46.689 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.687+0000 7f8c77e00640 1 -- 172.21.15.189:0/3611111225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c781a0e80 con 0x7f8c78103970 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c77e00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400e9f0 tx=0x7f8c6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400ccc0 con 0x7f8c78103970 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c640035f0 con 0x7f8c78103970 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c781a1170 con 0x7f8c78103970 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400ce60 con 0x7f8c78103970 2024-09-10T23:50:46.690 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.688+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c781a7850 con 0x7f8c78103970 2024-09-10T23:50:46.691 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.689+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c780fecd0 con 0x7f8c78103970 2024-09-10T23:50:46.693 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.691+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8c64004000 con 0x7f8c78103970 2024-09-10T23:50:46.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.693+0000 7f8c75600640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 0x7f8c600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:50:46.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.693+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5397+0+0 (secure 0 0 0) 0x7f8c640e5410 con 0x7f8c78103970 2024-09-10T23:50:46.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.693+0000 7f8c7d200640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 0x7f8c600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:50:46.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.694+0000 7f8c7d200640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 0x7f8c600b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009830 tx=0x7f8c6c0303b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:50:46.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.695+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8c640acd90 con 0x7f8c78103970 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:46.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:46 smithi052 ceph-mon[33526]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:46.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:46.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:50:46.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:46 smithi033 ceph-mon[30593]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T23:50:46.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:50:46.895+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8c78063590 con 0x7f8c600b52e0 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi052 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 5698M 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:47 smithi189 ceph-mon[34000]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:50:47.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi052 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 5698M 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:47 smithi052 ceph-mon[33526]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi052 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 5698M 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:50:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:50:47.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:47 smithi033 ceph-mon[30593]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T23:50:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:48 smithi189 ceph-mon[34000]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:48 smithi189 ceph-mon[34000]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:48 smithi052 ceph-mon[33526]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:48 smithi052 ceph-mon[33526]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:48.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:48 smithi033 ceph-mon[30593]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:48 smithi033 ceph-mon[30593]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:50:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/2939798435' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"}]': finished 2024-09-10T23:50:50.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:50:50.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:50:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/2939798435' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"}]': finished 2024-09-10T23:50:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:50:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/2939798435' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"} : dispatch 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56e0c2a1-9cff-40f2-9dad-5119984743e4"}]': finished 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T23:50:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:50:51.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:51 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/959365134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:51.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:51 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/959365134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:51 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/959365134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:50:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:52 smithi052 ceph-mon[33526]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-10T23:50:52.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:52 smithi033 ceph-mon[30593]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-10T23:50:52.831 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:52 smithi189 ceph-mon[34000]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-10T23:50:54.697 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:54 smithi052 ceph-mon[33526]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:50:54.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:54 smithi189 ceph-mon[34000]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:50:54.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:54 smithi033 ceph-mon[30593]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T23:50:56.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:56 smithi189 ceph-mon[34000]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:50:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:56 smithi052 ceph-mon[33526]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:50:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:56 smithi033 ceph-mon[30593]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:50:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:50:58 smithi189 ceph-mon[34000]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:50:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:50:58 smithi052 ceph-mon[33526]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:50:58.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:50:58 smithi033 ceph-mon[30593]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T23:51:00.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:00 smithi189 ceph-mon[34000]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:00.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:51:00.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:00 smithi052 ceph-mon[33526]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:00.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:51:00.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:00.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:00 smithi033 ceph-mon[30593]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T23:51:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:01.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:01 smithi189 ceph-mon[34000]: Deploying daemon osd.8 on smithi189 2024-09-10T23:51:01.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:01 smithi052 ceph-mon[33526]: Deploying daemon osd.8 on smithi189 2024-09-10T23:51:01.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:01 smithi033 ceph-mon[30593]: Deploying daemon osd.8 on smithi189 2024-09-10T23:51:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:02 smithi052 ceph-mon[33526]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:51:02.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:02 smithi033 ceph-mon[30593]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:51:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:02 smithi189 ceph-mon[34000]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T23:51:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:04 smithi052 ceph-mon[33526]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:04.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:04 smithi033 ceph-mon[30593]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:04 smithi189 ceph-mon[34000]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:06 smithi052 ceph-mon[33526]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:06 smithi033 ceph-mon[30593]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:06.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:06 smithi189 ceph-mon[34000]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:08.571 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:08 smithi189 ceph-mon[34000]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:08.571 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:08.571 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:08.571 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:08 smithi052 ceph-mon[33526]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:08.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:08 smithi033 ceph-mon[30593]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:10.463 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:10 smithi189 ceph-mon[34000]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:10 smithi052 ceph-mon[33526]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:10.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:10 smithi033 ceph-mon[30593]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:11 smithi189 ceph-mon[34000]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:11.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:11 smithi052 ceph-mon[33526]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:11 smithi033 ceph-mon[30593]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:12.329 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.328+0000 7f8c75600640 1 -- 172.21.15.189:0/3611111225 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c78063590 con 0x7f8c600b52e0 2024-09-10T23:51:12.329 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 msgr2=0x7f8c600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 0x7f8c600b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009830 tx=0x7f8c6c0303b0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 msgr2=0x7f8c7819f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400e9f0 tx=0x7f8c6400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 shutdown_connections 2024-09-10T23:51:12.331 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8c600b52e0 0x7f8c600b77a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c78106520 0x7f8c781a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c78103970 0x7f8c7819f9a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 --2- 172.21.15.189:0/3611111225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c7806b6e0 0x7f8c7819f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.330+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 >> 172.21.15.189:0/3611111225 conn(0x7f8c780fd1e0 msgr2=0x7f8c78104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.331+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 shutdown_connections 2024-09-10T23:51:12.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:51:12.331+0000 7f8c7fc00640 1 -- 172.21.15.189:0/3611111225 wait complete. 2024-09-10T23:51:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:13.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:13.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:13.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:13.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:13.147 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T23:51:13.151 INFO:tasks.cephadm:Deploying osd.9 on smithi033 with /dev/vg_nvme/lv_1... 2024-09-10T23:51:13.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:51:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:51:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:13 smithi052 ceph-mon[33526]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:13.984 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:13 smithi033 ceph-mon[30593]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:14.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:13 smithi189 ceph-mon[34000]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:14.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 23:51:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-10T23:51:13.769+0000 7fdefe837640 -1 osd.8 0 log_to_monitors true 2024-09-10T23:51:14.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:14 smithi033 ceph-mon[30593]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:14 smithi033 ceph-mon[30593]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:14 smithi189 ceph-mon[34000]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:14 smithi189 ceph-mon[34000]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:14.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:14 smithi052 ceph-mon[33526]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:14.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:14 smithi052 ceph-mon[33526]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:15 smithi033 ceph-mon[30593]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:15.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:15 smithi052 ceph-mon[33526]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: from='osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:51:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:15 smithi189 ceph-mon[34000]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T23:51:16.582 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-10T23:51:16.232+0000 7fdef9000640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T23:51:16.582 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-10T23:51:16.254+0000 7fdeef000640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:51:16.923 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: from='osd.8 ' entity='osd.8' 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] boot 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:51:16.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: from='osd.8 ' entity='osd.8' 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] boot 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:51:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:17.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: from='osd.8 ' entity='osd.8' 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: osd.8 [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] boot 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T23:51:17.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T23:51:17.399 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:51:17.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_1 2024-09-10T23:51:17.826 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:51:17.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi189 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:17 smithi052 ceph-mon[33526]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi189 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:17.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:17 smithi033 ceph-mon[30593]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:51:18.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:51:18.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:51:18.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi189 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:17 smithi189 ceph-mon[34000]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T23:51:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 -- 172.21.15.33:0/2655865572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa8076f20 msgr2=0x7f1aa8075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2655865572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa8076f20 0x7f1aa8075580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009ca0 tx=0x7f1a9802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 -- 172.21.15.33:0/2655865572 shutdown_connections 2024-09-10T23:51:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2655865572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa810a820 0x7f1aa810cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2655865572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa8075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2655865572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa8076f20 0x7f1aa8075580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 -- 172.21.15.33:0/2655865572 >> 172.21.15.33:0/2655865572 conn(0x7f1aa80fe180 msgr2=0x7f1aa81005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 -- 172.21.15.33:0/2655865572 shutdown_connections 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.471+0000 7f1aa7200640 1 -- 172.21.15.33:0/2655865572 wait complete. 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.472+0000 7f1aa7200640 1 Processor -- start 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.472+0000 7f1aa7200640 1 -- start start 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.472+0000 7f1aa7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.472+0000 7f1aa7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa8076f20 0x7f1aa819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa7200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8110610 con 0x7f1aa810a820 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8110490 con 0x7f1aa8075ac0 2024-09-10T23:51:18.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8110790 con 0x7f1aa8076f20 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58366/0 (socket says 172.21.15.33:58366) 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 -- 172.21.15.33:0/2154269583 learned_addr learned my addr 172.21.15.33:0/2154269583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1a9d400640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa8076f20 0x7f1aa819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 -- 172.21.15.33:0/2154269583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa8076f20 msgr2=0x7f1aa819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa8076f20 0x7f1aa819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 -- 172.21.15.33:0/2154269583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 msgr2=0x7f1aa819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa819ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:18.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa6800640 1 -- 172.21.15.33:0/2154269583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa819c840 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.473+0000 7f1aa5e00640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1aa6800640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d950 tx=0x7f1aa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0017070 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1aa0009c30 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa819cb30 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0003b90 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.474+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa81a3210 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.475+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa8075f40 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.477+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1aa0005030 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.479+0000 7f1a9f400640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 0x7f1a8c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.479+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5829+0+0 (secure 0 0 0) 0x7f1aa00e4ab0 con 0x7f1aa810a820 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.479+0000 7f1aa5e00640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 0x7f1a8c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.480+0000 7f1aa5e00640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 0x7f1a8c0b7850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a98031840 tx=0x7f1a98031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:51:18.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.480+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1aa0009de0 con 0x7f1aa810a820 2024-09-10T23:51:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:18.690+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1aa80fee60 con 0x7f1a8c0b5390 2024-09-10T23:51:19.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:51:19.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:19.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:19.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:19.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:19.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:19 smithi052 ceph-mon[33526]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:19 smithi033 ceph-mon[30593]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: from='client.14589 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:20.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:19 smithi189 ceph-mon[34000]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:22.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:21 smithi033 ceph-mon[30593]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-10T23:51:22.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:21 smithi189 ceph-mon[34000]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-10T23:51:22.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:21 smithi052 ceph-mon[33526]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-10T23:51:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"} : dispatch 2024-09-10T23:51:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"}]': finished 2024-09-10T23:51:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:22 smithi033 ceph-mon[30593]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:51:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1133512874' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"} : dispatch 2024-09-10T23:51:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"}]': finished 2024-09-10T23:51:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:22 smithi189 ceph-mon[34000]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:51:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1133512874' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:23.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"} : dispatch 2024-09-10T23:51:23.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/580396632' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c1eb7a4-412e-46b0-830c-138a45e0cc38"}]': finished 2024-09-10T23:51:23.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:22 smithi052 ceph-mon[33526]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T23:51:23.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:23.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1133512874' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:24 smithi052 ceph-mon[33526]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:51:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:24 smithi189 ceph-mon[34000]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:51:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:24 smithi033 ceph-mon[30593]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T23:51:26.327 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:26 smithi033 ceph-mon[30593]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-10T23:51:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:26 smithi189 ceph-mon[34000]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-10T23:51:26.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:26 smithi052 ceph-mon[33526]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-10T23:51:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:28 smithi189 ceph-mon[34000]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:51:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:28 smithi052 ceph-mon[33526]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:51:28.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:28 smithi033 ceph-mon[30593]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:51:30.328 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:30 smithi033 ceph-mon[30593]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:30 smithi189 ceph-mon[34000]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:30 smithi052 ceph-mon[33526]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:51:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:32 smithi189 ceph-mon[34000]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:32 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:51:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:32 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:32.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:32 smithi033 ceph-mon[30593]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:32.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:32 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:51:32.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:32 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:32 smithi052 ceph-mon[33526]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:32 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T23:51:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:32 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:33.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:33 smithi189 ceph-mon[34000]: Deploying daemon osd.9 on smithi033 2024-09-10T23:51:33.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:33 smithi052 ceph-mon[33526]: Deploying daemon osd.9 on smithi033 2024-09-10T23:51:33.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:33 smithi033 ceph-mon[30593]: Deploying daemon osd.9 on smithi033 2024-09-10T23:51:34.307 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:34 smithi033 ceph-mon[30593]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:34 smithi189 ceph-mon[34000]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:34 smithi052 ceph-mon[33526]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:36.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:36 smithi033 ceph-mon[30593]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:36 smithi189 ceph-mon[34000]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:36 smithi052 ceph-mon[33526]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:38 smithi189 ceph-mon[34000]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:38.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:38 smithi052 ceph-mon[33526]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:38.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:38 smithi033 ceph-mon[30593]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:40 smithi189 ceph-mon[34000]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:40.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:40 smithi033 ceph-mon[30593]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:40.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:40.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:40.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:40 smithi052 ceph-mon[33526]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:40.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:42 smithi189 ceph-mon[34000]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:42 smithi052 ceph-mon[33526]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:42 smithi033 ceph-mon[30593]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:44.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.533+0000 7f1a9f400640 1 -- 172.21.15.33:0/2154269583 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1aa80fee60 con 0x7f1a8c0b5390 2024-09-10T23:51:44.537 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 9 on host 'smithi033' 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 msgr2=0x7f1a8c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 0x7f1a8c0b7850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a98031840 tx=0x7f1a98031000 comp rx=0 tx=0).stop 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 msgr2=0x7f1aa819bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d950 tx=0x7f1aa000de10 comp rx=0 tx=0).stop 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 shutdown_connections 2024-09-10T23:51:44.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a8c0b5390 0x7f1a8c0b7850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aa810a820 0x7f1aa819bfa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1aa8076f20 0x7f1aa819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 --2- 172.21.15.33:0/2154269583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1aa8075ac0 0x7f1aa819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 >> 172.21.15.33:0/2154269583 conn(0x7f1aa80fe180 msgr2=0x7f1aa80fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 shutdown_connections 2024-09-10T23:51:44.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:51:44.536+0000 7f1aa7200640 1 -- 172.21.15.33:0/2154269583 wait complete. 2024-09-10T23:51:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:44.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.429 DEBUG:teuthology.orchestra.run.smithi033:osd.9> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T23:51:45.434 INFO:tasks.cephadm:Deploying osd.10 on smithi052 with /dev/vg_nvme/lv_1... 2024-09-10T23:51:45.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:51:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:45.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:51:45.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:51:46.432 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 10 23:51:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-10T23:51:46.240+0000 7fa6b4e3c640 -1 osd.9 0 log_to_monitors true 2024-09-10T23:51:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:46 smithi052 ceph-mon[33526]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:46 smithi052 ceph-mon[33526]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:51:46.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:46 smithi033 ceph-mon[30593]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:46 smithi033 ceph-mon[30593]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:51:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:46 smithi189 ceph-mon[34000]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:46 smithi189 ceph-mon[34000]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T23:51:47.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:47 smithi052 ceph-mon[33526]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:51:47.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:47 smithi052 ceph-mon[33526]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:51:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:47 smithi052 ceph-mon[33526]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:51:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:47 smithi052 ceph-mon[33526]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:47 smithi033 ceph-mon[30593]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:51:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:47 smithi033 ceph-mon[30593]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:51:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:47 smithi033 ceph-mon[30593]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:51:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:47 smithi033 ceph-mon[30593]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:47 smithi189 ceph-mon[34000]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T23:51:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:47 smithi189 ceph-mon[34000]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T23:51:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:47 smithi189 ceph-mon[34000]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-09-10T23:51:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:47 smithi189 ceph-mon[34000]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:48.038 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-10T23:51:48.011+0000 7fa6afa00640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T23:51:48.525 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-10T23:51:48.036+0000 7fa6a5a00640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:51:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:48 smithi189 ceph-mon[34000]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:51:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:48 smithi189 ceph-mon[34000]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:51:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:48 smithi189 ceph-mon[34000]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' 2024-09-10T23:51:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:48 smithi052 ceph-mon[33526]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:51:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:48 smithi052 ceph-mon[33526]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:51:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:48 smithi052 ceph-mon[33526]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' 2024-09-10T23:51:49.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-mon[30593]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-09-10T23:51:49.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-mon[30593]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T23:51:49.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:48 smithi033 ceph-mon[30593]: from='osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777]' entity='osd.9' 2024-09-10T23:51:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T23:51:49.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_1 2024-09-10T23:51:49.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:51:49.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:51:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] boot 2024-09-10T23:51:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:51:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:49 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:51:49.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:51:49.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:49.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] boot 2024-09-10T23:51:49.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:51:49.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:49 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: osd.9 [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] boot 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T23:51:49.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:49 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T23:51:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T23:51:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.548+0000 7f3aa5400640 1 -- 172.21.15.52:0/1851861477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0102a30 msgr2=0x7f3aa0102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.548+0000 7f3aa5400640 1 --2- 172.21.15.52:0/1851861477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0102a30 0x7f3aa0102e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009930 tx=0x7f3a9002a420 comp rx=0 tx=0).stop 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 -- 172.21.15.52:0/1851861477 shutdown_connections 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 --2- 172.21.15.52:0/1851861477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0104550 0x7f3aa010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 --2- 172.21.15.52:0/1851861477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0103b90 0x7f3aa0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 --2- 172.21.15.52:0/1851861477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0102a30 0x7f3aa0102e30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 -- 172.21.15.52:0/1851861477 >> 172.21.15.52:0/1851861477 conn(0x7f3aa00fe320 msgr2=0x7f3aa0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 -- 172.21.15.52:0/1851861477 shutdown_connections 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.549+0000 7f3aa5400640 1 -- 172.21.15.52:0/1851861477 wait complete. 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 Processor -- start 2024-09-10T23:51:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 -- start start 2024-09-10T23:51:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0104550 0x7f3aa019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa010e5b0 con 0x7f3aa0102a30 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa010e430 con 0x7f3aa0103b90 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.550+0000 7f3aa5400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa010e730 con 0x7f3aa0104550 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a9e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57776/0 (socket says 172.21.15.52:57776) 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a9e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.52:38822/0 (socket says 172.21.15.52:38822) 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 -- 172.21.15.52:0/3173861583 learned_addr learned my addr 172.21.15.52:0/3173861583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a9f200640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0104550 0x7f3aa019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 -- 172.21.15.52:0/3173861583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0104550 msgr2=0x7f3aa019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0104550 0x7f3aa019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 -- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 msgr2=0x7f3aa019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a97e00640 1 -- 172.21.15.52:0/3173861583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa019ca50 con 0x7f3aa0103b90 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.551+0000 7f3a9e800640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.552+0000 7f3a97e00640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800d770 tx=0x7f3a8800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:51:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.554+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88017070 con 0x7f3aa0103b90 2024-09-10T23:51:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.554+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a880054b0 con 0x7f3aa0103b90 2024-09-10T23:51:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.554+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa019cd40 con 0x7f3aa0103b90 2024-09-10T23:51:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.554+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88004c60 con 0x7f3aa0103b90 2024-09-10T23:51:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.554+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa01a3420 con 0x7f3aa0103b90 2024-09-10T23:51:50.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.555+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa0102e30 con 0x7f3aa0103b90 2024-09-10T23:51:50.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.558+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3a88004e00 con 0x7f3aa0103b90 2024-09-10T23:51:50.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.558+0000 7f3a97400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 0x7f3a840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:51:50.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.559+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6261+0+0 (secure 0 0 0) 0x7f3a880e4e30 con 0x7f3aa0103b90 2024-09-10T23:51:50.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.559+0000 7f3a9e800640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 0x7f3a840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:51:50.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.560+0000 7f3a9e800640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 0x7f3a840b77a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a90005ab0 tx=0x7f3a90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:51:50.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.562+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a880abe00 con 0x7f3aa0103b90 2024-09-10T23:51:50.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:51:50.770+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3aa0109a30 con 0x7f3a840b52e0 2024-09-10T23:51:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi033 2024-09-10T23:51:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:50 smithi189 ceph-mon[34000]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:51:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi033 2024-09-10T23:51:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:50 smithi052 ceph-mon[33526]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi033 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 4273M 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:51:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:51:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:50 smithi033 ceph-mon[30593]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T23:51:51.687 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:51 smithi052 ceph-mon[33526]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:51.687 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:51 smithi052 ceph-mon[33526]: from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:51.687 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:51.687 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:51.687 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:51 smithi189 ceph-mon[34000]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:51 smithi189 ceph-mon[34000]: from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:52.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:51 smithi033 ceph-mon[30593]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:52.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:51 smithi033 ceph-mon[30593]: from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:51:52.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:51:52.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:51:52.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/213930029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"}]': finished 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:51:54.300 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/213930029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"}]': finished 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:51:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/213930029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"} : dispatch 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c44b0d1e-3875-477b-96ce-3e82126df19e"}]': finished 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T23:51:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:51:55.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:55 smithi189 ceph-mon[34000]: from='client.? 172.21.15.52:0/811153759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:55.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:55 smithi052 ceph-mon[33526]: from='client.? 172.21.15.52:0/811153759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:55.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:55 smithi033 ceph-mon[30593]: from='client.? 172.21.15.52:0/811153759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:51:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:56 smithi189 ceph-mon[34000]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:56.426 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:56 smithi033 ceph-mon[30593]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:56 smithi052 ceph-mon[33526]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:51:58 smithi189 ceph-mon[34000]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:51:58 smithi052 ceph-mon[33526]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:51:58.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:51:58 smithi033 ceph-mon[30593]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:00 smithi189 ceph-mon[34000]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:00.356 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:00 smithi052 ceph-mon[33526]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:00 smithi033 ceph-mon[30593]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:02.185 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:02 smithi052 ceph-mon[33526]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:02 smithi189 ceph-mon[34000]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:02 smithi033 ceph-mon[30593]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:04 smithi189 ceph-mon[34000]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:52:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:04.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:04 smithi052 ceph-mon[33526]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:04.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:52:04.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:04 smithi033 ceph-mon[30593]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T23:52:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:05.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:05 smithi189 ceph-mon[34000]: Deploying daemon osd.10 on smithi052 2024-09-10T23:52:05.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:05 smithi052 ceph-mon[33526]: Deploying daemon osd.10 on smithi052 2024-09-10T23:52:05.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:05 smithi033 ceph-mon[30593]: Deploying daemon osd.10 on smithi052 2024-09-10T23:52:06.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:06 smithi189 ceph-mon[34000]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:06.372 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:06 smithi052 ceph-mon[33526]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:06.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:06 smithi033 ceph-mon[30593]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:08.235 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:08 smithi052 ceph-mon[33526]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:08 smithi033 ceph-mon[30593]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:08.912 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:08 smithi189 ceph-mon[34000]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:10 smithi052 ceph-mon[33526]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:10 smithi033 ceph-mon[30593]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:10 smithi189 ceph-mon[34000]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:12.354 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:12 smithi052 ceph-mon[33526]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:12.355 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:12.355 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:12.355 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:12 smithi033 ceph-mon[30593]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:12 smithi189 ceph-mon[34000]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:14.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:14 smithi052 ceph-mon[33526]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:14 smithi033 ceph-mon[30593]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:14 smithi189 ceph-mon[34000]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:16.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.373+0000 7f3a97400640 1 -- 172.21.15.52:0/3173861583 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3aa0109a30 con 0x7f3a840b52e0 2024-09-10T23:52:16.374 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 10 on host 'smithi052' 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 msgr2=0x7f3a840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 0x7f3a840b77a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a90005ab0 tx=0x7f3a90005a20 comp rx=0 tx=0).stop 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 msgr2=0x7f3aa019b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800d770 tx=0x7f3a8800dc30 comp rx=0 tx=0).stop 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 shutdown_connections 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a840b52e0 0x7f3a840b77a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:16.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3aa0104550 0x7f3aa019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa0103b90 0x7f3aa019b570 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 --2- 172.21.15.52:0/3173861583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102a30 0x7f3aa019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 >> 172.21.15.52:0/3173861583 conn(0x7f3aa00fe320 msgr2=0x7f3aa0109320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 shutdown_connections 2024-09-10T23:52:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T23:52:16.375+0000 7f3aa5400640 1 -- 172.21.15.52:0/3173861583 wait complete. 2024-09-10T23:52:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:16.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:16.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.401 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:17.401 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.401 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.451 DEBUG:teuthology.orchestra.run.smithi052:osd.10> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T23:52:17.455 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-10T23:52:17.456 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T23:52:17.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:17.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:17.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:17.705 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 23:52:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-10T23:52:17.649+0000 7fb0a1012640 -1 osd.10 0 log_to_monitors true 2024-09-10T23:52:17.830 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:52:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:18 smithi189 ceph-mon[34000]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:18 smithi189 ceph-mon[34000]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:18 smithi189 ceph-mon[34000]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:18 smithi052 ceph-mon[33526]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:18 smithi052 ceph-mon[33526]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:18 smithi052 ceph-mon[33526]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:18.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:18 smithi033 ceph-mon[30593]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:18.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:18 smithi033 ceph-mon[30593]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:18.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:18 smithi033 ceph-mon[30593]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T23:52:19.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:52:19.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:52:19.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:19.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.430 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:52:19.430 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:19 smithi189 ceph-mon[34000]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:52:19.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:52:19.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:52:19.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:19.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:52:19.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-mon[33526]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: from='osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T23:52:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:19 smithi033 ceph-mon[30593]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T23:52:20.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-10T23:52:19.862+0000 7fb09bc00640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T23:52:20.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 23:52:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-10T23:52:19.888+0000 7fb091c00640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:52:20.670 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:20 smithi189 ceph-mon[34000]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:20.670 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:20 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.670 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:20 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.670 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:20 smithi189 ceph-mon[34000]: from='osd.10 ' entity='osd.10' 2024-09-10T23:52:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:20 smithi052 ceph-mon[33526]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:20 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:20 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:20 smithi052 ceph-mon[33526]: from='osd.10 ' entity='osd.10' 2024-09-10T23:52:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:20 smithi033 ceph-mon[30593]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:20 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:20 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:20 smithi033 ceph-mon[30593]: from='osd.10 ' entity='osd.10' 2024-09-10T23:52:21.077 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T23:52:21.109 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-10T23:52:21.478 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] boot 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:52:21.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:21 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:21.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:52:21.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:52:21.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:21.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] boot 2024-09-10T23:52:21.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:52:21.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:21 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:21.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:52:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:52:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: osd.10 [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] boot 2024-09-10T23:52:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T23:52:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:21 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.113+0000 7fc093e00640 1 -- 172.21.15.189:0/3141286863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c104550 msgr2=0x7fc08c10aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.113+0000 7fc093e00640 1 --2- 172.21.15.189:0/3141286863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c104550 0x7fc08c10aed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d00 tx=0x7fc08402a910 comp rx=0 tx=0).stop 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 -- 172.21.15.189:0/3141286863 shutdown_connections 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 --2- 172.21.15.189:0/3141286863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c104550 0x7fc08c10aed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 --2- 172.21.15.189:0/3141286863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c103b90 0x7fc08c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 --2- 172.21.15.189:0/3141286863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c102a30 0x7fc08c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:22.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 -- 172.21.15.189:0/3141286863 >> 172.21.15.189:0/3141286863 conn(0x7fc08c0fe320 msgr2=0x7fc08c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 -- 172.21.15.189:0/3141286863 shutdown_connections 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.114+0000 7fc093e00640 1 -- 172.21.15.189:0/3141286863 wait complete. 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.115+0000 7fc093e00640 1 Processor -- start 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.115+0000 7fc093e00640 1 -- start start 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c103b90 0x7fc08c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c104550 0x7fc08c075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c10e540 con 0x7fc08c104550 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c10e3c0 con 0x7fc08c103b90 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc093e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c10e6c0 con 0x7fc08c102a30 2024-09-10T23:52:22.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:40480/0 (socket says 172.21.15.189:40480) 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 -- 172.21.15.189:0/4058873743 learned_addr learned my addr 172.21.15.189:0/4058873743 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c104550 0x7fc08c075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc090a00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c103b90 0x7fc08c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 -- 172.21.15.189:0/4058873743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c103b90 msgr2=0x7fc08c075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c103b90 0x7fc08c075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 -- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c104550 msgr2=0x7fc08c075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c104550 0x7fc08c075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.116+0000 7fc091400640 1 -- 172.21.15.189:0/4058873743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c076340 con 0x7fc08c102a30 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc091400640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc08000d950 tx=0x7fc08000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080017070 con 0x7fc08c102a30 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc080009c30 con 0x7fc08c102a30 2024-09-10T23:52:22.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f620 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c1a2e00 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.117+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c1a31a0 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.118+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c1a3420 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.120+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fc080010460 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.122+0000 7fc08a000640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 0x7fc0740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.123+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6694+0+0 (secure 0 0 0) 0x7fc0800e5150 con 0x7fc08c102a30 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.123+0000 7fc090a00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 0x7fc0740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:22.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.124+0000 7fc090a00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 0x7fc0740b7820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc07800bbe0 tx=0x7fc07800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:22.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.127+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc080009de0 con 0x7fc08c102a30 2024-09-10T23:52:22.321 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:22.319+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc08c105680 con 0x7fc0740b5360 2024-09-10T23:52:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:52:22.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:52:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:52:22.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:22.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T23:52:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T23:52:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T23:52:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:23 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi052 2024-09-10T23:52:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:23 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T23:52:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:23 smithi189 ceph-mon[34000]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:23 smithi189 ceph-mon[34000]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:52:23.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:23 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi052 2024-09-10T23:52:23.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:23 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T23:52:23.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:23 smithi052 ceph-mon[33526]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:23.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:23 smithi052 ceph-mon[33526]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:52:23.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:23 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi052 2024-09-10T23:52:23.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:23 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T23:52:23.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:23 smithi033 ceph-mon[30593]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:23.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:23 smithi033 ceph-mon[30593]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T23:52:24.433 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:24 smithi189 ceph-mon[34000]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:24 smithi052 ceph-mon[33526]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:24 smithi033 ceph-mon[30593]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/3326763580' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"}]': finished 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:26 smithi189 ceph-mon[34000]: from='client.? 172.21.15.189:0/1430968004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:52:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/3326763580' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"}]': finished 2024-09-10T23:52:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:52:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:26 smithi052 ceph-mon[33526]: from='client.? 172.21.15.189:0/1430968004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/3326763580' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"} : dispatch 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ac102b3-44aa-4de6-a636-1fd62a7c05eb"}]': finished 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:26 smithi033 ceph-mon[30593]: from='client.? 172.21.15.189:0/1430968004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T23:52:28.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:28 smithi052 ceph-mon[33526]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:52:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:28 smithi033 ceph-mon[30593]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:52:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:28 smithi189 ceph-mon[34000]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-10T23:52:30.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:30 smithi052 ceph-mon[33526]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:52:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:30 smithi033 ceph-mon[30593]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:52:30.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:30 smithi189 ceph-mon[34000]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-10T23:52:32.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:32 smithi189 ceph-mon[34000]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:52:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:32 smithi052 ceph-mon[33526]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:52:32.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:32 smithi033 ceph-mon[30593]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T23:52:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:34 smithi052 ceph-mon[33526]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:34.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:34 smithi189 ceph-mon[34000]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:34.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:34 smithi033 ceph-mon[30593]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:35.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:52:35.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:35 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:35.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:52:35.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:35 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:35.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T23:52:35.830 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:35 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:36 smithi189 ceph-mon[34000]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:36 smithi189 ceph-mon[34000]: Deploying daemon osd.11 on smithi189 2024-09-10T23:52:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:36 smithi052 ceph-mon[33526]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:36 smithi052 ceph-mon[33526]: Deploying daemon osd.11 on smithi189 2024-09-10T23:52:36.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:36 smithi033 ceph-mon[30593]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T23:52:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:36 smithi033 ceph-mon[30593]: Deploying daemon osd.11 on smithi189 2024-09-10T23:52:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:38 smithi052 ceph-mon[33526]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:38 smithi033 ceph-mon[30593]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:38 smithi189 ceph-mon[34000]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:40 smithi052 ceph-mon[33526]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:40 smithi033 ceph-mon[30593]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:40 smithi189 ceph-mon[34000]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:42 smithi189 ceph-mon[34000]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:42.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:42 smithi052 ceph-mon[33526]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:42.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:42 smithi033 ceph-mon[30593]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:43.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:43.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:43.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:43.734 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:43.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:43.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:44 smithi052 ceph-mon[33526]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:44 smithi033 ceph-mon[30593]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:44.826 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:44 smithi189 ceph-mon[34000]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:46 smithi052 ceph-mon[33526]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:46 smithi033 ceph-mon[30593]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:46.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:46 smithi189 ceph-mon[34000]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:47.338 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.338+0000 7fc08a000640 1 -- 172.21.15.189:0/4058873743 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc08c105680 con 0x7fc0740b5360 2024-09-10T23:52:47.339 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 msgr2=0x7fc0740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 0x7fc0740b7820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc07800bbe0 tx=0x7fc07800b390 comp rx=0 tx=0).stop 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 msgr2=0x7fc08c076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc08000d950 tx=0x7fc08000de10 comp rx=0 tx=0).stop 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 shutdown_connections 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0740b5360 0x7fc0740b7820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:47.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc08c104550 0x7fc08c075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:47.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc08c103b90 0x7fc08c075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:47.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 --2- 172.21.15.189:0/4058873743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc08c102a30 0x7fc08c076cd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:47.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 >> 172.21.15.189:0/4058873743 conn(0x7fc08c0fe320 msgr2=0x7fc08c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:47.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 shutdown_connections 2024-09-10T23:52:47.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:47.340+0000 7fc093e00640 1 -- 172.21.15.189:0/4058873743 wait complete. 2024-09-10T23:52:48.119 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T23:52:48.124 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T23:52:48.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:52:48.513 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:52:48.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:48 smithi033 ceph-mon[30593]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:48 smithi052 ceph-mon[33526]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-mon[34000]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:48.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:49.062 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 23:52:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-10T23:52:48.761+0000 7f096de0e640 -1 osd.11 0 log_to_monitors true 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 -- 172.21.15.33:0/2504833916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c105da0 msgr2=0x7feb5c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 --2- 172.21.15.33:0/2504833916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c105da0 0x7feb5c106220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feb48009930 tx=0x7feb4802a420 comp rx=0 tx=0).stop 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 -- 172.21.15.33:0/2504833916 shutdown_connections 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 --2- 172.21.15.33:0/2504833916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 0x7feb5c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 --2- 172.21.15.33:0/2504833916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c105da0 0x7feb5c106220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 --2- 172.21.15.33:0/2504833916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c104c40 0x7feb5c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 -- 172.21.15.33:0/2504833916 >> 172.21.15.33:0/2504833916 conn(0x7feb5c100510 msgr2=0x7feb5c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 -- 172.21.15.33:0/2504833916 shutdown_connections 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.145+0000 7feb63a00640 1 -- 172.21.15.33:0/2504833916 wait complete. 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.146+0000 7feb63a00640 1 Processor -- start 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.146+0000 7feb63a00640 1 -- start start 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c105da0 0x7feb5c19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 0x7feb5c19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c110750 con 0x7feb5c104c40 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1105d0 con 0x7feb5c106760 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb63a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1108d0 con 0x7feb5c105da0 2024-09-10T23:52:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50716/0 (socket says 172.21.15.33:50716) 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 -- 172.21.15.33:0/1263093131 learned_addr learned my addr 172.21.15.33:0/1263093131 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb5be00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c105da0 0x7feb5c19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 0x7feb5c19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 -- 172.21.15.33:0/1263093131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c105da0 msgr2=0x7feb5c19b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c105da0 0x7feb5c19b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 -- 172.21.15.33:0/1263093131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 msgr2=0x7feb5c19c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 0x7feb5c19c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.147+0000 7feb61000640 1 -- 172.21.15.33:0/1263093131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c19ca50 con 0x7feb5c104c40 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb61000640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb5000ea60 tx=0x7feb5000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000cde0 con 0x7feb5c104c40 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb500035f0 con 0x7feb5c104c40 2024-09-10T23:52:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50010690 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c19cd40 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.148+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c1a3420 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.149+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c105040 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.151+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7feb50004000 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.153+0000 7feb59600640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 0x7feb440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.153+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6809+0+0 (secure 0 0 0) 0x7feb500e5c10 con 0x7feb5c104c40 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.153+0000 7feb5be00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 0x7feb440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.154+0000 7feb5be00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 0x7feb440b7820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb48000c00 tx=0x7feb48005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.155+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feb50056220 con 0x7feb5c104c40 2024-09-10T23:52:49.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.354+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7feb5c02e640 con 0x7feb5c104c40 2024-09-10T23:52:49.356 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:52:49.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.354+0000 7feb59600640 1 -- 172.21.15.33:0/1263093131 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7feb500ad010 con 0x7feb5c104c40 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 msgr2=0x7feb440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 0x7feb440b7820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb48000c00 tx=0x7feb48005720 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 msgr2=0x7feb5c19af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feb5000ea60 tx=0x7feb5000ef20 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 shutdown_connections 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7feb440b5360 0x7feb440b7820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5c106760 0x7feb5c19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb5c105da0 0x7feb5c19b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.356+0000 7feb63a00640 1 --2- 172.21.15.33:0/1263093131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb5c104c40 0x7feb5c19af20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.357+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 >> 172.21.15.33:0/1263093131 conn(0x7feb5c100510 msgr2=0x7feb5c109200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:49.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.357+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 shutdown_connections 2024-09-10T23:52:49.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:49.357+0000 7feb63a00640 1 -- 172.21.15.33:0/1263093131 wait complete. 2024-09-10T23:52:49.539 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:49 smithi033 ceph-mon[30593]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:49.540 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:49 smithi033 ceph-mon[30593]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:49.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:49 smithi052 ceph-mon[33526]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:49.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:49 smithi052 ceph-mon[33526]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:49.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:49 smithi189 ceph-mon[34000]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:49.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:49 smithi189 ceph-mon[34000]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T23:52:50.262 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726012340,"num_in_osds":12,"osd_in_since":1726012345,"num_remapped_pgs":0} 2024-09-10T23:52:50.542 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-10T23:52:50.359+0000 7f0968a00640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T23:52:50.543 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-10T23:52:50.375+0000 7f0963a00640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:50 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1263093131' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:50 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1263093131' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: from='osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T23:52:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:50 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1263093131' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:51.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T23:52:51.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:51 smithi033 ceph-mon[30593]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:52:51.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:51 smithi033 ceph-mon[30593]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:52:51.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:51.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:51.666 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:52:51.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:51 smithi052 ceph-mon[33526]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:52:51.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:51 smithi052 ceph-mon[33526]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:52:51.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:51.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:51.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:51 smithi189 ceph-mon[34000]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T23:52:51.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:51 smithi189 ceph-mon[34000]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T23:52:51.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:51.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:52.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 -- 172.21.15.33:0/923430047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 msgr2=0x7f9758105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:52.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 --2- 172.21.15.33:0/923430047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f9758105060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9748009930 tx=0x7f974802a420 comp rx=0 tx=0).stop 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 -- 172.21.15.33:0/923430047 shutdown_connections 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 --2- 172.21.15.33:0/923430047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758106780 0x7f975810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 --2- 172.21.15.33:0/923430047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758105dc0 0x7f9758106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 --2- 172.21.15.33:0/923430047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f9758105060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 -- 172.21.15.33:0/923430047 >> 172.21.15.33:0/923430047 conn(0x7f9758100510 msgr2=0x7f9758102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 -- 172.21.15.33:0/923430047 shutdown_connections 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.265+0000 7f975ee00640 1 -- 172.21.15.33:0/923430047 wait complete. 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 Processor -- start 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 -- start start 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758105dc0 0x7f975819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 0x7f975819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f97581107e0 con 0x7f9758104c60 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9758110660 con 0x7f9758106780 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.266+0000 7f975ee00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9758110960 con 0x7f9758105dc0 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f974f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758105dc0 0x7f975819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34738/0 (socket says 172.21.15.33:34738) 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 -- 172.21.15.33:0/3552749164 learned_addr learned my addr 172.21.15.33:0/3552749164 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f975ce00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 0x7f975819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 -- 172.21.15.33:0/3552749164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758105dc0 msgr2=0x7f975819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758105dc0 0x7f975819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 -- 172.21.15.33:0/3552749164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 msgr2=0x7f975819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 0x7f975819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 -- 172.21.15.33:0/3552749164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975819cac0 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f975ce00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 0x7f975819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.267+0000 7f9757e00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9748005ab0 tx=0x7f9748003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.268+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974803f070 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.268+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9748031b10 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.268+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748035030 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.268+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975819cd50 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.268+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97581a32c0 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.269+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975810bfe0 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.271+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9748031680 con 0x7f9758104c60 2024-09-10T23:52:52.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.274+0000 7f9755600640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 0x7f973c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:52.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.274+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f97481062f0 con 0x7f9758104c60 2024-09-10T23:52:52.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.274+0000 7f974f400640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 0x7f973c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:52.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.274+0000 7f974f400640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 0x7f973c0b77a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9740009bd0 tx=0x7f9740005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:52.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.277+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f97480cd5b0 con 0x7f9758104c60 2024-09-10T23:52:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.476+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9758063d80 con 0x7f9758104c60 2024-09-10T23:52:52.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: purged_snaps scrub starts 2024-09-10T23:52:52.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: purged_snaps scrub ok 2024-09-10T23:52:52.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:52.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] boot 2024-09-10T23:52:52.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:52:52.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.476+0000 7f9755600640 1 -- 172.21.15.33:0/3552749164 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f97480cceb0 con 0x7f9758104c60 2024-09-10T23:52:52.478 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:52:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 msgr2=0x7f973c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 0x7f973c0b77a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9740009bd0 tx=0x7f9740005f90 comp rx=0 tx=0).stop 2024-09-10T23:52:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 msgr2=0x7f975819af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9748005ab0 tx=0x7f9748003c10 comp rx=0 tx=0).stop 2024-09-10T23:52:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 shutdown_connections 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f973c0b52e0 0x7f973c0b77a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9758106780 0x7f975819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9758105dc0 0x7f975819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 --2- 172.21.15.33:0/3552749164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9758104c60 0x7f975819af90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 >> 172.21.15.33:0/3552749164 conn(0x7f9758100510 msgr2=0x7f97581091b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 shutdown_connections 2024-09-10T23:52:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:52.479+0000 7f975ee00640 1 -- 172.21.15.33:0/3552749164 wait complete. 2024-09-10T23:52:52.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: purged_snaps scrub starts 2024-09-10T23:52:52.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: purged_snaps scrub ok 2024-09-10T23:52:52.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:52.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] boot 2024-09-10T23:52:52.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:52:52.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: purged_snaps scrub starts 2024-09-10T23:52:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: purged_snaps scrub ok 2024-09-10T23:52:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T23:52:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: osd.11 [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] boot 2024-09-10T23:52:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T23:52:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T23:52:53.361 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726012371,"num_in_osds":12,"osd_in_since":1726012345,"num_remapped_pgs":0} 2024-09-10T23:52:53.362 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3552749164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:53.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:52:53.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3552749164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:53.751 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:52:53.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3552749164' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:53.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 -- 172.21.15.33:0/3350981585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3644075540 msgr2=0x7f3644075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 --2- 172.21.15.33:0/3350981585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3644075540 0x7f3644075920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3638009900 tx=0x7f363802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 -- 172.21.15.33:0/3350981585 shutdown_connections 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 --2- 172.21.15.33:0/3350981585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364410f3c0 0x7f36441117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 --2- 172.21.15.33:0/3350981585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364410edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 --2- 172.21.15.33:0/3350981585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3644075540 0x7f3644075920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 -- 172.21.15.33:0/3350981585 >> 172.21.15.33:0/3350981585 conn(0x7f36440fe810 msgr2=0x7f3644100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 -- 172.21.15.33:0/3350981585 shutdown_connections 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.356+0000 7f364c400640 1 -- 172.21.15.33:0/3350981585 wait complete. 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 Processor -- start 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 -- start start 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 0x7f36441a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3644114e60 con 0x7f364410f3c0 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3644114ce0 con 0x7f3644075540 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.358+0000 7f364c400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3644114fe0 con 0x7f3644075f40 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f364a400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 0x7f36441a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52384/0 (socket says 172.21.15.33:52384) 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59100/0 (socket says 172.21.15.33:59100) 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649000640 1 -- 172.21.15.33:0/3581988883 learned_addr learned my addr 172.21.15.33:0/3581988883 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 -- 172.21.15.33:0/3581988883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 msgr2=0x7f364419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 -- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 msgr2=0x7f36441a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 0x7f36441a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 -- 172.21.15.33:0/3581988883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36441a1440 con 0x7f3644075540 2024-09-10T23:52:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f364a400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 0x7f36441a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:52:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.359+0000 7f3649a00640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f363802a910 tx=0x7f3638003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.360+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363803f070 con 0x7f3644075540 2024-09-10T23:52:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.360+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a16d0 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.360+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f363803baf0 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.360+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638035030 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.360+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a7df0 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.361+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644075920 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.363+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f363803b660 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.365+0000 7f3642000640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 0x7f362c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.365+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f3638106670 con 0x7f3644075540 2024-09-10T23:52:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.365+0000 7f3649000640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 0x7f362c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.366+0000 7f3649000640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 0x7f362c0b7820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3644101060 tx=0x7f363000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.367+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36380cd2e0 con 0x7f3644075540 2024-09-10T23:52:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: Detected new or changed devices on smithi189 2024-09-10T23:52:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T23:52:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: Detected new or changed devices on smithi189 2024-09-10T23:52:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T23:52:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:54.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.562+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36441a8080 con 0x7f3644075540 2024-09-10T23:52:54.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.564+0000 7f3642000640 1 -- 172.21.15.33:0/3581988883 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18433 (secure 0 0 0) 0x7f36380d1d10 con 0x7f3644075540 2024-09-10T23:52:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:52:54.566 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":71,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:52:52.354859+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:52:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.566+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 msgr2=0x7f362c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.566+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 0x7f362c0b7820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3644101060 tx=0x7f363000b480 comp rx=0 tx=0).stop 2024-09-10T23:52:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.566+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 msgr2=0x7f364419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.566+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f363802a910 tx=0x7f3638003b90 comp rx=0 tx=0).stop 2024-09-10T23:52:54.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 shutdown_connections 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f362c0b5360 0x7f362c0b7820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f364410f3c0 0x7f36441a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3644075f40 0x7f364419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 --2- 172.21.15.33:0/3581988883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3644075540 0x7f364419b390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 >> 172.21.15.33:0/3581988883 conn(0x7f36440fe810 msgr2=0x7f36441115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 shutdown_connections 2024-09-10T23:52:54.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:54.567+0000 7f364c400640 1 -- 172.21.15.33:0/3581988883 wait complete. 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: Detected new or changed devices on smithi189 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:55.507 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:48:07.161907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:52:55.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T23:52:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:55 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3581988883' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:52:55.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:55 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3581988883' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:52:55.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:55 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3581988883' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:52:55.880 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 -- 172.21.15.33:0/2618039155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854108f90 msgr2=0x7f585410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 --2- 172.21.15.33:0/2618039155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854108f90 0x7f585410f790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f584c009ca0 tx=0x7f584c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 -- 172.21.15.33:0/2618039155 shutdown_connections 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 --2- 172.21.15.33:0/2618039155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854108f90 0x7f585410f790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 --2- 172.21.15.33:0/2618039155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108610 0x7f5854108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 --2- 172.21.15.33:0/2618039155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854102c00 0x7f5854102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 -- 172.21.15.33:0/2618039155 >> 172.21.15.33:0/2618039155 conn(0x7f58540fe6d0 msgr2=0x7f5854100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 -- 172.21.15.33:0/2618039155 shutdown_connections 2024-09-10T23:52:56.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.472+0000 7f585aa00640 1 -- 172.21.15.33:0/2618039155 wait complete. 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.473+0000 7f585aa00640 1 Processor -- start 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.473+0000 7f585aa00640 1 -- start start 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 0x7f585419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108f90 0x7f58541a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5854112b20 con 0x7f5854102c00 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58541129a0 con 0x7f5854108610 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5854112ca0 con 0x7f5854108f90 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f5859600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f5859600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34760/0 (socket says 172.21.15.33:34760) 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f5859600640 1 -- 172.21.15.33:0/2074837647 learned_addr learned my addr 172.21.15.33:0/2074837647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f5858c00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 0x7f585419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.474+0000 7f585a000640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108f90 0x7f58541a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 -- 172.21.15.33:0/2074837647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108f90 msgr2=0x7f58541a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108f90 0x7f58541a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 -- 172.21.15.33:0/2074837647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 msgr2=0x7f585419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 0x7f585419b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 -- 172.21.15.33:0/2074837647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58541a11d0 con 0x7f5854102c00 2024-09-10T23:52:56.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5858c00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 0x7f585419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:52:56.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5859600640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f584800d950 tx=0x7f584800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:56.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848017030 con 0x7f5854102c00 2024-09-10T23:52:56.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58541a14c0 con 0x7f5854102c00 2024-09-10T23:52:56.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5848004020 con 0x7f5854102c00 2024-09-10T23:52:56.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480055d0 con 0x7f5854102c00 2024-09-10T23:52:56.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.475+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58541a7b80 con 0x7f5854102c00 2024-09-10T23:52:56.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.477+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5854102fe0 con 0x7f5854102c00 2024-09-10T23:52:56.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.479+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5848009a30 con 0x7f5854102c00 2024-09-10T23:52:56.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.480+0000 7f5852000640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 0x7f583c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:56.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.480+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f58480e5970 con 0x7f5854102c00 2024-09-10T23:52:56.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.480+0000 7f5858c00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 0x7f583c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:56.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.481+0000 7f5858c00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 0x7f583c0b7850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5840005fd0 tx=0x7f584000b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:56.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.482+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58480acc30 con 0x7f5854102c00 2024-09-10T23:52:56.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.680+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f585402e5c0 con 0x7f5854102c00 2024-09-10T23:52:56.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:56 smithi033 ceph-mon[30593]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:56.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.681+0000 7f5852000640 1 -- 172.21.15.33:0/2074837647 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f58480ac530 con 0x7f5854102c00 2024-09-10T23:52:56.682 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.683+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 msgr2=0x7f583c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.683+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 0x7f583c0b7850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5840005fd0 tx=0x7f584000b5d0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.683+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 msgr2=0x7f585419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.683+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f584800d950 tx=0x7f584800de10 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 shutdown_connections 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f583c0b5390 0x7f583c0b7850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5854108f90 0x7f58541a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5854108610 0x7f585419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 --2- 172.21.15.33:0/2074837647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5854102c00 0x7f585419b120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:56.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 >> 172.21.15.33:0/2074837647 conn(0x7f58540fe6d0 msgr2=0x7f5854106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:56.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 shutdown_connections 2024-09-10T23:52:56.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:52:56.684+0000 7f585aa00640 1 -- 172.21.15.33:0/2074837647 wait complete. 2024-09-10T23:52:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:56 smithi052 ceph-mon[33526]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:56 smithi189 ceph-mon[34000]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:57.654 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:57 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2074837647' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:52:57.657 INFO:tasks.cephadm:Adding mds.a on smithi033 2024-09-10T23:52:57.657 INFO:tasks.cephadm:Adding mds.d on smithi033 2024-09-10T23:52:57.657 INFO:tasks.cephadm:Adding mds.g on smithi033 2024-09-10T23:52:57.657 INFO:tasks.cephadm:Adding mds.j on smithi033 2024-09-10T23:52:57.657 INFO:tasks.cephadm:Adding mds.b on smithi052 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.e on smithi052 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.h on smithi052 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.k on smithi052 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-10T23:52:57.658 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-10T23:52:57.659 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-10T23:52:57.659 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-10T23:52:57.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:57 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2074837647' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:52:57.715 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:57 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2074837647' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T23:52:58.038 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T23:52:58.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:58 smithi189 ceph-mon[34000]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:58.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 -- 172.21.15.189:0/2732227863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50102a20 msgr2=0x7f3e50102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:58.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 --2- 172.21.15.189:0/2732227863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50102a20 0x7f3e50102e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009960 tx=0x7f3e4002a460 comp rx=0 tx=0).stop 2024-09-10T23:52:58.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 -- 172.21.15.189:0/2732227863 shutdown_connections 2024-09-10T23:52:58.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 --2- 172.21.15.189:0/2732227863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50104540 0x7f3e5010aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 --2- 172.21.15.189:0/2732227863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 0x7f3e50104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 --2- 172.21.15.189:0/2732227863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50102a20 0x7f3e50102e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 -- 172.21.15.189:0/2732227863 >> 172.21.15.189:0/2732227863 conn(0x7f3e500fe2f0 msgr2=0x7f3e50100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:58.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 -- 172.21.15.189:0/2732227863 shutdown_connections 2024-09-10T23:52:58.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.629+0000 7f3e55a00640 1 -- 172.21.15.189:0/2732227863 wait complete. 2024-09-10T23:52:58.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 Processor -- start 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 -- start start 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50102a20 0x7f3e50076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 0x7f3e50075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e5a0 con 0x7f3e50102a20 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e420 con 0x7f3e50103b80 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e55a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010e720 con 0x7f3e50104540 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e4f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:58.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e4f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:57276/0 (socket says 172.21.15.189:57276) 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e4e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 0x7f3e50075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.630+0000 7f3e4f400640 1 -- 172.21.15.189:0/903454016 learned_addr learned my addr 172.21.15.189:0/903454016 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4ea00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50102a20 0x7f3e50076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 -- 172.21.15.189:0/903454016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 msgr2=0x7f3e50075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 0x7f3e50075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 -- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50102a20 msgr2=0x7f3e50076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50102a20 0x7f3e50076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 -- 172.21.15.189:0/903454016 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50076340 con 0x7f3e50104540 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e4f400640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800cce0 tx=0x7f3e4800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:58.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800f450 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e4800fa80 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48018ad0 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.631+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e501a2e10 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.632+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501a32c0 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.633+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e50109e40 con 0x7f3e50104540 2024-09-10T23:52:58.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.635+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3e4800f5f0 con 0x7f3e50104540 2024-09-10T23:52:58.638 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.637+0000 7f3e47400640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 0x7f3e340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:52:58.638 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.637+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f3e480e5f30 con 0x7f3e50104540 2024-09-10T23:52:58.638 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.638+0000 7f3e4ea00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 0x7f3e340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:52:58.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.638+0000 7f3e4ea00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 0x7f3e340b7820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e40000c00 tx=0x7f3e40005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:52:58.642 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.641+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e48014030 con 0x7f3e50104540 2024-09-10T23:52:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:58 smithi052 ceph-mon[33526]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:58 smithi033 ceph-mon[30593]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:58.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.840+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f3e50063850 con 0x7f3e340b5360 2024-09-10T23:52:58.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.850+0000 7f3e47400640 1 -- 172.21.15.189:0/903454016 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3e50063850 con 0x7f3e340b5360 2024-09-10T23:52:58.851 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-10T23:52:58.853 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 msgr2=0x7f3e340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:58.853 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 0x7f3e340b7820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e40000c00 tx=0x7f3e40005040 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 msgr2=0x7f3e50075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800cce0 tx=0x7f3e4800a620 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 shutdown_connections 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e340b5360 0x7f3e340b7820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e50104540 0x7f3e50075a80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103b80 0x7f3e50075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 --2- 172.21.15.189:0/903454016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e50102a20 0x7f3e50076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.852+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 >> 172.21.15.189:0/903454016 conn(0x7f3e500fe2f0 msgr2=0x7f3e50107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.853+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 shutdown_connections 2024-09-10T23:52:58.854 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T23:52:58.853+0000 7f3e55a00640 1 -- 172.21.15.189:0/903454016 wait complete. 2024-09-10T23:52:59.773 DEBUG:teuthology.orchestra.run.smithi033:mds.a> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T23:52:59.784 DEBUG:teuthology.orchestra.run.smithi033:mds.d> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T23:52:59.835 DEBUG:teuthology.orchestra.run.smithi033:mds.g> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T23:52:59.886 DEBUG:teuthology.orchestra.run.smithi033:mds.j> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T23:52:59.934 DEBUG:teuthology.orchestra.run.smithi052:mds.b> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T23:52:59.938 DEBUG:teuthology.orchestra.run.smithi052:mds.e> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T23:52:59.984 DEBUG:teuthology.orchestra.run.smithi052:mds.h> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T23:52:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:52:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:52:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T23:52:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:59.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:52:59.997 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:52:59 smithi189 ceph-mon[34000]: Deploying daemon mds.l on smithi189 2024-09-10T23:53:00.031 DEBUG:teuthology.orchestra.run.smithi052:mds.k> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T23:53:00.076 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T23:53:00.080 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:00.121 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:00.122 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:00.122 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:00.122 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:00.122 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:52:59 smithi052 ceph-mon[33526]: Deploying daemon mds.l on smithi189 2024-09-10T23:53:00.126 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T23:53:00.172 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T23:53:00.217 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T23:53:00.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:00.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:00.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:52:59 smithi033 ceph-mon[30593]: Deploying daemon mds.l on smithi189 2024-09-10T23:53:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.182+0000 7fbe8c600640 1 -- 172.21.15.33:0/3469978248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe841087d0 msgr2=0x7fbe84108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.182+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3469978248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe841087d0 0x7fbe84108c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009900 tx=0x7fbe7002a410 comp rx=0 tx=0).stop 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 -- 172.21.15.33:0/3469978248 shutdown_connections 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3469978248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe84109150 0x7fbe8410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3469978248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe841087d0 0x7fbe84108c10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3469978248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe841031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 -- 172.21.15.33:0/3469978248 >> 172.21.15.33:0/3469978248 conn(0x7fbe840fe830 msgr2=0x7fbe84100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 -- 172.21.15.33:0/3469978248 shutdown_connections 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.183+0000 7fbe8c600640 1 -- 172.21.15.33:0/3469978248 wait complete. 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.184+0000 7fbe8c600640 1 Processor -- start 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.184+0000 7fbe8c600640 1 -- start start 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe84199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 0x7fbe841996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 0x7fbe8419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84112cd0 con 0x7fbe84109150 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84112b50 con 0x7fbe84102dc0 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8c600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84112e50 con 0x7fbe841087d0 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 0x7fbe8419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe89c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe84199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe89c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe84199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59680/0 (socket says 172.21.15.33:59680) 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe89c00640 1 -- 172.21.15.33:0/3293689501 learned_addr learned my addr 172.21.15.33:0/3293689501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe89200640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 0x7fbe841996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 -- 172.21.15.33:0/3293689501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 msgr2=0x7fbe841996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 0x7fbe841996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 -- 172.21.15.33:0/3293689501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 msgr2=0x7fbe84199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe84199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe8a600640 1 -- 172.21.15.33:0/3293689501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8419f220 con 0x7fbe84109150 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.185+0000 7fbe89200640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 0x7fbe841996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe8a600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 0x7fbe8419ea50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00d680 tx=0x7fbe7c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c017070 con 0x7fbe84109150 2024-09-10T23:53:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe7c009820 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8419f510 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c004c60 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.186+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841a5da0 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.187+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe84104070 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.189+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fbe7c005220 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.191+0000 7fbe82000640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 0x7fbe6c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.192+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fbe7c0e4fe0 con 0x7fbe84109150 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.192+0000 7fbe89c00640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 0x7fbe6c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.192+0000 7fbe89c00640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 0x7fbe6c0b7820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009fd0 tx=0x7fbe78009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:01.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.195+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbe7c0ac2a0 con 0x7fbe84109150 2024-09-10T23:53:01.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.432+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe8410af30 con 0x7fbe84109150 2024-09-10T23:53:01.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.432+0000 7fbe82000640 1 -- 172.21.15.33:0/3293689501 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fbe7c0abba0 con 0x7fbe84109150 2024-09-10T23:53:01.434 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:01.434 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":1,"btime":"2024-09-10T23:43:51:794915+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T23:53:01.434 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 1 2024-09-10T23:53:01.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 msgr2=0x7fbe6c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:01.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 0x7fbe6c0b7820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009fd0 tx=0x7fbe78009720 comp rx=0 tx=0).stop 2024-09-10T23:53:01.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 msgr2=0x7fbe8419ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:01.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 0x7fbe8419ea50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00d680 tx=0x7fbe7c00db40 comp rx=0 tx=0).stop 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 shutdown_connections 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbe6c0b5360 0x7fbe6c0b7820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe84109150 0x7fbe8419ea50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe841087d0 0x7fbe841996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 --2- 172.21.15.33:0/3293689501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe84102dc0 0x7fbe84199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 >> 172.21.15.33:0/3293689501 conn(0x7fbe840fe830 msgr2=0x7fbe84100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 shutdown_connections 2024-09-10T23:53:01.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:01.435+0000 7fbe8c600640 1 -- 172.21.15.33:0/3293689501 wait complete. 2024-09-10T23:53:01.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:01 smithi189 ceph-mon[34000]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:01.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:01 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3293689501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:02.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:01 smithi033 ceph-mon[30593]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:02.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:01 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3293689501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:02.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:01 smithi052 ceph-mon[33526]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:02.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:01 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3293689501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:02.309 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:01 smithi189 systemd[1]: Starting Ceph mds.l for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:53:02.582 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 podman[63339]: 2024-09-10 23:53:02.21261688 +0000 UTC m=+0.027170371 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:02.582 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 podman[63339]: 2024-09-10 23:53:02.348233221 +0000 UTC m=+0.162786711 container create 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T23:53:03.082 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 podman[63339]: 2024-09-10 23:53:02.62206487 +0000 UTC m=+0.436618360 container init 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:53:03.082 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 podman[63339]: 2024-09-10 23:53:02.628262867 +0000 UTC m=+0.442816357 container start 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T23:53:03.082 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 ceph-mds[63358]: -- 172.21.15.189:0/4115683181 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc3d261860 con 0x55cc3d23f400 2024-09-10T23:53:03.082 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l[63354]: starting mds.l at 2024-09-10T23:53:03.083 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 bash[63339]: 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 2024-09-10T23:53:03.083 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 23:53:02 smithi189 systemd[1]: Started Ceph mds.l for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:03.814 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6832/588474684,v1:172.21.15.189:6833/588474684] up:boot 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: fsmap 1 up:standby 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:03.815 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:03 smithi052 ceph-mon[33526]: Deploying daemon mds.k on smithi052 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6832/588474684,v1:172.21.15.189:6833/588474684] up:boot 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: fsmap 1 up:standby 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:04.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:03 smithi033 ceph-mon[30593]: Deploying daemon mds.k on smithi052 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6832/588474684,v1:172.21.15.189:6833/588474684] up:boot 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: fsmap 1 up:standby 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:04.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:04.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:04.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:04.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:03 smithi189 ceph-mon[34000]: Deploying daemon mds.k on smithi052 2024-09-10T23:53:04.243 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:05.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 -- 172.21.15.33:0/2623804748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 msgr2=0x7f6ed41117a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:05.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 --2- 172.21.15.33:0/2623804748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41117a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009ca0 tx=0x7f6ecc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 -- 172.21.15.33:0/2623804748 shutdown_connections 2024-09-10T23:53:05.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 --2- 172.21.15.33:0/2623804748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41117a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 --2- 172.21.15.33:0/2623804748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed4075de0 0x7f6ed410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 --2- 172.21.15.33:0/2623804748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed40754c0 0x7f6ed40758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 -- 172.21.15.33:0/2623804748 >> 172.21.15.33:0/2623804748 conn(0x7f6ed40fe810 msgr2=0x7f6ed4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 -- 172.21.15.33:0/2623804748 shutdown_connections 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.269+0000 7f6edc600640 1 -- 172.21.15.33:0/2623804748 wait complete. 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 Processor -- start 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 -- start start 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed40754c0 0x7f6ed419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed4075de0 0x7f6ed419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:05.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4114e80 con 0x7f6ed410f3b0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4114d00 con 0x7f6ed4075de0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.270+0000 7f6edc600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4115000 con 0x7f6ed40754c0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36600/0 (socket says 172.21.15.33:36600) 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6ed9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed4075de0 0x7f6ed419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 -- 172.21.15.33:0/1503583685 learned_addr learned my addr 172.21.15.33:0/1503583685 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6ed9c00640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed40754c0 0x7f6ed419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 -- 172.21.15.33:0/1503583685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed40754c0 msgr2=0x7f6ed419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed40754c0 0x7f6ed419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 -- 172.21.15.33:0/1503583685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed4075de0 msgr2=0x7f6ed419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed4075de0 0x7f6ed419b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.271+0000 7f6eda600640 1 -- 172.21.15.33:0/1503583685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed41a1500 con 0x7f6ed410f3b0 2024-09-10T23:53:05.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6eda600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc031040 tx=0x7f6ecc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc004040 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ecc004670 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed41a1790 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc030ba0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.272+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41a7eb0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.273+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed40758a0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.275+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f6ecc0041e0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.277+0000 7f6ed2000640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 0x7f6ebc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:05.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.277+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f6ecc106930 con 0x7f6ed410f3b0 2024-09-10T23:53:05.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.277+0000 7f6ed9c00640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 0x7f6ebc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:05.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.278+0000 7f6ed9c00640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 0x7f6ebc0b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8005d00 tx=0x7f6ec800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:05.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.281+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ecc0cdbf0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.517+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ed402e5c0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.517+0000 7f6ed2000640 1 -- 172.21.15.33:0/1503583685 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f6ecc0d63a0 con 0x7f6ed410f3b0 2024-09-10T23:53:05.519 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-09-10T23:53:05.519 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:05.519 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"btime":"2024-09-10T23:53:02:674703+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:53:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 msgr2=0x7f6ebc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 0x7f6ebc0b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8005d00 tx=0x7f6ec800b410 comp rx=0 tx=0).stop 2024-09-10T23:53:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 msgr2=0x7f6ed41a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:05.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc031040 tx=0x7f6ecc032bc0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 shutdown_connections 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6ebc0b52e0 0x7f6ebc0b77a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed410f3b0 0x7f6ed41a0d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ed4075de0 0x7f6ed419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 --2- 172.21.15.33:0/1503583685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed40754c0 0x7f6ed419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.520+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 >> 172.21.15.33:0/1503583685 conn(0x7f6ed40fe810 msgr2=0x7f6ed40ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.521+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 shutdown_connections 2024-09-10T23:53:05.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:05.521+0000 7f6edc600640 1 -- 172.21.15.33:0/1503583685 wait complete. 2024-09-10T23:53:05.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:05 smithi052 ceph-mon[33526]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:05.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1503583685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:05 smithi189 ceph-mon[34000]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1503583685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:06.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:05 smithi033 ceph-mon[30593]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:06.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1503583685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:06.285 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 podman[63732]: 2024-09-10 23:53:06.005254338 +0000 UTC m=+0.172434540 container create b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:53:06.285 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 podman[63732]: 2024-09-10 23:53:06.284084442 +0000 UTC m=+0.451264674 container init b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T23:53:06.705 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 podman[63732]: 2024-09-10 23:53:06.290745361 +0000 UTC m=+0.457925571 container start b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:53:06.706 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 ceph-mds[63758]: -- 172.21.15.52:0/496377315 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e85073860 con 0x559e85050800 2024-09-10T23:53:06.706 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: starting mds.k at 2024-09-10T23:53:06.706 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 bash[63732]: b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd 2024-09-10T23:53:06.706 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 23:53:06 smithi052 systemd[1]: Started Ceph mds.k for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:07.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: Deploying daemon mds.j on smithi033 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6832/1634418949,v1:172.21.15.52:6833/1634418949] up:boot 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: fsmap 2 up:standby 2024-09-10T23:53:07.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:07 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:07.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: Deploying daemon mds.j on smithi033 2024-09-10T23:53:07.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6832/1634418949,v1:172.21.15.52:6833/1634418949] up:boot 2024-09-10T23:53:07.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: fsmap 2 up:standby 2024-09-10T23:53:07.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:07 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: Deploying daemon mds.j on smithi033 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6832/1634418949,v1:172.21.15.52:6833/1634418949] up:boot 2024-09-10T23:53:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: fsmap 2 up:standby 2024-09-10T23:53:07.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:07 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T23:53:08.408 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:08 smithi033 ceph-mon[30593]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:08.818 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:08 smithi189 ceph-mon[34000]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:08 smithi052 ceph-mon[33526]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:09.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 -- 172.21.15.33:0/3641305242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b681087b0 msgr2=0x7f2b68108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 --2- 172.21.15.33:0/3641305242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b681087b0 0x7f2b68108bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009900 tx=0x7f2b5402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 -- 172.21.15.33:0/3641305242 shutdown_connections 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 --2- 172.21.15.33:0/3641305242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b68109130 0x7f2b6810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 --2- 172.21.15.33:0/3641305242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b681087b0 0x7f2b68108bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 --2- 172.21.15.33:0/3641305242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68102da0 0x7f2b68103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 -- 172.21.15.33:0/3641305242 >> 172.21.15.33:0/3641305242 conn(0x7f2b680fe810 msgr2=0x7f2b68100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 -- 172.21.15.33:0/3641305242 shutdown_connections 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.417+0000 7f2b70400640 1 -- 172.21.15.33:0/3641305242 wait complete. 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.418+0000 7f2b70400640 1 Processor -- start 2024-09-10T23:53:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.418+0000 7f2b70400640 1 -- start start 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 0x7f2b6819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68109130 0x7f2b681a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680769a0 con 0x7f2b68102da0 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b68076820 con 0x7f2b681087b0 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b70400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b68076b20 con 0x7f2b68109130 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36618/0 (socket says 172.21.15.33:36618) 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6da00640 1 -- 172.21.15.33:0/3274074132 learned_addr learned my addr 172.21.15.33:0/3274074132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6d000640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 0x7f2b6819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6e400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68109130 0x7f2b681a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.419+0000 7f2b6da00640 1 -- 172.21.15.33:0/3274074132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68109130 msgr2=0x7f2b681a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6da00640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68109130 0x7f2b681a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6da00640 1 -- 172.21.15.33:0/3274074132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 msgr2=0x7f2b6819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6da00640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 0x7f2b6819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6da00640 1 -- 172.21.15.33:0/3274074132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b681a1470 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6d000640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 0x7f2b6819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b6da00640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00d770 tx=0x7f2b5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c017070 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b5c0054b0 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b681a1760 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c004c60 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.420+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b681a7e20 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.421+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b68103180 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.424+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f2b5c004e00 con 0x7f2b68102da0 2024-09-10T23:53:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.425+0000 7f2b66000640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 0x7f2b500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:09.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.425+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f2b5c0e55d0 con 0x7f2b68102da0 2024-09-10T23:53:09.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.426+0000 7f2b6d000640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 0x7f2b500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:09.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.426+0000 7f2b6d000640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 0x7f2b500b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b540057c0 tx=0x7f2b540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:09.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.427+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b5c0ac240 con 0x7f2b68102da0 2024-09-10T23:53:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.671+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b6819c4f0 con 0x7f2b68102da0 2024-09-10T23:53:09.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.672+0000 7f2b66000640 1 -- 172.21.15.33:0/3274074132 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f2b5c0b0c70 con 0x7f2b68102da0 2024-09-10T23:53:09.673 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:09.673 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"btime":"2024-09-10T23:53:06:819135+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:53:09.674 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2024-09-10T23:53:09.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 msgr2=0x7f2b500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:09.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 0x7f2b500b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b540057c0 tx=0x7f2b540058d0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 msgr2=0x7f2b6819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:09.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00d770 tx=0x7f2b5c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:53:09.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 shutdown_connections 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2b500b52e0 0x7f2b500b77a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b68109130 0x7f2b681a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b681087b0 0x7f2b6819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 --2- 172.21.15.33:0/3274074132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b68102da0 0x7f2b6819b3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 >> 172.21.15.33:0/3274074132 conn(0x7f2b680fe810 msgr2=0x7f2b681065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 shutdown_connections 2024-09-10T23:53:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:09.676+0000 7f2b70400640 1 -- 172.21.15.33:0/3274074132 wait complete. 2024-09-10T23:53:10.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:10 smithi033 ceph-mon[30593]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:10.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3274074132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:10 smithi189 ceph-mon[34000]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3274074132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:10 smithi052 ceph-mon[33526]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3274074132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.33:6834/1700135488,v1:172.21.15.33:6835/1700135488] up:boot 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: fsmap 3 up:standby 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:11.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: Deploying daemon mds.d on smithi033 2024-09-10T23:53:11.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:11 smithi033 ceph-mon[30593]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.33:6834/1700135488,v1:172.21.15.33:6835/1700135488] up:boot 2024-09-10T23:53:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: fsmap 3 up:standby 2024-09-10T23:53:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:53:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: Deploying daemon mds.d on smithi033 2024-09-10T23:53:11.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:11 smithi189 ceph-mon[34000]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:11.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.33:6834/1700135488,v1:172.21.15.33:6835/1700135488] up:boot 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: fsmap 3 up:standby 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: Deploying daemon mds.d on smithi033 2024-09-10T23:53:11.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:11 smithi052 ceph-mon[33526]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:13.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:13.776 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:13 smithi033 systemd[1]: Starting Ceph mds.d for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:53:14.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:13 smithi189 ceph-mon[34000]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:14.135 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:13 smithi033 ceph-mon[30593]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:14.136 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:13 smithi033 podman[72341]: 2024-09-10 23:53:13.72129644 +0000 UTC m=+0.030869257 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:14.136 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:13 smithi033 podman[72341]: 2024-09-10 23:53:13.856991659 +0000 UTC m=+0.166564475 container create 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T23:53:14.136 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 podman[72341]: 2024-09-10 23:53:14.135153127 +0000 UTC m=+0.444725943 container init 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:53:14.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:13 smithi052 ceph-mon[33526]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:14.339 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:14.479 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 podman[72341]: 2024-09-10 23:53:14.141869992 +0000 UTC m=+0.451442808 container start 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T23:53:14.480 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 ceph-mds[72372]: -- 172.21.15.33:0/4013895099 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ad94a3860 con 0x563ad9481000 2024-09-10T23:53:14.480 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d[72368]: starting mds.d at 2024-09-10T23:53:14.480 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 bash[72341]: 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 2024-09-10T23:53:14.480 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 10 23:53:14 smithi033 systemd[1]: Started Ceph mds.d for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:15.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 -- 172.21.15.33:0/1767262064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 msgr2=0x7f8b8c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 --2- 172.21.15.33:0/1767262064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c108bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009900 tx=0x7f8b7802a410 comp rx=0 tx=0).stop 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 -- 172.21.15.33:0/1767262064 shutdown_connections 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 --2- 172.21.15.33:0/1767262064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 0x7f8b8c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 --2- 172.21.15.33:0/1767262064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c108bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 --2- 172.21.15.33:0/1767262064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 -- 172.21.15.33:0/1767262064 >> 172.21.15.33:0/1767262064 conn(0x7f8b8c0fe810 msgr2=0x7f8b8c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 -- 172.21.15.33:0/1767262064 shutdown_connections 2024-09-10T23:53:15.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.105+0000 7f8b91400640 1 -- 172.21.15.33:0/1767262064 wait complete. 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.106+0000 7f8b91400640 1 Processor -- start 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.106+0000 7f8b91400640 1 -- start start 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.106+0000 7f8b91400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b91400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b91400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 0x7f8b8c1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b91400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c112c30 con 0x7f8b8c1087b0 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b91400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c112ab0 con 0x7f8b8c102da0 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b91400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c112db0 con 0x7f8b8c109130 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b89e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:44838/0 (socket says 172.21.15.33:44838) 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 -- 172.21.15.33:0/964027408 learned_addr learned my addr 172.21.15.33:0/964027408 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8b200640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 0x7f8b8c1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 -- 172.21.15.33:0/964027408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 msgr2=0x7f8b8c1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 0x7f8b8c1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 -- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 msgr2=0x7f8b8c19b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c19b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.107+0000 7f8b8a800640 1 -- 172.21.15.33:0/964027408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c1a1450 con 0x7f8b8c102da0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b8a800640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00d950 tx=0x7f8b7c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c017070 con 0x7f8b8c102da0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b7c009c30 con 0x7f8b8c102da0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00f620 con 0x7f8b8c102da0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c1a1740 con 0x7f8b8c102da0 2024-09-10T23:53:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.108+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c1a7fd0 con 0x7f8b8c102da0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.109+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c103180 con 0x7f8b8c102da0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.111+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8b7c010460 con 0x7f8b8c102da0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.113+0000 7f8b83400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 0x7f8b700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.113+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f8b7c0e52e0 con 0x7f8b8c102da0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.113+0000 7f8b89e00640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 0x7f8b700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.114+0000 7f8b89e00640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 0x7f8b700b7820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b780057c0 tx=0x7f8b780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.117+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b7c009de0 con 0x7f8b8c102da0 2024-09-10T23:53:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.354+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b8c10f320 con 0x7f8b8c102da0 2024-09-10T23:53:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.354+0000 7f8b83400640 1 -- 172.21.15.33:0/964027408 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f8b7c0abf50 con 0x7f8b8c102da0 2024-09-10T23:53:15.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:15.356 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"btime":"2024-09-10T23:53:14:820556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:53:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 5 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 msgr2=0x7f8b700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 0x7f8b700b7820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b780057c0 tx=0x7f8b780058d0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 msgr2=0x7f8b8c19b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00d950 tx=0x7f8b7c00de10 comp rx=0 tx=0).stop 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 shutdown_connections 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b700b5360 0x7f8b700b7820 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b8c109130 0x7f8b8c1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1087b0 0x7f8b8c19b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 --2- 172.21.15.33:0/964027408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b8c102da0 0x7f8b8c19b3a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 >> 172.21.15.33:0/964027408 conn(0x7f8b8c0fe810 msgr2=0x7f8b8c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 shutdown_connections 2024-09-10T23:53:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:15.357+0000 7f8b91400640 1 -- 172.21.15.33:0/964027408 wait complete. 2024-09-10T23:53:15.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: Deploying daemon mds.e on smithi052 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.33:6836/3156147972,v1:172.21.15.33:6837/3156147972] up:boot 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: fsmap 4 up:standby 2024-09-10T23:53:15.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:53:15.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: Deploying daemon mds.e on smithi052 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.33:6836/3156147972,v1:172.21.15.33:6837/3156147972] up:boot 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: fsmap 4 up:standby 2024-09-10T23:53:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:53:15.758 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.758 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: Deploying daemon mds.e on smithi052 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.33:6836/3156147972,v1:172.21.15.33:6837/3156147972] up:boot 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: fsmap 4 up:standby 2024-09-10T23:53:15.759 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T23:53:16.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:16 smithi033 ceph-mon[30593]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:16 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/964027408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:16.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:16 smithi189 ceph-mon[34000]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:16.649 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:16 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/964027408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:16 smithi052 ceph-mon[33526]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:16 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/964027408' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:17.447 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 systemd[1]: Starting Ceph mds.e for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:53:17.706 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 podman[64047]: 2024-09-10 23:53:17.350832629 +0000 UTC m=+0.027793749 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:17.706 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 podman[64047]: 2024-09-10 23:53:17.494736148 +0000 UTC m=+0.171697267 container create 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T23:53:18.201 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 podman[64047]: 2024-09-10 23:53:17.778220404 +0000 UTC m=+0.455181524 container init 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 podman[64047]: 2024-09-10 23:53:17.784809666 +0000 UTC m=+0.461770796 container start 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 ceph-mds[64065]: -- 172.21.15.52:0/161946190 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b01481bc20 con 0x55b0147f8800 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: starting mds.e at 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 bash[64047]: 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e 2024-09-10T23:53:18.206 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 23:53:17 smithi052 systemd[1]: Started Ceph mds.e for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:18.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:18.598 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:18.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:18.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 -- 172.21.15.33:0/4035440995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc104e10 msgr2=0x7fb9fc1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 --2- 172.21.15.33:0/4035440995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc104e10 0x7fb9fc1051f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009900 tx=0x7fb9ec02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 -- 172.21.15.33:0/4035440995 shutdown_connections 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 --2- 172.21.15.33:0/4035440995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 0x7fb9fc1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 --2- 172.21.15.33:0/4035440995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc10a820 0x7fb9fc10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 --2- 172.21.15.33:0/4035440995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc104e10 0x7fb9fc1051f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 -- 172.21.15.33:0/4035440995 >> 172.21.15.33:0/4035440995 conn(0x7fb9fc100840 msgr2=0x7fb9fc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 -- 172.21.15.33:0/4035440995 shutdown_connections 2024-09-10T23:53:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.260+0000 7fba01a00640 1 -- 172.21.15.33:0/4035440995 wait complete. 2024-09-10T23:53:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.261+0000 7fba01a00640 1 Processor -- start 2024-09-10T23:53:19.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.261+0000 7fba01a00640 1 -- start start 2024-09-10T23:53:19.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 0x7fb9fc19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:19.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:19.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 0x7fb9fc1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:19.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc114d20 con 0x7fb9fc10a820 2024-09-10T23:53:19.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc114ba0 con 0x7fb9fc104e10 2024-09-10T23:53:19.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc114ea0 con 0x7fb9fc10b1a0 2024-09-10T23:53:19.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58992/0 (socket says 172.21.15.33:58992) 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 -- 172.21.15.33:0/4062911584 learned_addr learned my addr 172.21.15.33:0/4062911584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fbe00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 0x7fb9fc19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fba01000640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 0x7fb9fc1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 -- 172.21.15.33:0/4062911584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 msgr2=0x7fb9fc1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 0x7fb9fc1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 -- 172.21.15.33:0/4062911584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 msgr2=0x7fb9fc19b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.262+0000 7fb9fb400640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 0x7fb9fc19b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9fb400640 1 -- 172.21.15.33:0/4062911584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1a11a0 con 0x7fb9fc10a820 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9fbe00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 0x7fb9fc19b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9fb400640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c920 tx=0x7fb9e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8007c70 con 0x7fb9fc10a820 2024-09-10T23:53:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9e8007e10 con 0x7fb9fc10a820 2024-09-10T23:53:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8018710 con 0x7fb9fc10a820 2024-09-10T23:53:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc1a1490 con 0x7fb9fc10a820 2024-09-10T23:53:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.263+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc1a7b50 con 0x7fb9fc10a820 2024-09-10T23:53:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.265+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc1051f0 con 0x7fb9fc10a820 2024-09-10T23:53:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.268+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb9e800f450 con 0x7fb9fc10a820 2024-09-10T23:53:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.269+0000 7fb9f8c00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 0x7fb9e00b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.269+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fb9e80e5d00 con 0x7fb9fc10a820 2024-09-10T23:53:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.269+0000 7fb9fbe00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 0x7fb9e00b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.270+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb9e8014030 con 0x7fb9fc10a820 2024-09-10T23:53:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.270+0000 7fb9fbe00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 0x7fb9e00b7850 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec02a910 tx=0x7fb9ec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:19.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:19 smithi033 ceph-mon[30593]: Deploying daemon mds.f on smithi189 2024-09-10T23:53:19.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:19 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:boot 2024-09-10T23:53:19.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:19 smithi033 ceph-mon[30593]: fsmap 5 up:standby 2024-09-10T23:53:19.509 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:53:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.508+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9fc19c220 con 0x7fb9fc10a820 2024-09-10T23:53:19.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.508+0000 7fb9f8c00640 1 -- 172.21.15.33:0/4062911584 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fb9fc19c220 con 0x7fb9fc10a820 2024-09-10T23:53:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:19.510 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"btime":"2024-09-10T23:53:18:344790+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:53:19.511 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-09-10T23:53:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 msgr2=0x7fb9e00b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 0x7fb9e00b7850 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec02a910 tx=0x7fb9ec005fd0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 msgr2=0x7fb9fc19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c920 tx=0x7fb9e800cde0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 shutdown_connections 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb9e00b5390 0x7fb9e00b7850 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb9fc10b1a0 0x7fb9fc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9fc10a820 0x7fb9fc19b630 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 --2- 172.21.15.33:0/4062911584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9fc104e10 0x7fb9fc19b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:19.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 >> 172.21.15.33:0/4062911584 conn(0x7fb9fc100840 msgr2=0x7fb9fc106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:19.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 shutdown_connections 2024-09-10T23:53:19.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:19.511+0000 7fba01a00640 1 -- 172.21.15.33:0/4062911584 wait complete. 2024-09-10T23:53:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:19 smithi189 ceph-mon[34000]: Deploying daemon mds.f on smithi189 2024-09-10T23:53:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:19 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:boot 2024-09-10T23:53:19.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:19 smithi189 ceph-mon[34000]: fsmap 5 up:standby 2024-09-10T23:53:19.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:53:19.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:19 smithi052 ceph-mon[33526]: Deploying daemon mds.f on smithi189 2024-09-10T23:53:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:19 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:boot 2024-09-10T23:53:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:19 smithi052 ceph-mon[33526]: fsmap 5 up:standby 2024-09-10T23:53:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T23:53:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:20 smithi189 ceph-mon[34000]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:20 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4062911584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:20 smithi052 ceph-mon[33526]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:20 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4062911584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:20 smithi033 ceph-mon[30593]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:20 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4062911584' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:21.291 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 podman[63656]: 2024-09-10 23:53:21.012246327 +0000 UTC m=+0.155406505 container create adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:53:21.291 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 podman[63656]: 2024-09-10 23:53:21.290336433 +0000 UTC m=+0.433496609 container init adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T23:53:21.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 podman[63656]: 2024-09-10 23:53:21.299676835 +0000 UTC m=+0.442837010 container start adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:53:21.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 ceph-mds[63682]: -- 172.21.15.189:0/1742099515 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576518d7860 con 0x5576518b4800 2024-09-10T23:53:21.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: starting mds.f at 2024-09-10T23:53:21.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 bash[63656]: adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e 2024-09-10T23:53:21.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 23:53:21 smithi189 systemd[1]: Started Ceph mds.f for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:22.389 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6834/3755759093,v1:172.21.15.189:6835/3755759093] up:boot 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: fsmap 6 up:standby 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:22.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:22.401 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6834/3755759093,v1:172.21.15.189:6835/3755759093] up:boot 2024-09-10T23:53:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: fsmap 6 up:standby 2024-09-10T23:53:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:53:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:22.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:22.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:22.774 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:22.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6834/3755759093,v1:172.21.15.189:6835/3755759093] up:boot 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: fsmap 6 up:standby 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 -- 172.21.15.33:0/3248320996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc10f220 msgr2=0x7f3fcc111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 --2- 172.21.15.33:0/3248320996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc10f220 0x7f3fcc111610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009ca0 tx=0x7f3fc402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 -- 172.21.15.33:0/3248320996 shutdown_connections 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 --2- 172.21.15.33:0/3248320996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc10f220 0x7f3fcc111610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 --2- 172.21.15.33:0/3248320996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc075f40 0x7f3fcc10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 --2- 172.21.15.33:0/3248320996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 -- 172.21.15.33:0/3248320996 >> 172.21.15.33:0/3248320996 conn(0x7f3fcc0fe6d0 msgr2=0x7f3fcc100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 -- 172.21.15.33:0/3248320996 shutdown_connections 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.385+0000 7f3fd1800640 1 -- 172.21.15.33:0/3248320996 wait complete. 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 Processor -- start 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 -- start start 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc075f40 0x7f3fcc19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 0x7f3fcc1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc114cd0 con 0x7f3fcc075540 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc114b50 con 0x7f3fcc10f220 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.386+0000 7f3fd1800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc114e50 con 0x7f3fcc075f40 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45772/0 (socket says 172.21.15.33:45772) 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 -- 172.21.15.33:0/10153497 learned_addr learned my addr 172.21.15.33:0/10153497 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fd0e00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 0x7f3fcc1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcb400640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc075f40 0x7f3fcc19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 -- 172.21.15.33:0/10153497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc075f40 msgr2=0x7f3fcc19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc075f40 0x7f3fcc19b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 -- 172.21.15.33:0/10153497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 msgr2=0x7f3fcc1a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 0x7f3fcc1a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 -- 172.21.15.33:0/10153497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc1a11f0 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fd0e00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 0x7f3fcc1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.387+0000 7f3fcbe00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9f0 tx=0x7f3fbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.388+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00cd80 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.388+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fbc0108c0 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.388+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0187c0 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.388+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc1a14e0 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.388+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc1a7ba0 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.389+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc075920 con 0x7f3fcc075540 2024-09-10T23:53:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.391+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3fbc010430 con 0x7f3fcc075540 2024-09-10T23:53:23.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.393+0000 7f3fc8c00640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 0x7f3fb00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:23.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.393+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f3fbc0e5ab0 con 0x7f3fcc075540 2024-09-10T23:53:23.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.393+0000 7f3fcb400640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 0x7f3fb00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:23.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.394+0000 7f3fcb400640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 0x7f3fb00b78d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc100e70 tx=0x7f3fb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:23.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.397+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3fbc0ac720 con 0x7f3fcc075540 2024-09-10T23:53:23.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:23 smithi033 ceph-mon[30593]: Deploying daemon mds.c on smithi189 2024-09-10T23:53:23.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.630+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fcc1a7f30 con 0x7f3fcc075540 2024-09-10T23:53:23.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.630+0000 7f3fc8c00640 1 -- 172.21.15.33:0/10153497 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7f3fbc0a6e20 con 0x7f3fcc075540 2024-09-10T23:53:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:23.632 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"btime":"2024-09-10T23:53:21:363219+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:53:23.632 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 msgr2=0x7f3fb00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 0x7f3fb00b78d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc100e70 tx=0x7f3fb8005f90 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 msgr2=0x7f3fcc19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9f0 tx=0x7f3fbc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 shutdown_connections 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3fb00b5410 0x7f3fb00b78d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fcc10f220 0x7f3fcc1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fcc075f40 0x7f3fcc19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 --2- 172.21.15.33:0/10153497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc075540 0x7f3fcc19b140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:23.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 >> 172.21.15.33:0/10153497 conn(0x7f3fcc0fe6d0 msgr2=0x7f3fcc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:23.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 shutdown_connections 2024-09-10T23:53:23.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:23.633+0000 7f3fd1800640 1 -- 172.21.15.33:0/10153497 wait complete. 2024-09-10T23:53:23.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:23 smithi189 ceph-mon[34000]: Deploying daemon mds.c on smithi189 2024-09-10T23:53:23.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:23 smithi052 ceph-mon[33526]: Deploying daemon mds.c on smithi189 2024-09-10T23:53:24.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:24 smithi189 ceph-mon[34000]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:24.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:24 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/10153497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:24 smithi052 ceph-mon[33526]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:24.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:24 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/10153497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:24 smithi033 ceph-mon[30593]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:24 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/10153497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:24.832 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:24 smithi189 podman[63964]: 2024-09-10 23:53:24.590578372 +0000 UTC m=+0.166718748 container create 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:24 smithi189 podman[63964]: 2024-09-10 23:53:24.873637126 +0000 UTC m=+0.449777502 container init 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:24 smithi189 podman[63964]: 2024-09-10 23:53:24.880100289 +0000 UTC m=+0.456240666 container start 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:24 smithi189 ceph-mds[63984]: -- 172.21.15.189:0/2981443685 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563608e35860 con 0x563608e13400 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: starting mds.c at 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:25 smithi189 bash[63964]: 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b 2024-09-10T23:53:25.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 23:53:25 smithi189 systemd[1]: Started Ceph mds.c for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:26.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:26.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: Deploying daemon mds.h on smithi052 2024-09-10T23:53:26.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6836/3553481852,v1:172.21.15.189:6837/3553481852] up:boot 2024-09-10T23:53:26.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: fsmap 7 up:standby 2024-09-10T23:53:26.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:26 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:26.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:26.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: Deploying daemon mds.h on smithi052 2024-09-10T23:53:26.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6836/3553481852,v1:172.21.15.189:6837/3553481852] up:boot 2024-09-10T23:53:26.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: fsmap 7 up:standby 2024-09-10T23:53:26.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:26 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: Deploying daemon mds.h on smithi052 2024-09-10T23:53:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6836/3553481852,v1:172.21.15.189:6837/3553481852] up:boot 2024-09-10T23:53:26.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: fsmap 7 up:standby 2024-09-10T23:53:26.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:26 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T23:53:26.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:27.001 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:27.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 -- 172.21.15.33:0/3698284645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810a9b0 msgr2=0x7faf9810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:27.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3698284645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810a9b0 0x7faf9810adf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf88009900 tx=0x7faf8802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 -- 172.21.15.33:0/3698284645 shutdown_connections 2024-09-10T23:53:27.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3698284645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810b330 0x7faf98111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3698284645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810a9b0 0x7faf9810adf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3698284645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf98105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.753+0000 7faf9ea00640 1 -- 172.21.15.33:0/3698284645 >> 172.21.15.33:0/3698284645 conn(0x7faf98100a50 msgr2=0x7faf98102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.754+0000 7faf9ea00640 1 -- 172.21.15.33:0/3698284645 shutdown_connections 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.754+0000 7faf9ea00640 1 -- 172.21.15.33:0/3698284645 wait complete. 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.754+0000 7faf9ea00640 1 Processor -- start 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 -- start start 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf9819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810a9b0 0x7faf9819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:27.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faf98114de0 con 0x7faf9810b330 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf98114c60 con 0x7faf9810a9b0 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faf98114f60 con 0x7faf98104fa0 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45794/0 (socket says 172.21.15.33:45794) 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf9ca00640 1 -- 172.21.15.33:0/3670750722 learned_addr learned my addr 172.21.15.33:0/3670750722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf97400640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810a9b0 0x7faf9819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.755+0000 7faf97e00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf9819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 -- 172.21.15.33:0/3670750722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 msgr2=0x7faf9819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf9819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 -- 172.21.15.33:0/3670750722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810a9b0 msgr2=0x7faf9819b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810a9b0 0x7faf9819b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 -- 172.21.15.33:0/3670750722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf981a13e0 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf97e00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf9819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ca00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf9000eb10 tx=0x7faf9000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90004b20 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf981a16d0 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf90004cc0 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90010690 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.756+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf981a7d90 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.758+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf98105380 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.761+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7faf90005020 con 0x7faf9810b330 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.763+0000 7faf94c00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 0x7faf7c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.763+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7faf900e5e40 con 0x7faf9810b330 2024-09-10T23:53:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.763+0000 7faf97e00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 0x7faf7c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.764+0000 7faf97e00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 0x7faf7c0b77a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf8000abe0 tx=0x7faf8000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.767+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf900ad100 con 0x7faf9810b330 2024-09-10T23:53:28.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:27.999+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf9802e5c0 con 0x7faf9810b330 2024-09-10T23:53:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.000+0000 7faf94c00640 1 -- 172.21.15.33:0/3670750722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7faf900aca00 con 0x7faf9810b330 2024-09-10T23:53:28.002 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:28.002 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"btime":"2024-09-10T23:53:25:379074+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T23:53:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.002+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 msgr2=0x7faf7c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.002+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 0x7faf7c0b77a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf8000abe0 tx=0x7faf8000a5c0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.002+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 msgr2=0x7faf981a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.002+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf9000eb10 tx=0x7faf9000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 shutdown_connections 2024-09-10T23:53:28.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faf7c0b52e0 0x7faf7c0b77a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf9810b330 0x7faf981a0c10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9810a9b0 0x7faf9819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 --2- 172.21.15.33:0/3670750722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faf98104fa0 0x7faf9819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 >> 172.21.15.33:0/3670750722 conn(0x7faf98100a50 msgr2=0x7faf98102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 shutdown_connections 2024-09-10T23:53:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:28.003+0000 7faf9ea00640 1 -- 172.21.15.33:0/3670750722 wait complete. 2024-09-10T23:53:28.031 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:27 smithi052 systemd[1]: Starting Ceph mds.h for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:53:28.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:28 smithi033 ceph-mon[30593]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:28.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:28 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3670750722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:28.328 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:28 smithi052 ceph-mon[33526]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:28.328 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:28 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3670750722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:28.329 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 podman[64340]: 2024-09-10 23:53:27.934596637 +0000 UTC m=+0.027942190 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:28.329 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 podman[64340]: 2024-09-10 23:53:28.058219958 +0000 UTC m=+0.151565508 container create ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T23:53:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:28 smithi189 ceph-mon[34000]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:28 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3670750722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:28.705 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 podman[64340]: 2024-09-10 23:53:28.444278633 +0000 UTC m=+0.537624186 container init ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:53:28.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 podman[64340]: 2024-09-10 23:53:28.452528476 +0000 UTC m=+0.545874030 container start ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:53:28.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 ceph-mds[64360]: -- 172.21.15.52:0/3677726613 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556bc53f860 con 0x5556bc51c800 2024-09-10T23:53:28.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: starting mds.h at 2024-09-10T23:53:28.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 bash[64340]: ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 2024-09-10T23:53:28.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 23:53:28 smithi052 systemd[1]: Started Ceph mds.h for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:29.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:29.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:29.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:29.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: Deploying daemon mds.i on smithi189 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:boot 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: fsmap 8 up:standby 2024-09-10T23:53:29.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: Deploying daemon mds.i on smithi189 2024-09-10T23:53:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:30.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:boot 2024-09-10T23:53:30.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: fsmap 8 up:standby 2024-09-10T23:53:30.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:53:30.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: Deploying daemon mds.i on smithi189 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:boot 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: fsmap 8 up:standby 2024-09-10T23:53:30.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T23:53:31.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:31.473 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:31.822 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 podman[64266]: 2024-09-10 23:53:31.550898964 +0000 UTC m=+0.141481995 container create 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T23:53:31.822 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 podman[64266]: 2024-09-10 23:53:31.820928281 +0000 UTC m=+0.411511313 container init 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T23:53:31.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:31 smithi033 ceph-mon[30593]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.076+0000 7f7e81a00640 1 -- 172.21.15.33:0/1292015851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c10b330 msgr2=0x7f7e7c111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.076+0000 7f7e81a00640 1 --2- 172.21.15.33:0/1292015851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c10b330 0x7f7e7c111b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009ca0 tx=0x7f7e7402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 -- 172.21.15.33:0/1292015851 shutdown_connections 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 --2- 172.21.15.33:0/1292015851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c10b330 0x7f7e7c111b30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 --2- 172.21.15.33:0/1292015851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10a9b0 0x7f7e7c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 --2- 172.21.15.33:0/1292015851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 -- 172.21.15.33:0/1292015851 >> 172.21.15.33:0/1292015851 conn(0x7f7e7c100a50 msgr2=0x7f7e7c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:32.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 -- 172.21.15.33:0/1292015851 shutdown_connections 2024-09-10T23:53:32.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.077+0000 7f7e81a00640 1 -- 172.21.15.33:0/1292015851 wait complete. 2024-09-10T23:53:32.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 Processor -- start 2024-09-10T23:53:32.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 -- start start 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c10a9b0 0x7f7e7c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10b330 0x7f7e7c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c114e60 con 0x7f7e7c104fa0 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c114ce0 con 0x7f7e7c10a9b0 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.078+0000 7f7e81a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c114fe0 con 0x7f7e7c10b330 2024-09-10T23:53:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60232/0 (socket says 172.21.15.33:60232) 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 -- 172.21.15.33:0/3860038588 learned_addr learned my addr 172.21.15.33:0/3860038588 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7a000640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c10a9b0 0x7f7e7c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7b400640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10b330 0x7f7e7c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 -- 172.21.15.33:0/3860038588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10b330 msgr2=0x7f7e7c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10b330 0x7f7e7c1a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 -- 172.21.15.33:0/3860038588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c10a9b0 msgr2=0x7f7e7c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c10a9b0 0x7f7e7c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 -- 172.21.15.33:0/3860038588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c1a1400 con 0x7f7e7c104fa0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.079+0000 7f7e7aa00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.080+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00cd80 con 0x7f7e7c104fa0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.080+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e6c0108c0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.080+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0187c0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.080+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c1a16f0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.080+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c1a7db0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:31 smithi189 ceph-mon[34000]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.081+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7c105380 con 0x7f7e7c104fa0 2024-09-10T23:53:32.085 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 podman[64266]: 2024-09-10 23:53:31.828007341 +0000 UTC m=+0.418590373 container start 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T23:53:32.085 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 ceph-mds[64285]: -- 172.21.15.189:0/2997224080 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591b66a3860 con 0x5591b6681000 2024-09-10T23:53:32.085 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i[64281]: starting mds.i at 2024-09-10T23:53:32.085 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 bash[64266]: 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 2024-09-10T23:53:32.085 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 23:53:31 smithi189 systemd[1]: Started Ceph mds.i for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.084+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7e6c010430 con 0x7f7e7c104fa0 2024-09-10T23:53:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.085+0000 7f7e73400640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 0x7f7e600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.086+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f7e6c0e5ec0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.086+0000 7f7e7a000640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 0x7f7e600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.087+0000 7f7e7a000640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 0x7f7e600b7820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c10a560 tx=0x7f7e6800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.087+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7e6c0acbd0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:31 smithi052 ceph-mon[33526]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.329+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e7c02e5c0 con 0x7f7e7c104fa0 2024-09-10T23:53:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.329+0000 7f7e73400640 1 -- 172.21.15.33:0/3860038588 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7f7e6c0b1600 con 0x7f7e7c104fa0 2024-09-10T23:53:32.332 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:32.332 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":9,"btime":"2024-09-10T23:53:29:082192+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:53:32.332 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 9 2024-09-10T23:53:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 msgr2=0x7f7e600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 0x7f7e600b7820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c10a560 tx=0x7f7e6800b410 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 msgr2=0x7f7e7c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 shutdown_connections 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7e600b5360 0x7f7e600b7820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e7c10b330 0x7f7e7c1a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e7c10a9b0 0x7f7e7c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 --2- 172.21.15.33:0/3860038588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e7c104fa0 0x7f7e7c19b350 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.332+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 >> 172.21.15.33:0/3860038588 conn(0x7f7e7c100a50 msgr2=0x7f7e7c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.333+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 shutdown_connections 2024-09-10T23:53:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:32.333+0000 7f7e81a00640 1 -- 172.21.15.33:0/3860038588 wait complete. 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:33.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: Deploying daemon mds.g on smithi033 2024-09-10T23:53:33.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3860038588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:33.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6838/317615852,v1:172.21.15.189:6839/317615852] up:boot 2024-09-10T23:53:33.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: fsmap 9 up:standby 2024-09-10T23:53:33.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:53:33.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:33.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: Deploying daemon mds.g on smithi033 2024-09-10T23:53:33.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3860038588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:33.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6838/317615852,v1:172.21.15.189:6839/317615852] up:boot 2024-09-10T23:53:33.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: fsmap 9 up:standby 2024-09-10T23:53:33.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:53:33.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: Deploying daemon mds.g on smithi033 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3860038588' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6838/317615852,v1:172.21.15.189:6839/317615852] up:boot 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: fsmap 9 up:standby 2024-09-10T23:53:33.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T23:53:34.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:34 smithi033 ceph-mon[30593]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:34 smithi189 ceph-mon[34000]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:34 smithi052 ceph-mon[33526]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:35.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:35.909 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:35 smithi033 systemd[1]: Starting Ceph mds.g for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-10T23:53:36.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:36 smithi033 ceph-mon[30593]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:36.223 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:35 smithi033 podman[73208]: 2024-09-10 23:53:35.813050854 +0000 UTC m=+0.031900143 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T23:53:36.223 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:35 smithi033 podman[73208]: 2024-09-10 23:53:35.951784521 +0000 UTC m=+0.170633786 container create d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T23:53:36.223 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 podman[73208]: 2024-09-10 23:53:36.222413609 +0000 UTC m=+0.441262904 container init d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T23:53:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:36 smithi189 ceph-mon[34000]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:36 smithi052 ceph-mon[33526]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:36.526 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 podman[73208]: 2024-09-10 23:53:36.228823536 +0000 UTC m=+0.447672803 container start d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-10T23:53:36.526 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 ceph-mds[73248]: -- 172.21.15.33:0/1081855444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3fc25b860 con 0x55c3fc238800 2024-09-10T23:53:36.526 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g[73244]: starting mds.g at 2024-09-10T23:53:36.526 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 bash[73208]: d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f 2024-09-10T23:53:36.526 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 10 23:53:36 smithi033 systemd[1]: Started Ceph mds.g for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:37.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 -- 172.21.15.33:0/2540568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 msgr2=0x7fca3010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:37.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 --2- 172.21.15.33:0/2540568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca3010f7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca28009ca0 tx=0x7fca2802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 -- 172.21.15.33:0/2540568975 shutdown_connections 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 --2- 172.21.15.33:0/2540568975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca3010f7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 --2- 172.21.15.33:0/2540568975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30108620 0x7fca30108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 --2- 172.21.15.33:0/2540568975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30102c10 0x7fca30102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 -- 172.21.15.33:0/2540568975 >> 172.21.15.33:0/2540568975 conn(0x7fca300fe660 msgr2=0x7fca30100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 -- 172.21.15.33:0/2540568975 shutdown_connections 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.031+0000 7fca36400640 1 -- 172.21.15.33:0/2540568975 wait complete. 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.032+0000 7fca36400640 1 Processor -- start 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.032+0000 7fca36400640 1 -- start start 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30102c10 0x7fca300754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30108620 0x7fca300759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca30112b60 con 0x7fca30108fa0 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca301129e0 con 0x7fca30108620 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca36400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca30112ce0 con 0x7fca30102c10 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca35a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca35a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60268/0 (socket says 172.21.15.33:60268) 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca35a00640 1 -- 172.21.15.33:0/864082292 learned_addr learned my addr 172.21.15.33:0/864082292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca35000640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30102c10 0x7fca300754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.033+0000 7fca2fe00640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30108620 0x7fca300759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 -- 172.21.15.33:0/864082292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30102c10 msgr2=0x7fca300754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30102c10 0x7fca300754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 -- 172.21.15.33:0/864082292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30108620 msgr2=0x7fca300759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30108620 0x7fca300759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 -- 172.21.15.33:0/864082292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca301a7350 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca35a00640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca28005e30 tx=0x7fca280093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28032d10 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca28032eb0 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28030b20 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301a75e0 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.034+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301a7b70 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.035+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca30102ff0 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.038+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fca28030cc0 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.039+0000 7fca2d600640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 0x7fca140b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.039+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fca28106ac0 con 0x7fca30108fa0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.039+0000 7fca35000640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 0x7fca140b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.040+0000 7fca35000640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 0x7fca140b78d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca20009bd0 tx=0x7fca20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:37.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.043+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca280cdd80 con 0x7fca30108fa0 2024-09-10T23:53:37.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.283+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca301a7ee0 con 0x7fca30108fa0 2024-09-10T23:53:37.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.284+0000 7fca2d600640 1 -- 172.21.15.33:0/864082292 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8866 (secure 0 0 0) 0x7fca280cd680 con 0x7fca30108fa0 2024-09-10T23:53:37.286 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:37.287 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":11,"btime":"2024-09-10T23:53:37:047413+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:53:37.287 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 11 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 msgr2=0x7fca140b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 0x7fca140b78d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca20009bd0 tx=0x7fca20005f90 comp rx=0 tx=0).stop 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 msgr2=0x7fca30075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca28005e30 tx=0x7fca280093d0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 shutdown_connections 2024-09-10T23:53:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fca140b5410 0x7fca140b78d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca30108fa0 0x7fca30075f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca30108620 0x7fca300759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 --2- 172.21.15.33:0/864082292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca30102c10 0x7fca300754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 >> 172.21.15.33:0/864082292 conn(0x7fca300fe660 msgr2=0x7fca30101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 shutdown_connections 2024-09-10T23:53:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:37.287+0000 7fca36400640 1 -- 172.21.15.33:0/864082292 wait complete. 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:37.647 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:37.648 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: Deploying daemon mds.a on smithi033 2024-09-10T23:53:37.648 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.33:6838/1714634262,v1:172.21.15.33:6839/1714634262] up:boot 2024-09-10T23:53:37.648 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: fsmap 10 up:standby 2024-09-10T23:53:37.648 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:53:37.648 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:37 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/864082292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: Deploying daemon mds.a on smithi033 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.33:6838/1714634262,v1:172.21.15.33:6839/1714634262] up:boot 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: fsmap 10 up:standby 2024-09-10T23:53:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:53:37.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:37 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/864082292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: Deploying daemon mds.a on smithi033 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.33:6838/1714634262,v1:172.21.15.33:6839/1714634262] up:boot 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: fsmap 10 up:standby 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T23:53:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:37 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/864082292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:38 smithi052 ceph-mon[33526]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:38.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:38 smithi033 ceph-mon[30593]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:38 smithi189 ceph-mon[34000]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:40.192 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:39 smithi033 podman[73598]: 2024-09-10 23:53:39.945939289 +0000 UTC m=+0.150555343 container create add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T23:53:40.192 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 podman[73598]: 2024-09-10 23:53:40.191321055 +0000 UTC m=+0.395937103 container init add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:40.527 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 podman[73598]: 2024-09-10 23:53:40.197946103 +0000 UTC m=+0.402562165 container start add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T23:53:40.527 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-mds[73617]: -- 172.21.15.33:0/1481215183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639d8ead860 con 0x5639d8e8b000 2024-09-10T23:53:40.527 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a[73613]: starting mds.a at 2024-09-10T23:53:40.527 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 bash[73598]: add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb 2024-09-10T23:53:40.527 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 10 23:53:40 smithi033 systemd[1]: Started Ceph mds.a for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T23:53:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:41.649 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:41 smithi052 ceph-mon[33526]: Deploying daemon mds.b on smithi052 2024-09-10T23:53:41.649 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:41 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.33:6840/1697461712,v1:172.21.15.33:6841/1697461712] up:boot 2024-09-10T23:53:41.649 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:41 smithi052 ceph-mon[33526]: fsmap 11 up:standby 2024-09-10T23:53:41.650 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:53:41.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:41.722 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:41 smithi033 ceph-mon[30593]: Deploying daemon mds.b on smithi052 2024-09-10T23:53:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:41 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.33:6840/1697461712,v1:172.21.15.33:6841/1697461712] up:boot 2024-09-10T23:53:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:41 smithi033 ceph-mon[30593]: fsmap 11 up:standby 2024-09-10T23:53:41.723 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:53:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:41 smithi189 ceph-mon[34000]: Deploying daemon mds.b on smithi052 2024-09-10T23:53:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:41 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.33:6840/1697461712,v1:172.21.15.33:6841/1697461712] up:boot 2024-09-10T23:53:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:41 smithi189 ceph-mon[34000]: fsmap 11 up:standby 2024-09-10T23:53:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T23:53:42.065 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:42 smithi033 ceph-mon[30593]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 -- 172.21.15.33:0/2124748048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5724102dc0 msgr2=0x7f57241031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 --2- 172.21.15.33:0/2124748048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5724102dc0 0x7f57241031a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5714009900 tx=0x7f571402a410 comp rx=0 tx=0).stop 2024-09-10T23:53:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 -- 172.21.15.33:0/2124748048 shutdown_connections 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 --2- 172.21.15.33:0/2124748048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 --2- 172.21.15.33:0/2124748048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57241087d0 0x7f5724108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 --2- 172.21.15.33:0/2124748048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5724102dc0 0x7f57241031a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 -- 172.21.15.33:0/2124748048 >> 172.21.15.33:0/2124748048 conn(0x7f57240fe830 msgr2=0x7f5724100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 -- 172.21.15.33:0/2124748048 shutdown_connections 2024-09-10T23:53:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.643+0000 7f572aa00640 1 -- 172.21.15.33:0/2124748048 wait complete. 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 Processor -- start 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 -- start start 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5724102dc0 0x7f5724109940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5724112d10 con 0x7f57241087d0 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5724112b90 con 0x7f5724109150 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.644+0000 7f572aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5724112e90 con 0x7f5724102dc0 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f5728a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35014/0 (socket says 172.21.15.33:35014) 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 -- 172.21.15.33:0/3991476309 learned_addr learned my addr 172.21.15.33:0/3991476309 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f5723e00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5724102dc0 0x7f5724109940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 -- 172.21.15.33:0/3991476309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5724102dc0 msgr2=0x7f5724109940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5724102dc0 0x7f5724109940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 -- 172.21.15.33:0/3991476309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 msgr2=0x7f572410a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 -- 172.21.15.33:0/3991476309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57241ab9e0 con 0x7f57241087d0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f5728a00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.645+0000 7f571b400640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f570c00d950 tx=0x7f570c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.646+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c017070 con 0x7f57241087d0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.646+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f570c009c30 con 0x7f57241087d0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.646+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57241abcd0 con 0x7f57241087d0 2024-09-10T23:53:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.646+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c00f620 con 0x7f57241087d0 2024-09-10T23:53:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.646+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57241ac200 con 0x7f57241087d0 2024-09-10T23:53:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.647+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57241031a0 con 0x7f57241087d0 2024-09-10T23:53:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.651+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f570c005030 con 0x7f57241087d0 2024-09-10T23:53:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.652+0000 7f5721600640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 0x7f57080b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.652+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f570c0e5240 con 0x7f57241087d0 2024-09-10T23:53:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.653+0000 7f5723e00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 0x7f57080b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.653+0000 7f5723e00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 0x7f57080b7820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5714006010 tx=0x7f5714005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.654+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f570c009de0 con 0x7f57241087d0 2024-09-10T23:53:42.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:42 smithi052 ceph-mon[33526]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:42 smithi189 ceph-mon[34000]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.886+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f572410ac40 con 0x7f57241087d0 2024-09-10T23:53:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.887+0000 7f5721600640 1 -- 172.21.15.33:0/3991476309 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f570c0b05f0 con 0x7f57241087d0 2024-09-10T23:53:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:42.889 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":12,"btime":"2024-09-10T23:53:40:429586+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T23:53:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 12 2024-09-10T23:53:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 msgr2=0x7f57080b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 0x7f57080b7820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5714006010 tx=0x7f5714005e80 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 msgr2=0x7f5724109e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f570c00d950 tx=0x7f570c00de10 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 shutdown_connections 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f57080b5360 0x7f57080b7820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5724109150 0x7f572410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57241087d0 0x7f5724109e80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 --2- 172.21.15.33:0/3991476309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5724102dc0 0x7f5724109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 >> 172.21.15.33:0/3991476309 conn(0x7f57240fe830 msgr2=0x7f57240fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 shutdown_connections 2024-09-10T23:53:42.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:42.889+0000 7f572aa00640 1 -- 172.21.15.33:0/3991476309 wait complete. 2024-09-10T23:53:43.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3991476309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:43.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:43 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3991476309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:43.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3991476309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:44.032 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:43 smithi052 podman[64638]: 2024-09-10 23:53:43.748591663 +0000 UTC m=+0.158824155 container create d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T23:53:44.294 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 podman[64638]: 2024-09-10 23:53:44.159993465 +0000 UTC m=+0.570225976 container init d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T23:53:44.294 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 podman[64638]: 2024-09-10 23:53:44.166397027 +0000 UTC m=+0.576629521 container start d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T23:53:44.294 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mds[64664]: -- 172.21.15.52:0/1373248422 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562044805860 con 0x5620447e2800 2024-09-10T23:53:44.294 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: starting mds.b at 2024-09-10T23:53:44.294 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 bash[64638]: d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 2024-09-10T23:53:44.705 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:44 smithi052 systemd[1]: Started Ceph mds.b for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:44 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:44 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:44 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:45.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:53:45.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:45 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:boot 2024-09-10T23:53:45.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:45 smithi033 ceph-mon[30593]: fsmap 12 up:standby 2024-09-10T23:53:45.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:53:45.761 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:45 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:45.779 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:45 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:boot 2024-09-10T23:53:45.779 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:45 smithi052 ceph-mon[33526]: fsmap 12 up:standby 2024-09-10T23:53:45.779 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:53:45.779 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:45 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:45.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:45 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:boot 2024-09-10T23:53:45.921 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:45 smithi189 ceph-mon[34000]: fsmap 12 up:standby 2024-09-10T23:53:45.922 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T23:53:45.922 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:45 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:46.653 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:46 smithi033 ceph-mon[30593]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:46.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 -- 172.21.15.33:0/890777560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 msgr2=0x7f0f00105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 --2- 172.21.15.33:0/890777560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f00105380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009900 tx=0x7f0ef402a410 comp rx=0 tx=0).stop 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 -- 172.21.15.33:0/890777560 shutdown_connections 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 --2- 172.21.15.33:0/890777560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010b330 0x7f0f00111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 --2- 172.21.15.33:0/890777560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010a9b0 0x7f0f0010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 --2- 172.21.15.33:0/890777560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f00105380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 -- 172.21.15.33:0/890777560 >> 172.21.15.33:0/890777560 conn(0x7f0f00100a50 msgr2=0x7f0f00102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 -- 172.21.15.33:0/890777560 shutdown_connections 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.777+0000 7f0f07800640 1 -- 172.21.15.33:0/890777560 wait complete. 2024-09-10T23:53:46.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 Processor -- start 2024-09-10T23:53:46.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 -- start start 2024-09-10T23:53:46.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010a9b0 0x7f0f0019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010b330 0x7f0f001a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00114e70 con 0x7f0f00104fa0 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00114cf0 con 0x7f0f0010a9b0 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f07800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00114ff0 con 0x7f0f0010b330 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f04e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35022/0 (socket says 172.21.15.33:35022) 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.779+0000 7f0f04e00640 1 -- 172.21.15.33:0/1490941229 learned_addr learned my addr 172.21.15.33:0/1490941229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f05800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010b330 0x7f0f001a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0effe00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010a9b0 0x7f0f0019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 -- 172.21.15.33:0/1490941229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010b330 msgr2=0x7f0f001a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:46.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010b330 0x7f0f001a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 -- 172.21.15.33:0/1490941229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010a9b0 msgr2=0x7f0f0019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010a9b0 0x7f0f0019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 -- 172.21.15.33:0/1490941229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f001a14f0 con 0x7f0f00104fa0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.780+0000 7f0f04e00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009230 tx=0x7f0ef4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.781+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef403f030 con 0x7f0f00104fa0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.781+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ef4003a80 con 0x7f0f00104fa0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.781+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f001a1780 con 0x7f0f00104fa0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.781+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4035070 con 0x7f0f00104fa0 2024-09-10T23:53:46.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.781+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a7ea0 con 0x7f0f00104fa0 2024-09-10T23:53:46.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.782+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f00105380 con 0x7f0f00104fa0 2024-09-10T23:53:46.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.784+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0ef403bbb0 con 0x7f0f00104fa0 2024-09-10T23:53:46.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.786+0000 7f0efd600640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 0x7f0ee80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:46.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.786+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f0ef41060b0 con 0x7f0f00104fa0 2024-09-10T23:53:46.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.786+0000 7f0effe00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 0x7f0ee80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:46.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.787+0000 7f0effe00640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 0x7f0ee80b7820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f0010a1c0 tx=0x7f0eec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:46.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:46.790+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ef40ccd20 con 0x7f0f00104fa0 2024-09-10T23:53:46.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:46 smithi189 ceph-mon[34000]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:46.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:46 smithi052 ceph-mon[33526]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:47.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.033+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f0002e5c0 con 0x7f0f00104fa0 2024-09-10T23:53:47.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.034+0000 7f0efd600640 1 -- 172.21.15.33:0/1490941229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f0ef40d1750 con 0x7f0f00104fa0 2024-09-10T23:53:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:47.036 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"btime":"2024-09-10T23:53:44:451617+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T23:53:47.037 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.036+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 msgr2=0x7f0ee80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.036+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 0x7f0ee80b7820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f0010a1c0 tx=0x7f0eec005f90 comp rx=0 tx=0).stop 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.036+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 msgr2=0x7f0f0019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.036+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009230 tx=0x7f0ef4004270 comp rx=0 tx=0).stop 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 shutdown_connections 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0ee80b5360 0x7f0ee80b7820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f0010b330 0x7f0f001a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010a9b0 0x7f0f0019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:47.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 --2- 172.21.15.33:0/1490941229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f00104fa0 0x7f0f0019b440 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:47.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 >> 172.21.15.33:0/1490941229 conn(0x7f0f00100a50 msgr2=0x7f0f001014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:47.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 shutdown_connections 2024-09-10T23:53:47.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:47.037+0000 7f0f07800640 1 -- 172.21.15.33:0/1490941229 wait complete. 2024-09-10T23:53:47.857 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T23:53:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1490941229' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:48.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1490941229' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1490941229' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:48.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 -- 172.21.15.33:0/3519574739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd58104e10 msgr2=0x7fcd581051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:48.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 --2- 172.21.15.33:0/3519574739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd58104e10 0x7fcd581051f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009900 tx=0x7fcd4802a410 comp rx=0 tx=0).stop 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 -- 172.21.15.33:0/3519574739 shutdown_connections 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 --2- 172.21.15.33:0/3519574739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 --2- 172.21.15.33:0/3519574739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd5810a820 0x7fcd5810ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 --2- 172.21.15.33:0/3519574739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd58104e10 0x7fcd581051f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 -- 172.21.15.33:0/3519574739 >> 172.21.15.33:0/3519574739 conn(0x7fcd58100840 msgr2=0x7fcd58102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 -- 172.21.15.33:0/3519574739 shutdown_connections 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.937+0000 7fcd57200640 1 -- 172.21.15.33:0/3519574739 wait complete. 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.938+0000 7fcd57200640 1 Processor -- start 2024-09-10T23:53:48.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.938+0000 7fcd57200640 1 -- start start 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 0x7fcd5819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58114d10 con 0x7fcd5810a820 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58114b90 con 0x7fcd58104e10 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd57200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58114e90 con 0x7fcd5810b1a0 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd55e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 0x7fcd5819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:48.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35040/0 (socket says 172.21.15.33:35040) 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd4fe00640 1 -- 172.21.15.33:0/3374078989 learned_addr learned my addr 172.21.15.33:0/3374078989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.939+0000 7fcd56800640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 -- 172.21.15.33:0/3374078989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 msgr2=0x7fcd581a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 -- 172.21.15.33:0/3374078989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 msgr2=0x7fcd5819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 0x7fcd5819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 -- 172.21.15.33:0/3374078989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd581a1290 con 0x7fcd5810a820 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd55e00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 0x7fcd5819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd56800640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4fe00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e9f0 tx=0x7fcd4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:48.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000cd80 con 0x7fcd5810a820 2024-09-10T23:53:48.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd400108c0 con 0x7fcd5810a820 2024-09-10T23:53:48.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd400187c0 con 0x7fcd5810a820 2024-09-10T23:53:48.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.940+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd581a1580 con 0x7fcd5810a820 2024-09-10T23:53:48.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.941+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd581a7c40 con 0x7fcd5810a820 2024-09-10T23:53:48.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.942+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd581051f0 con 0x7fcd5810a820 2024-09-10T23:53:48.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.944+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fcd40010430 con 0x7fcd5810a820 2024-09-10T23:53:48.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.946+0000 7fcd4ea00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 0x7fcd3c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:48.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.946+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fcd400e5bf0 con 0x7fcd5810a820 2024-09-10T23:53:48.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.946+0000 7fcd55e00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 0x7fcd3c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:48.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.947+0000 7fcd55e00640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 0x7fcd3c0b7850 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd480057c0 tx=0x7fcd480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:48.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:48.953+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd400aceb0 con 0x7fcd5810a820 2024-09-10T23:53:49.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.165+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcd5810cfe0 con 0x7fcd5810a820 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.166+0000 7fcd4ea00640 1 -- 172.21.15.33:0/3374078989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fcd400ac7b0 con 0x7fcd5810a820 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-09-10T23:53:49.168 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:53:49.169 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.168+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 msgr2=0x7fcd3c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.168+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 0x7fcd3c0b7850 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd480057c0 tx=0x7fcd480058d0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.168+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 msgr2=0x7fcd5819b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.168+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e9f0 tx=0x7fcd4000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 shutdown_connections 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd3c0b5390 0x7fcd3c0b7850 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd5810b1a0 0x7fcd581a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd5810a820 0x7fcd5819b720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 --2- 172.21.15.33:0/3374078989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd58104e10 0x7fcd5819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 >> 172.21.15.33:0/3374078989 conn(0x7fcd58100840 msgr2=0x7fcd58102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 shutdown_connections 2024-09-10T23:53:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:49.169+0000 7fcd57200640 1 -- 172.21.15.33:0/3374078989 wait complete. 2024-09-10T23:53:49.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:49.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:49.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:49.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:53:49.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:49 smithi033 ceph-mon[30593]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:49.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:49 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3374078989' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:53:50.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:49 smithi189 ceph-mon[34000]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:50.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:49 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3374078989' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:53:50.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:49 smithi052 ceph-mon[33526]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:50.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:49 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3374078989' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T23:53:50.831 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:53:50.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:53:51.238 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:51.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:51 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:51 smithi033 ceph-mon[30593]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:51 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:51 smithi189 ceph-mon[34000]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 -- 172.21.15.33:0/1307912834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc108620 msgr2=0x7f52dc108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1307912834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc108620 0x7f52dc108a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009900 tx=0x7f52c802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 -- 172.21.15.33:0/1307912834 shutdown_connections 2024-09-10T23:53:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1307912834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 0x7f52dc10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1307912834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc108620 0x7f52dc108a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1307912834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc102c10 0x7f52dc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 -- 172.21.15.33:0/1307912834 >> 172.21.15.33:0/1307912834 conn(0x7f52dc0fe660 msgr2=0x7f52dc100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.880+0000 7f52dbe00640 1 -- 172.21.15.33:0/1307912834 shutdown_connections 2024-09-10T23:53:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.881+0000 7f52dbe00640 1 -- 172.21.15.33:0/1307912834 wait complete. 2024-09-10T23:53:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 Processor -- start 2024-09-10T23:53:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 -- start start 2024-09-10T23:53:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 0x7f52dc19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 0x7f52dc1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc112b10 con 0x7f52dc102c10 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc112990 con 0x7f52dc108fa0 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52dbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc112c90 con 0x7f52dc108620 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52daa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52daa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38808/0 (socket says 172.21.15.33:38808) 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.882+0000 7f52daa00640 1 -- 172.21.15.33:0/1774634038 learned_addr learned my addr 172.21.15.33:0/1774634038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52db400640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 0x7f52dc1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52da000640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 0x7f52dc19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 -- 172.21.15.33:0/1774634038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 msgr2=0x7f52dc19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 0x7f52dc19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 -- 172.21.15.33:0/1774634038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 msgr2=0x7f52dc1a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 0x7f52dc1a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 -- 172.21.15.33:0/1774634038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc1a1190 con 0x7f52dc102c10 2024-09-10T23:53:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52da000640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 0x7f52dc19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:53:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.883+0000 7f52daa00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d950 tx=0x7f52cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.884+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc017070 con 0x7f52dc102c10 2024-09-10T23:53:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.884+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc1a1480 con 0x7f52dc102c10 2024-09-10T23:53:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.884+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52cc009c30 con 0x7f52dc102c10 2024-09-10T23:53:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.884+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f620 con 0x7f52dc102c10 2024-09-10T23:53:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.884+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc1a7d10 con 0x7f52dc102c10 2024-09-10T23:53:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.885+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52dc103ec0 con 0x7f52dc102c10 2024-09-10T23:53:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.887+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f52cc010460 con 0x7f52dc102c10 2024-09-10T23:53:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.890+0000 7f52d3400640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 0x7f52c00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.890+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f52cc0e52f0 con 0x7f52dc102c10 2024-09-10T23:53:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.890+0000 7f52da000640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 0x7f52c00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.891+0000 7f52da000640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 0x7f52c00b78d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f52c8000c00 tx=0x7f52c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:51.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:51.894+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52cc0ac650 con 0x7f52dc102c10 2024-09-10T23:53:51.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:51 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:51.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:51 smithi052 ceph-mon[33526]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.112+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52dc10f190 con 0x7f52dc102c10 2024-09-10T23:53:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.690+0000 7f52d3400640 1 -- 172.21.15.33:0/1774634038 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f52cc009de0 con 0x7f52dc102c10 2024-09-10T23:53:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-09-10T23:53:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.693+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 msgr2=0x7f52c00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.693+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 0x7f52c00b78d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f52c8000c00 tx=0x7f52c8005a20 comp rx=0 tx=0).stop 2024-09-10T23:53:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.693+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 msgr2=0x7f52dc19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.693+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d950 tx=0x7f52cc00de10 comp rx=0 tx=0).stop 2024-09-10T23:53:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 shutdown_connections 2024-09-10T23:53:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52c00b5410 0x7f52c00b78d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52dc108fa0 0x7f52dc1a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52dc108620 0x7f52dc19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 --2- 172.21.15.33:0/1774634038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52dc102c10 0x7f52dc19b0e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 >> 172.21.15.33:0/1774634038 conn(0x7f52dc0fe660 msgr2=0x7f52dc104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 shutdown_connections 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:52.694+0000 7f52dbe00640 1 -- 172.21.15.33:0/1774634038 wait complete. 2024-09-10T23:53:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:53:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:52.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:52.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:52.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:52.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:52 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:52 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:53:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:52 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:53:53.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T23:53:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:53.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:53:53.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:53 smithi052 ceph-mon[33526]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:53:53.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:53 smithi052 ceph-mon[33526]: pgmap v335: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:54.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:53:54.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:53 smithi033 ceph-mon[30593]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:53:54.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:53 smithi033 ceph-mon[30593]: pgmap v335: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:54.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1774634038' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T23:53:54.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:53 smithi189 ceph-mon[34000]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T23:53:54.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:53 smithi189 ceph-mon[34000]: pgmap v335: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 -- 172.21.15.33:0/43842154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0040776d0 msgr2=0x7fa004077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 --2- 172.21.15.33:0/43842154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0040776d0 0x7fa004077ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009ca0 tx=0x7f9ff402a8b0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 -- 172.21.15.33:0/43842154 shutdown_connections 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 --2- 172.21.15.33:0/43842154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa004113990 0x7fa004115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 --2- 172.21.15.33:0/43842154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004077ff0 0x7fa004113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 --2- 172.21.15.33:0/43842154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0040776d0 0x7fa004077ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 -- 172.21.15.33:0/43842154 >> 172.21.15.33:0/43842154 conn(0x7fa004100a50 msgr2=0x7fa004102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 -- 172.21.15.33:0/43842154 shutdown_connections 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.461+0000 7fa008e00640 1 -- 172.21.15.33:0/43842154 wait complete. 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 Processor -- start 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 -- start start 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0040776d0 0x7fa00419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004113990 0x7fa0041a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa004119360 con 0x7fa004077ff0 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0041191e0 con 0x7fa004113990 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.462+0000 7fa008e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0041194e0 con 0x7fa0040776d0 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38826/0 (socket says 172.21.15.33:38826) 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 -- 172.21.15.33:0/784394898 learned_addr learned my addr 172.21.15.33:0/784394898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7fa002800640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004113990 0x7fa0041a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7fa001e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0040776d0 0x7fa00419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 -- 172.21.15.33:0/784394898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0040776d0 msgr2=0x7fa00419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0040776d0 0x7fa00419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 -- 172.21.15.33:0/784394898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004113990 msgr2=0x7fa0041a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004113990 0x7fa0041a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.463+0000 7f9ff9400640 1 -- 172.21.15.33:0/784394898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0041a59c0 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7f9ff9400640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b4a0 tx=0x7f9fec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec014070 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fec010aa0 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0041a5cb0 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec017b70 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.464+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0041ac3f0 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.465+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa004077b30 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.469+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9fec010610 con 0x7fa004077ff0 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.470+0000 7f9ffb400640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 0x7f9fe80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.471+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7497+0+0 (secure 0 0 0) 0x7f9fec0e5130 con 0x7fa004077ff0 2024-09-10T23:53:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.471+0000 7fa001e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 0x7f9fe80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.471+0000 7fa001e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 0x7f9fe80b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.473+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fec0abc30 con 0x7fa004077ff0 2024-09-10T23:53:54.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.671+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fa0041a0a40 con 0x7fa004077ff0 2024-09-10T23:53:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.708+0000 7f9ffb400640 1 -- 172.21.15.33:0/784394898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7f9fec0b0660 con 0x7fa004077ff0 2024-09-10T23:53:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.710+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 msgr2=0x7f9fe80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.710+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 0x7f9fe80b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40093a0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.710+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 msgr2=0x7fa00419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.710+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b4a0 tx=0x7f9fec00b960 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 shutdown_connections 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9fe80b52e0 0x7f9fe80b77a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa004113990 0x7fa0041a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004077ff0 0x7fa00419fe50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 --2- 172.21.15.33:0/784394898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0040776d0 0x7fa00419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:54.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 >> 172.21.15.33:0/784394898 conn(0x7fa004100a50 msgr2=0x7fa004102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:54.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 shutdown_connections 2024-09-10T23:53:54.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:54.711+0000 7fa008e00640 1 -- 172.21.15.33:0/784394898 wait complete. 2024-09-10T23:53:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:54 smithi052 ceph-mon[33526]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:53:54.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:54 smithi052 ceph-mon[33526]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:53:54.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:54 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:53:55.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:54 smithi033 ceph-mon[30593]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:53:55.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:54 smithi033 ceph-mon[30593]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:53:55.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:54 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:53:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:54 smithi189 ceph-mon[34000]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:53:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:54 smithi189 ceph-mon[34000]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T23:53:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:54 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-10T23:53:55.518 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:53:55.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:55 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:53:55.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:55 smithi033 ceph-mon[30593]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:53:55.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:55 smithi033 ceph-mon[30593]: pgmap v338: 97 pgs: 2 creating+peering, 91 unknown, 4 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:56.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:55 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:53:56.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:55 smithi189 ceph-mon[34000]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:53:56.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:55 smithi189 ceph-mon[34000]: pgmap v338: 97 pgs: 2 creating+peering, 91 unknown, 4 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:56.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:55 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/784394898' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T23:53:56.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:55 smithi052 ceph-mon[33526]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T23:53:56.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:55 smithi052 ceph-mon[33526]: pgmap v338: 97 pgs: 2 creating+peering, 91 unknown, 4 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 -- 172.21.15.33:0/1050293601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0077ff0 msgr2=0x7fddf0113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 --2- 172.21.15.33:0/1050293601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0077ff0 0x7fddf0113450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009900 tx=0x7fdddc02a410 comp rx=0 tx=0).stop 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 -- 172.21.15.33:0/1050293601 shutdown_connections 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 --2- 172.21.15.33:0/1050293601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf0113990 0x7fddf0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 --2- 172.21.15.33:0/1050293601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0077ff0 0x7fddf0113450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 --2- 172.21.15.33:0/1050293601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf00776d0 0x7fddf0077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 -- 172.21.15.33:0/1050293601 >> 172.21.15.33:0/1050293601 conn(0x7fddf0100a50 msgr2=0x7fddf0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 -- 172.21.15.33:0/1050293601 shutdown_connections 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.502+0000 7fddf8600640 1 -- 172.21.15.33:0/1050293601 wait complete. 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 Processor -- start 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 -- start start 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf00776d0 0x7fddf019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 0x7fddf019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0119240 con 0x7fddf0113990 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01190c0 con 0x7fddf00776d0 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.504+0000 7fddf8600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01193c0 con 0x7fddf0077ff0 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 0x7fddf019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:56.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf00776d0 0x7fddf019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 0x7fddf019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:36848/0 (socket says 172.21.15.33:36848) 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf5200640 1 -- 172.21.15.33:0/4184966230 learned_addr learned my addr 172.21.15.33:0/4184966230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38838/0 (socket says 172.21.15.33:38838) 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 -- 172.21.15.33:0/4184966230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 msgr2=0x7fddf019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 0x7fddf019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 -- 172.21.15.33:0/4184966230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf00776d0 msgr2=0x7fddf019f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf00776d0 0x7fddf019f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.505+0000 7fddf6600640 1 -- 172.21.15.33:0/4184966230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf01a5860 con 0x7fddf0113990 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddf6600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005fd0 tx=0x7fdde800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde800cdf0 con 0x7fddf0113990 2024-09-10T23:53:56.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdde8005020 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8010690 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf01a5b50 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.506+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf01ac210 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.507+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0077ab0 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.510+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdde8004a40 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.511+0000 7fddee000640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 0x7fddd80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.511+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7879+0+0 (secure 0 0 0) 0x7fdde80e6090 con 0x7fddf0113990 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.511+0000 7fddf5c00640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 0x7fddd80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:56.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.512+0000 7fddf5c00640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 0x7fddd80b78f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009bd0 tx=0x7fdde4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:56.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.513+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdde80ad0e0 con 0x7fddf0113990 2024-09-10T23:53:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:56.753+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fddf01a08e0 con 0x7fddf0113990 2024-09-10T23:53:57.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:56 smithi033 ceph-mon[30593]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:53:57.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:56 smithi189 ceph-mon[34000]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:53:57.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:56 smithi052 ceph-mon[33526]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T23:53:57.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.737+0000 7fddee000640 1 -- 172.21.15.33:0/4184966230 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fdde80ac9e0 con 0x7fddf0113990 2024-09-10T23:53:57.738 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:53:57.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 msgr2=0x7fddd80b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 0x7fddd80b78f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009bd0 tx=0x7fdde4005f90 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 msgr2=0x7fddf01a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005fd0 tx=0x7fdde800ef10 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 shutdown_connections 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fddd80b5430 0x7fddd80b78f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf0113990 0x7fddf01a5090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fddf0077ff0 0x7fddf019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 --2- 172.21.15.33:0/4184966230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddf00776d0 0x7fddf019f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.740+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 >> 172.21.15.33:0/4184966230 conn(0x7fddf0100a50 msgr2=0x7fddf0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.741+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 shutdown_connections 2024-09-10T23:53:57.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:57.741+0000 7fddf8600640 1 -- 172.21.15.33:0/4184966230 wait complete. 2024-09-10T23:53:58.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:57 smithi033 ceph-mon[30593]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:53:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:57 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:53:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:57 smithi033 ceph-mon[30593]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:53:58.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:57 smithi033 ceph-mon[30593]: pgmap v341: 97 pgs: 24 creating+peering, 24 unknown, 49 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:57 smithi189 ceph-mon[34000]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:53:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:57 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:53:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:57 smithi189 ceph-mon[34000]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:53:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:57 smithi189 ceph-mon[34000]: pgmap v341: 97 pgs: 24 creating+peering, 24 unknown, 49 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:57 smithi052 ceph-mon[33526]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T23:53:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:57 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T23:53:58.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:57 smithi052 ceph-mon[33526]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T23:53:58.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:57 smithi052 ceph-mon[33526]: pgmap v341: 97 pgs: 24 creating+peering, 24 unknown, 49 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:53:58.532 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T23:53:58.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T23:53:58.915 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:active 2024-09-10T23:53:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:58 smithi033 ceph-mon[30593]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:53:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:53:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:53:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:53:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:53:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:active 2024-09-10T23:53:59.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:58 smithi189 ceph-mon[34000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:53:59.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T23:53:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4184966230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T23:53:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T23:53:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T23:53:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] up:active 2024-09-10T23:53:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:58 smithi052 ceph-mon[33526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 -- 172.21.15.33:0/2358221391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9468104df0 msgr2=0x7f94681051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 --2- 172.21.15.33:0/2358221391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9468104df0 0x7f94681051d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9458009900 tx=0x7f945802a410 comp rx=0 tx=0).stop 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 -- 172.21.15.33:0/2358221391 shutdown_connections 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 --2- 172.21.15.33:0/2358221391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f946810b180 0x7f9468111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 --2- 172.21.15.33:0/2358221391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810a800 0x7f946810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 --2- 172.21.15.33:0/2358221391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9468104df0 0x7f94681051d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.494+0000 7f946ca00640 1 -- 172.21.15.33:0/2358221391 >> 172.21.15.33:0/2358221391 conn(0x7f9468100840 msgr2=0x7f9468102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.495+0000 7f946ca00640 1 -- 172.21.15.33:0/2358221391 shutdown_connections 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.495+0000 7f946ca00640 1 -- 172.21.15.33:0/2358221391 wait complete. 2024-09-10T23:53:59.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.495+0000 7f946ca00640 1 Processor -- start 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 -- start start 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9468104df0 0x7f946819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 0x7f94681a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9468114d40 con 0x7f946810a800 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9468114bc0 con 0x7f946810b180 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f946ca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9468114ec0 con 0x7f9468104df0 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f945fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f945fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38870/0 (socket says 172.21.15.33:38870) 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f945fe00640 1 -- 172.21.15.33:0/902249148 learned_addr learned my addr 172.21.15.33:0/902249148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:53:59.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f9467400640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9468104df0 0x7f946819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f945fe00640 1 -- 172.21.15.33:0/902249148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9468104df0 msgr2=0x7f946819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f945fe00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9468104df0 0x7f946819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.496+0000 7f9467e00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 0x7f94681a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f945fe00640 1 -- 172.21.15.33:0/902249148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 msgr2=0x7f94681a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f945fe00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 0x7f94681a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f945fe00640 1 -- 172.21.15.33:0/902249148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94681a11c0 con 0x7f946810a800 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f9467e00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 0x7f94681a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f945fe00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f945000e9f0 tx=0x7f945000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945000cd80 con 0x7f946810a800 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94681a14b0 con 0x7f946810a800 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94500108c0 con 0x7f946810a800 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500187c0 con 0x7f946810a800 2024-09-10T23:53:59.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.497+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681a7d40 con 0x7f946810a800 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.498+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94681060a0 con 0x7f946810a800 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.500+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9450010430 con 0x7f946810a800 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.502+0000 7f9464c00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 0x7f944c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.502+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f94500e5ec0 con 0x7f946810a800 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.502+0000 7f9467400640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 0x7f944c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.503+0000 7f9467400640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 0x7f944c0b78d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9458006010 tx=0x7f9458005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:53:59.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.506+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f94500ace30 con 0x7f946810a800 2024-09-10T23:53:59.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.710+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f946810cf60 con 0x7f946810a800 2024-09-10T23:53:59.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.745+0000 7f9464c00640 1 -- 172.21.15.33:0/902249148 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v78) ==== 157+0+0 (secure 0 0 0) 0x7f94500ac730 con 0x7f946810a800 2024-09-10T23:53:59.747 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:53:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: 2024-09-10T23:53:59.465+0000 7fdee2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:53:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 msgr2=0x7f944c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 0x7f944c0b78d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9458006010 tx=0x7f9458005e80 comp rx=0 tx=0).stop 2024-09-10T23:53:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 msgr2=0x7f946819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:53:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f945000e9f0 tx=0x7f945000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 shutdown_connections 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f944c0b5410 0x7f944c0b78d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f946810b180 0x7f94681a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946810a800 0x7f946819b650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 --2- 172.21.15.33:0/902249148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9468104df0 0x7f946819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 >> 172.21.15.33:0/902249148 conn(0x7f9468100840 msgr2=0x7f94681020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 shutdown_connections 2024-09-10T23:53:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:53:59.748+0000 7f946ca00640 1 -- 172.21.15.33:0/902249148 wait complete. 2024-09-10T23:54:00.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:59 smithi033 ceph-mon[30593]: pgmap v343: 97 pgs: 22 creating+peering, 2 unknown, 73 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:00.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:53:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:54:00.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:59 smithi189 ceph-mon[34000]: pgmap v343: 97 pgs: 22 creating+peering, 2 unknown, 73 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:00.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:53:59 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:54:00.208 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:59 smithi052 ceph-mon[33526]: pgmap v343: 97 pgs: 22 creating+peering, 2 unknown, 73 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:00.208 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:53:59 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-10T23:54:00.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:54:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:00 smithi033 ceph-mon[30593]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:54:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:00 smithi033 ceph-mon[30593]: Cluster is now healthy 2024-09-10T23:54:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:00 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:54:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:00 smithi033 ceph-mon[30593]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:54:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:00 smithi189 ceph-mon[34000]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:54:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:00 smithi189 ceph-mon[34000]: Cluster is now healthy 2024-09-10T23:54:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:00 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:54:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:00 smithi189 ceph-mon[34000]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:54:01.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:00 smithi052 ceph-mon[33526]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T23:54:01.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:00 smithi052 ceph-mon[33526]: Cluster is now healthy 2024-09-10T23:54:01.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:00 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/902249148' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T23:54:01.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:00 smithi052 ceph-mon[33526]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T23:54:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 -- 172.21.15.33:0/2809575510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810b180 msgr2=0x7f0fd8111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/2809575510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810b180 0x7f0fd8111980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009ca0 tx=0x7f0fd002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 -- 172.21.15.33:0/2809575510 shutdown_connections 2024-09-10T23:54:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/2809575510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810b180 0x7f0fd8111980 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/2809575510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd810a800 0x7f0fd810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/2809575510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd8104df0 0x7f0fd81051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 -- 172.21.15.33:0/2809575510 >> 172.21.15.33:0/2809575510 conn(0x7f0fd8100840 msgr2=0x7f0fd8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 -- 172.21.15.33:0/2809575510 shutdown_connections 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.567+0000 7f0fdcc00640 1 -- 172.21.15.33:0/2809575510 wait complete. 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 Processor -- start 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 -- start start 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd8104df0 0x7f0fd819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 0x7f0fd81a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8114d00 con 0x7f0fd810a800 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8114b80 con 0x7f0fd810b180 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.568+0000 7f0fdcc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8114e80 con 0x7f0fd8104df0 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43182/0 (socket says 172.21.15.33:43182) 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 -- 172.21.15.33:0/354946208 learned_addr learned my addr 172.21.15.33:0/354946208 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd7400640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd8104df0 0x7f0fd819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd7e00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 0x7f0fd81a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 -- 172.21.15.33:0/354946208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd8104df0 msgr2=0x7f0fd819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd8104df0 0x7f0fd819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 -- 172.21.15.33:0/354946208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 msgr2=0x7f0fd81a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 0x7f0fd81a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 -- 172.21.15.33:0/354946208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd81a1140 con 0x7f0fd810a800 2024-09-10T23:54:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd7e00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 0x7f0fd81a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.569+0000 7f0fd6a00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400e9f0 tx=0x7f0fc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.570+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400cd80 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.570+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fc40054b0 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.570+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4010430 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.570+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd81a1430 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.570+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd81a7af0 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.571+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd81051d0 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.575+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0fc4005000 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.576+0000 7f0fcfe00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 0x7f0fbc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.576+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8277+0+0 (secure 0 0 0) 0x7f0fc40e6240 con 0x7f0fd810a800 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.577+0000 7f0fd7400640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 0x7f0fbc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.577+0000 7f0fd7400640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 0x7f0fbc0b78d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009bd0 tx=0x7f0fc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:01.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.578+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0fc4056220 con 0x7f0fd810a800 2024-09-10T23:54:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:01.777+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0fd81a7ee0 con 0x7f0fd810a800 2024-09-10T23:54:02.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:01 smithi033 ceph-mon[30593]: pgmap v345: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s wr, 1 op/s 2024-09-10T23:54:02.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:01 smithi189 ceph-mon[34000]: pgmap v345: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s wr, 1 op/s 2024-09-10T23:54:02.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:01 smithi052 ceph-mon[33526]: pgmap v345: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s wr, 1 op/s 2024-09-10T23:54:03.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:02 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:54:03.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:02 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:54:03.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:02 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T23:54:03.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.772+0000 7f0fcfe00640 1 -- 172.21.15.33:0/354946208 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v80) ==== 228+0+0 (secure 0 0 0) 0x7f0fc40ad070 con 0x7f0fd810a800 2024-09-10T23:54:03.773 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' created 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.775+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 msgr2=0x7f0fbc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.775+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 0x7f0fbc0b78d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009bd0 tx=0x7f0fc8005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.775+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 msgr2=0x7f0fd819b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.775+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400e9f0 tx=0x7f0fc400edf0 comp rx=0 tx=0).stop 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 shutdown_connections 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0fbc0b5410 0x7f0fbc0b78d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd810b180 0x7f0fd81a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fd810a800 0x7f0fd819b5d0 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400e9f0 tx=0x7f0fc400edf0 comp rx=0 tx=0).stop 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 --2- 172.21.15.33:0/354946208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fd8104df0 0x7f0fd819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 >> 172.21.15.33:0/354946208 conn(0x7f0fd8100840 msgr2=0x7f0fd8102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 shutdown_connections 2024-09-10T23:54:03.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:03.776+0000 7f0fdcc00640 1 -- 172.21.15.33:0/354946208 wait complete. 2024-09-10T23:54:04.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:03 smithi033 ceph-mon[30593]: pgmap v347: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:04.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:03 smithi033 ceph-mon[30593]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:54:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:03 smithi189 ceph-mon[34000]: pgmap v347: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:04.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:03 smithi189 ceph-mon[34000]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:54:04.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:03 smithi052 ceph-mon[33526]: pgmap v347: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:04.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:03 smithi052 ceph-mon[33526]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T23:54:04.503 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T23:54:04.899 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:05.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:04 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:54:05.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:04 smithi033 ceph-mon[30593]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:54:05.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:04 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:54:05.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:04 smithi189 ceph-mon[34000]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:54:05.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:04 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/354946208' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T23:54:05.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:04 smithi052 ceph-mon[33526]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T23:54:05.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 -- 172.21.15.33:0/1902479286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b40104fa0 msgr2=0x7f5b40105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 --2- 172.21.15.33:0/1902479286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b40104fa0 0x7f5b40105380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009900 tx=0x7f5b3002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 -- 172.21.15.33:0/1902479286 shutdown_connections 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 --2- 172.21.15.33:0/1902479286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4010b330 0x7f5b40111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 --2- 172.21.15.33:0/1902479286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010a9b0 0x7f5b4010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 --2- 172.21.15.33:0/1902479286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b40104fa0 0x7f5b40105380 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 -- 172.21.15.33:0/1902479286 >> 172.21.15.33:0/1902479286 conn(0x7f5b40100a50 msgr2=0x7f5b40102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 -- 172.21.15.33:0/1902479286 shutdown_connections 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.481+0000 7f5b47600640 1 -- 172.21.15.33:0/1902479286 wait complete. 2024-09-10T23:54:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 Processor -- start 2024-09-10T23:54:05.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 -- start start 2024-09-10T23:54:05.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b40104fa0 0x7f5b4019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010b330 0x7f5b401a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40114e40 con 0x7f5b4010a9b0 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40114cc0 con 0x7f5b40104fa0 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b47600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40114fc0 con 0x7f5b4010b330 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b37e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b37e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43204/0 (socket says 172.21.15.33:43204) 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.483+0000 7f5b37e00640 1 -- 172.21.15.33:0/668626655 learned_addr learned my addr 172.21.15.33:0/668626655 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b44c00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b40104fa0 0x7f5b4019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b45600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010b330 0x7f5b401a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 -- 172.21.15.33:0/668626655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010b330 msgr2=0x7f5b401a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010b330 0x7f5b401a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 -- 172.21.15.33:0/668626655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b40104fa0 msgr2=0x7f5b4019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b40104fa0 0x7f5b4019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 -- 172.21.15.33:0/668626655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b401a1580 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b37e00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800d950 tx=0x7f5b2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.484+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28017070 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.485+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b401a1870 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.485+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b28009c30 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.485+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800f620 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.485+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b401a7f30 con 0x7f5b4010a9b0 2024-09-10T23:54:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.486+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b40105380 con 0x7f5b4010a9b0 2024-09-10T23:54:05.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.488+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5b28010460 con 0x7f5b4010a9b0 2024-09-10T23:54:05.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.489+0000 7f5b3e000640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 0x7f5b240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.490+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8770+0+0 (secure 0 0 0) 0x7f5b280e59e0 con 0x7f5b4010a9b0 2024-09-10T23:54:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.490+0000 7f5b44c00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 0x7f5b240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.490+0000 7f5b44c00640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 0x7f5b240b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006010 tx=0x7f5b30005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.492+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5b28009de0 con 0x7f5b4010a9b0 2024-09-10T23:54:05.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.686+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f5b4019c600 con 0x7f5b4010a9b0 2024-09-10T23:54:05.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.788+0000 7f5b3e000640 1 -- 172.21.15.33:0/668626655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v82) ==== 169+0+0 (secure 0 0 0) 0x7f5b280abfd0 con 0x7f5b4010a9b0 2024-09-10T23:54:05.789 INFO:teuthology.orchestra.run.smithi033.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T23:54:05.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 msgr2=0x7f5b240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 0x7f5b240b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006010 tx=0x7f5b30005e80 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 msgr2=0x7f5b4019ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800d950 tx=0x7f5b2800de10 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 shutdown_connections 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b240b52e0 0x7f5b240b77a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4010b330 0x7f5b401a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4010a9b0 0x7f5b4019ba10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 --2- 172.21.15.33:0/668626655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b40104fa0 0x7f5b4019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 >> 172.21.15.33:0/668626655 conn(0x7f5b40100a50 msgr2=0x7f5b40101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 shutdown_connections 2024-09-10T23:54:05.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:05.791+0000 7f5b47600640 1 -- 172.21.15.33:0/668626655 wait complete. 2024-09-10T23:54:06.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:05 smithi033 ceph-mon[30593]: pgmap v349: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:06.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:05 smithi033 ceph-mon[30593]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:54:06.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:54:06.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:05 smithi033 ceph-mon[30593]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:54:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:05 smithi189 ceph-mon[34000]: pgmap v349: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:05 smithi189 ceph-mon[34000]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:54:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:54:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:05 smithi189 ceph-mon[34000]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:54:06.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:05 smithi052 ceph-mon[33526]: pgmap v349: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T23:54:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:05 smithi052 ceph-mon[33526]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T23:54:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-10T23:54:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:05 smithi052 ceph-mon[33526]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T23:54:06.569 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T23:54:06.953 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:07.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:06 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:54:07.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:06 smithi189 ceph-mon[34000]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:54:07.092 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:06 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:54:07.092 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:06 smithi033 ceph-mon[30593]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:54:07.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:06 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/668626655' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T23:54:07.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:06 smithi052 ceph-mon[33526]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T23:54:07.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 -- 172.21.15.33:0/2703345702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 msgr2=0x7f0114115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 --2- 172.21.15.33:0/2703345702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f0114115bd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f010c009ca0 tx=0x7f010c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 -- 172.21.15.33:0/2703345702 shutdown_connections 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 --2- 172.21.15.33:0/2703345702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f0114115bd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 --2- 172.21.15.33:0/2703345702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 0x7f01141132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 --2- 172.21.15.33:0/2703345702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f0114077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 -- 172.21.15.33:0/2703345702 >> 172.21.15.33:0/2703345702 conn(0x7f0114100840 msgr2=0x7f0114102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 -- 172.21.15.33:0/2703345702 shutdown_connections 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.556+0000 7f011a400640 1 -- 172.21.15.33:0/2703345702 wait complete. 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.557+0000 7f011a400640 1 Processor -- start 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 -- start start 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 0x7f011419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f01141a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f01141190c0 con 0x7f01141137e0 2024-09-10T23:54:07.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0114118f40 con 0x7f0114077ff0 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f011a400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0114119240 con 0x7f01140776d0 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0119a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f01141a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0119000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0119000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37454/0 (socket says 172.21.15.33:37454) 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0119a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f01141a4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43232/0 (socket says 172.21.15.33:43232) 2024-09-10T23:54:07.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0119000640 1 -- 172.21.15.33:0/304614105 learned_addr learned my addr 172.21.15.33:0/304614105 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.558+0000 7f0113e00640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 0x7f011419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 -- 172.21.15.33:0/304614105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 msgr2=0x7f011419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 0x7f011419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 -- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 msgr2=0x7f01141a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f01141a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 -- 172.21.15.33:0/304614105 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141a5620 con 0x7f01140776d0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0119000640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f010800e9f0 tx=0x7f010800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010800cd80 con 0x7f01140776d0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01141a5910 con 0x7f01140776d0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01080054b0 con 0x7f01140776d0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108010430 con 0x7f01140776d0 2024-09-10T23:54:07.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.559+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01141abfd0 con 0x7f01140776d0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.560+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0114077ab0 con 0x7f01140776d0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.563+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0108004f70 con 0x7f01140776d0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.565+0000 7f0111600640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 0x7f00fc0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.565+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8770+0+0 (secure 0 0 0) 0x7f01080e62b0 con 0x7f01140776d0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.565+0000 7f0113e00640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 0x7f00fc0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.566+0000 7f0113e00640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 0x7f00fc0b7850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0114103450 tx=0x7f0100005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:07.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.569+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01080acf50 con 0x7f01140776d0 2024-09-10T23:54:07.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:07.805+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f01141ac290 con 0x7f01140776d0 2024-09-10T23:54:08.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:07 smithi189 ceph-mon[34000]: pgmap v352: 129 pgs: 4 creating+peering, 9 unknown, 116 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:08.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:07 smithi052 ceph-mon[33526]: pgmap v352: 129 pgs: 4 creating+peering, 9 unknown, 116 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:08.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:07 smithi033 ceph-mon[30593]: pgmap v352: 129 pgs: 4 creating+peering, 9 unknown, 116 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:08.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.810+0000 7f0111600640 1 -- 172.21.15.33:0/304614105 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7f01080ac850 con 0x7f01140776d0 2024-09-10T23:54:08.811 INFO:teuthology.orchestra.run.smithi033.stderr:added data pool 4 to fsmap 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 msgr2=0x7f00fc0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 0x7f00fc0b7850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0114103450 tx=0x7f0100005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 msgr2=0x7f011419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f010800e9f0 tx=0x7f010800edf0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 shutdown_connections 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00fc0b5390 0x7f00fc0b7850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01141137e0 0x7f01141a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0114077ff0 0x7f011419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 --2- 172.21.15.33:0/304614105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01140776d0 0x7f011419f570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 >> 172.21.15.33:0/304614105 conn(0x7f0114100840 msgr2=0x7f0114102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 shutdown_connections 2024-09-10T23:54:08.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:08.813+0000 7f011a400640 1 -- 172.21.15.33:0/304614105 wait complete. 2024-09-10T23:54:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:08 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/304614105' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:08 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:08 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/304614105' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:08 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:08 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/304614105' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:08 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-10T23:54:09.850 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:54:10.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:09 smithi189 ceph-mon[34000]: pgmap v353: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:10.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:09 smithi189 ceph-mon[34000]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:54:10.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:09 smithi189 ceph-mon[34000]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:54:10.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:09 smithi189 ceph-mon[34000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:10.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:09 smithi052 ceph-mon[33526]: pgmap v353: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:09 smithi052 ceph-mon[33526]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:54:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:09 smithi052 ceph-mon[33526]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:54:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:09 smithi052 ceph-mon[33526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:09 smithi033 ceph-mon[30593]: pgmap v353: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:09 smithi033 ceph-mon[30593]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T23:54:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:09 smithi033 ceph-mon[30593]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T23:54:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:09 smithi033 ceph-mon[30593]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 -- 172.21.15.33:0/1521566210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd780075de0 msgr2=0x7fd78010ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 --2- 172.21.15.33:0/1521566210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd780075de0 0x7fd78010ece0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009900 tx=0x7fd76c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 -- 172.21.15.33:0/1521566210 shutdown_connections 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 --2- 172.21.15.33:0/1521566210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd78010f220 0x7fd780111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 --2- 172.21.15.33:0/1521566210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd780075de0 0x7fd78010ece0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 --2- 172.21.15.33:0/1521566210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 0x7fd7800758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 -- 172.21.15.33:0/1521566210 >> 172.21.15.33:0/1521566210 conn(0x7fd7800fe6c0 msgr2=0x7fd780100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 -- 172.21.15.33:0/1521566210 shutdown_connections 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.815+0000 7fd786400640 1 -- 172.21.15.33:0/1521566210 wait complete. 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.816+0000 7fd786400640 1 Processor -- start 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.816+0000 7fd786400640 1 -- start start 2024-09-10T23:54:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 0x7fd78019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd780075de0 0x7fd78019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd780114d60 con 0x7fd78010f220 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd780114be0 con 0x7fd7800754c0 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd786400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd780114ee0 con 0x7fd780075de0 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43242/0 (socket says 172.21.15.33:43242) 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 0x7fd78019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 -- 172.21.15.33:0/174611092 learned_addr learned my addr 172.21.15.33:0/174611092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd77fe00640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd780075de0 0x7fd78019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 -- 172.21.15.33:0/174611092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd780075de0 msgr2=0x7fd78019b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd780075de0 0x7fd78019b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 -- 172.21.15.33:0/174611092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 msgr2=0x7fd78019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 0x7fd78019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.817+0000 7fd785a00640 1 -- 172.21.15.33:0/174611092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7801a1280 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd785a00640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd77800b9e0 tx=0x7fd77800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778019070 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd778014440 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7780125a0 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7801a1570 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.818+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7801a7cb0 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.819+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7800758a0 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.821+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd77800cb20 con 0x7fd78010f220 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.823+0000 7fd77d600640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 0x7fd7680b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.823+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7fd7780e5970 con 0x7fd78010f220 2024-09-10T23:54:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.823+0000 7fd785000640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 0x7fd7680b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.824+0000 7fd785000640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 0x7fd7680b78d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd774009bd0 tx=0x7fd774005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:10.825+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7780abf40 con 0x7fd78010f220 2024-09-10T23:54:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:10 smithi033 ceph-mon[30593]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:54:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:10 smithi033 ceph-mon[30593]: Cluster is now healthy 2024-09-10T23:54:11.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.062+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7801a7fd0 con 0x7fd78010f220 2024-09-10T23:54:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.063+0000 7fd77d600640 1 -- 172.21.15.33:0/174611092 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11836 (secure 0 0 0) 0x7fd7780b0970 con 0x7fd78010f220 2024-09-10T23:54:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:11.064 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"btime":"2024-09-10T23:54:08:797799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:07.807147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34688,"qdb_cluster":[34688]},"id":1}]} 2024-09-10T23:54:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.065+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 msgr2=0x7fd7680b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.065+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 0x7fd7680b78d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd774009bd0 tx=0x7fd774005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.065+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 msgr2=0x7fd7801a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.065+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd77800b9e0 tx=0x7fd77800bea0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 shutdown_connections 2024-09-10T23:54:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd7680b5410 0x7fd7680b78d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78010f220 0x7fd7801a0ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd780075de0 0x7fd78019b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 --2- 172.21.15.33:0/174611092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7800754c0 0x7fd78019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 >> 172.21.15.33:0/174611092 conn(0x7fd7800fe6c0 msgr2=0x7fd7801113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 shutdown_connections 2024-09-10T23:54:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:11.066+0000 7fd786400640 1 -- 172.21.15.33:0/174611092 wait complete. 2024-09-10T23:54:11.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:10 smithi052 ceph-mon[33526]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:54:11.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:10 smithi052 ceph-mon[33526]: Cluster is now healthy 2024-09-10T23:54:11.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:10 smithi189 ceph-mon[34000]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T23:54:11.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:10 smithi189 ceph-mon[34000]: Cluster is now healthy 2024-09-10T23:54:11.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:54:12.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:11 smithi052 ceph-mon[33526]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:12.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:11 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/174611092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:12.260 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:12.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:11 smithi033 ceph-mon[30593]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:12.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:11 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/174611092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:11 smithi189 ceph-mon[34000]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:11 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/174611092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.862+0000 7fe3af200640 1 -- 172.21.15.33:0/3792895070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810b330 msgr2=0x7fe3a8111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.862+0000 7fe3af200640 1 --2- 172.21.15.33:0/3792895070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810b330 0x7fe3a8111b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009ca0 tx=0x7fe3a002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 -- 172.21.15.33:0/3792895070 shutdown_connections 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 --2- 172.21.15.33:0/3792895070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810b330 0x7fe3a8111b30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 --2- 172.21.15.33:0/3792895070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810a9b0 0x7fe3a810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 --2- 172.21.15.33:0/3792895070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 0x7fe3a8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 -- 172.21.15.33:0/3792895070 >> 172.21.15.33:0/3792895070 conn(0x7fe3a8100a50 msgr2=0x7fe3a8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:12.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 -- 172.21.15.33:0/3792895070 shutdown_connections 2024-09-10T23:54:12.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 -- 172.21.15.33:0/3792895070 wait complete. 2024-09-10T23:54:12.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.863+0000 7fe3af200640 1 Processor -- start 2024-09-10T23:54:12.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 -- start start 2024-09-10T23:54:12.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 0x7fe3a819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810b330 0x7fe3a81a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8114e60 con 0x7fe3a810a9b0 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8114ce0 con 0x7fe3a810b330 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3af200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8114fe0 con 0x7fe3a8104fa0 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3a7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58502/0 (socket says 172.21.15.33:58502) 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3a7400640 1 -- 172.21.15.33:0/2330499246 learned_addr learned my addr 172.21.15.33:0/2330499246 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3a7e00640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 0x7fe3a819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.864+0000 7fe3ad200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810b330 0x7fe3a81a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 -- 172.21.15.33:0/2330499246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 msgr2=0x7fe3a819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:12.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 0x7fe3a819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 -- 172.21.15.33:0/2330499246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810b330 msgr2=0x7fe3a81a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810b330 0x7fe3a81a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 -- 172.21.15.33:0/2330499246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a81a1420 con 0x7fe3a810a9b0 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a7400640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe39400e9f0 tx=0x7fe39400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39400cd80 con 0x7fe3a810a9b0 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3940108c0 con 0x7fe3a810a9b0 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a81a1710 con 0x7fe3a810a9b0 2024-09-10T23:54:12.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.865+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940187c0 con 0x7fe3a810a9b0 2024-09-10T23:54:12.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.866+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a81a7fa0 con 0x7fe3a810a9b0 2024-09-10T23:54:12.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.867+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a8106250 con 0x7fe3a810a9b0 2024-09-10T23:54:12.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.872+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe394010430 con 0x7fe3a810a9b0 2024-09-10T23:54:12.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.873+0000 7fe3a4c00640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 0x7fe38c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:12.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.873+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7fe3940e6600 con 0x7fe3a810a9b0 2024-09-10T23:54:12.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.874+0000 7fe3a7e00640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 0x7fe38c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:12.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.874+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3940acbd0 con 0x7fe3a810a9b0 2024-09-10T23:54:12.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:12.874+0000 7fe3a7e00640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 0x7fe38c0b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe398009bd0 tx=0x7fe398005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:13.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.071+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3a8105380 con 0x7fe3a810a9b0 2024-09-10T23:54:13.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.072+0000 7fe3a4c00640 1 -- 172.21.15.33:0/2330499246 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24177 (secure 0 0 0) 0x7fe3940b1600 con 0x7fe3a810a9b0 2024-09-10T23:54:13.074 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:13.074 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:07.807009+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:54:13.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 msgr2=0x7fe38c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:13.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 0x7fe38c0b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe398009bd0 tx=0x7fe398005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:13.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 msgr2=0x7fe3a819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:13.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe39400e9f0 tx=0x7fe39400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 shutdown_connections 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe38c0b5360 0x7fe38c0b7820 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a810b330 0x7fe3a81a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a810a9b0 0x7fe3a819b8b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 --2- 172.21.15.33:0/2330499246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a8104fa0 0x7fe3a819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 >> 172.21.15.33:0/2330499246 conn(0x7fe3a8100a50 msgr2=0x7fe3a8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 shutdown_connections 2024-09-10T23:54:13.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:13.075+0000 7fe3af200640 1 -- 172.21.15.33:0/2330499246 wait complete. 2024-09-10T23:54:13.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:54:14.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:13 smithi052 ceph-mon[33526]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:14.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:13 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2330499246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:14.253 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:13 smithi033 ceph-mon[30593]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:13 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2330499246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:13 smithi189 ceph-mon[34000]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:13 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2330499246' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2477365002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc102da0 msgr2=0x7f1cdc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2477365002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc102da0 0x7f1cdc103180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009900 tx=0x7f1ccc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2477365002 shutdown_connections 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2477365002 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 0x7f1cdc10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2477365002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2477365002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc102da0 0x7f1cdc103180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2477365002 >> 172.21.15.33:0/2477365002 conn(0x7f1cdc0fe810 msgr2=0x7f1cdc100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2477365002 shutdown_connections 2024-09-10T23:54:14.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.806+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2477365002 wait complete. 2024-09-10T23:54:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.807+0000 7f1ce0e00640 1 Processor -- start 2024-09-10T23:54:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.807+0000 7f1ce0e00640 1 -- start start 2024-09-10T23:54:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc102da0 0x7f1cdc199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 0x7f1cdc19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc112c60 con 0x7f1cdc1087b0 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc112ae0 con 0x7f1cdc102da0 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1ce0e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc112de0 con 0x7f1cdc109130 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1cd9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1cd9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58514/0 (socket says 172.21.15.33:58514) 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1cd9400640 1 -- 172.21.15.33:0/2570171367 learned_addr learned my addr 172.21.15.33:0/2570171367 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1cd9e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc102da0 0x7f1cdc199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.808+0000 7f1cda800640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 0x7f1cdc19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 -- 172.21.15.33:0/2570171367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 msgr2=0x7f1cdc19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 0x7f1cdc19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 -- 172.21.15.33:0/2570171367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc102da0 msgr2=0x7f1cdc199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc102da0 0x7f1cdc199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 -- 172.21.15.33:0/2570171367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc19f1c0 con 0x7f1cdc1087b0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd9400640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c920 tx=0x7f1cc800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8007c70 con 0x7f1cdc1087b0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cc8007e10 con 0x7f1cdc1087b0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc19f4b0 con 0x7f1cdc1087b0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8018710 con 0x7f1cdc1087b0 2024-09-10T23:54:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.809+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc1a5d40 con 0x7f1cdc1087b0 2024-09-10T23:54:14.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.810+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc103180 con 0x7f1cdc1087b0 2024-09-10T23:54:14.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.813+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1cc800f450 con 0x7f1cdc1087b0 2024-09-10T23:54:14.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.814+0000 7f1cd2a00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 0x7f1cc00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:14.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.814+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f1cc80e5fb0 con 0x7f1cdc1087b0 2024-09-10T23:54:14.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.814+0000 7f1cd9e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 0x7f1cc00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.815+0000 7f1cd9e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 0x7f1cc00b7820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0057c0 tx=0x7f1ccc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:14.818+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1cc8014030 con 0x7f1cdc1087b0 2024-09-10T23:54:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.016+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cdc10af40 con 0x7f1cdc1087b0 2024-09-10T23:54:15.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.018+0000 7f1cd2a00640 1 -- 172.21.15.33:0/2570171367 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24177 (secure 0 0 0) 0x7f1cc80acbd0 con 0x7f1cdc1087b0 2024-09-10T23:54:15.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:15.019 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:07.807009+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.020+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 msgr2=0x7f1cc00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.020+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 0x7f1cc00b7820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0057c0 tx=0x7f1ccc0058d0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 msgr2=0x7f1cdc199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800c920 tx=0x7f1cc800cde0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 shutdown_connections 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1cc00b5360 0x7f1cc00b7820 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cdc109130 0x7f1cdc19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cdc1087b0 0x7f1cdc199650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 --2- 172.21.15.33:0/2570171367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cdc102da0 0x7f1cdc199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 >> 172.21.15.33:0/2570171367 conn(0x7f1cdc0fe810 msgr2=0x7f1cdc100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 shutdown_connections 2024-09-10T23:54:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:15.021+0000 7f1ce0e00640 1 -- 172.21.15.33:0/2570171367 wait complete. 2024-09-10T23:54:15.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:54:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:15 smithi052 ceph-mon[33526]: pgmap v357: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:15 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2570171367' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:16.248 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:16.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:15 smithi033 ceph-mon[30593]: pgmap v357: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:16.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:15 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2570171367' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:15 smithi189 ceph-mon[34000]: pgmap v357: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:15 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2570171367' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 -- 172.21.15.33:0/1227217956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c10a9b0 msgr2=0x7f860c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 --2- 172.21.15.33:0/1227217956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c10a9b0 0x7f860c10adf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009900 tx=0x7f85f402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 -- 172.21.15.33:0/1227217956 shutdown_connections 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 --2- 172.21.15.33:0/1227217956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10b330 0x7f860c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 --2- 172.21.15.33:0/1227217956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c10a9b0 0x7f860c10adf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 --2- 172.21.15.33:0/1227217956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c104fa0 0x7f860c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 -- 172.21.15.33:0/1227217956 >> 172.21.15.33:0/1227217956 conn(0x7f860c100a50 msgr2=0x7f860c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 -- 172.21.15.33:0/1227217956 shutdown_connections 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.825+0000 7f8611800640 1 -- 172.21.15.33:0/1227217956 wait complete. 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.826+0000 7f8611800640 1 Processor -- start 2024-09-10T23:54:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 -- start start 2024-09-10T23:54:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10a9b0 0x7f860c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c10b330 0x7f860c1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f860c114e90 con 0x7f860c104fa0 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f860c114d10 con 0x7f860c10b330 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8611800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f860c115010 con 0x7f860c10a9b0 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f860aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f860aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58524/0 (socket says 172.21.15.33:58524) 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f860aa00640 1 -- 172.21.15.33:0/3201590800 learned_addr learned my addr 172.21.15.33:0/3201590800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.827+0000 7f8603e00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10a9b0 0x7f860c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860b400640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c10b330 0x7f860c1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 -- 172.21.15.33:0/3201590800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10a9b0 msgr2=0x7f860c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10a9b0 0x7f860c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 -- 172.21.15.33:0/3201590800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c10b330 msgr2=0x7f860c1a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c10b330 0x7f860c1a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 -- 172.21.15.33:0/3201590800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c1a14b0 con 0x7f860c104fa0 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f860aa00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00b4a0 tx=0x7f85fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc014070 con 0x7f860c104fa0 2024-09-10T23:54:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c1a17a0 con 0x7f860c104fa0 2024-09-10T23:54:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.828+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85fc010aa0 con 0x7f860c104fa0 2024-09-10T23:54:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.829+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc017b70 con 0x7f860c104fa0 2024-09-10T23:54:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.829+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c1a8030 con 0x7f860c104fa0 2024-09-10T23:54:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.830+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860c105380 con 0x7f860c104fa0 2024-09-10T23:54:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.832+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f85fc010610 con 0x7f860c104fa0 2024-09-10T23:54:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.833+0000 7f8603400640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 0x7f85f00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.834+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f85fc0e5580 con 0x7f860c104fa0 2024-09-10T23:54:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.834+0000 7f8603e00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 0x7f85f00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.834+0000 7f8603e00640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 0x7f85f00b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85f40057c0 tx=0x7f85f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:16.835+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85fc0abbb0 con 0x7f860c104fa0 2024-09-10T23:54:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.070+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f860c19c530 con 0x7f860c104fa0 2024-09-10T23:54:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.071+0000 7f8603400640 1 -- 172.21.15.33:0/3201590800 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11836 (secure 0 0 0) 0x7f85fc0b05e0 con 0x7f860c104fa0 2024-09-10T23:54:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:17.072 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"btime":"2024-09-10T23:54:08:797799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24622,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34595,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34622,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34649,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:07.807147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34688,"qdb_cluster":[34688]},"id":1}]} 2024-09-10T23:54:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 msgr2=0x7f85f00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 0x7f85f00b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85f40057c0 tx=0x7f85f40058d0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 msgr2=0x7f860c19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00b4a0 tx=0x7f85fc00b960 comp rx=0 tx=0).stop 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 shutdown_connections 2024-09-10T23:54:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85f00b5360 0x7f85f00b7820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f860c10b330 0x7f860c1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f860c10a9b0 0x7f860c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 --2- 172.21.15.33:0/3201590800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f860c104fa0 0x7f860c19b400 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 >> 172.21.15.33:0/3201590800 conn(0x7f860c100a50 msgr2=0x7f860c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 shutdown_connections 2024-09-10T23:54:17.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:17.073+0000 7f8611800640 1 -- 172.21.15.33:0/3201590800 wait complete. 2024-09-10T23:54:18.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:54:18.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:17 smithi033 ceph-mon[30593]: pgmap v358: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:18.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:17 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3201590800' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:18.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:17 smithi052 ceph-mon[33526]: pgmap v358: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:18.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:17 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3201590800' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:17 smithi189 ceph-mon[34000]: pgmap v358: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:17 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3201590800' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:54:18.492 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 -- 172.21.15.33:0/943508562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10103af0 msgr2=0x7f5d10103ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 --2- 172.21.15.33:0/943508562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10103af0 0x7f5d10103ed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009900 tx=0x7f5d0002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 -- 172.21.15.33:0/943508562 shutdown_connections 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 --2- 172.21.15.33:0/943508562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 0x7f5d1010f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 --2- 172.21.15.33:0/943508562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10104410 0x7f5d1010c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 --2- 172.21.15.33:0/943508562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10103af0 0x7f5d10103ed0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 -- 172.21.15.33:0/943508562 >> 172.21.15.33:0/943508562 conn(0x7f5d100fd5b0 msgr2=0x7f5d100ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 -- 172.21.15.33:0/943508562 shutdown_connections 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.050+0000 7f5d14a00640 1 -- 172.21.15.33:0/943508562 wait complete. 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.051+0000 7f5d14a00640 1 Processor -- start 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.051+0000 7f5d14a00640 1 -- start start 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10103af0 0x7f5d101017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 0x7f5d10102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10112a70 con 0x7f5d10104410 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d101128f0 con 0x7f5d1010cf50 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d14a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10112bf0 con 0x7f5d10103af0 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58554/0 (socket says 172.21.15.33:58554) 2024-09-10T23:54:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 -- 172.21.15.33:0/966690948 learned_addr learned my addr 172.21.15.33:0/966690948 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d0e800640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10103af0 0x7f5d101017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d0f200640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 0x7f5d10102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 -- 172.21.15.33:0/966690948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10103af0 msgr2=0x7f5d101017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10103af0 0x7f5d101017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 -- 172.21.15.33:0/966690948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 msgr2=0x7f5d10102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 0x7f5d10102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.052+0000 7f5d05e00640 1 -- 172.21.15.33:0/966690948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d101a73c0 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d05e00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800d740 tx=0x7f5cf800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8017020 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cf800de50 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800f620 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d101a76b0 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.053+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d101a7ba0 con 0x7f5d10104410 2024-09-10T23:54:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.054+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d10103ed0 con 0x7f5d10104410 2024-09-10T23:54:19.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.057+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5cf8010460 con 0x7f5d10104410 2024-09-10T23:54:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.060+0000 7f5d07e00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 0x7f5cf40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.060+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f5cf80e59e0 con 0x7f5d10104410 2024-09-10T23:54:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.060+0000 7f5d0e800640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 0x7f5cf40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.061+0000 7f5d0e800640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 0x7f5cf40b78d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d000057c0 tx=0x7f5d000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:19.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.064+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cf8021070 con 0x7f5d10104410 2024-09-10T23:54:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.262+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d1002e610 con 0x7f5d10104410 2024-09-10T23:54:19.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.263+0000 7f5d07e00640 1 -- 172.21.15.33:0/966690948 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24177 (secure 0 0 0) 0x7f5cf80ac600 con 0x7f5d10104410 2024-09-10T23:54:19.265 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:19.265 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:07.807009+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 msgr2=0x7f5cf40b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 0x7f5cf40b78d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d000057c0 tx=0x7f5d000058d0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 msgr2=0x7f5d10101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800d740 tx=0x7f5cf800dc00 comp rx=0 tx=0).stop 2024-09-10T23:54:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 shutdown_connections 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5cf40b5410 0x7f5cf40b78d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d1010cf50 0x7f5d10102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d10104410 0x7f5d10101ce0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 --2- 172.21.15.33:0/966690948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d10103af0 0x7f5d101017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 >> 172.21.15.33:0/966690948 conn(0x7f5d100fd5b0 msgr2=0x7f5d100fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.266+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 shutdown_connections 2024-09-10T23:54:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:19.267+0000 7f5d14a00640 1 -- 172.21.15.33:0/966690948 wait complete. 2024-09-10T23:54:20.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:19 smithi033 ceph-mon[30593]: pgmap v359: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:20.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:19 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/966690948' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:20.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:53:56.754883+0000', 'modified': '2024-09-10T23:54:07.807147+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34688}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34688': {'gid': 34688, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.52:6839/2315099444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 2315099444}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 2315099444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34688, 'qdb_cluster': [34688]} 2024-09-10T23:54:20.066 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:54:20.066 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:54:20.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:19 smithi052 ceph-mon[33526]: pgmap v359: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:20.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:19 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/966690948' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:19 smithi189 ceph-mon[34000]: pgmap v359: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:19 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/966690948' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:21.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 -- 172.21.15.33:0/2523425091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b41087d0 msgr2=0x7f54b4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 --2- 172.21.15.33:0/2523425091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b41087d0 0x7f54b4108c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009900 tx=0x7f54a002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 -- 172.21.15.33:0/2523425091 shutdown_connections 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 --2- 172.21.15.33:0/2523425091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b4109150 0x7f54b410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 --2- 172.21.15.33:0/2523425091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b41087d0 0x7f54b4108c10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 --2- 172.21.15.33:0/2523425091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4102dc0 0x7f54b41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 -- 172.21.15.33:0/2523425091 >> 172.21.15.33:0/2523425091 conn(0x7f54b40fe830 msgr2=0x7f54b4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 -- 172.21.15.33:0/2523425091 shutdown_connections 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.077+0000 7f54bbe00640 1 -- 172.21.15.33:0/2523425091 wait complete. 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.078+0000 7f54bbe00640 1 Processor -- start 2024-09-10T23:54:21.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.078+0000 7f54bbe00640 1 -- start start 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b41087d0 0x7f54b419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4109150 0x7f54b41a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4112d10 con 0x7f54b4102dc0 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4112b90 con 0x7f54b41087d0 2024-09-10T23:54:21.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54bbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4112e90 con 0x7f54b4109150 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54b9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54b9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38076/0 (socket says 172.21.15.33:38076) 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54b9400640 1 -- 172.21.15.33:0/1759328256 learned_addr learned my addr 172.21.15.33:0/1759328256 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54b8a00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b41087d0 0x7f54b419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.079+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4109150 0x7f54b41a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 -- 172.21.15.33:0/1759328256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4109150 msgr2=0x7f54b41a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4109150 0x7f54b41a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 -- 172.21.15.33:0/1759328256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b41087d0 msgr2=0x7f54b419b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b41087d0 0x7f54b419b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 -- 172.21.15.33:0/1759328256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b41a1480 con 0x7f54b4102dc0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b9400640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54a800d950 tx=0x7f54a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b2000640 1 -- 172.21.15.33:0/1759328256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8017070 con 0x7f54b4102dc0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b2000640 1 -- 172.21.15.33:0/1759328256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54a8009c30 con 0x7f54b4102dc0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54b2000640 1 -- 172.21.15.33:0/1759328256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a800f620 con 0x7f54b4102dc0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.080+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b41a1770 con 0x7f54b4102dc0 2024-09-10T23:54:21.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.081+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b41a7e30 con 0x7f54b4102dc0 2024-09-10T23:54:21.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.084+0000 7f54be803740 1 Processor -- start 2024-09-10T23:54:21.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 -- start start 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5566f311ad50 con 0x5566f31a3b60 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566f310a180 con 0x5566f31afaf0 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54be803740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566f310df90 con 0x5566f31a3240 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.085+0000 7f54b2000640 1 -- 172.21.15.33:0/1759328256 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f54a8010460 con 0x7f54b4102dc0 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33580/0 (socket says 172.21.15.33:33580) 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 -- 172.21.15.33:0/1566733798 learned_addr learned my addr 172.21.15.33:0/1566733798 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b8a00640 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9400640 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 -- 172.21.15.33:0/1566733798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 msgr2=0x5566f31b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 -- 172.21.15.33:0/1566733798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 msgr2=0x5566f31af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.086+0000 7f54b9e00640 1 -- 172.21.15.33:0/1566733798 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f30d4a70 con 0x5566f31a3240 2024-09-10T23:54:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0103a0 tx=0x7f54ac010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e348f2620afc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54a6600640 1 -- 172.21.15.33:0/1566733798 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac016070 con 0x5566f31a3240 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54a6600640 1 -- 172.21.15.33:0/1566733798 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54ac004d20 con 0x5566f31a3240 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54a6600640 1 -- 172.21.15.33:0/1566733798 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac005390 con 0x5566f31a3240 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54be803740 1 -- 172.21.15.33:0/1566733798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 msgr2=0x5566f31a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.087+0000 7f54be803740 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0103a0 tx=0x7f54ac010860 comp rx=0 tx=0).stop 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54b2000640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 0x7f549c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 -- 172.21.15.33:0/1566733798 shutdown_connections 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 --2- 172.21.15.33:0/1566733798 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31a3620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 -- 172.21.15.33:0/1566733798 >> 172.21.15.33:0/1566733798 conn(0x5566f31a1020 msgr2=0x5566f31a2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54b2000640 1 -- 172.21.15.33:0/1759328256 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f54a80e5a00 con 0x7f54b4102dc0 2024-09-10T23:54:21.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 0x7f549c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 -- 172.21.15.33:0/1566733798 shutdown_connections 2024-09-10T23:54:21.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.088+0000 7f54be803740 1 -- 172.21.15.33:0/1566733798 wait complete. 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 -- start start 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 0x7f549c0b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54ac005f10 tx=0x7f54ac000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 Processor -- start 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5566f2f6b5f0 con 0x5566f31a3b60 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566f30a5460 con 0x5566f31afaf0 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566f31b2840 con 0x5566f31a3240 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.089+0000 7f54be803740 10 client.0 _ll_register_callbacks cb 0x5566f30b5210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:54:21.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38092/0 (socket says 172.21.15.33:38092) 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b8a00640 1 -- 172.21.15.33:0/1927491718 learned_addr learned my addr 172.21.15.33:0/1927491718 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9e00640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 -- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 msgr2=0x5566f31ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 -- 172.21.15.33:0/1927491718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 msgr2=0x5566f31acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 -- 172.21.15.33:0/1927491718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566f2e68540 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f54b9400640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31acab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5566f31a63c0 tx=0x7f54a800bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53871986c71ed24d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.090+0000 7f549aa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8020070 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f54a80ab230 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566f30a7a70 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f54a80ab920 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f54be803740 10 client.24763 fetch_fsmap learned FSMap version 16 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x5566f30c26f0 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5566f30a7a70 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.091+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f54a80af020 con 0x5566f31a3240 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 10 client.24763 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 10 client.24763 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:54:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 20 client.24763 populate_metadata read hostname 'smithi033' 2024-09-10T23:54:21.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f31c0830 0x5566f31c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 4 client.24763 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:54:21.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566f311cca0 con 0x5566f31c0830 2024-09-10T23:54:21.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.092+0000 7f54b8a00640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f31c0830 0x5566f31c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.093+0000 7f54b8a00640 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f31c0830 0x5566f31c1ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf419a057acabb2c server_cookie=a072a9490de225 in_seq=0 out_seq=0 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.093+0000 7f549aa00640 10 client.24763 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.094+0000 7f549aa00640 1 -- 172.21.15.33:0/1927491718 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566f311cca0 con 0x5566f31c0830 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.094+0000 7f549aa00640 10 client.24763 handle_command_reply: tid=0 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.094+0000 7f54be803740 1 client.24763 shutdown 2024-09-10T23:54:21.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.094+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 msgr2=0x5566f31acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.094+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31acab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5566f31a63c0 tx=0x7f54a800bf60 comp rx=0 tx=0).stop 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 shutdown_connections 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f31c0830 0x5566f31c1ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 --2- 172.21.15.33:0/1927491718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3240 0x5566f31acab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 >> 172.21.15.33:0/1927491718 conn(0x5566f31a1020 msgr2=0x5566f31a6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f549aa00640 0 client.24763 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 shutdown_connections 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 1 -- 172.21.15.33:0/1927491718 wait complete. 2024-09-10T23:54:21.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.095+0000 7f54be803740 20 client.24763 trim_cache size 0 max 16384 2024-09-10T23:54:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.114+0000 7f54be803740 1 Processor -- start 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.114+0000 7f54be803740 1 -- start start 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3b60 0x5566f31a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5566f31bffe0 con 0x5566f31a3240 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566f31c06b0 con 0x5566f31afaf0 2024-09-10T23:54:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54be803740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566f31c0d80 con 0x5566f31a3b60 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38100/0 (socket says 172.21.15.33:38100) 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 -- 172.21.15.33:0/683782148 learned_addr learned my addr 172.21.15.33:0/683782148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9e00640 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b8a00640 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3b60 0x5566f31a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 -- 172.21.15.33:0/683782148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3b60 msgr2=0x5566f31a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3b60 0x5566f31a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 -- 172.21.15.33:0/683782148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 msgr2=0x5566f31ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.115+0000 7f54b9400640 1 -- 172.21.15.33:0/683782148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566f31adcf0 con 0x5566f31a3240 2024-09-10T23:54:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.116+0000 7f54b9400640 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54a80abf60 tx=0x7f54a80e5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4caa3b0745a6fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.116+0000 7f54a5c00640 1 -- 172.21.15.33:0/683782148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8020070 con 0x5566f31a3240 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.116+0000 7f54a5c00640 1 -- 172.21.15.33:0/683782148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54a80abae0 con 0x5566f31a3240 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.116+0000 7f54a5c00640 1 -- 172.21.15.33:0/683782148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8097040 con 0x5566f31a3240 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- 172.21.15.33:0/683782148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 msgr2=0x5566f31a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54a80abf60 tx=0x7f54a80e5c80 comp rx=0 tx=0).stop 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- 172.21.15.33:0/683782148 shutdown_connections 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31afaf0 0x5566f31ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31a3b60 0x5566f31a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 --2- 172.21.15.33:0/683782148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3240 0x5566f31a7d30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- 172.21.15.33:0/683782148 >> 172.21.15.33:0/683782148 conn(0x5566f31a1020 msgr2=0x5566f319bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- 172.21.15.33:0/683782148 shutdown_connections 2024-09-10T23:54:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- 172.21.15.33:0/683782148 wait complete. 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.117+0000 7f54be803740 1 -- start start 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 Processor -- start 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 0x5566f31c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31afaf0 0x5566f31c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5566f31c1b20 con 0x5566f31a3b60 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566f31c1450 con 0x5566f31a3240 2024-09-10T23:54:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566f31c21f0 con 0x5566f31afaf0 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54be803740 10 client.0 _ll_register_callbacks cb 0x7f54a8010ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54b8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54b8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38112/0 (socket says 172.21.15.33:38112) 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.118+0000 7f54b8a00640 1 -- 172.21.15.33:0/3552038159 learned_addr learned my addr 172.21.15.33:0/3552038159 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b9e00640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31afaf0 0x5566f31c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b9400640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 0x5566f31c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 -- 172.21.15.33:0/3552038159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31afaf0 msgr2=0x5566f31c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31afaf0 0x5566f31c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 -- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 msgr2=0x5566f31c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 0x5566f31c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 -- 172.21.15.33:0/3552038159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566f31ca380 con 0x5566f31a3b60 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b9400640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 0x5566f31c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f54b8a00640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f54a002a910 tx=0x7f54a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780dbc35bb49cd00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f549aa00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.119+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a004a070 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54a80abae0 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f54a0003b40 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f54a0035040 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 10 client.14913 fetch_fsmap learned FSMap version 16 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x5566f322db10 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54a80abae0 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f54a003d450 con 0x5566f31a3b60 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 10 client.14913 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 10 client.14913 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 20 client.14913 populate_metadata read hostname 'smithi033' 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f32326e0 0x5566f32313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.120+0000 7f54be803740 4 client.14913 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:54:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.121+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "status"}) -- 0x5566f3118750 con 0x5566f32326e0 2024-09-10T23:54:21.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.121+0000 7f54b9400640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f32326e0 0x5566f32313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:21.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.121+0000 7f54b9400640 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f32326e0 0x5566f32313f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2ef7e79a70c42b server_cookie=9caecfe43eec71d0 in_seq=0 out_seq=0 2024-09-10T23:54:21.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.121+0000 7f549aa00640 10 client.14913 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:54:21.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f549aa00640 1 -- 172.21.15.33:0/3552038159 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5566f3118750 con 0x5566f32326e0 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f549aa00640 10 client.14913 handle_command_reply: tid=0 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 client.14913 shutdown 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 msgr2=0x5566f31c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f54a002a910 tx=0x7f54a0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 shutdown_connections 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5566f32326e0 0x5566f32313f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566f31afaf0 0x5566f31c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5566f31a3b60 0x5566f31c5410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f549aa00640 0 client.14913 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.122+0000 7f54be803740 1 --2- 172.21.15.33:0/3552038159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566f31a3240 0x5566f31c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.123+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 >> 172.21.15.33:0/3552038159 conn(0x5566f31a1020 msgr2=0x5566f31a7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.123+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 shutdown_connections 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.123+0000 7f54be803740 1 -- 172.21.15.33:0/3552038159 wait complete. 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.123+0000 7f54be803740 20 client.14913 trim_cache size 0 max 16384 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34688, 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:54:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 23.383198295, 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 16, 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 83, 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 36.913183084000003 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:54:21.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 msgr2=0x7f549c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 0x7f549c0b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54ac005f10 tx=0x7f54ac000f40 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 msgr2=0x7f54b419b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54a800d950 tx=0x7f54a800de10 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 shutdown_connections 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f549c0b52e0 0x7f549c0b77a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f54b4109150 0x7f54b41a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54b41087d0 0x7f54b419b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 --2- 172.21.15.33:0/1759328256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54b4102dc0 0x7f54b419b3d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 >> 172.21.15.33:0/1759328256 conn(0x7f54b40fe830 msgr2=0x7f54b4104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 shutdown_connections 2024-09-10T23:54:21.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:21.124+0000 7f54bbe00640 1 -- 172.21.15.33:0/1759328256 wait complete. 2024-09-10T23:54:22.028 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:54:22.028 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:22.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:54:22.077 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:21 smithi033 ceph-mon[30593]: pgmap v360: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:22.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:21 smithi052 ceph-mon[33526]: pgmap v360: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:22.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:21 smithi189 ceph-mon[34000]: pgmap v360: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 -- 172.21.15.33:0/690423042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0077ff0 msgr2=0x7f07e0113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 --2- 172.21.15.33:0/690423042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0077ff0 0x7f07e0113450 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009900 tx=0x7f07c802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 -- 172.21.15.33:0/690423042 shutdown_connections 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 --2- 172.21.15.33:0/690423042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0113990 0x7f07e0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 --2- 172.21.15.33:0/690423042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0077ff0 0x7f07e0113450 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 --2- 172.21.15.33:0/690423042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 0x7f07e0077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.038+0000 7f07e5200640 1 -- 172.21.15.33:0/690423042 >> 172.21.15.33:0/690423042 conn(0x7f07e0100a50 msgr2=0x7f07e0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.039+0000 7f07e5200640 1 -- 172.21.15.33:0/690423042 shutdown_connections 2024-09-10T23:54:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.039+0000 7f07e5200640 1 -- 172.21.15.33:0/690423042 wait complete. 2024-09-10T23:54:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 Processor -- start 2024-09-10T23:54:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 -- start start 2024-09-10T23:54:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 0x7f07e019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0077ff0 0x7f07e019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07e0119220 con 0x7f07e0113990 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f07e01190a0 con 0x7f07e00776d0 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.040+0000 7f07e5200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07e01193a0 con 0x7f07e0077ff0 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38134/0 (socket says 172.21.15.33:38134) 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 -- 172.21.15.33:0/3270210548 learned_addr learned my addr 172.21.15.33:0/3270210548 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07dde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 0x7f07e019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07d5400640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0077ff0 0x7f07e019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 -- 172.21.15.33:0/3270210548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0077ff0 msgr2=0x7f07e019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0077ff0 0x7f07e019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 -- 172.21.15.33:0/3270210548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 msgr2=0x7f07e019f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 0x7f07e019f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.041+0000 7f07de800640 1 -- 172.21.15.33:0/3270210548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e01a5820 con 0x7f07e0113990 2024-09-10T23:54:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07de800640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9d0 tx=0x7f07d800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8004d20 con 0x7f07e0113990 2024-09-10T23:54:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07d8005020 con 0x7f07e0113990 2024-09-10T23:54:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80116d0 con 0x7f07e0113990 2024-09-10T23:54:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e01a5b10 con 0x7f07e0113990 2024-09-10T23:54:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.042+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e01ac1d0 con 0x7f07e0113990 2024-09-10T23:54:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.043+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e0077ab0 con 0x7f07e0113990 2024-09-10T23:54:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.045+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f07d800f040 con 0x7f07e0113990 2024-09-10T23:54:23.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.047+0000 7f07d7400640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 0x7f07c40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.047+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f07d80e5fd0 con 0x7f07e0113990 2024-09-10T23:54:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.047+0000 7f07dde00640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 0x7f07c40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:23.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.048+0000 7f07dde00640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 0x7f07c40b7820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07d000abe0 tx=0x7f07d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.050+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07d8016030 con 0x7f07e0113990 2024-09-10T23:54:23.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.283+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07e01ac530 con 0x7f07e0113990 2024-09-10T23:54:23.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.283+0000 7f07d7400640 1 -- 172.21.15.33:0/3270210548 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f07d80acbf0 con 0x7f07e0113990 2024-09-10T23:54:23.285 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:54:23.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 msgr2=0x7f07c40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 0x7f07c40b7820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07d000abe0 tx=0x7f07d000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 msgr2=0x7f07e01a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9d0 tx=0x7f07d800edd0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 shutdown_connections 2024-09-10T23:54:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07c40b5360 0x7f07c40b7820 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e0113990 0x7f07e01a5050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07e0077ff0 0x7f07e019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 --2- 172.21.15.33:0/3270210548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07e00776d0 0x7f07e019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 >> 172.21.15.33:0/3270210548 conn(0x7f07e0100a50 msgr2=0x7f07e0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 shutdown_connections 2024-09-10T23:54:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:23.286+0000 7f07e5200640 1 -- 172.21.15.33:0/3270210548 wait complete. 2024-09-10T23:54:23.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:23 smithi033 ceph-mon[30593]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:23.940 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:23 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3270210548' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:23.978 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:54:23.979 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:54:23.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:54:23.979 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:54:23.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:23.979 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-10T23:54:24.016 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:54:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:54:24.016 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:54:24.017 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42038sec preferred_lft 42038sec 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:54:24.018 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-10T23:54:24.019 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:54:24.019 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:54:24.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:54:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:23 smithi052 ceph-mon[33526]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:23 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3270210548' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:54:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:23 smithi189 ceph-mon[34000]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:23 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3270210548' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:54:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:24.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:24.437 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:54:24.494 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-10T23:54:24.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:24.498 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-10T23:54:24.548 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-10T23:54:24.548 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:54:24.548 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:54:24.548 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:54:24.548 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:54:24.549 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:54:24.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:54:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:25.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:25.149 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-10T23:54:25.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:25.186 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-10T23:54:25.263 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:54:25.263 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:54:25.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:25.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T23:54:25.263 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:54:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:54:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:25.442 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T23:54:25.442 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:54:25.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:54:25.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:25.693 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:54:25.693 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:54:25.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-10T23:54:25.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:54:25.693 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:54:25.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:54:25.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:25.862 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T23:54:25.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:54:25.862 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:25.898 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:54:25.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:54:25.899 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:25.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-10T23:54:26.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:25 smithi033 ceph-mon[30593]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:26.075 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-10T23:54:26.152 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-10T23:54:26.153 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/437b4d012036d8e3af53a023523cce54ac31ed96826d8160f06091a1e02047c9/merged 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/085d82ac78b4762fcce28eb773044281472f5b3a7eaa86eae6180251ddb1647d/merged 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:26.154 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ecc68c373b467fb5798dbd35f04b9dc0807fa04870fda58548a08ee2210a883e/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/6cd0914955d8c45c80d646495269c19810a2703a67cd70de091bee394028df86/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c1520af8389fe03b1b0169460a2b41f889bd48168b8e57f5051f152da3640d22/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/938483e170c5c2711581d0c09d07bfe535acc9d75679ae5e49a68ee4b8212b7c/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/4901f7d0058de69266e4753965f0253b8b2a1ada6d307792f03032e10c8eb511/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f4a70eeb387e14bc2f9b9ab21574e68b3f2b7852a0a2ad752870f62a52982392/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/fd697faf9c5292486f7c4a6750a1ed3d2888b4edbc864d21e03578952a7e3d4c/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/0cb546a2397883b1c46cc26aded6a710a1d66144a17be23c4d76218bae519e82/merged 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:26.155 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:26.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:26.156 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-10T23:54:26.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:25 smithi052 ceph-mon[33526]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:26.232 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:54:26.232 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T23:54:26.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-10T23:54:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:25 smithi189 ceph-mon[34000]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:26.333 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-10T23:54:26.370 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-10T23:54:26.371 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/437b4d012036d8e3af53a023523cce54ac31ed96826d8160f06091a1e02047c9/merged 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/085d82ac78b4762fcce28eb773044281472f5b3a7eaa86eae6180251ddb1647d/merged 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:26.372 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ecc68c373b467fb5798dbd35f04b9dc0807fa04870fda58548a08ee2210a883e/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/6cd0914955d8c45c80d646495269c19810a2703a67cd70de091bee394028df86/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c1520af8389fe03b1b0169460a2b41f889bd48168b8e57f5051f152da3640d22/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/938483e170c5c2711581d0c09d07bfe535acc9d75679ae5e49a68ee4b8212b7c/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/4901f7d0058de69266e4753965f0253b8b2a1ada6d307792f03032e10c8eb511/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f4a70eeb387e14bc2f9b9ab21574e68b3f2b7852a0a2ad752870f62a52982392/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/fd697faf9c5292486f7c4a6750a1ed3d2888b4edbc864d21e03578952a7e3d4c/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/0cb546a2397883b1c46cc26aded6a710a1d66144a17be23c4d76218bae519e82/merged 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:26.373 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:26.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:26.374 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-10T23:54:26.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:2024-09-10T23:54:26.452+0000 7f00b9620480 -1 init, newargv = 0x5650cf71b7d0 newargc=15 2024-09-10T23:54:26.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[76855]: starting ceph client 2024-09-10T23:54:26.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[76855]: starting fuse 2024-09-10T23:54:27.553 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-10T23:54:27.617 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-10T23:54:27.656 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:54:27.657 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/437b4d012036d8e3af53a023523cce54ac31ed96826d8160f06091a1e02047c9/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/085d82ac78b4762fcce28eb773044281472f5b3a7eaa86eae6180251ddb1647d/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ecc68c373b467fb5798dbd35f04b9dc0807fa04870fda58548a08ee2210a883e/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/6cd0914955d8c45c80d646495269c19810a2703a67cd70de091bee394028df86/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c1520af8389fe03b1b0169460a2b41f889bd48168b8e57f5051f152da3640d22/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/938483e170c5c2711581d0c09d07bfe535acc9d75679ae5e49a68ee4b8212b7c/merged 2024-09-10T23:54:27.658 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/4901f7d0058de69266e4753965f0253b8b2a1ada6d307792f03032e10c8eb511/merged 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f4a70eeb387e14bc2f9b9ab21574e68b3f2b7852a0a2ad752870f62a52982392/merged 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/fd697faf9c5292486f7c4a6750a1ed3d2888b4edbc864d21e03578952a7e3d4c/merged 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/0cb546a2397883b1c46cc26aded6a710a1d66144a17be23c4d76218bae519e82/merged 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:54:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:27.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:27.660 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-10T23:54:27.738 INFO:teuthology.orchestra.run.smithi033.stdout:120 2024-09-10T23:54:27.738 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T23:54:27.739 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-09-10T23:54:27.740 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-09-10T23:54:27.741 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:54:27.741 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:54:27.741 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.admin")) 2024-09-10T23:54:27.741 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-09-10T23:54:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.admin.76855.asok 2024-09-10T23:54:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:27.920 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76855.asok 2024-09-10T23:54:27.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:27.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76855.asok status 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "admin", 2024-09-10T23:54:28.107 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "76855", 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 14925, 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 14925 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:54:28.108 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 787765145 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 787765145 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.14925 192.168.0.1:0/787765145", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/787765145", 2024-09-10T23:54:28.109 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 16, 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 83, 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-09-10T23:54:28.110 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:54:28.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:28.120 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-09-10T23:54:28.120 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:28.157 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-09-10T23:54:28.157 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:28.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:28.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:28.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:27 smithi052 ceph-mon[33526]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:28.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:27 smithi033 ceph-mon[30593]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:28.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T23:54:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:27 smithi189 ceph-mon[34000]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:28.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:54:28.369 INFO:teuthology.orchestra.run.smithi033.stdout:# file: . 2024-09-10T23:54:28.369 INFO:teuthology.orchestra.run.smithi033.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T23:54:28.369 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:28.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:54:28.377 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:54:28.377 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:54:28.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:54:28.835 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.435+0000 7fa84aa00640 1 -- 172.21.15.33:0/3309884227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844103cc0 msgr2=0x7fa8441040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.435+0000 7fa84aa00640 1 --2- 172.21.15.33:0/3309884227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844103cc0 0x7fa8441040a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa83402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 -- 172.21.15.33:0/3309884227 shutdown_connections 2024-09-10T23:54:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 --2- 172.21.15.33:0/3309884227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa84410d120 0x7fa84410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 --2- 172.21.15.33:0/3309884227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8441045e0 0x7fa84410cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 --2- 172.21.15.33:0/3309884227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844103cc0 0x7fa8441040a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 -- 172.21.15.33:0/3309884227 >> 172.21.15.33:0/3309884227 conn(0x7fa8440fd700 msgr2=0x7fa8440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 -- 172.21.15.33:0/3309884227 shutdown_connections 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.436+0000 7fa84aa00640 1 -- 172.21.15.33:0/3309884227 wait complete. 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 Processor -- start 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 -- start start 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844103cc0 0x7fa844101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 0x7fa844101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa844112c40 con 0x7fa84410d120 2024-09-10T23:54:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa844112ac0 con 0x7fa8441045e0 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa84aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa844112dc0 con 0x7fa844103cc0 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa848a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.437+0000 7fa848a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38142/0 (socket says 172.21.15.33:38142) 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 -- 172.21.15.33:0/508871087 learned_addr learned my addr 172.21.15.33:0/508871087 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa843e00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844103cc0 0x7fa844101970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa843400640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 0x7fa844101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 -- 172.21.15.33:0/508871087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844103cc0 msgr2=0x7fa844101970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844103cc0 0x7fa844101970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 -- 172.21.15.33:0/508871087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 msgr2=0x7fa844101eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 0x7fa844101eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 -- 172.21.15.33:0/508871087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8441a75b0 con 0x7fa84410d120 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa843400640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 0x7fa844101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa848a00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00eaa0 tx=0x7fa83c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.438+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00cdb0 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.439+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c005020 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.439+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0116d0 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.439+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8441a78a0 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.439+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8441a7d90 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.440+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8441040a0 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.442+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fa83c00f040 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.443+0000 7fa840c00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 0x7fa8280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.444+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7fa83c0e60f0 con 0x7fa84410d120 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.444+0000 7fa843e00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 0x7fa8280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.444+0000 7fa843e00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 0x7fa8280b77a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8340057c0 tx=0x7fa8340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.445+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa83c016030 con 0x7fa84410d120 2024-09-10T23:54:29.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.658+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa84402e5c0 con 0x7fa84410d120 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.658+0000 7fa840c00640 1 -- 172.21.15.33:0/508871087 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+591 (secure 0 0 0) 0x7fa83c0acd10 con 0x7fa84410d120 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/391857889 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3555926237 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1526717857 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:29.660 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:29.661 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3494052248 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:29.661 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2678027127 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:29.661 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2864911126 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:29.661 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 msgr2=0x7fa8280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 0x7fa8280b77a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8340057c0 tx=0x7fa8340058d0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 msgr2=0x7fa8441023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00eaa0 tx=0x7fa83c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 shutdown_connections 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b52e0 0x7fa8280b77a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa84410d120 0x7fa8441023f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441045e0 0x7fa844101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 --2- 172.21.15.33:0/508871087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844103cc0 0x7fa844101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 >> 172.21.15.33:0/508871087 conn(0x7fa8440fd700 msgr2=0x7fa8440fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:29.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 shutdown_connections 2024-09-10T23:54:29.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:29.661+0000 7fa84aa00640 1 -- 172.21.15.33:0/508871087 wait complete. 2024-09-10T23:54:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:29 smithi033 ceph-mon[30593]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:29 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/508871087' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:30.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:29 smithi052 ceph-mon[33526]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:30.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:29 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/508871087' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:29 smithi189 ceph-mon[34000]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:29 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/508871087' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:30.415 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:54:30.416 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:54:30.453 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T23:54:30.872 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:31.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 -- 172.21.15.33:0/2673894276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93981087d0 msgr2=0x7f9398108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:31.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 --2- 172.21.15.33:0/2673894276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93981087d0 0x7f9398108c10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9380009900 tx=0x7f938002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 -- 172.21.15.33:0/2673894276 shutdown_connections 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 --2- 172.21.15.33:0/2673894276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9398109150 0x7f939810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 --2- 172.21.15.33:0/2673894276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93981087d0 0x7f9398108c10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 --2- 172.21.15.33:0/2673894276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398102dc0 0x7f93981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 -- 172.21.15.33:0/2673894276 >> 172.21.15.33:0/2673894276 conn(0x7f93980fe830 msgr2=0x7f9398100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 -- 172.21.15.33:0/2673894276 shutdown_connections 2024-09-10T23:54:31.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.537+0000 7f939ea00640 1 -- 172.21.15.33:0/2673894276 wait complete. 2024-09-10T23:54:31.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 Processor -- start 2024-09-10T23:54:31.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 -- start start 2024-09-10T23:54:31.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93981087d0 0x7f9398199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398109150 0x7f939819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112c80 con 0x7f9398102dc0 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112b00 con 0x7f9398109150 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.538+0000 7f939ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112e00 con 0x7f93981087d0 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54934/0 (socket says 172.21.15.33:54934) 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 -- 172.21.15.33:0/3003906945 learned_addr learned my addr 172.21.15.33:0/3003906945 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f939ca00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398109150 0x7f939819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f938f400640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93981087d0 0x7f9398199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 -- 172.21.15.33:0/3003906945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93981087d0 msgr2=0x7f9398199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:31.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93981087d0 0x7f9398199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 -- 172.21.15.33:0/3003906945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398109150 msgr2=0x7f939819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:31.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398109150 0x7f939819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.539+0000 7f9397e00640 1 -- 172.21.15.33:0/3003906945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939819f270 con 0x7f9398102dc0 2024-09-10T23:54:31.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f9397e00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f938800d950 tx=0x7f938800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388017030 con 0x7f9398102dc0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9388004020 con 0x7f9398102dc0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939819f560 con 0x7f9398102dc0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880055d0 con 0x7f9398102dc0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.540+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981a5df0 con 0x7f9398102dc0 2024-09-10T23:54:31.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.541+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93981031a0 con 0x7f9398102dc0 2024-09-10T23:54:31.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.543+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9388009a30 con 0x7f9398102dc0 2024-09-10T23:54:31.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.545+0000 7f9395600640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 0x7f937c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:31.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.545+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f93880e5e10 con 0x7f9398102dc0 2024-09-10T23:54:31.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.545+0000 7f938f400640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 0x7f937c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:31.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.546+0000 7f938f400640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 0x7f937c0b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93800057c0 tx=0x7f93800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:31.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.546+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93880acab0 con 0x7f9398102dc0 2024-09-10T23:54:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.756+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f939819a2f0 con 0x7f9398102dc0 2024-09-10T23:54:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.756+0000 7f9395600640 1 -- 172.21.15.33:0/3003906945 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+591 (secure 0 0 0) 0x7f93880ac3b0 con 0x7f9398102dc0 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/391857889 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3555926237 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1526717857 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3494052248 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2678027127 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:31.759 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2864911126 2024-09-11T23:44:17.611833+0000 2024-09-10T23:54:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-10T23:54:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 msgr2=0x7f937c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 0x7f937c0b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93800057c0 tx=0x7f93800058d0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 msgr2=0x7f93981991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f938800d950 tx=0x7f938800de10 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 shutdown_connections 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f937c0b5360 0x7f937c0b7820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9398109150 0x7f939819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93981087d0 0x7f9398199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 --2- 172.21.15.33:0/3003906945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9398102dc0 0x7f93981991c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 >> 172.21.15.33:0/3003906945 conn(0x7f93980fe830 msgr2=0x7f9398100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 shutdown_connections 2024-09-10T23:54:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:31.759+0000 7f939ea00640 1 -- 172.21.15.33:0/3003906945 wait complete. 2024-09-10T23:54:32.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:31 smithi033 ceph-mon[30593]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:32.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:31 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3003906945' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:32.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:31 smithi052 ceph-mon[33526]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:32.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:31 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3003906945' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:31 smithi189 ceph-mon[34000]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T23:54:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:31 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3003906945' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T23:54:32.540 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-09-10T23:54:32.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:32.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:54:32.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[76855]: fuse finished with error 0 and tester_r 0 2024-09-10T23:54:32.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:54:32.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:54:32.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:54:32.633 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T23:54:32.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:54:33.141 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:33.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 -- 172.21.15.33:0/4262759949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40077ff0 msgr2=0x7f3f40113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 --2- 172.21.15.33:0/4262759949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40077ff0 0x7f3f40113450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009900 tx=0x7f3f2c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 -- 172.21.15.33:0/4262759949 shutdown_connections 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 --2- 172.21.15.33:0/4262759949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40113990 0x7f3f40115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 --2- 172.21.15.33:0/4262759949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40077ff0 0x7f3f40113450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 --2- 172.21.15.33:0/4262759949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f40077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 -- 172.21.15.33:0/4262759949 >> 172.21.15.33:0/4262759949 conn(0x7f3f40100a50 msgr2=0x7f3f40102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 -- 172.21.15.33:0/4262759949 shutdown_connections 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.713+0000 7f3f48600640 1 -- 172.21.15.33:0/4262759949 wait complete. 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.714+0000 7f3f48600640 1 Processor -- start 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.714+0000 7f3f48600640 1 -- start start 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:33.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 0x7f3f4019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 0x7f3f401a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3f40119270 con 0x7f3f40113990 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f401190f0 con 0x7f3f400776d0 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f48600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f401193f0 con 0x7f3f40077ff0 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f46600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 0x7f3f401a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f45c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f45c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:48686/0 (socket says 172.21.15.33:48686) 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f45200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 0x7f3f4019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.715+0000 7f3f45c00640 1 -- 172.21.15.33:0/1464169651 learned_addr learned my addr 172.21.15.33:0/1464169651 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 -- 172.21.15.33:0/1464169651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 msgr2=0x7f3f4019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 0x7f3f4019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 -- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 msgr2=0x7f3f401a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 0x7f3f401a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 -- 172.21.15.33:0/1464169651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f401a5890 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f46600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 0x7f3f401a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45200640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 0x7f3f4019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.716+0000 7f3f45c00640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e9f0 tx=0x7f3f3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.717+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400cd80 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.717+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f401a5b80 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.717+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f340108c0 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.717+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34018840 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.717+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f401ac410 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.718+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f40077ab0 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.721+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3f34010430 con 0x7f3f400776d0 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.722+0000 7f3f3e000640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 0x7f3f280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:33.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.722+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f3f340e6350 con 0x7f3f400776d0 2024-09-10T23:54:33.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.722+0000 7f3f45200640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 0x7f3f280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:33.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.723+0000 7f3f45200640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 0x7f3f280b7820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006010 tx=0x7f3f2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:33.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.725+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3f340ac920 con 0x7f3f400776d0 2024-09-10T23:54:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.925+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f4010eb20 con 0x7f3f400776d0 2024-09-10T23:54:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.927+0000 7f3f3e000640 1 -- 172.21.15.33:0/1464169651 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24177 (secure 0 0 0) 0x7f3f340b1350 con 0x7f3f400776d0 2024-09-10T23:54:33.929 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:33.929 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:07.807009+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:54:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 msgr2=0x7f3f280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 0x7f3f280b7820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006010 tx=0x7f3f2c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 msgr2=0x7f3f4019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e9f0 tx=0x7f3f3400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 shutdown_connections 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f280b5360 0x7f3f280b7820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f40113990 0x7f3f401a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f40077ff0 0x7f3f4019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 --2- 172.21.15.33:0/1464169651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f400776d0 0x7f3f4019f7e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 >> 172.21.15.33:0/1464169651 conn(0x7f3f40100a50 msgr2=0x7f3f40102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 shutdown_connections 2024-09-10T23:54:33.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:33.929+0000 7f3f48600640 1 -- 172.21.15.33:0/1464169651 wait complete. 2024-09-10T23:54:34.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:33 smithi052 ceph-mon[33526]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:34.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:33 smithi033 ceph-mon[30593]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:33 smithi189 ceph-mon[34000]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:34.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:54:35.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:34 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1464169651' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:35.160 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:34 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1464169651' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:35.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:34 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1464169651' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:35.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 -- 172.21.15.33:0/2057849154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5594109150 msgr2=0x7f559410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 --2- 172.21.15.33:0/2057849154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5594109150 0x7f559410f950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f558c009900 tx=0x7f558c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 -- 172.21.15.33:0/2057849154 shutdown_connections 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 --2- 172.21.15.33:0/2057849154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5594109150 0x7f559410f950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 --2- 172.21.15.33:0/2057849154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55941087d0 0x7f5594108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 --2- 172.21.15.33:0/2057849154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 0x7f55941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 -- 172.21.15.33:0/2057849154 >> 172.21.15.33:0/2057849154 conn(0x7f55940fe830 msgr2=0x7f5594100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 -- 172.21.15.33:0/2057849154 shutdown_connections 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.724+0000 7f559a400640 1 -- 172.21.15.33:0/2057849154 wait complete. 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.725+0000 7f559a400640 1 Processor -- start 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.725+0000 7f559a400640 1 -- start start 2024-09-10T23:54:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 0x7f559419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5594109150 0x7f55941a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5594112cc0 con 0x7f55941087d0 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5594112b40 con 0x7f5594102dc0 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f559a400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5594112e40 con 0x7f5594109150 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f558aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f558aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54972/0 (socket says 172.21.15.33:54972) 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f558aa00640 1 -- 172.21.15.33:0/3656878434 learned_addr learned my addr 172.21.15.33:0/3656878434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f5593e00640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5594109150 0x7f55941a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.726+0000 7f5593400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 0x7f559419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 -- 172.21.15.33:0/3656878434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5594109150 msgr2=0x7f55941a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5594109150 0x7f55941a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 -- 172.21.15.33:0/3656878434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 msgr2=0x7f559419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 0x7f559419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 -- 172.21.15.33:0/3656878434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55941a1430 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f558aa00640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f557c00eb90 tx=0x7f557c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c004d20 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f557c00ee90 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c010690 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55941a1720 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.727+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55941a7de0 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.728+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55941031a0 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.731+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f557c005020 con 0x7f55941087d0 2024-09-10T23:54:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.732+0000 7f5590c00640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.732+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f557c0e6470 con 0x7f55941087d0 2024-09-10T23:54:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.732+0000 7f5593400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.733+0000 7f5593400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 0x7f55780b77a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5584009bd0 tx=0x7f5584005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.736+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f557c0ad0f0 con 0x7f55941087d0 2024-09-10T23:54:35.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.939+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f559402e5c0 con 0x7f55941087d0 2024-09-10T23:54:35.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.941+0000 7f5590c00640 1 -- 172.21.15.33:0/3656878434 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24177 (secure 0 0 0) 0x7f557c0ac9f0 con 0x7f55941087d0 2024-09-10T23:54:35.943 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:54:35.943 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:07.807009+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 msgr2=0x7f55780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 0x7f55780b77a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5584009bd0 tx=0x7f5584005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 msgr2=0x7f559419b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f557c00eb90 tx=0x7f557c00c6a0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 shutdown_connections 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.943+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5594109150 0x7f55941a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.944+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55941087d0 0x7f559419b8c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.944+0000 7f559a400640 1 --2- 172.21.15.33:0/3656878434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5594102dc0 0x7f559419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.944+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 >> 172.21.15.33:0/3656878434 conn(0x7f55940fe830 msgr2=0x7f5594104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.944+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 shutdown_connections 2024-09-10T23:54:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:35.944+0000 7f559a400640 1 -- 172.21.15.33:0/3656878434 wait complete. 2024-09-10T23:54:36.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:35 smithi189 ceph-mon[34000]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:36.156 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:35 smithi033 ceph-mon[30593]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:36.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:35 smithi052 ceph-mon[33526]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-10T23:54:36.709 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:54:37.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:36 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3656878434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:37.095 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:37.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:36 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3656878434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:37.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:36 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3656878434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:54:37.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 -- 172.21.15.33:0/2044168157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 msgr2=0x7fce281051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:37.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 --2- 172.21.15.33:0/2044168157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce281051d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce18009900 tx=0x7fce1802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 -- 172.21.15.33:0/2044168157 shutdown_connections 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 --2- 172.21.15.33:0/2044168157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 0x7fce28111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 --2- 172.21.15.33:0/2044168157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 0x7fce2810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 --2- 172.21.15.33:0/2044168157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce281051d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 -- 172.21.15.33:0/2044168157 >> 172.21.15.33:0/2044168157 conn(0x7fce28100840 msgr2=0x7fce28102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 -- 172.21.15.33:0/2044168157 shutdown_connections 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.752+0000 7fce2d000640 1 -- 172.21.15.33:0/2044168157 wait complete. 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 Processor -- start 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 -- start start 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 0x7fce2819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 0x7fce281a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fce28114d40 con 0x7fce28104df0 2024-09-10T23:54:37.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce28114bc0 con 0x7fce2810a800 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.753+0000 7fce2d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce28114ec0 con 0x7fce2810b180 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54980/0 (socket says 172.21.15.33:54980) 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 -- 172.21.15.33:0/815188277 learned_addr learned my addr 172.21.15.33:0/815188277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce26a00640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 0x7fce2819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27e00640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 0x7fce281a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 -- 172.21.15.33:0/815188277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 msgr2=0x7fce281a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 0x7fce281a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 -- 172.21.15.33:0/815188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 msgr2=0x7fce2819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 0x7fce2819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.754+0000 7fce27400640 1 -- 172.21.15.33:0/815188277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce281a1220 con 0x7fce28104df0 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce27400640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce1802a910 tx=0x7fce18003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:37.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1803f070 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce18003e40 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce281a14b0 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18035030 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.755+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce281a7bd0 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.756+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce281051d0 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.758+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fce18031400 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.759+0000 7fce1fe00640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 0x7fce0c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.760+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7fce18106d10 con 0x7fce28104df0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.760+0000 7fce26a00640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 0x7fce0c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.760+0000 7fce26a00640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 0x7fce0c0b7850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce281031f0 tx=0x7fce1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:37.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.761+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fce180cd930 con 0x7fce28104df0 2024-09-10T23:54:37.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:37.997+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fce281a7ef0 con 0x7fce28104df0 2024-09-10T23:54:38.208 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:37 smithi052 ceph-mon[33526]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:38.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:37 smithi033 ceph-mon[30593]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:37 smithi189 ceph-mon[34000]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.919+0000 7fce1fe00640 1 -- 172.21.15.33:0/815188277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fce180cd230 con 0x7fce28104df0 2024-09-10T23:54:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 msgr2=0x7fce0c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 0x7fce0c0b7850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce281031f0 tx=0x7fce1400b390 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 msgr2=0x7fce2819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce1802a910 tx=0x7fce18003c20 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 shutdown_connections 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fce0c0b5390 0x7fce0c0b7850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810b180 0x7fce281a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce2810a800 0x7fce2819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 --2- 172.21.15.33:0/815188277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce28104df0 0x7fce2819b170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.922+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 >> 172.21.15.33:0/815188277 conn(0x7fce28100840 msgr2=0x7fce28101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:38.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.923+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 shutdown_connections 2024-09-10T23:54:38.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:38.923+0000 7fce2d000640 1 -- 172.21.15.33:0/815188277 wait complete. 2024-09-10T23:54:39.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:38 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:54:39.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:38 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:54:39.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:38 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T23:54:39.834 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T23:54:39.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T23:54:40.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:39 smithi052 ceph-mon[33526]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:40.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:39 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:54:40.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:39 smithi052 ceph-mon[33526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:40.218 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:40.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:39 smithi033 ceph-mon[30593]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:40.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:39 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:54:40.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:39 smithi033 ceph-mon[30593]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:39 smithi189 ceph-mon[34000]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:39 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/815188277' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T23:54:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:39 smithi189 ceph-mon[34000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 -- 172.21.15.33:0/336454276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c109150 msgr2=0x7f874c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 --2- 172.21.15.33:0/336454276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c109150 0x7f874c10f950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8744009ca0 tx=0x7f874402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 -- 172.21.15.33:0/336454276 shutdown_connections 2024-09-10T23:54:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 --2- 172.21.15.33:0/336454276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c109150 0x7f874c10f950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 --2- 172.21.15.33:0/336454276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c1087d0 0x7f874c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 --2- 172.21.15.33:0/336454276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 0x7f874c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 -- 172.21.15.33:0/336454276 >> 172.21.15.33:0/336454276 conn(0x7f874c0fe830 msgr2=0x7f874c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 -- 172.21.15.33:0/336454276 shutdown_connections 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.856+0000 7f8752400640 1 -- 172.21.15.33:0/336454276 wait complete. 2024-09-10T23:54:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 Processor -- start 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 -- start start 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 0x7f874c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c109150 0x7f874c1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112cd0 con 0x7f874c1087d0 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112b50 con 0x7f874c102dc0 2024-09-10T23:54:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.857+0000 7f8752400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112e50 con 0x7f874c109150 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f874b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 0x7f874c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35620/0 (socket says 172.21.15.33:35620) 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 -- 172.21.15.33:0/3957490307 learned_addr learned my addr 172.21.15.33:0/3957490307 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f874be00640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c109150 0x7f874c1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 -- 172.21.15.33:0/3957490307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c109150 msgr2=0x7f874c1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c109150 0x7f874c1a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 -- 172.21.15.33:0/3957490307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 msgr2=0x7f874c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 0x7f874c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.858+0000 7f8742a00640 1 -- 172.21.15.33:0/3957490307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874c1a1430 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8742a00640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f873400e9f0 tx=0x7f873400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873400cd80 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87340054b0 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734010430 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874c1a1720 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.859+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874c1a7de0 con 0x7f874c1087d0 2024-09-10T23:54:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.860+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874c1031a0 con 0x7f874c1087d0 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.862+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8734005000 con 0x7f874c1087d0 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.865+0000 7f8748c00640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 0x7f87300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.865+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f87340e63b0 con 0x7f874c1087d0 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.865+0000 7f874b400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 0x7f87300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.866+0000 7f874b400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 0x7f87300b7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f873c005d00 tx=0x7f873c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:40.867+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8734056220 con 0x7f874c1087d0 2024-09-10T23:54:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.103+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f874c02e5c0 con 0x7f874c1087d0 2024-09-10T23:54:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.929+0000 7f8748c00640 1 -- 172.21.15.33:0/3957490307 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f87340acfd0 con 0x7f874c1087d0 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 msgr2=0x7f87300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 0x7f87300b7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f873c005d00 tx=0x7f873c00b410 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 msgr2=0x7f874c19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f873400e9f0 tx=0x7f873400edf0 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 shutdown_connections 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f87300b5360 0x7f87300b7820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f874c109150 0x7f874c1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f874c1087d0 0x7f874c19b8c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 --2- 172.21.15.33:0/3957490307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f874c102dc0 0x7f874c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.932+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 >> 172.21.15.33:0/3957490307 conn(0x7f874c0fe830 msgr2=0x7f874c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.933+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 shutdown_connections 2024-09-10T23:54:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:41.933+0000 7f8752400640 1 -- 172.21.15.33:0/3957490307 wait complete. 2024-09-10T23:54:42.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:41 smithi052 ceph-mon[33526]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:42.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:41 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:54:42.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:41 smithi033 ceph-mon[30593]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:42.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:41 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:54:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:41 smithi189 ceph-mon[34000]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:41 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T23:54:42.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T23:54:43.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:54:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:54:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:54:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:54:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:42 smithi052 ceph-mon[33526]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:54:43.216 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:54:43.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:42 smithi033 ceph-mon[30593]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3957490307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T23:54:43.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:42 smithi189 ceph-mon[34000]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T23:54:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 -- 172.21.15.33:0/3894826951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 msgr2=0x7f67f410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 --2- 172.21.15.33:0/3894826951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f410cad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009900 tx=0x7f67dc02a400 comp rx=0 tx=0).stop 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 -- 172.21.15.33:0/3894826951 shutdown_connections 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 --2- 172.21.15.33:0/3894826951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 0x7f67f410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 --2- 172.21.15.33:0/3894826951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f410cad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.929+0000 7f67fa200640 1 --2- 172.21.15.33:0/3894826951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.930+0000 7f67fa200640 1 -- 172.21.15.33:0/3894826951 >> 172.21.15.33:0/3894826951 conn(0x7f67f40fd700 msgr2=0x7f67f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.930+0000 7f67fa200640 1 -- 172.21.15.33:0/3894826951 shutdown_connections 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.930+0000 7f67fa200640 1 -- 172.21.15.33:0/3894826951 wait complete. 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.930+0000 7f67fa200640 1 Processor -- start 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 -- start start 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 0x7f67f419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4112c40 con 0x7f67f41045e0 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4112ac0 con 0x7f67f4103cc0 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67fa200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4112dc0 con 0x7f67f410d120 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67eaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67eaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35630/0 (socket says 172.21.15.33:35630) 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67eaa00640 1 -- 172.21.15.33:0/342333199 learned_addr learned my addr 172.21.15.33:0/342333199 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.931+0000 7f67f3e00640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 0x7f67f419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67f3400640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 -- 172.21.15.33:0/342333199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 msgr2=0x7f67f419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 0x7f67f419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 -- 172.21.15.33:0/342333199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 msgr2=0x7f67f41991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 -- 172.21.15.33:0/342333199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f419f260 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67f3400640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67eaa00640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005940 tx=0x7f67dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc03f030 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f419f4f0 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67dc004440 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.932+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc035070 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.933+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41a5c10 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.933+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f41040a0 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.936+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f67dc003c80 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.937+0000 7f67f0c00640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 0x7f67d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.937+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8802+0+0 (secure 0 0 0) 0x7f67dc106aa0 con 0x7f67f41045e0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.937+0000 7f67f3400640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 0x7f67d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.938+0000 7f67f3400640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 0x7f67d80b77a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f67e4005d00 tx=0x7f67e4005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:43.939+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f67dc0cd6c0 con 0x7f67f41045e0 2024-09-10T23:54:44.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.177+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f67f402e5c0 con 0x7f67f41045e0 2024-09-10T23:54:44.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:44.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:active 2024-09-10T23:54:44.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:54:44.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:54:44.180 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: Cluster is now healthy 2024-09-10T23:54:44.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:54:44.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:54:44.181 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:43 smithi033 ceph-mon[30593]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:54:44.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:active 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: Cluster is now healthy 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:54:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:43 smithi052 ceph-mon[33526]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:54:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] up:active 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: Cluster is now healthy 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-09-10T23:54:44.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:43 smithi189 ceph-mon[34000]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-09-10T23:54:44.955 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 23:54:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: 2024-09-10T23:54:44.469+0000 7fdee2600640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T23:54:44.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.953+0000 7f67f0c00640 1 -- 172.21.15.33:0/342333199 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f67dc0d4e20 con 0x7f67f41045e0 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.956+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 msgr2=0x7f67d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.956+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 0x7f67d80b77a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f67e4005d00 tx=0x7f67e4005ed0 comp rx=0 tx=0).stop 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 msgr2=0x7f67f41996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005940 tx=0x7f67dc004040 comp rx=0 tx=0).stop 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 shutdown_connections 2024-09-10T23:54:44.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f67d80b52e0 0x7f67d80b77a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67f410d120 0x7f67f419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f41045e0 0x7f67f41996f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 --2- 172.21.15.33:0/342333199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4103cc0 0x7f67f41991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 >> 172.21.15.33:0/342333199 conn(0x7f67f40fd700 msgr2=0x7f67f40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 shutdown_connections 2024-09-10T23:54:44.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:44.957+0000 7f67fa200640 1 -- 172.21.15.33:0/342333199 wait complete. 2024-09-10T23:54:45.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:44 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:active 2024-09-10T23:54:45.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:44 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:45.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:44 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:54:45.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:44 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:active 2024-09-10T23:54:45.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:44 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:45.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:44 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:54:45.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:44 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] up:active 2024-09-10T23:54:45.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:44 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:45.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:44 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T23:54:46.012 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T23:54:46.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:45 smithi033 ceph-mon[30593]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-09-10T23:54:46.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:45 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:54:46.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:45 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:46.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:45 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:45 smithi189 ceph-mon[34000]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-09-10T23:54:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:45 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:54:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:45 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:45 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:45 smithi052 ceph-mon[33526]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-09-10T23:54:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:45 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/342333199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T23:54:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:45 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-09-10T23:54:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:45 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 -- 172.21.15.33:0/3002130111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 msgr2=0x7f14c410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 --2- 172.21.15.33:0/3002130111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c410f3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009ca0 tx=0x7f14bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 -- 172.21.15.33:0/3002130111 shutdown_connections 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 --2- 172.21.15.33:0/3002130111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c410f3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 --2- 172.21.15.33:0/3002130111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4104420 0x7f14c410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 --2- 172.21.15.33:0/3002130111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4103b00 0x7f14c4103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 -- 172.21.15.33:0/3002130111 >> 172.21.15.33:0/3002130111 conn(0x7f14c40fd540 msgr2=0x7f14c40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 -- 172.21.15.33:0/3002130111 shutdown_connections 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.984+0000 7f14c9a00640 1 -- 172.21.15.33:0/3002130111 wait complete. 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 Processor -- start 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 -- start start 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4103b00 0x7f14c41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4104420 0x7f14c4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4112ad0 con 0x7f14c410cf60 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4112950 con 0x7f14c4103b00 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.985+0000 7f14c9a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4112c50 con 0x7f14c4104420 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35648/0 (socket says 172.21.15.33:35648) 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 -- 172.21.15.33:0/2609388821 learned_addr learned my addr 172.21.15.33:0/2609388821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c3e00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4103b00 0x7f14c41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14bb400640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4104420 0x7f14c4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 -- 172.21.15.33:0/2609388821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4104420 msgr2=0x7f14c4101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:47.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4104420 0x7f14c4101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 -- 172.21.15.33:0/2609388821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4103b00 msgr2=0x7f14c41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4103b00 0x7f14c41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 -- 172.21.15.33:0/2609388821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c41a7320 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.986+0000 7f14c9000640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14bc031040 tx=0x7f14bc032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.987+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc004040 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.987+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14bc004670 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.987+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c41a75b0 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.987+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc030bb0 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.987+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c41a7b40 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.988+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c4103ee0 con 0x7f14c410cf60 2024-09-10T23:54:47.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.992+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f14bc0041e0 con 0x7f14c410cf60 2024-09-10T23:54:47.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.993+0000 7f14c1600640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 0x7f14a80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:47.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.993+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9071+0+0 (secure 0 0 0) 0x7f14bc107240 con 0x7f14c410cf60 2024-09-10T23:54:47.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.993+0000 7f14c3e00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 0x7f14a80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:47.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.994+0000 7f14c3e00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 0x7f14a80b78d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14b400bbe0 tx=0x7f14b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:47.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:46.995+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14bc0cdd60 con 0x7f14c410cf60 2024-09-10T23:54:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.229+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f14c4102ab0 con 0x7f14c410cf60 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:54:47.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-10T23:54:47.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-10T23:54:47.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]} : dispatch 2024-09-10T23:54:47.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:46 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-10T23:54:47.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:54:47.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-10T23:54:47.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-10T23:54:47.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]} : dispatch 2024-09-10T23:54:47.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:46 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-09-10T23:54:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]} : dispatch 2024-09-10T23:54:47.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:46 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]} : dispatch 2024-09-10T23:54:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.974+0000 7f14c1600640 1 -- 172.21.15.33:0/2609388821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f14bc0cd660 con 0x7f14c410cf60 2024-09-10T23:54:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 msgr2=0x7f14a80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 0x7f14a80b78d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14b400bbe0 tx=0x7f14b400b390 comp rx=0 tx=0).stop 2024-09-10T23:54:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 msgr2=0x7f14c4102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14bc031040 tx=0x7f14bc032bc0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 shutdown_connections 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14a80b5410 0x7f14a80b78d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14c410cf60 0x7f14c4102230 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14c4104420 0x7f14c4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 --2- 172.21.15.33:0/2609388821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c4103b00 0x7f14c41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.977+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 >> 172.21.15.33:0/2609388821 conn(0x7f14c40fd540 msgr2=0x7f14c410f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:47.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.978+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 shutdown_connections 2024-09-10T23:54:47.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:47.978+0000 7f14c9a00640 1 -- 172.21.15.33:0/2609388821 wait complete. 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: pgmap v373: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T23:54:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:54:48.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:54:48.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: pgmap v373: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:54:48.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: pgmap v373: 129 pgs: 129 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8, 9, 11]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T23:54:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T23:54:48.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T23:54:48.818 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T23:54:48.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T23:54:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:49.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:48 smithi033 ceph-mon[30593]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:54:49.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:48 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:54:49.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:48 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:49.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:48 smithi189 ceph-mon[34000]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:54:49.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:48 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:54:49.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:48 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:49.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:48 smithi052 ceph-mon[33526]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T23:54:49.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:48 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2609388821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T23:54:49.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:48 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:54:49.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 -- 172.21.15.33:0/3017745869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 msgr2=0x7f6700075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 --2- 172.21.15.33:0/3017745869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f6700075920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009900 tx=0x7f66f402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 -- 172.21.15.33:0/3017745869 shutdown_connections 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 --2- 172.21.15.33:0/3017745869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 0x7f67001117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 --2- 172.21.15.33:0/3017745869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 0x7f670010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 --2- 172.21.15.33:0/3017745869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f6700075920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 -- 172.21.15.33:0/3017745869 >> 172.21.15.33:0/3017745869 conn(0x7f67000fe830 msgr2=0x7f6700100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 -- 172.21.15.33:0/3017745869 shutdown_connections 2024-09-10T23:54:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.833+0000 7f6708200640 1 -- 172.21.15.33:0/3017745869 wait complete. 2024-09-10T23:54:49.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.834+0000 7f6708200640 1 Processor -- start 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.834+0000 7f6708200640 1 -- start start 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 0x7f670019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 0x7f67001a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6700114ea0 con 0x7f6700075540 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6700114d20 con 0x7f670010f3e0 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6708200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6700115020 con 0x7f6700075f40 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6705800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6705800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35660/0 (socket says 172.21.15.33:35660) 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6704e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 0x7f670019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:49.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6705800640 1 -- 172.21.15.33:0/2822643284 learned_addr learned my addr 172.21.15.33:0/2822643284 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.835+0000 7f6706200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 0x7f67001a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 -- 172.21.15.33:0/2822643284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 msgr2=0x7f670019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 0x7f670019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 -- 172.21.15.33:0/2822643284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 msgr2=0x7f67001a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 0x7f67001a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 -- 172.21.15.33:0/2822643284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67001a1480 con 0x7f6700075540 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6705800640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66f402a910 tx=0x7f66f4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f403f070 con 0x7f6700075540 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f403baf0 con 0x7f6700075540 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67001a1710 con 0x7f6700075540 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.836+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4035030 con 0x7f6700075540 2024-09-10T23:54:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.837+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67001a7e30 con 0x7f6700075540 2024-09-10T23:54:49.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.838+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6700075920 con 0x7f6700075540 2024-09-10T23:54:49.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.840+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f66f403b660 con 0x7f6700075540 2024-09-10T23:54:49.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.842+0000 7f66fe000640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 0x7f66e80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:49.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.842+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f66f4106d00 con 0x7f6700075540 2024-09-10T23:54:49.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.842+0000 7f6704e00640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 0x7f66e80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:49.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.843+0000 7f6704e00640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 0x7f66e80b77a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6700101040 tx=0x7f66ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:49.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:49.844+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f66f40cd1d0 con 0x7f6700075540 2024-09-10T23:54:50.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.069+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6700100440 con 0x7f66e80b52e0 2024-09-10T23:54:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.104+0000 7f66fe000640 1 -- 172.21.15.33:0/2822643284 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6700100440 con 0x7f66e80b52e0 2024-09-10T23:54:50.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:49 smithi033 ceph-mon[30593]: pgmap v376: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:50.107 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:54:50.076+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:54:50.108 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:54:50.076+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:54:50.108 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:54:50.076+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:54:50.108 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:54:50.076+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:54:50.108 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:54:50.076+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 msgr2=0x7f66e80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 0x7f66e80b77a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6700101040 tx=0x7f66ec00b390 comp rx=0 tx=0).stop 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 msgr2=0x7f670019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66f402a910 tx=0x7f66f4003b90 comp rx=0 tx=0).stop 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 shutdown_connections 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66e80b52e0 0x7f66e80b77a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f670010f3e0 0x7f67001a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6700075f40 0x7f670019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 --2- 172.21.15.33:0/2822643284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6700075540 0x7f670019b3d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 >> 172.21.15.33:0/2822643284 conn(0x7f67000fe830 msgr2=0x7f67001115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 shutdown_connections 2024-09-10T23:54:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:50.107+0000 7f6708200640 1 -- 172.21.15.33:0/2822643284 wait complete. 2024-09-10T23:54:50.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:49 smithi189 ceph-mon[34000]: pgmap v376: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:50.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:49 smithi052 ceph-mon[33526]: pgmap v376: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:50.848 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T23:54:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:51.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:50 smithi033 ceph-mon[30593]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:51.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:50 smithi189 ceph-mon[34000]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:51.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:50 smithi052 ceph-mon[33526]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:51.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 -- 172.21.15.33:0/3832616178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 msgr2=0x7fcd380758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:51.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 --2- 172.21.15.33:0/3832616178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd380758c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009900 tx=0x7fcd2c02a410 comp rx=0 tx=0).stop 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 -- 172.21.15.33:0/3832616178 shutdown_connections 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 --2- 172.21.15.33:0/3832616178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd3810f200 0x7fcd381115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 --2- 172.21.15.33:0/3832616178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd38075e00 0x7fcd3810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 --2- 172.21.15.33:0/3832616178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd380758c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 -- 172.21.15.33:0/3832616178 >> 172.21.15.33:0/3832616178 conn(0x7fcd380fe660 msgr2=0x7fcd38100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 -- 172.21.15.33:0/3832616178 shutdown_connections 2024-09-10T23:54:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.823+0000 7fcd3e000640 1 -- 172.21.15.33:0/3832616178 wait complete. 2024-09-10T23:54:51.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.824+0000 7fcd3e000640 1 Processor -- start 2024-09-10T23:54:51.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.824+0000 7fcd3e000640 1 -- start start 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38075e00 0x7fcd3819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd3810f200 0x7fcd381a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38114c90 con 0x7fcd380754e0 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38114b10 con 0x7fcd38075e00 2024-09-10T23:54:51.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3e000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcd38114e10 con 0x7fcd3810f200 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37566/0 (socket says 172.21.15.33:37566) 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3cc00640 1 -- 172.21.15.33:0/11092898 learned_addr learned my addr 172.21.15.33:0/11092898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd3d600640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd3810f200 0x7fcd381a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.825+0000 7fcd37e00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38075e00 0x7fcd3819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 -- 172.21.15.33:0/11092898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd3810f200 msgr2=0x7fcd381a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd3810f200 0x7fcd381a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:51.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 -- 172.21.15.33:0/11092898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38075e00 msgr2=0x7fcd3819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38075e00 0x7fcd3819b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 -- 172.21.15.33:0/11092898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd381a1230 con 0x7fcd380754e0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3cc00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c03f030 con 0x7fcd380754e0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd2c003a80 con 0x7fcd380754e0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd381a14c0 con 0x7fcd380754e0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.826+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c035070 con 0x7fcd380754e0 2024-09-10T23:54:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.827+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd381a7be0 con 0x7fcd380754e0 2024-09-10T23:54:51.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.828+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd380758c0 con 0x7fcd380754e0 2024-09-10T23:54:51.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.830+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fcd2c003c30 con 0x7fcd380754e0 2024-09-10T23:54:51.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.831+0000 7fcd35600640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 0x7fcd200b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:51.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.831+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fcd2c106d70 con 0x7fcd380754e0 2024-09-10T23:54:51.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.831+0000 7fcd37e00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 0x7fcd200b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:51.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.832+0000 7fcd37e00640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 0x7fcd200b78d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcd38100e70 tx=0x7fcd2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:51.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:51.835+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd2c0cd0e0 con 0x7fcd380754e0 2024-09-10T23:54:52.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.060+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fcd38100270 con 0x7fcd200b5410 2024-09-10T23:54:52.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.088+0000 7fcd35600640 1 -- 172.21.15.33:0/11092898 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd38100270 con 0x7fcd200b5410 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 msgr2=0x7fcd200b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 0x7fcd200b78d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcd38100e70 tx=0x7fcd2400b390 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 msgr2=0x7fcd3819b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c004270 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 shutdown_connections 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcd200b5410 0x7fcd200b78d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcd3810f200 0x7fcd381a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38075e00 0x7fcd3819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 --2- 172.21.15.33:0/11092898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd380754e0 0x7fcd3819b180 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.090+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 >> 172.21.15.33:0/11092898 conn(0x7fcd380fe660 msgr2=0x7fcd381113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:52.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.091+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 shutdown_connections 2024-09-10T23:54:52.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:52.091+0000 7fcd3e000640 1 -- 172.21.15.33:0/11092898 wait complete. 2024-09-10T23:54:52.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:51 smithi033 ceph-mon[30593]: pgmap v377: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:52.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:51 smithi033 ceph-mon[30593]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-09-10T23:54:52.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:51 smithi189 ceph-mon[34000]: pgmap v377: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:52.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:51 smithi189 ceph-mon[34000]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-09-10T23:54:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:51 smithi052 ceph-mon[33526]: pgmap v377: 129 pgs: 3 peering, 126 active+clean; 584 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-09-10T23:54:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:51 smithi052 ceph-mon[33526]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-09-10T23:54:52.946 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T23:54:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:53 smithi033 ceph-mon[30593]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:53 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:53.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:53 smithi189 ceph-mon[34000]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:53.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:53 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:53.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:53 smithi052 ceph-mon[33526]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:53.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:53 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:54:54.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:54 smithi033 ceph-mon[30593]: pgmap v378: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:54.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:54.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:54 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 -- 172.21.15.33:0/175005036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d0102da0 msgr2=0x7f13d0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 --2- 172.21.15.33:0/175005036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d0102da0 0x7f13d0103180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009900 tx=0x7f13c002a410 comp rx=0 tx=0).stop 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 -- 172.21.15.33:0/175005036 shutdown_connections 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 --2- 172.21.15.33:0/175005036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0109130 0x7f13d010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 --2- 172.21.15.33:0/175005036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d01087b0 0x7f13d0108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 --2- 172.21.15.33:0/175005036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d0102da0 0x7f13d0103180 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 -- 172.21.15.33:0/175005036 >> 172.21.15.33:0/175005036 conn(0x7f13d00fe810 msgr2=0x7f13d0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:54.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 -- 172.21.15.33:0/175005036 shutdown_connections 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.061+0000 7f13d6200640 1 -- 172.21.15.33:0/175005036 wait complete. 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.062+0000 7f13d6200640 1 Processor -- start 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 -- start start 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 0x7f13d00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d0109130 0x7f13d0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0112cf0 con 0x7f13d01087b0 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0112b70 con 0x7f13d0102da0 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.063+0000 7f13d6200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0112e70 con 0x7f13d0109130 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13c6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 0x7f13d00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56658/0 (socket says 172.21.15.33:56658) 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 -- 172.21.15.33:0/73140898 learned_addr learned my addr 172.21.15.33:0/73140898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cfe00640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d0109130 0x7f13d0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 -- 172.21.15.33:0/73140898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d0109130 msgr2=0x7f13d0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d0109130 0x7f13d0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 -- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 msgr2=0x7f13d00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 0x7f13d00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 -- 172.21.15.33:0/73140898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01a75c0 con 0x7f13d0102da0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13c6a00640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 0x7f13d00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.064+0000 7f13cf400640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13c002a930 tx=0x7f13c0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.065+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c003f070 con 0x7f13d0102da0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.065+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13c003baf0 con 0x7f13d0102da0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.065+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d01a7850 con 0x7f13d0102da0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.065+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0035030 con 0x7f13d0102da0 2024-09-10T23:54:54.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.065+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d01a7d80 con 0x7f13d0102da0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.066+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d0103180 con 0x7f13d0102da0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.068+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f13c003b660 con 0x7f13d0102da0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.069+0000 7f13ccc00640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 0x7f13b40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.070+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f13c01069e0 con 0x7f13d0102da0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.070+0000 7f13c6a00640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 0x7f13b40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.070+0000 7f13c6a00640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 0x7f13b40b78b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13d0076f90 tx=0x7f13b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.072+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13c00cd3a0 con 0x7f13d0102da0 2024-09-10T23:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.329+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f13d0063590 con 0x7f13b40b53f0 2024-09-10T23:54:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:54 smithi189 ceph-mon[34000]: pgmap v378: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:54 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:54.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.336+0000 7f13ccc00640 1 -- 172.21.15.33:0/73140898 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f13d0063590 con 0x7f13b40b53f0 2024-09-10T23:54:54.340 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_0/ff3e19cf-8017-4e6a-ab1d-9470571e50c1 2024-09-10T23:54:54.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 msgr2=0x7f13b40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 0x7f13b40b78b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13d0076f90 tx=0x7f13b8005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:54.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 msgr2=0x7f13d00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:54.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13c002a930 tx=0x7f13c0003b90 comp rx=0 tx=0).stop 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 shutdown_connections 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f13b40b53f0 0x7f13b40b78b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13d0109130 0x7f13d0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13d01087b0 0x7f13d00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 --2- 172.21.15.33:0/73140898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13d0102da0 0x7f13d00754a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 >> 172.21.15.33:0/73140898 conn(0x7f13d00fe810 msgr2=0x7f13d0100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 shutdown_connections 2024-09-10T23:54:54.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:54.340+0000 7f13d6200640 1 -- 172.21.15.33:0/73140898 wait complete. 2024-09-10T23:54:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:54 smithi052 ceph-mon[33526]: pgmap v378: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:54 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:55 smithi033 ceph-mon[30593]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:55 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:55 smithi189 ceph-mon[34000]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:55.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:55 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:55 smithi052 ceph-mon[33526]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:55.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:55 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:55.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T23:54:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:56 smithi189 ceph-mon[34000]: pgmap v379: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 4 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:56.363 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:56 smithi033 ceph-mon[30593]: pgmap v379: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 4 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:56 smithi052 ceph-mon[33526]: pgmap v379: 129 pgs: 129 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 4 op/s; 560 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 -- 172.21.15.33:0/1839714446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706810f3c0 msgr2=0x7f70681117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 --2- 172.21.15.33:0/1839714446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706810f3c0 0x7f70681117b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7060009ca0 tx=0x7f706002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 -- 172.21.15.33:0/1839714446 shutdown_connections 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 --2- 172.21.15.33:0/1839714446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706810f3c0 0x7f70681117b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 --2- 172.21.15.33:0/1839714446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075f40 0x7f706810edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 --2- 172.21.15.33:0/1839714446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7068075540 0x7f7068075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 -- 172.21.15.33:0/1839714446 >> 172.21.15.33:0/1839714446 conn(0x7f70680fe850 msgr2=0x7f7068100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 -- 172.21.15.33:0/1839714446 shutdown_connections 2024-09-10T23:54:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.630+0000 7f706ea00640 1 -- 172.21.15.33:0/1839714446 wait complete. 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.631+0000 7f706ea00640 1 Processor -- start 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.631+0000 7f706ea00640 1 -- start start 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075540 0x7f706819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f706810f3c0 0x7f70681a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7068114e60 con 0x7f7068075f40 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7068114ce0 con 0x7f7068075540 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7068114fe0 con 0x7f706810f3c0 2024-09-10T23:54:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f7067400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f7067400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37612/0 (socket says 172.21.15.33:37612) 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f7067400640 1 -- 172.21.15.33:0/1919459259 learned_addr learned my addr 172.21.15.33:0/1919459259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.632+0000 7f706ca00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f706810f3c0 0x7f70681a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067e00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075540 0x7f706819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 -- 172.21.15.33:0/1919459259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f706810f3c0 msgr2=0x7f70681a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f706810f3c0 0x7f70681a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 -- 172.21.15.33:0/1919459259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075540 msgr2=0x7f706819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075540 0x7f706819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 -- 172.21.15.33:0/1919459259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70681a1460 con 0x7f7068075f40 2024-09-10T23:54:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7067400640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f705400e9f0 tx=0x7f705400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705400cd80 con 0x7f7068075f40 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70540108c0 con 0x7f7068075f40 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.633+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70681a1750 con 0x7f7068075f40 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.634+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540187c0 con 0x7f7068075f40 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.634+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70681a7e10 con 0x7f7068075f40 2024-09-10T23:54:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.635+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7068075920 con 0x7f7068075f40 2024-09-10T23:54:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.638+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7054010430 con 0x7f7068075f40 2024-09-10T23:54:56.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.639+0000 7f7064c00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 0x7f704c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.640+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f70540e6940 con 0x7f7068075f40 2024-09-10T23:54:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.640+0000 7f7067e00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 0x7f704c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.640+0000 7f7067e00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 0x7f704c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7058009bd0 tx=0x7f7058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.644+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f70540accb0 con 0x7f7068075f40 2024-09-10T23:54:56.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.889+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7068063590 con 0x7f704c0b5370 2024-09-10T23:54:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.919+0000 7f7064c00640 1 -- 172.21.15.33:0/1919459259 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7068063590 con 0x7f704c0b5370 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 msgr2=0x7f704c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 0x7f704c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7058009bd0 tx=0x7f7058005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 msgr2=0x7f706819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f705400e9f0 tx=0x7f705400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 shutdown_connections 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f704c0b5370 0x7f704c0b7830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f706810f3c0 0x7f70681a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7068075f40 0x7f706819b8f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 --2- 172.21.15.33:0/1919459259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7068075540 0x7f706819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 >> 172.21.15.33:0/1919459259 conn(0x7f70680fe850 msgr2=0x7f70680ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 shutdown_connections 2024-09-10T23:54:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:56.922+0000 7f706ea00640 1 -- 172.21.15.33:0/1919459259 wait complete. 2024-09-10T23:54:57.779 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T23:54:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:54:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:58 smithi189 ceph-mon[34000]: pgmap v380: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 456 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:58.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:58 smithi189 ceph-mon[34000]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:58.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:58 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.343 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:58 smithi033 ceph-mon[30593]: pgmap v380: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 456 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:58.343 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:58 smithi033 ceph-mon[30593]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:58.343 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.343 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:58 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:58 smithi052 ceph-mon[33526]: pgmap v380: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 456 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T23:54:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:58 smithi052 ceph-mon[33526]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:54:58.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:58 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.896+0000 7fb373200640 1 -- 172.21.15.33:0/2136766370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb37410f200 msgr2=0x7fb3741115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.896+0000 7fb373200640 1 --2- 172.21.15.33:0/2136766370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb37410f200 0x7fb3741115f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009ca0 tx=0x7fb36c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 -- 172.21.15.33:0/2136766370 shutdown_connections 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 --2- 172.21.15.33:0/2136766370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb37410f200 0x7fb3741115f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 --2- 172.21.15.33:0/2136766370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb374075e00 0x7fb37410ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 --2- 172.21.15.33:0/2136766370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3740754e0 0x7fb3740758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 -- 172.21.15.33:0/2136766370 >> 172.21.15.33:0/2136766370 conn(0x7fb3740fe660 msgr2=0x7fb374100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 -- 172.21.15.33:0/2136766370 shutdown_connections 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.897+0000 7fb373200640 1 -- 172.21.15.33:0/2136766370 wait complete. 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 Processor -- start 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 -- start start 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb374075e00 0x7fb37419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb37410f200 0x7fb3741a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb374114ce0 con 0x7fb3740754e0 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb374114b60 con 0x7fb374075e00 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.898+0000 7fb373200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb374114e60 con 0x7fb37410f200 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37632/0 (socket says 172.21.15.33:37632) 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 -- 172.21.15.33:0/1987989290 learned_addr learned my addr 172.21.15.33:0/1987989290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371400640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb374075e00 0x7fb37419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb372800640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb37410f200 0x7fb3741a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 -- 172.21.15.33:0/1987989290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb37410f200 msgr2=0x7fb3741a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb37410f200 0x7fb3741a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 -- 172.21.15.33:0/1987989290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb374075e00 msgr2=0x7fb37419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb374075e00 0x7fb37419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 -- 172.21.15.33:0/1987989290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3741a11e0 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.899+0000 7fb371e00640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb36400d950 tx=0x7fb36400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.902+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364017070 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.902+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3741a14d0 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.902+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb364009c30 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.902+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36400f620 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.902+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3741a7d60 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.903+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3740758c0 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.906+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb364010460 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.908+0000 7fb36aa00640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 0x7fb3580b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.908+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fb3640e5bf0 con 0x7fb3740754e0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.909+0000 7fb371400640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 0x7fb3580b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.909+0000 7fb371400640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 0x7fb3580b78d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb374101e00 tx=0x7fb360005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:54:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:58.910+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb364009de0 con 0x7fb3740754e0 2024-09-10T23:54:59.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.142+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb3741001c0 con 0x7fb3580b5410 2024-09-10T23:54:59.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.147+0000 7fb36aa00640 1 -- 172.21.15.33:0/1987989290 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb3741001c0 con 0x7fb3580b5410 2024-09-10T23:54:59.148 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_1/c85b8603-cd2d-49f9-976d-043a280bbf35 2024-09-10T23:54:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 msgr2=0x7fb3580b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 0x7fb3580b78d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb374101e00 tx=0x7fb360005f90 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 msgr2=0x7fb37419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb36400d950 tx=0x7fb36400de10 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 shutdown_connections 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb3580b5410 0x7fb3580b78d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb37410f200 0x7fb3741a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb374075e00 0x7fb37419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 --2- 172.21.15.33:0/1987989290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3740754e0 0x7fb37419b130 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.149+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 >> 172.21.15.33:0/1987989290 conn(0x7fb3740fe660 msgr2=0x7fb3740feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.150+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 shutdown_connections 2024-09-10T23:54:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:54:59.150+0000 7fb373200640 1 -- 172.21.15.33:0/1987989290 wait complete. 2024-09-10T23:54:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:59.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:54:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:59.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:59.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:59.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:54:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:54:59.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:54:59.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:54:59.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:54:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:55:00.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:55:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:00 smithi189 ceph-mon[34000]: pgmap v381: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 KiB/s wr, 6 op/s; 414 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:55:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:00 smithi189 ceph-mon[34000]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:00 smithi052 ceph-mon[33526]: pgmap v381: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 KiB/s wr, 6 op/s; 414 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:55:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:00 smithi052 ceph-mon[33526]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:00.466 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:00.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:00 smithi033 ceph-mon[30593]: pgmap v381: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.1 KiB/s wr, 6 op/s; 414 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T23:55:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:00 smithi033 ceph-mon[30593]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 -- 172.21.15.33:0/1141991698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580103b40 msgr2=0x7fd580103f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 --2- 172.21.15.33:0/1141991698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580103b40 0x7fd580103f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd570009900 tx=0x7fd57002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 -- 172.21.15.33:0/1141991698 shutdown_connections 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 --2- 172.21.15.33:0/1141991698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd58010d0f0 0x7fd58010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 --2- 172.21.15.33:0/1141991698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 0x7fd58010cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 --2- 172.21.15.33:0/1141991698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580103b40 0x7fd580103f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 -- 172.21.15.33:0/1141991698 >> 172.21.15.33:0/1141991698 conn(0x7fd5800fd6f0 msgr2=0x7fd5800ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 -- 172.21.15.33:0/1141991698 shutdown_connections 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.054+0000 7fd584c00640 1 -- 172.21.15.33:0/1141991698 wait complete. 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 Processor -- start 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 -- start start 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 0x7fd580199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 0x7fd580199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd580112c20 con 0x7fd58010d0f0 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd580112aa0 con 0x7fd580103b40 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.055+0000 7fd584c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd580112da0 con 0x7fd580104540 2024-09-10T23:55:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 0x7fd580199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 0x7fd580199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33600/0 (socket says 172.21.15.33:33600) 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57746/0 (socket says 172.21.15.33:57746) 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57de00640 1 -- 172.21.15.33:0/3531595092 learned_addr learned my addr 172.21.15.33:0/3531595092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd575400640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 0x7fd580199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 -- 172.21.15.33:0/3531595092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 msgr2=0x7fd580199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 0x7fd580199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 -- 172.21.15.33:0/3531595092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 msgr2=0x7fd580199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 0x7fd580199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.056+0000 7fd57e800640 1 -- 172.21.15.33:0/3531595092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58019f2c0 con 0x7fd58010d0f0 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd57e800640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e940 tx=0x7fd57800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578004d20 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd578005020 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58019f5b0 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5780116d0 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.057+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5801a5c70 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.058+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd580103f20 con 0x7fd58010d0f0 2024-09-10T23:55:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.060+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd57800f040 con 0x7fd58010d0f0 2024-09-10T23:55:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.062+0000 7fd577400640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 0x7fd5640b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.062+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fd5780e5dd0 con 0x7fd58010d0f0 2024-09-10T23:55:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.062+0000 7fd57de00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 0x7fd5640b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.063+0000 7fd57de00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 0x7fd5640b7830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd570009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.065+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd578016030 con 0x7fd58010d0f0 2024-09-10T23:55:01.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.296+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd580108140 con 0x7fd58010d0f0 2024-09-10T23:55:01.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.297+0000 7fd577400640 1 -- 172.21.15.33:0/3531595092 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7fd5780cf0e0 con 0x7fd58010d0f0 2024-09-10T23:55:01.298 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:01.298 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:55:01.298 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:55:01.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 msgr2=0x7fd5640b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 0x7fd5640b7830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd570009560 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 msgr2=0x7fd58019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e940 tx=0x7fd57800ee00 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 shutdown_connections 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd5640b5370 0x7fd5640b7830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd58010d0f0 0x7fd58019eaf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd580104540 0x7fd580199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 --2- 172.21.15.33:0/3531595092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd580103b40 0x7fd580199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.299+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 >> 172.21.15.33:0/3531595092 conn(0x7fd5800fd6f0 msgr2=0x7fd5800fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.300+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 shutdown_connections 2024-09-10T23:55:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:01.300+0000 7fd584c00640 1 -- 172.21.15.33:0/3531595092 wait complete. 2024-09-10T23:55:02.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:55:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:02 smithi189 ceph-mon[34000]: pgmap v382: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:02 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3531595092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:55:02.353 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:02 smithi033 ceph-mon[30593]: pgmap v382: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:02.353 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:02 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3531595092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:55:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:02 smithi052 ceph-mon[33526]: pgmap v382: 129 pgs: 129 active+clean; 609 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:02.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:02 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3531595092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:55:02.685 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:03.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.296+0000 7f8ba9400640 1 -- 172.21.15.33:0/177804944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba41093d0 msgr2=0x7f8ba41097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:03.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.296+0000 7f8ba9400640 1 --2- 172.21.15.33:0/177804944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba41093d0 0x7f8ba41097b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009900 tx=0x7f8b9402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 -- 172.21.15.33:0/177804944 shutdown_connections 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 --2- 172.21.15.33:0/177804944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410f760 0x7f8ba4115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 --2- 172.21.15.33:0/177804944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba410ede0 0x7f8ba410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 --2- 172.21.15.33:0/177804944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba41093d0 0x7f8ba41097b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 -- 172.21.15.33:0/177804944 >> 172.21.15.33:0/177804944 conn(0x7f8ba4078a40 msgr2=0x7f8ba407ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 -- 172.21.15.33:0/177804944 shutdown_connections 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 -- 172.21.15.33:0/177804944 wait complete. 2024-09-10T23:55:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.297+0000 7f8ba9400640 1 Processor -- start 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 -- start start 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 0x7f8ba419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410ede0 0x7f8ba419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4119270 con 0x7f8ba410f760 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba41190f0 con 0x7f8ba41093d0 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba41193f0 con 0x7f8ba410ede0 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57762/0 (socket says 172.21.15.33:57762) 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.298+0000 7f8ba3200640 1 -- 172.21.15.33:0/3575367029 learned_addr learned my addr 172.21.15.33:0/3575367029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba2800640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 0x7f8ba419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8b99e00640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410ede0 0x7f8ba419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 -- 172.21.15.33:0/3575367029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410ede0 msgr2=0x7f8ba419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410ede0 0x7f8ba419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 -- 172.21.15.33:0/3575367029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 msgr2=0x7f8ba419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 0x7f8ba419f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 -- 172.21.15.33:0/3575367029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba41a5850 con 0x7f8ba410f760 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba2800640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 0x7f8ba419f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.299+0000 7f8ba3200640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00eaa0 tx=0x7f8b9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.300+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00cdb0 con 0x7f8ba410f760 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.300+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b9c005020 con 0x7f8ba410f760 2024-09-10T23:55:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.300+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba41a5b40 con 0x7f8ba410f760 2024-09-10T23:55:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.300+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0116d0 con 0x7f8ba410f760 2024-09-10T23:55:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.300+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba41ac200 con 0x7f8ba410f760 2024-09-10T23:55:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.301+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba41097b0 con 0x7f8ba410f760 2024-09-10T23:55:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.303+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8b9c00f040 con 0x7f8ba410f760 2024-09-10T23:55:03.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.305+0000 7f8b9be00640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 0x7f8b880b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:03.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.305+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f8b9c0e60a0 con 0x7f8ba410f760 2024-09-10T23:55:03.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.305+0000 7f8ba2800640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 0x7f8b880b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:03.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.306+0000 7f8ba2800640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 0x7f8b880b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b94006010 tx=0x7f8b94005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:03.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.308+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b9c016030 con 0x7f8ba410f760 2024-09-10T23:55:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.503+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba4110fb0 con 0x7f8ba410f760 2024-09-10T23:55:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.505+0000 7f8b9be00640 1 -- 172.21.15.33:0/3575367029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24676 (secure 0 0 0) 0x7f8b9c0aca60 con 0x7f8ba410f760 2024-09-10T23:55:03.507 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:03.507 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:47.963798+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:55:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 msgr2=0x7f8b880b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 0x7f8b880b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b94006010 tx=0x7f8b94005a20 comp rx=0 tx=0).stop 2024-09-10T23:55:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 msgr2=0x7f8ba41a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00eaa0 tx=0x7f8b9c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:55:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 shutdown_connections 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8b880b5370 0x7f8b880b7830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba410f760 0x7f8ba41a5080 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ba410ede0 0x7f8ba419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 --2- 172.21.15.33:0/3575367029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ba41093d0 0x7f8ba419f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 >> 172.21.15.33:0/3575367029 conn(0x7f8ba4078a40 msgr2=0x7f8ba4079370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 shutdown_connections 2024-09-10T23:55:03.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:03.508+0000 7f8ba9400640 1 -- 172.21.15.33:0/3575367029 wait complete. 2024-09-10T23:55:04.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:04 smithi033 ceph-mon[30593]: pgmap v383: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:04.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:04 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3575367029' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:04 smithi189 ceph-mon[34000]: pgmap v383: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:04 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3575367029' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:04.391 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:55:04.391 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:55:04.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:04 smithi052 ceph-mon[33526]: pgmap v383: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 373 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T23:55:04.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:04 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3575367029' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:05.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 -- 172.21.15.33:0/1009259754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 msgr2=0x7f01841031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 --2- 172.21.15.33:0/1009259754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01841031a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0174009900 tx=0x7f017402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 -- 172.21.15.33:0/1009259754 shutdown_connections 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 --2- 172.21.15.33:0/1009259754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 0x7f018410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 --2- 172.21.15.33:0/1009259754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 0x7f0184108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 --2- 172.21.15.33:0/1009259754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01841031a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 -- 172.21.15.33:0/1009259754 >> 172.21.15.33:0/1009259754 conn(0x7f01840fe830 msgr2=0x7f0184100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 -- 172.21.15.33:0/1009259754 shutdown_connections 2024-09-10T23:55:05.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.423+0000 7f0189a00640 1 -- 172.21.15.33:0/1009259754 wait complete. 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 Processor -- start 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 -- start start 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 0x7f01840759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 0x7f0184075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112c80 con 0x7f0184102dc0 2024-09-10T23:55:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112b00 con 0x7f01841087d0 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.424+0000 7f0189a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0184112e00 con 0x7f0184109150 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57778/0 (socket says 172.21.15.33:57778) 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 -- 172.21.15.33:0/2337405666 learned_addr learned my addr 172.21.15.33:0/2337405666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f017a000640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 0x7f01840759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0183400640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 0x7f0184075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 -- 172.21.15.33:0/2337405666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 msgr2=0x7f0184075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 0x7f0184075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 -- 172.21.15.33:0/2337405666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 msgr2=0x7f01840759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 0x7f01840759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.425+0000 7f0182a00640 1 -- 172.21.15.33:0/2337405666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01841a75d0 con 0x7f0184102dc0 2024-09-10T23:55:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f0182a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0174009230 tx=0x7f0174004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017403f030 con 0x7f0184102dc0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01841a7860 con 0x7f0184102dc0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0174003a80 con 0x7f0184102dc0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01841a7d40 con 0x7f0184102dc0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.426+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174049060 con 0x7f0184102dc0 2024-09-10T23:55:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.427+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01841031a0 con 0x7f0184102dc0 2024-09-10T23:55:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.429+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f017403bc90 con 0x7f0184102dc0 2024-09-10T23:55:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.431+0000 7f017be00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 0x7f01680b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.431+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f0174106ed0 con 0x7f0184102dc0 2024-09-10T23:55:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.431+0000 7f017a000640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 0x7f01680b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.432+0000 7f017a000640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 0x7f01680b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0184076f90 tx=0x7f016c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.435+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01740cd890 con 0x7f0184102dc0 2024-09-10T23:55:05.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.630+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0184063590 con 0x7f01680b5370 2024-09-10T23:55:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.640+0000 7f017be00640 1 -- 172.21.15.33:0/2337405666 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340623 (secure 0 0 0) 0x7f0184063590 con 0x7f01680b5370 2024-09-10T23:55:05.645 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 msgr2=0x7f01680b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 0x7f01680b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0184076f90 tx=0x7f016c00b390 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 msgr2=0x7f01840754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0174009230 tx=0x7f0174004270 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 shutdown_connections 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f01680b5370 0x7f01680b7830 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0184109150 0x7f0184075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01841087d0 0x7f01840759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 --2- 172.21.15.33:0/2337405666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0184102dc0 0x7f01840754a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 >> 172.21.15.33:0/2337405666 conn(0x7f01840fe830 msgr2=0x7f0184100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 shutdown_connections 2024-09-10T23:55:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:05.646+0000 7f0189a00640 1 -- 172.21.15.33:0/2337405666 wait complete. 2024-09-10T23:55:06.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:06 smithi033 ceph-mon[30593]: pgmap v384: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-10T23:55:06.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:06 smithi189 ceph-mon[34000]: pgmap v384: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-10T23:55:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:06 smithi052 ceph-mon[33526]: pgmap v384: 129 pgs: 129 active+clean; 632 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-10T23:55:06.563 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-10T23:55:04.793518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646889,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":189,"num_read_kb":176,"num_write":289,"num_write_kb":2257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360620,"kb_used_data":11360,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581204,"statfs":{"total":1151940427776,"available":1151571152896,"internally_reserved":0,"allocated":11632640,"data_stored":7666049,"data_compressed":391497,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41687,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":72,"num_write":31,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.498141+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:54:48.498141+0000","last_peered":"2024-09-10T23:54:48.498141+0000","last_clean":"2024-09-10T23:54:48.498141+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:54:48.498141+0000","last_undegraded":"2024-09-10T23:54:48.498141+0000","last_fullsized":"2024-09-10T23:54:48.498141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496818+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:54:48.496818+0000","last_peered":"2024-09-10T23:54:48.496818+0000","last_clean":"2024-09-10T23:54:48.496818+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:54:48.496818+0000","last_undegraded":"2024-09-10T23:54:48.496818+0000","last_fullsized":"2024-09-10T23:54:48.496818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970408+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:54:47.970408+0000","last_peered":"2024-09-10T23:54:47.970408+0000","last_clean":"2024-09-10T23:54:47.970408+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:54:47.970408+0000","last_undegraded":"2024-09-10T23:54:47.970408+0000","last_fullsized":"2024-09-10T23:54:47.970408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497086+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:54:48.497086+0000","last_peered":"2024-09-10T23:54:48.497086+0000","last_clean":"2024-09-10T23:54:48.497086+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:54:48.497086+0000","last_undegraded":"2024-09-10T23:54:48.497086+0000","last_fullsized":"2024-09-10T23:54:48.497086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554891+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:54:48.554891+0000","last_peered":"2024-09-10T23:54:48.554891+0000","last_clean":"2024-09-10T23:54:48.554891+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:54:48.554891+0000","last_undegraded":"2024-09-10T23:54:48.554891+0000","last_fullsized":"2024-09-10T23:54:48.554891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497999+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:54:48.497999+0000","last_peered":"2024-09-10T23:54:48.497999+0000","last_clean":"2024-09-10T23:54:48.497999+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:54:48.497999+0000","last_undegraded":"2024-09-10T23:54:48.497999+0000","last_fullsized":"2024-09-10T23:54:48.497999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.997606+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:54:47.997606+0000","last_peered":"2024-09-10T23:54:47.997606+0000","last_clean":"2024-09-10T23:54:47.997606+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:54:47.997606+0000","last_undegraded":"2024-09-10T23:54:47.997606+0000","last_fullsized":"2024-09-10T23:54:47.997606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972379+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:54:47.972379+0000","last_peered":"2024-09-10T23:54:47.972379+0000","last_clean":"2024-09-10T23:54:47.972379+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:54:47.972379+0000","last_undegraded":"2024-09-10T23:54:47.972379+0000","last_fullsized":"2024-09-10T23:54:47.972379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973736+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:54:47.973736+0000","last_peered":"2024-09-10T23:54:47.973736+0000","last_clean":"2024-09-10T23:54:47.973736+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:54:47.973736+0000","last_undegraded":"2024-09-10T23:54:47.973736+0000","last_fullsized":"2024-09-10T23:54:47.973736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974874+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:54:47.974874+0000","last_peered":"2024-09-10T23:54:47.974874+0000","last_clean":"2024-09-10T23:54:47.974874+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:54:47.974874+0000","last_undegraded":"2024-09-10T23:54:47.974874+0000","last_fullsized":"2024-09-10T23:54:47.974874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979116+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:54:47.979116+0000","last_peered":"2024-09-10T23:54:47.979116+0000","last_clean":"2024-09-10T23:54:47.979116+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:54:47.979116+0000","last_undegraded":"2024-09-10T23:54:47.979116+0000","last_fullsized":"2024-09-10T23:54:47.979116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973074+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:54:47.973074+0000","last_peered":"2024-09-10T23:54:47.973074+0000","last_clean":"2024-09-10T23:54:47.973074+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:54:47.973074+0000","last_undegraded":"2024-09-10T23:54:47.973074+0000","last_fullsized":"2024-09-10T23:54:47.973074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978876+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:54:47.978876+0000","last_peered":"2024-09-10T23:54:47.978876+0000","last_clean":"2024-09-10T23:54:47.978876+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:54:47.978876+0000","last_undegraded":"2024-09-10T23:54:47.978876+0000","last_fullsized":"2024-09-10T23:54:47.978876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973851+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:54:47.973851+0000","last_peered":"2024-09-10T23:54:47.973851+0000","last_clean":"2024-09-10T23:54:47.973851+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:54:47.973851+0000","last_undegraded":"2024-09-10T23:54:47.973851+0000","last_fullsized":"2024-09-10T23:54:47.973851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974362+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:54:47.974362+0000","last_peered":"2024-09-10T23:54:47.974362+0000","last_clean":"2024-09-10T23:54:47.974362+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:54:47.974362+0000","last_undegraded":"2024-09-10T23:54:47.974362+0000","last_fullsized":"2024-09-10T23:54:47.974362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496244+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:54:48.496244+0000","last_peered":"2024-09-10T23:54:48.496244+0000","last_clean":"2024-09-10T23:54:48.496244+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:54:48.496244+0000","last_undegraded":"2024-09-10T23:54:48.496244+0000","last_fullsized":"2024-09-10T23:54:48.496244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971002+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:54:47.971002+0000","last_peered":"2024-09-10T23:54:47.971002+0000","last_clean":"2024-09-10T23:54:47.971002+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:54:47.971002+0000","last_undegraded":"2024-09-10T23:54:47.971002+0000","last_fullsized":"2024-09-10T23:54:47.971002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974454+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:54:47.974454+0000","last_peered":"2024-09-10T23:54:47.974454+0000","last_clean":"2024-09-10T23:54:47.974454+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:54:47.974454+0000","last_undegraded":"2024-09-10T23:54:47.974454+0000","last_fullsized":"2024-09-10T23:54:47.974454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973428+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:54:47.973428+0000","last_peered":"2024-09-10T23:54:47.973428+0000","last_clean":"2024-09-10T23:54:47.973428+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:54:47.973428+0000","last_undegraded":"2024-09-10T23:54:47.973428+0000","last_fullsized":"2024-09-10T23:54:47.973428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496495+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:54:48.496495+0000","last_peered":"2024-09-10T23:54:48.496495+0000","last_clean":"2024-09-10T23:54:48.496495+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:54:48.496495+0000","last_undegraded":"2024-09-10T23:54:48.496495+0000","last_fullsized":"2024-09-10T23:54:48.496495+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497940+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:54:48.497940+0000","last_peered":"2024-09-10T23:54:48.497940+0000","last_clean":"2024-09-10T23:54:48.497940+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:54:48.497940+0000","last_undegraded":"2024-09-10T23:54:48.497940+0000","last_fullsized":"2024-09-10T23:54:48.497940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972782+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:54:47.972782+0000","last_peered":"2024-09-10T23:54:47.972782+0000","last_clean":"2024-09-10T23:54:47.972782+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:54:47.972782+0000","last_undegraded":"2024-09-10T23:54:47.972782+0000","last_fullsized":"2024-09-10T23:54:47.972782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971901+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:54:47.971901+0000","last_peered":"2024-09-10T23:54:47.971901+0000","last_clean":"2024-09-10T23:54:47.971901+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:54:47.971901+0000","last_undegraded":"2024-09-10T23:54:47.971901+0000","last_fullsized":"2024-09-10T23:54:47.971901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974359+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:54:47.974359+0000","last_peered":"2024-09-10T23:54:47.974359+0000","last_clean":"2024-09-10T23:54:47.974359+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:54:47.974359+0000","last_undegraded":"2024-09-10T23:54:47.974359+0000","last_fullsized":"2024-09-10T23:54:47.974359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554840+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:54:48.554840+0000","last_peered":"2024-09-10T23:54:48.554840+0000","last_clean":"2024-09-10T23:54:48.554840+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:54:48.554840+0000","last_undegraded":"2024-09-10T23:54:48.554840+0000","last_fullsized":"2024-09-10T23:54:48.554840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974905+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:54:47.974905+0000","last_peered":"2024-09-10T23:54:47.974905+0000","last_clean":"2024-09-10T23:54:47.974905+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:54:47.974905+0000","last_undegraded":"2024-09-10T23:54:47.974905+0000","last_fullsized":"2024-09-10T23:54:47.974905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970478+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:54:47.970478+0000","last_peered":"2024-09-10T23:54:47.970478+0000","last_clean":"2024-09-10T23:54:47.970478+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:54:47.970478+0000","last_undegraded":"2024-09-10T23:54:47.970478+0000","last_fullsized":"2024-09-10T23:54:47.970478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496771+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:54:48.496771+0000","last_peered":"2024-09-10T23:54:48.496771+0000","last_clean":"2024-09-10T23:54:48.496771+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:54:48.496771+0000","last_undegraded":"2024-09-10T23:54:48.496771+0000","last_fullsized":"2024-09-10T23:54:48.496771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:00.757167+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:55:00.757167+0000","last_peered":"2024-09-10T23:55:00.757167+0000","last_clean":"2024-09-10T23:55:00.757167+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:55:00.757167+0000","last_undegraded":"2024-09-10T23:55:00.757167+0000","last_fullsized":"2024-09-10T23:55:00.757167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496080+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:54:48.496080+0000","last_peered":"2024-09-10T23:54:48.496080+0000","last_clean":"2024-09-10T23:54:48.496080+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:54:48.496080+0000","last_undegraded":"2024-09-10T23:54:48.496080+0000","last_fullsized":"2024-09-10T23:54:48.496080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970486+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:54:47.970486+0000","last_peered":"2024-09-10T23:54:47.970486+0000","last_clean":"2024-09-10T23:54:47.970486+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:54:47.970486+0000","last_undegraded":"2024-09-10T23:54:47.970486+0000","last_fullsized":"2024-09-10T23:54:47.970486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974179+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:54:47.974179+0000","last_peered":"2024-09-10T23:54:47.974179+0000","last_clean":"2024-09-10T23:54:47.974179+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:54:47.974179+0000","last_undegraded":"2024-09-10T23:54:47.974179+0000","last_fullsized":"2024-09-10T23:54:47.974179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973694+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:54:47.973694+0000","last_peered":"2024-09-10T23:54:47.973694+0000","last_clean":"2024-09-10T23:54:47.973694+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:54:47.973694+0000","last_undegraded":"2024-09-10T23:54:47.973694+0000","last_fullsized":"2024-09-10T23:54:47.973694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969187+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:54:47.969187+0000","last_peered":"2024-09-10T23:54:47.969187+0000","last_clean":"2024-09-10T23:54:47.969187+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:54:47.969187+0000","last_undegraded":"2024-09-10T23:54:47.969187+0000","last_fullsized":"2024-09-10T23:54:47.969187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497593+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:54:48.497593+0000","last_peered":"2024-09-10T23:54:48.497593+0000","last_clean":"2024-09-10T23:54:48.497593+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:54:48.497593+0000","last_undegraded":"2024-09-10T23:54:48.497593+0000","last_fullsized":"2024-09-10T23:54:48.497593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979209+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:54:47.979209+0000","last_peered":"2024-09-10T23:54:47.979209+0000","last_clean":"2024-09-10T23:54:47.979209+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:54:47.979209+0000","last_undegraded":"2024-09-10T23:54:47.979209+0000","last_fullsized":"2024-09-10T23:54:47.979209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969056+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:54:47.969056+0000","last_peered":"2024-09-10T23:54:47.969056+0000","last_clean":"2024-09-10T23:54:47.969056+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:54:47.969056+0000","last_undegraded":"2024-09-10T23:54:47.969056+0000","last_fullsized":"2024-09-10T23:54:47.969056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979062+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:54:47.979062+0000","last_peered":"2024-09-10T23:54:47.979062+0000","last_clean":"2024-09-10T23:54:47.979062+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:54:47.979062+0000","last_undegraded":"2024-09-10T23:54:47.979062+0000","last_fullsized":"2024-09-10T23:54:47.979062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970275+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:54:47.970275+0000","last_peered":"2024-09-10T23:54:47.970275+0000","last_clean":"2024-09-10T23:54:47.970275+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:54:47.970275+0000","last_undegraded":"2024-09-10T23:54:47.970275+0000","last_fullsized":"2024-09-10T23:54:47.970275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977606+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:54:47.977606+0000","last_peered":"2024-09-10T23:54:47.977606+0000","last_clean":"2024-09-10T23:54:47.977606+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:54:47.977606+0000","last_undegraded":"2024-09-10T23:54:47.977606+0000","last_fullsized":"2024-09-10T23:54:47.977606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:59.000996+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:54:59.000996+0000","last_peered":"2024-09-10T23:54:59.000996+0000","last_clean":"2024-09-10T23:54:59.000996+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:54:59.000996+0000","last_undegraded":"2024-09-10T23:54:59.000996+0000","last_fullsized":"2024-09-10T23:54:59.000996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970385+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:54:47.970385+0000","last_peered":"2024-09-10T23:54:47.970385+0000","last_clean":"2024-09-10T23:54:47.970385+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:54:47.970385+0000","last_undegraded":"2024-09-10T23:54:47.970385+0000","last_fullsized":"2024-09-10T23:54:47.970385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969871+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:54:47.969871+0000","last_peered":"2024-09-10T23:54:47.969871+0000","last_clean":"2024-09-10T23:54:47.969871+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:54:47.969871+0000","last_undegraded":"2024-09-10T23:54:47.969871+0000","last_fullsized":"2024-09-10T23:54:47.969871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977922+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:54:47.977922+0000","last_peered":"2024-09-10T23:54:47.977922+0000","last_clean":"2024-09-10T23:54:47.977922+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:54:47.977922+0000","last_undegraded":"2024-09-10T23:54:47.977922+0000","last_fullsized":"2024-09-10T23:54:47.977922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.982298+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:54:47.982298+0000","last_peered":"2024-09-10T23:54:47.982298+0000","last_clean":"2024-09-10T23:54:47.982298+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:54:47.982298+0000","last_undegraded":"2024-09-10T23:54:47.982298+0000","last_fullsized":"2024-09-10T23:54:47.982298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496150+0000","last_change":"2024-09-10T23:53:55.748784+0000","last_active":"2024-09-10T23:54:48.496150+0000","last_peered":"2024-09-10T23:54:48.496150+0000","last_clean":"2024-09-10T23:54:48.496150+0000","last_became_active":"2024-09-10T23:53:55.748434+0000","last_became_peered":"2024-09-10T23:53:55.748434+0000","last_unstale":"2024-09-10T23:54:48.496150+0000","last_undegraded":"2024-09-10T23:54:48.496150+0000","last_fullsized":"2024-09-10T23:54:48.496150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:11.641162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974157+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:54:47.974157+0000","last_peered":"2024-09-10T23:54:47.974157+0000","last_clean":"2024-09-10T23:54:47.974157+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:54:47.974157+0000","last_undegraded":"2024-09-10T23:54:47.974157+0000","last_fullsized":"2024-09-10T23:54:47.974157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978160+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:54:47.978160+0000","last_peered":"2024-09-10T23:54:47.978160+0000","last_clean":"2024-09-10T23:54:47.978160+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:54:47.978160+0000","last_undegraded":"2024-09-10T23:54:47.978160+0000","last_fullsized":"2024-09-10T23:54:47.978160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980584+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:54:47.980584+0000","last_peered":"2024-09-10T23:54:47.980584+0000","last_clean":"2024-09-10T23:54:47.980584+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:54:47.980584+0000","last_undegraded":"2024-09-10T23:54:47.980584+0000","last_fullsized":"2024-09-10T23:54:47.980584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.981155+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:54:47.981155+0000","last_peered":"2024-09-10T23:54:47.981155+0000","last_clean":"2024-09-10T23:54:47.981155+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:54:47.981155+0000","last_undegraded":"2024-09-10T23:54:47.981155+0000","last_fullsized":"2024-09-10T23:54:47.981155+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970961+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:54:47.970961+0000","last_peered":"2024-09-10T23:54:47.970961+0000","last_clean":"2024-09-10T23:54:47.970961+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:54:47.970961+0000","last_undegraded":"2024-09-10T23:54:47.970961+0000","last_fullsized":"2024-09-10T23:54:47.970961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972067+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:54:47.972067+0000","last_peered":"2024-09-10T23:54:47.972067+0000","last_clean":"2024-09-10T23:54:47.972067+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:54:47.972067+0000","last_undegraded":"2024-09-10T23:54:47.972067+0000","last_fullsized":"2024-09-10T23:54:47.972067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979679+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:54:47.979679+0000","last_peered":"2024-09-10T23:54:47.979679+0000","last_clean":"2024-09-10T23:54:47.979679+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:54:47.979679+0000","last_undegraded":"2024-09-10T23:54:47.979679+0000","last_fullsized":"2024-09-10T23:54:47.979679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979404+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:54:47.979404+0000","last_peered":"2024-09-10T23:54:47.979404+0000","last_clean":"2024-09-10T23:54:47.979404+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:54:47.979404+0000","last_undegraded":"2024-09-10T23:54:47.979404+0000","last_fullsized":"2024-09-10T23:54:47.979404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554549+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:54:48.554549+0000","last_peered":"2024-09-10T23:54:48.554549+0000","last_clean":"2024-09-10T23:54:48.554549+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:54:48.554549+0000","last_undegraded":"2024-09-10T23:54:48.554549+0000","last_fullsized":"2024-09-10T23:54:48.554549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980609+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:54:47.980609+0000","last_peered":"2024-09-10T23:54:47.980609+0000","last_clean":"2024-09-10T23:54:47.980609+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:54:47.980609+0000","last_undegraded":"2024-09-10T23:54:47.980609+0000","last_fullsized":"2024-09-10T23:54:47.980609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970388+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:54:47.970388+0000","last_peered":"2024-09-10T23:54:47.970388+0000","last_clean":"2024-09-10T23:54:47.970388+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:54:47.970388+0000","last_undegraded":"2024-09-10T23:54:47.970388+0000","last_fullsized":"2024-09-10T23:54:47.970388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.976188+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:54:47.976188+0000","last_peered":"2024-09-10T23:54:47.976188+0000","last_clean":"2024-09-10T23:54:47.976188+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:54:47.976188+0000","last_undegraded":"2024-09-10T23:54:47.976188+0000","last_fullsized":"2024-09-10T23:54:47.976188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973971+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:54:47.973971+0000","last_peered":"2024-09-10T23:54:47.973971+0000","last_clean":"2024-09-10T23:54:47.973971+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:54:47.973971+0000","last_undegraded":"2024-09-10T23:54:47.973971+0000","last_fullsized":"2024-09-10T23:54:47.973971+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.991626+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:54:47.991626+0000","last_peered":"2024-09-10T23:54:47.991626+0000","last_clean":"2024-09-10T23:54:47.991626+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:54:47.991626+0000","last_undegraded":"2024-09-10T23:54:47.991626+0000","last_fullsized":"2024-09-10T23:54:47.991626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977679+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:54:47.977679+0000","last_peered":"2024-09-10T23:54:47.977679+0000","last_clean":"2024-09-10T23:54:47.977679+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:54:47.977679+0000","last_undegraded":"2024-09-10T23:54:47.977679+0000","last_fullsized":"2024-09-10T23:54:47.977679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977897+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:54:47.977897+0000","last_peered":"2024-09-10T23:54:47.977897+0000","last_clean":"2024-09-10T23:54:47.977897+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:54:47.977897+0000","last_undegraded":"2024-09-10T23:54:47.977897+0000","last_fullsized":"2024-09-10T23:54:47.977897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973014+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:54:47.973014+0000","last_peered":"2024-09-10T23:54:47.973014+0000","last_clean":"2024-09-10T23:54:47.973014+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:54:47.973014+0000","last_undegraded":"2024-09-10T23:54:47.973014+0000","last_fullsized":"2024-09-10T23:54:47.973014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970503+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:54:47.970503+0000","last_peered":"2024-09-10T23:54:47.970503+0000","last_clean":"2024-09-10T23:54:47.970503+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:54:47.970503+0000","last_undegraded":"2024-09-10T23:54:47.970503+0000","last_fullsized":"2024-09-10T23:54:47.970503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977722+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:54:47.977722+0000","last_peered":"2024-09-10T23:54:47.977722+0000","last_clean":"2024-09-10T23:54:47.977722+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:54:47.977722+0000","last_undegraded":"2024-09-10T23:54:47.977722+0000","last_fullsized":"2024-09-10T23:54:47.977722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:00.003817+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:55:00.003817+0000","last_peered":"2024-09-10T23:55:00.003817+0000","last_clean":"2024-09-10T23:55:00.003817+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:55:00.003817+0000","last_undegraded":"2024-09-10T23:55:00.003817+0000","last_fullsized":"2024-09-10T23:55:00.003817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497886+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:54:48.497886+0000","last_peered":"2024-09-10T23:54:48.497886+0000","last_clean":"2024-09-10T23:54:48.497886+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:54:48.497886+0000","last_undegraded":"2024-09-10T23:54:48.497886+0000","last_fullsized":"2024-09-10T23:54:48.497886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979679+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:54:47.979679+0000","last_peered":"2024-09-10T23:54:47.979679+0000","last_clean":"2024-09-10T23:54:47.979679+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:54:47.979679+0000","last_undegraded":"2024-09-10T23:54:47.979679+0000","last_fullsized":"2024-09-10T23:54:47.979679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978257+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:54:47.978257+0000","last_peered":"2024-09-10T23:54:47.978257+0000","last_clean":"2024-09-10T23:54:47.978257+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:54:47.978257+0000","last_undegraded":"2024-09-10T23:54:47.978257+0000","last_fullsized":"2024-09-10T23:54:47.978257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973270+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:54:47.973270+0000","last_peered":"2024-09-10T23:54:47.973270+0000","last_clean":"2024-09-10T23:54:47.973270+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:54:47.973270+0000","last_undegraded":"2024-09-10T23:54:47.973270+0000","last_fullsized":"2024-09-10T23:54:47.973270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970202+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:54:47.970202+0000","last_peered":"2024-09-10T23:54:47.970202+0000","last_clean":"2024-09-10T23:54:47.970202+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:54:47.970202+0000","last_undegraded":"2024-09-10T23:54:47.970202+0000","last_fullsized":"2024-09-10T23:54:47.970202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971306+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:54:47.971306+0000","last_peered":"2024-09-10T23:54:47.971306+0000","last_clean":"2024-09-10T23:54:47.971306+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:54:47.971306+0000","last_undegraded":"2024-09-10T23:54:47.971306+0000","last_fullsized":"2024-09-10T23:54:47.971306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979012+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:54:47.979012+0000","last_peered":"2024-09-10T23:54:47.979012+0000","last_clean":"2024-09-10T23:54:47.979012+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:54:47.979012+0000","last_undegraded":"2024-09-10T23:54:47.979012+0000","last_fullsized":"2024-09-10T23:54:47.979012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973880+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:54:47.973880+0000","last_peered":"2024-09-10T23:54:47.973880+0000","last_clean":"2024-09-10T23:54:47.973880+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:54:47.973880+0000","last_undegraded":"2024-09-10T23:54:47.973880+0000","last_fullsized":"2024-09-10T23:54:47.973880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'29","reported_seq":123,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:01.007532+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:55:01.007532+0000","last_peered":"2024-09-10T23:55:01.007532+0000","last_clean":"2024-09-10T23:55:01.007532+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:55:01.007532+0000","last_undegraded":"2024-09-10T23:55:01.007532+0000","last_fullsized":"2024-09-10T23:55:01.007532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51895,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":63,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496544+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:54:48.496544+0000","last_peered":"2024-09-10T23:54:48.496544+0000","last_clean":"2024-09-10T23:54:48.496544+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:54:48.496544+0000","last_undegraded":"2024-09-10T23:54:48.496544+0000","last_fullsized":"2024-09-10T23:54:48.496544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972869+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:54:47.972869+0000","last_peered":"2024-09-10T23:54:47.972869+0000","last_clean":"2024-09-10T23:54:47.972869+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:54:47.972869+0000","last_undegraded":"2024-09-10T23:54:47.972869+0000","last_fullsized":"2024-09-10T23:54:47.972869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979278+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:54:47.979278+0000","last_peered":"2024-09-10T23:54:47.979278+0000","last_clean":"2024-09-10T23:54:47.979278+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:54:47.979278+0000","last_undegraded":"2024-09-10T23:54:47.979278+0000","last_fullsized":"2024-09-10T23:54:47.979278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973551+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:54:47.973551+0000","last_peered":"2024-09-10T23:54:47.973551+0000","last_clean":"2024-09-10T23:54:47.973551+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:54:47.973551+0000","last_undegraded":"2024-09-10T23:54:47.973551+0000","last_fullsized":"2024-09-10T23:54:47.973551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554922+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:54:48.554922+0000","last_peered":"2024-09-10T23:54:48.554922+0000","last_clean":"2024-09-10T23:54:48.554922+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:54:48.554922+0000","last_undegraded":"2024-09-10T23:54:48.554922+0000","last_fullsized":"2024-09-10T23:54:48.554922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980777+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:54:47.980777+0000","last_peered":"2024-09-10T23:54:47.980777+0000","last_clean":"2024-09-10T23:54:47.980777+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:54:47.980777+0000","last_undegraded":"2024-09-10T23:54:47.980777+0000","last_fullsized":"2024-09-10T23:54:47.980777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497407+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:54:48.497407+0000","last_peered":"2024-09-10T23:54:48.497407+0000","last_clean":"2024-09-10T23:54:48.497407+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:54:48.497407+0000","last_undegraded":"2024-09-10T23:54:48.497407+0000","last_fullsized":"2024-09-10T23:54:48.497407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973024+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:54:47.973024+0000","last_peered":"2024-09-10T23:54:47.973024+0000","last_clean":"2024-09-10T23:54:47.973024+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:54:47.973024+0000","last_undegraded":"2024-09-10T23:54:47.973024+0000","last_fullsized":"2024-09-10T23:54:47.973024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:00.002677+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:55:00.002677+0000","last_peered":"2024-09-10T23:55:00.002677+0000","last_clean":"2024-09-10T23:55:00.002677+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:55:00.002677+0000","last_undegraded":"2024-09-10T23:55:00.002677+0000","last_fullsized":"2024-09-10T23:55:00.002677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.495936+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:54:48.495936+0000","last_peered":"2024-09-10T23:54:48.495936+0000","last_clean":"2024-09-10T23:54:48.495936+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:54:48.495936+0000","last_undegraded":"2024-09-10T23:54:48.495936+0000","last_fullsized":"2024-09-10T23:54:48.495936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554719+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:54:48.554719+0000","last_peered":"2024-09-10T23:54:48.554719+0000","last_clean":"2024-09-10T23:54:48.554719+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:54:48.554719+0000","last_undegraded":"2024-09-10T23:54:48.554719+0000","last_fullsized":"2024-09-10T23:54:48.554719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496304+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:54:48.496304+0000","last_peered":"2024-09-10T23:54:48.496304+0000","last_clean":"2024-09-10T23:54:48.496304+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:54:48.496304+0000","last_undegraded":"2024-09-10T23:54:48.496304+0000","last_fullsized":"2024-09-10T23:54:48.496304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977270+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:54:47.977270+0000","last_peered":"2024-09-10T23:54:47.977270+0000","last_clean":"2024-09-10T23:54:47.977270+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:54:47.977270+0000","last_undegraded":"2024-09-10T23:54:47.977270+0000","last_fullsized":"2024-09-10T23:54:47.977270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973661+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:54:47.973661+0000","last_peered":"2024-09-10T23:54:47.973661+0000","last_clean":"2024-09-10T23:54:47.973661+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:54:47.973661+0000","last_undegraded":"2024-09-10T23:54:47.973661+0000","last_fullsized":"2024-09-10T23:54:47.973661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496367+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:54:48.496367+0000","last_peered":"2024-09-10T23:54:48.496367+0000","last_clean":"2024-09-10T23:54:48.496367+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:54:48.496367+0000","last_undegraded":"2024-09-10T23:54:48.496367+0000","last_fullsized":"2024-09-10T23:54:48.496367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969911+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:54:47.969911+0000","last_peered":"2024-09-10T23:54:47.969911+0000","last_clean":"2024-09-10T23:54:47.969911+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:54:47.969911+0000","last_undegraded":"2024-09-10T23:54:47.969911+0000","last_fullsized":"2024-09-10T23:54:47.969911+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969273+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:54:47.969273+0000","last_peered":"2024-09-10T23:54:47.969273+0000","last_clean":"2024-09-10T23:54:47.969273+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:54:47.969273+0000","last_undegraded":"2024-09-10T23:54:47.969273+0000","last_fullsized":"2024-09-10T23:54:47.969273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980259+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:54:47.980259+0000","last_peered":"2024-09-10T23:54:47.980259+0000","last_clean":"2024-09-10T23:54:47.980259+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:54:47.980259+0000","last_undegraded":"2024-09-10T23:54:47.980259+0000","last_fullsized":"2024-09-10T23:54:47.980259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970789+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:54:47.970789+0000","last_peered":"2024-09-10T23:54:47.970789+0000","last_clean":"2024-09-10T23:54:47.970789+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:54:47.970789+0000","last_undegraded":"2024-09-10T23:54:47.970789+0000","last_fullsized":"2024-09-10T23:54:47.970789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:00.003390+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:55:00.003390+0000","last_peered":"2024-09-10T23:55:00.003390+0000","last_clean":"2024-09-10T23:55:00.003390+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:55:00.003390+0000","last_undegraded":"2024-09-10T23:55:00.003390+0000","last_fullsized":"2024-09-10T23:55:00.003390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":1,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974216+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:54:47.974216+0000","last_peered":"2024-09-10T23:54:47.974216+0000","last_clean":"2024-09-10T23:54:47.974216+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:54:47.974216+0000","last_undegraded":"2024-09-10T23:54:47.974216+0000","last_fullsized":"2024-09-10T23:54:47.974216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970984+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:54:47.970984+0000","last_peered":"2024-09-10T23:54:47.970984+0000","last_clean":"2024-09-10T23:54:47.970984+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:54:47.970984+0000","last_undegraded":"2024-09-10T23:54:47.970984+0000","last_fullsized":"2024-09-10T23:54:47.970984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973540+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:54:47.973540+0000","last_peered":"2024-09-10T23:54:47.973540+0000","last_clean":"2024-09-10T23:54:47.973540+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:54:47.973540+0000","last_undegraded":"2024-09-10T23:54:47.973540+0000","last_fullsized":"2024-09-10T23:54:47.973540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970770+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:54:47.970770+0000","last_peered":"2024-09-10T23:54:47.970770+0000","last_clean":"2024-09-10T23:54:47.970770+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:54:47.970770+0000","last_undegraded":"2024-09-10T23:54:47.970770+0000","last_fullsized":"2024-09-10T23:54:47.970770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970525+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:54:47.970525+0000","last_peered":"2024-09-10T23:54:47.970525+0000","last_clean":"2024-09-10T23:54:47.970525+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:54:47.970525+0000","last_undegraded":"2024-09-10T23:54:47.970525+0000","last_fullsized":"2024-09-10T23:54:47.970525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554577+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:54:48.554577+0000","last_peered":"2024-09-10T23:54:48.554577+0000","last_clean":"2024-09-10T23:54:48.554577+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:54:48.554577+0000","last_undegraded":"2024-09-10T23:54:48.554577+0000","last_fullsized":"2024-09-10T23:54:48.554577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970433+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:54:47.970433+0000","last_peered":"2024-09-10T23:54:47.970433+0000","last_clean":"2024-09-10T23:54:47.970433+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:54:47.970433+0000","last_undegraded":"2024-09-10T23:54:47.970433+0000","last_fullsized":"2024-09-10T23:54:47.970433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974912+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:54:47.974912+0000","last_peered":"2024-09-10T23:54:47.974912+0000","last_clean":"2024-09-10T23:54:47.974912+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:54:47.974912+0000","last_undegraded":"2024-09-10T23:54:47.974912+0000","last_fullsized":"2024-09-10T23:54:47.974912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971929+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:54:47.971929+0000","last_peered":"2024-09-10T23:54:47.971929+0000","last_clean":"2024-09-10T23:54:47.971929+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:54:47.971929+0000","last_undegraded":"2024-09-10T23:54:47.971929+0000","last_fullsized":"2024-09-10T23:54:47.971929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496677+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:54:48.496677+0000","last_peered":"2024-09-10T23:54:48.496677+0000","last_clean":"2024-09-10T23:54:48.496677+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:54:48.496677+0000","last_undegraded":"2024-09-10T23:54:48.496677+0000","last_fullsized":"2024-09-10T23:54:48.496677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977013+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:54:47.977013+0000","last_peered":"2024-09-10T23:54:47.977013+0000","last_clean":"2024-09-10T23:54:47.977013+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:54:47.977013+0000","last_undegraded":"2024-09-10T23:54:47.977013+0000","last_fullsized":"2024-09-10T23:54:47.977013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496026+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:54:48.496026+0000","last_peered":"2024-09-10T23:54:48.496026+0000","last_clean":"2024-09-10T23:54:48.496026+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:54:48.496026+0000","last_undegraded":"2024-09-10T23:54:48.496026+0000","last_fullsized":"2024-09-10T23:54:48.496026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972417+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:54:47.972417+0000","last_peered":"2024-09-10T23:54:47.972417+0000","last_clean":"2024-09-10T23:54:47.972417+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:54:47.972417+0000","last_undegraded":"2024-09-10T23:54:47.972417+0000","last_fullsized":"2024-09-10T23:54:47.972417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970258+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:54:47.970258+0000","last_peered":"2024-09-10T23:54:47.970258+0000","last_clean":"2024-09-10T23:54:47.970258+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:54:47.970258+0000","last_undegraded":"2024-09-10T23:54:47.970258+0000","last_fullsized":"2024-09-10T23:54:47.970258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.499482+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:54:48.499482+0000","last_peered":"2024-09-10T23:54:48.499482+0000","last_clean":"2024-09-10T23:54:48.499482+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:54:48.499482+0000","last_undegraded":"2024-09-10T23:54:48.499482+0000","last_fullsized":"2024-09-10T23:54:48.499482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971140+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:54:47.971140+0000","last_peered":"2024-09-10T23:54:47.971140+0000","last_clean":"2024-09-10T23:54:47.971140+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:54:47.971140+0000","last_undegraded":"2024-09-10T23:54:47.971140+0000","last_fullsized":"2024-09-10T23:54:47.971140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497464+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:54:48.497464+0000","last_peered":"2024-09-10T23:54:48.497464+0000","last_clean":"2024-09-10T23:54:48.497464+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:54:48.497464+0000","last_undegraded":"2024-09-10T23:54:48.497464+0000","last_fullsized":"2024-09-10T23:54:48.497464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974120+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:54:47.974120+0000","last_peered":"2024-09-10T23:54:47.974120+0000","last_clean":"2024-09-10T23:54:47.974120+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:54:47.974120+0000","last_undegraded":"2024-09-10T23:54:47.974120+0000","last_fullsized":"2024-09-10T23:54:47.974120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971718+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:54:47.971718+0000","last_peered":"2024-09-10T23:54:47.971718+0000","last_clean":"2024-09-10T23:54:47.971718+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:54:47.971718+0000","last_undegraded":"2024-09-10T23:54:47.971718+0000","last_fullsized":"2024-09-10T23:54:47.971718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554372+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:54:48.554372+0000","last_peered":"2024-09-10T23:54:48.554372+0000","last_clean":"2024-09-10T23:54:48.554372+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:54:48.554372+0000","last_undegraded":"2024-09-10T23:54:48.554372+0000","last_fullsized":"2024-09-10T23:54:48.554372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554336+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:54:48.554336+0000","last_peered":"2024-09-10T23:54:48.554336+0000","last_clean":"2024-09-10T23:54:48.554336+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:54:48.554336+0000","last_undegraded":"2024-09-10T23:54:48.554336+0000","last_fullsized":"2024-09-10T23:54:48.554336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970225+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:54:47.970225+0000","last_peered":"2024-09-10T23:54:47.970225+0000","last_clean":"2024-09-10T23:54:47.970225+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:54:47.970225+0000","last_undegraded":"2024-09-10T23:54:47.970225+0000","last_fullsized":"2024-09-10T23:54:47.970225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974804+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:54:47.974804+0000","last_peered":"2024-09-10T23:54:47.974804+0000","last_clean":"2024-09-10T23:54:47.974804+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:54:47.974804+0000","last_undegraded":"2024-09-10T23:54:47.974804+0000","last_fullsized":"2024-09-10T23:54:47.974804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980645+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:54:47.980645+0000","last_peered":"2024-09-10T23:54:47.980645+0000","last_clean":"2024-09-10T23:54:47.980645+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:54:47.980645+0000","last_undegraded":"2024-09-10T23:54:47.980645+0000","last_fullsized":"2024-09-10T23:54:47.980645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969340+0000","last_change":"2024-09-10T23:53:55.745654+0000","last_active":"2024-09-10T23:54:47.969340+0000","last_peered":"2024-09-10T23:54:47.969340+0000","last_clean":"2024-09-10T23:54:47.969340+0000","last_became_active":"2024-09-10T23:53:55.744912+0000","last_became_peered":"2024-09-10T23:53:55.744912+0000","last_unstale":"2024-09-10T23:54:47.969340+0000","last_undegraded":"2024-09-10T23:54:47.969340+0000","last_fullsized":"2024-09-10T23:54:47.969340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:14.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972989+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:54:47.972989+0000","last_peered":"2024-09-10T23:54:47.972989+0000","last_clean":"2024-09-10T23:54:47.972989+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:54:47.972989+0000","last_undegraded":"2024-09-10T23:54:47.972989+0000","last_fullsized":"2024-09-10T23:54:47.972989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496245+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:54:48.496245+0000","last_peered":"2024-09-10T23:54:48.496245+0000","last_clean":"2024-09-10T23:54:48.496245+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:54:48.496245+0000","last_undegraded":"2024-09-10T23:54:48.496245+0000","last_fullsized":"2024-09-10T23:54:48.496245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978475+0000","last_change":"2024-09-10T23:53:55.743116+0000","last_active":"2024-09-10T23:54:47.978475+0000","last_peered":"2024-09-10T23:54:47.978475+0000","last_clean":"2024-09-10T23:54:47.978475+0000","last_became_active":"2024-09-10T23:53:55.742780+0000","last_became_peered":"2024-09-10T23:53:55.742780+0000","last_unstale":"2024-09-10T23:54:47.978475+0000","last_undegraded":"2024-09-10T23:54:47.978475+0000","last_fullsized":"2024-09-10T23:54:47.978475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:22.503080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.499110+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:54:48.499110+0000","last_peered":"2024-09-10T23:54:48.499110+0000","last_clean":"2024-09-10T23:54:48.499110+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:54:48.499110+0000","last_undegraded":"2024-09-10T23:54:48.499110+0000","last_fullsized":"2024-09-10T23:54:48.499110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973733+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:54:47.973733+0000","last_peered":"2024-09-10T23:54:47.973733+0000","last_clean":"2024-09-10T23:54:47.973733+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:54:47.973733+0000","last_undegraded":"2024-09-10T23:54:47.973733+0000","last_fullsized":"2024-09-10T23:54:47.973733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974706+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:54:47.974706+0000","last_peered":"2024-09-10T23:54:47.974706+0000","last_clean":"2024-09-10T23:54:47.974706+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:54:47.974706+0000","last_undegraded":"2024-09-10T23:54:47.974706+0000","last_fullsized":"2024-09-10T23:54:47.974706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554717+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:54:48.554717+0000","last_peered":"2024-09-10T23:54:48.554717+0000","last_clean":"2024-09-10T23:54:48.554717+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:54:48.554717+0000","last_undegraded":"2024-09-10T23:54:48.554717+0000","last_fullsized":"2024-09-10T23:54:48.554717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554843+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:54:48.554843+0000","last_peered":"2024-09-10T23:54:48.554843+0000","last_clean":"2024-09-10T23:54:48.554843+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:54:48.554843+0000","last_undegraded":"2024-09-10T23:54:48.554843+0000","last_fullsized":"2024-09-10T23:54:48.554843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974017+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:54:47.974017+0000","last_peered":"2024-09-10T23:54:47.974017+0000","last_clean":"2024-09-10T23:54:47.974017+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:54:47.974017+0000","last_undegraded":"2024-09-10T23:54:47.974017+0000","last_fullsized":"2024-09-10T23:54:47.974017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56287,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":164,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":168861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710749,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":479143,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906978,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":1118675,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070505,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":483453,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266735,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":479255,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1075577,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626490,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":474533,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1070774,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":532482,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":474727,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":475171,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":526338,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":475921,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":51895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":53943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:55:06.569 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:55:06.984 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:07 smithi189 ceph-mon[34000]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:07.337 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:07 smithi033 ceph-mon[30593]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:07.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:07 smithi052 ceph-mon[33526]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:07.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 -- 172.21.15.33:0/1886912486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 msgr2=0x7f9688115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 --2- 172.21.15.33:0/1886912486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f9688115bd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9680009ca0 tx=0x7f968002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 -- 172.21.15.33:0/1886912486 shutdown_connections 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 --2- 172.21.15.33:0/1886912486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f9688115bd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 --2- 172.21.15.33:0/1886912486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9688077ff0 0x7f96881132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 --2- 172.21.15.33:0/1886912486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96880776d0 0x7f9688077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 -- 172.21.15.33:0/1886912486 >> 172.21.15.33:0/1886912486 conn(0x7f9688100840 msgr2=0x7f9688102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 -- 172.21.15.33:0/1886912486 shutdown_connections 2024-09-10T23:55:07.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.609+0000 7f968ec00640 1 -- 172.21.15.33:0/1886912486 wait complete. 2024-09-10T23:55:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.610+0000 7f968ec00640 1 Processor -- start 2024-09-10T23:55:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.610+0000 7f968ec00640 1 -- start start 2024-09-10T23:55:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96880776d0 0x7f968819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 0x7f968819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:07.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96881190b0 con 0x7f96881137e0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9688118f30 con 0x7f9688077ff0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ec00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9688119230 con 0x7f96880776d0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57792/0 (socket says 172.21.15.33:57792) 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 -- 172.21.15.33:0/3879314790 learned_addr learned my addr 172.21.15.33:0/3879314790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968ce00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 0x7f968819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968d800640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96880776d0 0x7f968819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 -- 172.21.15.33:0/3879314790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96880776d0 msgr2=0x7f968819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96880776d0 0x7f968819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.611+0000 7f968e200640 1 -- 172.21.15.33:0/3879314790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 msgr2=0x7f968819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968e200640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 0x7f968819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968e200640 1 -- 172.21.15.33:0/3879314790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96881a5570 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968ce00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 0x7f968819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968e200640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9680031040 tx=0x7f9680003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680032c90 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9680032e30 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96881a5800 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680030b20 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.612+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96881abf20 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.614+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688077ab0 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.616+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9680030cc0 con 0x7f96881137e0 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.617+0000 7f9686000640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 0x7f96700b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:07.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.617+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f9680107330 con 0x7f96881137e0 2024-09-10T23:55:07.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.617+0000 7f968d800640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 0x7f96700b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:07.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.618+0000 7f968d800640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 0x7f96700b78d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f967c009b60 tx=0x7f967c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:07.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.621+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96800cdcf0 con 0x7f96881137e0 2024-09-10T23:55:07.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.816+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9688115830 con 0x7f96700b5410 2024-09-10T23:55:07.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.822+0000 7f9686000640 1 -- 172.21.15.33:0/3879314790 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340623 (secure 0 0 0) 0x7f9688115830 con 0x7f96700b5410 2024-09-10T23:55:07.827 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:07.829 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 msgr2=0x7f96700b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 0x7f96700b78d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f967c009b60 tx=0x7f967c005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 msgr2=0x7f96881a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9680031040 tx=0x7f9680003f80 comp rx=0 tx=0).stop 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 shutdown_connections 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96700b5410 0x7f96700b78d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96881137e0 0x7f96881a4da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688077ff0 0x7f968819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 --2- 172.21.15.33:0/3879314790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96880776d0 0x7f968819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 >> 172.21.15.33:0/3879314790 conn(0x7f9688100840 msgr2=0x7f9688102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 shutdown_connections 2024-09-10T23:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:07.827+0000 7f968ec00640 1 -- 172.21.15.33:0/3879314790 wait complete. 2024-09-10T23:55:08.326 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:08 smithi033 ceph-mon[30593]: pgmap v385: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-10T23:55:08.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:08 smithi189 ceph-mon[34000]: pgmap v385: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-10T23:55:08.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:08 smithi052 ceph-mon[33526]: pgmap v385: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-10T23:55:08.705 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-10T23:55:06.793979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651154,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":220,"num_read_kb":196,"num_write":290,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360632,"kb_used_data":11372,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581192,"statfs":{"total":1151940427776,"available":1151571140608,"internally_reserved":0,"allocated":11644928,"data_stored":7678844,"data_compressed":391497,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45952,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":28,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.498141+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:54:48.498141+0000","last_peered":"2024-09-10T23:54:48.498141+0000","last_clean":"2024-09-10T23:54:48.498141+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:54:48.498141+0000","last_undegraded":"2024-09-10T23:54:48.498141+0000","last_fullsized":"2024-09-10T23:54:48.498141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496818+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:54:48.496818+0000","last_peered":"2024-09-10T23:54:48.496818+0000","last_clean":"2024-09-10T23:54:48.496818+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:54:48.496818+0000","last_undegraded":"2024-09-10T23:54:48.496818+0000","last_fullsized":"2024-09-10T23:54:48.496818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970408+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:54:47.970408+0000","last_peered":"2024-09-10T23:54:47.970408+0000","last_clean":"2024-09-10T23:54:47.970408+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:54:47.970408+0000","last_undegraded":"2024-09-10T23:54:47.970408+0000","last_fullsized":"2024-09-10T23:54:47.970408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497086+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:54:48.497086+0000","last_peered":"2024-09-10T23:54:48.497086+0000","last_clean":"2024-09-10T23:54:48.497086+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:54:48.497086+0000","last_undegraded":"2024-09-10T23:54:48.497086+0000","last_fullsized":"2024-09-10T23:54:48.497086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554891+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:54:48.554891+0000","last_peered":"2024-09-10T23:54:48.554891+0000","last_clean":"2024-09-10T23:54:48.554891+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:54:48.554891+0000","last_undegraded":"2024-09-10T23:54:48.554891+0000","last_fullsized":"2024-09-10T23:54:48.554891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497999+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:54:48.497999+0000","last_peered":"2024-09-10T23:54:48.497999+0000","last_clean":"2024-09-10T23:54:48.497999+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:54:48.497999+0000","last_undegraded":"2024-09-10T23:54:48.497999+0000","last_fullsized":"2024-09-10T23:54:48.497999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.997606+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:54:47.997606+0000","last_peered":"2024-09-10T23:54:47.997606+0000","last_clean":"2024-09-10T23:54:47.997606+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:54:47.997606+0000","last_undegraded":"2024-09-10T23:54:47.997606+0000","last_fullsized":"2024-09-10T23:54:47.997606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972379+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:54:47.972379+0000","last_peered":"2024-09-10T23:54:47.972379+0000","last_clean":"2024-09-10T23:54:47.972379+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:54:47.972379+0000","last_undegraded":"2024-09-10T23:54:47.972379+0000","last_fullsized":"2024-09-10T23:54:47.972379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973736+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:54:47.973736+0000","last_peered":"2024-09-10T23:54:47.973736+0000","last_clean":"2024-09-10T23:54:47.973736+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:54:47.973736+0000","last_undegraded":"2024-09-10T23:54:47.973736+0000","last_fullsized":"2024-09-10T23:54:47.973736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974874+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:54:47.974874+0000","last_peered":"2024-09-10T23:54:47.974874+0000","last_clean":"2024-09-10T23:54:47.974874+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:54:47.974874+0000","last_undegraded":"2024-09-10T23:54:47.974874+0000","last_fullsized":"2024-09-10T23:54:47.974874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979116+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:54:47.979116+0000","last_peered":"2024-09-10T23:54:47.979116+0000","last_clean":"2024-09-10T23:54:47.979116+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:54:47.979116+0000","last_undegraded":"2024-09-10T23:54:47.979116+0000","last_fullsized":"2024-09-10T23:54:47.979116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973074+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:54:47.973074+0000","last_peered":"2024-09-10T23:54:47.973074+0000","last_clean":"2024-09-10T23:54:47.973074+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:54:47.973074+0000","last_undegraded":"2024-09-10T23:54:47.973074+0000","last_fullsized":"2024-09-10T23:54:47.973074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978876+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:54:47.978876+0000","last_peered":"2024-09-10T23:54:47.978876+0000","last_clean":"2024-09-10T23:54:47.978876+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:54:47.978876+0000","last_undegraded":"2024-09-10T23:54:47.978876+0000","last_fullsized":"2024-09-10T23:54:47.978876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973851+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:54:47.973851+0000","last_peered":"2024-09-10T23:54:47.973851+0000","last_clean":"2024-09-10T23:54:47.973851+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:54:47.973851+0000","last_undegraded":"2024-09-10T23:54:47.973851+0000","last_fullsized":"2024-09-10T23:54:47.973851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974362+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:54:47.974362+0000","last_peered":"2024-09-10T23:54:47.974362+0000","last_clean":"2024-09-10T23:54:47.974362+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:54:47.974362+0000","last_undegraded":"2024-09-10T23:54:47.974362+0000","last_fullsized":"2024-09-10T23:54:47.974362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496244+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:54:48.496244+0000","last_peered":"2024-09-10T23:54:48.496244+0000","last_clean":"2024-09-10T23:54:48.496244+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:54:48.496244+0000","last_undegraded":"2024-09-10T23:54:48.496244+0000","last_fullsized":"2024-09-10T23:54:48.496244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971002+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:54:47.971002+0000","last_peered":"2024-09-10T23:54:47.971002+0000","last_clean":"2024-09-10T23:54:47.971002+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:54:47.971002+0000","last_undegraded":"2024-09-10T23:54:47.971002+0000","last_fullsized":"2024-09-10T23:54:47.971002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974454+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:54:47.974454+0000","last_peered":"2024-09-10T23:54:47.974454+0000","last_clean":"2024-09-10T23:54:47.974454+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:54:47.974454+0000","last_undegraded":"2024-09-10T23:54:47.974454+0000","last_fullsized":"2024-09-10T23:54:47.974454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973428+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:54:47.973428+0000","last_peered":"2024-09-10T23:54:47.973428+0000","last_clean":"2024-09-10T23:54:47.973428+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:54:47.973428+0000","last_undegraded":"2024-09-10T23:54:47.973428+0000","last_fullsized":"2024-09-10T23:54:47.973428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496495+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:54:48.496495+0000","last_peered":"2024-09-10T23:54:48.496495+0000","last_clean":"2024-09-10T23:54:48.496495+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:54:48.496495+0000","last_undegraded":"2024-09-10T23:54:48.496495+0000","last_fullsized":"2024-09-10T23:54:48.496495+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497940+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:54:48.497940+0000","last_peered":"2024-09-10T23:54:48.497940+0000","last_clean":"2024-09-10T23:54:48.497940+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:54:48.497940+0000","last_undegraded":"2024-09-10T23:54:48.497940+0000","last_fullsized":"2024-09-10T23:54:48.497940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972782+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:54:47.972782+0000","last_peered":"2024-09-10T23:54:47.972782+0000","last_clean":"2024-09-10T23:54:47.972782+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:54:47.972782+0000","last_undegraded":"2024-09-10T23:54:47.972782+0000","last_fullsized":"2024-09-10T23:54:47.972782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971901+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:54:47.971901+0000","last_peered":"2024-09-10T23:54:47.971901+0000","last_clean":"2024-09-10T23:54:47.971901+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:54:47.971901+0000","last_undegraded":"2024-09-10T23:54:47.971901+0000","last_fullsized":"2024-09-10T23:54:47.971901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974359+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:54:47.974359+0000","last_peered":"2024-09-10T23:54:47.974359+0000","last_clean":"2024-09-10T23:54:47.974359+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:54:47.974359+0000","last_undegraded":"2024-09-10T23:54:47.974359+0000","last_fullsized":"2024-09-10T23:54:47.974359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554840+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:54:48.554840+0000","last_peered":"2024-09-10T23:54:48.554840+0000","last_clean":"2024-09-10T23:54:48.554840+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:54:48.554840+0000","last_undegraded":"2024-09-10T23:54:48.554840+0000","last_fullsized":"2024-09-10T23:54:48.554840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974905+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:54:47.974905+0000","last_peered":"2024-09-10T23:54:47.974905+0000","last_clean":"2024-09-10T23:54:47.974905+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:54:47.974905+0000","last_undegraded":"2024-09-10T23:54:47.974905+0000","last_fullsized":"2024-09-10T23:54:47.974905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970478+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:54:47.970478+0000","last_peered":"2024-09-10T23:54:47.970478+0000","last_clean":"2024-09-10T23:54:47.970478+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:54:47.970478+0000","last_undegraded":"2024-09-10T23:54:47.970478+0000","last_fullsized":"2024-09-10T23:54:47.970478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496771+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:54:48.496771+0000","last_peered":"2024-09-10T23:54:48.496771+0000","last_clean":"2024-09-10T23:54:48.496771+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:54:48.496771+0000","last_undegraded":"2024-09-10T23:54:48.496771+0000","last_fullsized":"2024-09-10T23:54:48.496771+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:00.757167+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:55:00.757167+0000","last_peered":"2024-09-10T23:55:00.757167+0000","last_clean":"2024-09-10T23:55:00.757167+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:55:00.757167+0000","last_undegraded":"2024-09-10T23:55:00.757167+0000","last_fullsized":"2024-09-10T23:55:00.757167+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496080+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:54:48.496080+0000","last_peered":"2024-09-10T23:54:48.496080+0000","last_clean":"2024-09-10T23:54:48.496080+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:54:48.496080+0000","last_undegraded":"2024-09-10T23:54:48.496080+0000","last_fullsized":"2024-09-10T23:54:48.496080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970486+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:54:47.970486+0000","last_peered":"2024-09-10T23:54:47.970486+0000","last_clean":"2024-09-10T23:54:47.970486+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:54:47.970486+0000","last_undegraded":"2024-09-10T23:54:47.970486+0000","last_fullsized":"2024-09-10T23:54:47.970486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974179+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:54:47.974179+0000","last_peered":"2024-09-10T23:54:47.974179+0000","last_clean":"2024-09-10T23:54:47.974179+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:54:47.974179+0000","last_undegraded":"2024-09-10T23:54:47.974179+0000","last_fullsized":"2024-09-10T23:54:47.974179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973694+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:54:47.973694+0000","last_peered":"2024-09-10T23:54:47.973694+0000","last_clean":"2024-09-10T23:54:47.973694+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:54:47.973694+0000","last_undegraded":"2024-09-10T23:54:47.973694+0000","last_fullsized":"2024-09-10T23:54:47.973694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969187+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:54:47.969187+0000","last_peered":"2024-09-10T23:54:47.969187+0000","last_clean":"2024-09-10T23:54:47.969187+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:54:47.969187+0000","last_undegraded":"2024-09-10T23:54:47.969187+0000","last_fullsized":"2024-09-10T23:54:47.969187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497593+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:54:48.497593+0000","last_peered":"2024-09-10T23:54:48.497593+0000","last_clean":"2024-09-10T23:54:48.497593+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:54:48.497593+0000","last_undegraded":"2024-09-10T23:54:48.497593+0000","last_fullsized":"2024-09-10T23:54:48.497593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979209+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:54:47.979209+0000","last_peered":"2024-09-10T23:54:47.979209+0000","last_clean":"2024-09-10T23:54:47.979209+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:54:47.979209+0000","last_undegraded":"2024-09-10T23:54:47.979209+0000","last_fullsized":"2024-09-10T23:54:47.979209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969056+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:54:47.969056+0000","last_peered":"2024-09-10T23:54:47.969056+0000","last_clean":"2024-09-10T23:54:47.969056+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:54:47.969056+0000","last_undegraded":"2024-09-10T23:54:47.969056+0000","last_fullsized":"2024-09-10T23:54:47.969056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979062+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:54:47.979062+0000","last_peered":"2024-09-10T23:54:47.979062+0000","last_clean":"2024-09-10T23:54:47.979062+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:54:47.979062+0000","last_undegraded":"2024-09-10T23:54:47.979062+0000","last_fullsized":"2024-09-10T23:54:47.979062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970275+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:54:47.970275+0000","last_peered":"2024-09-10T23:54:47.970275+0000","last_clean":"2024-09-10T23:54:47.970275+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:54:47.970275+0000","last_undegraded":"2024-09-10T23:54:47.970275+0000","last_fullsized":"2024-09-10T23:54:47.970275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977606+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:54:47.977606+0000","last_peered":"2024-09-10T23:54:47.977606+0000","last_clean":"2024-09-10T23:54:47.977606+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:54:47.977606+0000","last_undegraded":"2024-09-10T23:54:47.977606+0000","last_fullsized":"2024-09-10T23:54:47.977606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":62,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:04.010828+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:55:04.010828+0000","last_peered":"2024-09-10T23:55:04.010828+0000","last_clean":"2024-09-10T23:55:04.010828+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:55:04.010828+0000","last_undegraded":"2024-09-10T23:55:04.010828+0000","last_fullsized":"2024-09-10T23:55:04.010828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970385+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:54:47.970385+0000","last_peered":"2024-09-10T23:54:47.970385+0000","last_clean":"2024-09-10T23:54:47.970385+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:54:47.970385+0000","last_undegraded":"2024-09-10T23:54:47.970385+0000","last_fullsized":"2024-09-10T23:54:47.970385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969871+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:54:47.969871+0000","last_peered":"2024-09-10T23:54:47.969871+0000","last_clean":"2024-09-10T23:54:47.969871+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:54:47.969871+0000","last_undegraded":"2024-09-10T23:54:47.969871+0000","last_fullsized":"2024-09-10T23:54:47.969871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977922+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:54:47.977922+0000","last_peered":"2024-09-10T23:54:47.977922+0000","last_clean":"2024-09-10T23:54:47.977922+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:54:47.977922+0000","last_undegraded":"2024-09-10T23:54:47.977922+0000","last_fullsized":"2024-09-10T23:54:47.977922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.982298+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:54:47.982298+0000","last_peered":"2024-09-10T23:54:47.982298+0000","last_clean":"2024-09-10T23:54:47.982298+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:54:47.982298+0000","last_undegraded":"2024-09-10T23:54:47.982298+0000","last_fullsized":"2024-09-10T23:54:47.982298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496150+0000","last_change":"2024-09-10T23:53:55.748784+0000","last_active":"2024-09-10T23:54:48.496150+0000","last_peered":"2024-09-10T23:54:48.496150+0000","last_clean":"2024-09-10T23:54:48.496150+0000","last_became_active":"2024-09-10T23:53:55.748434+0000","last_became_peered":"2024-09-10T23:53:55.748434+0000","last_unstale":"2024-09-10T23:54:48.496150+0000","last_undegraded":"2024-09-10T23:54:48.496150+0000","last_fullsized":"2024-09-10T23:54:48.496150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:11.641162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974157+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:54:47.974157+0000","last_peered":"2024-09-10T23:54:47.974157+0000","last_clean":"2024-09-10T23:54:47.974157+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:54:47.974157+0000","last_undegraded":"2024-09-10T23:54:47.974157+0000","last_fullsized":"2024-09-10T23:54:47.974157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":112,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978160+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:54:47.978160+0000","last_peered":"2024-09-10T23:54:47.978160+0000","last_clean":"2024-09-10T23:54:47.978160+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:54:47.978160+0000","last_undegraded":"2024-09-10T23:54:47.978160+0000","last_fullsized":"2024-09-10T23:54:47.978160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980584+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:54:47.980584+0000","last_peered":"2024-09-10T23:54:47.980584+0000","last_clean":"2024-09-10T23:54:47.980584+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:54:47.980584+0000","last_undegraded":"2024-09-10T23:54:47.980584+0000","last_fullsized":"2024-09-10T23:54:47.980584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.981155+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:54:47.981155+0000","last_peered":"2024-09-10T23:54:47.981155+0000","last_clean":"2024-09-10T23:54:47.981155+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:54:47.981155+0000","last_undegraded":"2024-09-10T23:54:47.981155+0000","last_fullsized":"2024-09-10T23:54:47.981155+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970961+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:54:47.970961+0000","last_peered":"2024-09-10T23:54:47.970961+0000","last_clean":"2024-09-10T23:54:47.970961+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:54:47.970961+0000","last_undegraded":"2024-09-10T23:54:47.970961+0000","last_fullsized":"2024-09-10T23:54:47.970961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972067+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:54:47.972067+0000","last_peered":"2024-09-10T23:54:47.972067+0000","last_clean":"2024-09-10T23:54:47.972067+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:54:47.972067+0000","last_undegraded":"2024-09-10T23:54:47.972067+0000","last_fullsized":"2024-09-10T23:54:47.972067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979679+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:54:47.979679+0000","last_peered":"2024-09-10T23:54:47.979679+0000","last_clean":"2024-09-10T23:54:47.979679+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:54:47.979679+0000","last_undegraded":"2024-09-10T23:54:47.979679+0000","last_fullsized":"2024-09-10T23:54:47.979679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979404+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:54:47.979404+0000","last_peered":"2024-09-10T23:54:47.979404+0000","last_clean":"2024-09-10T23:54:47.979404+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:54:47.979404+0000","last_undegraded":"2024-09-10T23:54:47.979404+0000","last_fullsized":"2024-09-10T23:54:47.979404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554549+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:54:48.554549+0000","last_peered":"2024-09-10T23:54:48.554549+0000","last_clean":"2024-09-10T23:54:48.554549+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:54:48.554549+0000","last_undegraded":"2024-09-10T23:54:48.554549+0000","last_fullsized":"2024-09-10T23:54:48.554549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980609+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:54:47.980609+0000","last_peered":"2024-09-10T23:54:47.980609+0000","last_clean":"2024-09-10T23:54:47.980609+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:54:47.980609+0000","last_undegraded":"2024-09-10T23:54:47.980609+0000","last_fullsized":"2024-09-10T23:54:47.980609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970388+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:54:47.970388+0000","last_peered":"2024-09-10T23:54:47.970388+0000","last_clean":"2024-09-10T23:54:47.970388+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:54:47.970388+0000","last_undegraded":"2024-09-10T23:54:47.970388+0000","last_fullsized":"2024-09-10T23:54:47.970388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.976188+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:54:47.976188+0000","last_peered":"2024-09-10T23:54:47.976188+0000","last_clean":"2024-09-10T23:54:47.976188+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:54:47.976188+0000","last_undegraded":"2024-09-10T23:54:47.976188+0000","last_fullsized":"2024-09-10T23:54:47.976188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973971+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:54:47.973971+0000","last_peered":"2024-09-10T23:54:47.973971+0000","last_clean":"2024-09-10T23:54:47.973971+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:54:47.973971+0000","last_undegraded":"2024-09-10T23:54:47.973971+0000","last_fullsized":"2024-09-10T23:54:47.973971+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.991626+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:54:47.991626+0000","last_peered":"2024-09-10T23:54:47.991626+0000","last_clean":"2024-09-10T23:54:47.991626+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:54:47.991626+0000","last_undegraded":"2024-09-10T23:54:47.991626+0000","last_fullsized":"2024-09-10T23:54:47.991626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977679+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:54:47.977679+0000","last_peered":"2024-09-10T23:54:47.977679+0000","last_clean":"2024-09-10T23:54:47.977679+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:54:47.977679+0000","last_undegraded":"2024-09-10T23:54:47.977679+0000","last_fullsized":"2024-09-10T23:54:47.977679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977897+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:54:47.977897+0000","last_peered":"2024-09-10T23:54:47.977897+0000","last_clean":"2024-09-10T23:54:47.977897+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:54:47.977897+0000","last_undegraded":"2024-09-10T23:54:47.977897+0000","last_fullsized":"2024-09-10T23:54:47.977897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973014+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:54:47.973014+0000","last_peered":"2024-09-10T23:54:47.973014+0000","last_clean":"2024-09-10T23:54:47.973014+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:54:47.973014+0000","last_undegraded":"2024-09-10T23:54:47.973014+0000","last_fullsized":"2024-09-10T23:54:47.973014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970503+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:54:47.970503+0000","last_peered":"2024-09-10T23:54:47.970503+0000","last_clean":"2024-09-10T23:54:47.970503+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:54:47.970503+0000","last_undegraded":"2024-09-10T23:54:47.970503+0000","last_fullsized":"2024-09-10T23:54:47.970503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977722+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:54:47.977722+0000","last_peered":"2024-09-10T23:54:47.977722+0000","last_clean":"2024-09-10T23:54:47.977722+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:54:47.977722+0000","last_undegraded":"2024-09-10T23:54:47.977722+0000","last_fullsized":"2024-09-10T23:54:47.977722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":66,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:05.013529+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:55:05.013529+0000","last_peered":"2024-09-10T23:55:05.013529+0000","last_clean":"2024-09-10T23:55:05.013529+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:55:05.013529+0000","last_undegraded":"2024-09-10T23:55:05.013529+0000","last_fullsized":"2024-09-10T23:55:05.013529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497886+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:54:48.497886+0000","last_peered":"2024-09-10T23:54:48.497886+0000","last_clean":"2024-09-10T23:54:48.497886+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:54:48.497886+0000","last_undegraded":"2024-09-10T23:54:48.497886+0000","last_fullsized":"2024-09-10T23:54:48.497886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979679+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:54:47.979679+0000","last_peered":"2024-09-10T23:54:47.979679+0000","last_clean":"2024-09-10T23:54:47.979679+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:54:47.979679+0000","last_undegraded":"2024-09-10T23:54:47.979679+0000","last_fullsized":"2024-09-10T23:54:47.979679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978257+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:54:47.978257+0000","last_peered":"2024-09-10T23:54:47.978257+0000","last_clean":"2024-09-10T23:54:47.978257+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:54:47.978257+0000","last_undegraded":"2024-09-10T23:54:47.978257+0000","last_fullsized":"2024-09-10T23:54:47.978257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973270+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:54:47.973270+0000","last_peered":"2024-09-10T23:54:47.973270+0000","last_clean":"2024-09-10T23:54:47.973270+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:54:47.973270+0000","last_undegraded":"2024-09-10T23:54:47.973270+0000","last_fullsized":"2024-09-10T23:54:47.973270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970202+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:54:47.970202+0000","last_peered":"2024-09-10T23:54:47.970202+0000","last_clean":"2024-09-10T23:54:47.970202+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:54:47.970202+0000","last_undegraded":"2024-09-10T23:54:47.970202+0000","last_fullsized":"2024-09-10T23:54:47.970202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971306+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:54:47.971306+0000","last_peered":"2024-09-10T23:54:47.971306+0000","last_clean":"2024-09-10T23:54:47.971306+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:54:47.971306+0000","last_undegraded":"2024-09-10T23:54:47.971306+0000","last_fullsized":"2024-09-10T23:54:47.971306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979012+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:54:47.979012+0000","last_peered":"2024-09-10T23:54:47.979012+0000","last_clean":"2024-09-10T23:54:47.979012+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:54:47.979012+0000","last_undegraded":"2024-09-10T23:54:47.979012+0000","last_fullsized":"2024-09-10T23:54:47.979012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973880+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:54:47.973880+0000","last_peered":"2024-09-10T23:54:47.973880+0000","last_clean":"2024-09-10T23:54:47.973880+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:54:47.973880+0000","last_undegraded":"2024-09-10T23:54:47.973880+0000","last_fullsized":"2024-09-10T23:54:47.973880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'30","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:06.015941+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:55:06.015941+0000","last_peered":"2024-09-10T23:55:06.015941+0000","last_clean":"2024-09-10T23:55:06.015941+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:55:06.015941+0000","last_undegraded":"2024-09-10T23:55:06.015941+0000","last_fullsized":"2024-09-10T23:55:06.015941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56160,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":73,"num_write":31,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496544+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:54:48.496544+0000","last_peered":"2024-09-10T23:54:48.496544+0000","last_clean":"2024-09-10T23:54:48.496544+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:54:48.496544+0000","last_undegraded":"2024-09-10T23:54:48.496544+0000","last_fullsized":"2024-09-10T23:54:48.496544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972869+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:54:47.972869+0000","last_peered":"2024-09-10T23:54:47.972869+0000","last_clean":"2024-09-10T23:54:47.972869+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:54:47.972869+0000","last_undegraded":"2024-09-10T23:54:47.972869+0000","last_fullsized":"2024-09-10T23:54:47.972869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.979278+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:54:47.979278+0000","last_peered":"2024-09-10T23:54:47.979278+0000","last_clean":"2024-09-10T23:54:47.979278+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:54:47.979278+0000","last_undegraded":"2024-09-10T23:54:47.979278+0000","last_fullsized":"2024-09-10T23:54:47.979278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973551+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:54:47.973551+0000","last_peered":"2024-09-10T23:54:47.973551+0000","last_clean":"2024-09-10T23:54:47.973551+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:54:47.973551+0000","last_undegraded":"2024-09-10T23:54:47.973551+0000","last_fullsized":"2024-09-10T23:54:47.973551+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554922+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:54:48.554922+0000","last_peered":"2024-09-10T23:54:48.554922+0000","last_clean":"2024-09-10T23:54:48.554922+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:54:48.554922+0000","last_undegraded":"2024-09-10T23:54:48.554922+0000","last_fullsized":"2024-09-10T23:54:48.554922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980777+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:54:47.980777+0000","last_peered":"2024-09-10T23:54:47.980777+0000","last_clean":"2024-09-10T23:54:47.980777+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:54:47.980777+0000","last_undegraded":"2024-09-10T23:54:47.980777+0000","last_fullsized":"2024-09-10T23:54:47.980777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497407+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:54:48.497407+0000","last_peered":"2024-09-10T23:54:48.497407+0000","last_clean":"2024-09-10T23:54:48.497407+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:54:48.497407+0000","last_undegraded":"2024-09-10T23:54:48.497407+0000","last_fullsized":"2024-09-10T23:54:48.497407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973024+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:54:47.973024+0000","last_peered":"2024-09-10T23:54:47.973024+0000","last_clean":"2024-09-10T23:54:47.973024+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:54:47.973024+0000","last_undegraded":"2024-09-10T23:54:47.973024+0000","last_fullsized":"2024-09-10T23:54:47.973024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:05.011842+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:55:05.011842+0000","last_peered":"2024-09-10T23:55:05.011842+0000","last_clean":"2024-09-10T23:55:05.011842+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:55:05.011842+0000","last_undegraded":"2024-09-10T23:55:05.011842+0000","last_fullsized":"2024-09-10T23:55:05.011842+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.495936+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:54:48.495936+0000","last_peered":"2024-09-10T23:54:48.495936+0000","last_clean":"2024-09-10T23:54:48.495936+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:54:48.495936+0000","last_undegraded":"2024-09-10T23:54:48.495936+0000","last_fullsized":"2024-09-10T23:54:48.495936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554719+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:54:48.554719+0000","last_peered":"2024-09-10T23:54:48.554719+0000","last_clean":"2024-09-10T23:54:48.554719+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:54:48.554719+0000","last_undegraded":"2024-09-10T23:54:48.554719+0000","last_fullsized":"2024-09-10T23:54:48.554719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496304+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:54:48.496304+0000","last_peered":"2024-09-10T23:54:48.496304+0000","last_clean":"2024-09-10T23:54:48.496304+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:54:48.496304+0000","last_undegraded":"2024-09-10T23:54:48.496304+0000","last_fullsized":"2024-09-10T23:54:48.496304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977270+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:54:47.977270+0000","last_peered":"2024-09-10T23:54:47.977270+0000","last_clean":"2024-09-10T23:54:47.977270+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:54:47.977270+0000","last_undegraded":"2024-09-10T23:54:47.977270+0000","last_fullsized":"2024-09-10T23:54:47.977270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973661+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:54:47.973661+0000","last_peered":"2024-09-10T23:54:47.973661+0000","last_clean":"2024-09-10T23:54:47.973661+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:54:47.973661+0000","last_undegraded":"2024-09-10T23:54:47.973661+0000","last_fullsized":"2024-09-10T23:54:47.973661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496367+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:54:48.496367+0000","last_peered":"2024-09-10T23:54:48.496367+0000","last_clean":"2024-09-10T23:54:48.496367+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:54:48.496367+0000","last_undegraded":"2024-09-10T23:54:48.496367+0000","last_fullsized":"2024-09-10T23:54:48.496367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969911+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:54:47.969911+0000","last_peered":"2024-09-10T23:54:47.969911+0000","last_clean":"2024-09-10T23:54:47.969911+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:54:47.969911+0000","last_undegraded":"2024-09-10T23:54:47.969911+0000","last_fullsized":"2024-09-10T23:54:47.969911+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969273+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:54:47.969273+0000","last_peered":"2024-09-10T23:54:47.969273+0000","last_clean":"2024-09-10T23:54:47.969273+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:54:47.969273+0000","last_undegraded":"2024-09-10T23:54:47.969273+0000","last_fullsized":"2024-09-10T23:54:47.969273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980259+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:54:47.980259+0000","last_peered":"2024-09-10T23:54:47.980259+0000","last_clean":"2024-09-10T23:54:47.980259+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:54:47.980259+0000","last_undegraded":"2024-09-10T23:54:47.980259+0000","last_fullsized":"2024-09-10T23:54:47.980259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970789+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:54:47.970789+0000","last_peered":"2024-09-10T23:54:47.970789+0000","last_clean":"2024-09-10T23:54:47.970789+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:54:47.970789+0000","last_undegraded":"2024-09-10T23:54:47.970789+0000","last_fullsized":"2024-09-10T23:54:47.970789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:55:05.012744+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:55:05.012744+0000","last_peered":"2024-09-10T23:55:05.012744+0000","last_clean":"2024-09-10T23:55:05.012744+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:55:05.012744+0000","last_undegraded":"2024-09-10T23:55:05.012744+0000","last_fullsized":"2024-09-10T23:55:05.012744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":1,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974216+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:54:47.974216+0000","last_peered":"2024-09-10T23:54:47.974216+0000","last_clean":"2024-09-10T23:54:47.974216+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:54:47.974216+0000","last_undegraded":"2024-09-10T23:54:47.974216+0000","last_fullsized":"2024-09-10T23:54:47.974216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970984+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:54:47.970984+0000","last_peered":"2024-09-10T23:54:47.970984+0000","last_clean":"2024-09-10T23:54:47.970984+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:54:47.970984+0000","last_undegraded":"2024-09-10T23:54:47.970984+0000","last_fullsized":"2024-09-10T23:54:47.970984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973540+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:54:47.973540+0000","last_peered":"2024-09-10T23:54:47.973540+0000","last_clean":"2024-09-10T23:54:47.973540+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:54:47.973540+0000","last_undegraded":"2024-09-10T23:54:47.973540+0000","last_fullsized":"2024-09-10T23:54:47.973540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970770+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:54:47.970770+0000","last_peered":"2024-09-10T23:54:47.970770+0000","last_clean":"2024-09-10T23:54:47.970770+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:54:47.970770+0000","last_undegraded":"2024-09-10T23:54:47.970770+0000","last_fullsized":"2024-09-10T23:54:47.970770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970525+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:54:47.970525+0000","last_peered":"2024-09-10T23:54:47.970525+0000","last_clean":"2024-09-10T23:54:47.970525+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:54:47.970525+0000","last_undegraded":"2024-09-10T23:54:47.970525+0000","last_fullsized":"2024-09-10T23:54:47.970525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554577+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:54:48.554577+0000","last_peered":"2024-09-10T23:54:48.554577+0000","last_clean":"2024-09-10T23:54:48.554577+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:54:48.554577+0000","last_undegraded":"2024-09-10T23:54:48.554577+0000","last_fullsized":"2024-09-10T23:54:48.554577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970433+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:54:47.970433+0000","last_peered":"2024-09-10T23:54:47.970433+0000","last_clean":"2024-09-10T23:54:47.970433+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:54:47.970433+0000","last_undegraded":"2024-09-10T23:54:47.970433+0000","last_fullsized":"2024-09-10T23:54:47.970433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974912+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:54:47.974912+0000","last_peered":"2024-09-10T23:54:47.974912+0000","last_clean":"2024-09-10T23:54:47.974912+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:54:47.974912+0000","last_undegraded":"2024-09-10T23:54:47.974912+0000","last_fullsized":"2024-09-10T23:54:47.974912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971929+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:54:47.971929+0000","last_peered":"2024-09-10T23:54:47.971929+0000","last_clean":"2024-09-10T23:54:47.971929+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:54:47.971929+0000","last_undegraded":"2024-09-10T23:54:47.971929+0000","last_fullsized":"2024-09-10T23:54:47.971929+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496677+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:54:48.496677+0000","last_peered":"2024-09-10T23:54:48.496677+0000","last_clean":"2024-09-10T23:54:48.496677+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:54:48.496677+0000","last_undegraded":"2024-09-10T23:54:48.496677+0000","last_fullsized":"2024-09-10T23:54:48.496677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.977013+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:54:47.977013+0000","last_peered":"2024-09-10T23:54:47.977013+0000","last_clean":"2024-09-10T23:54:47.977013+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:54:47.977013+0000","last_undegraded":"2024-09-10T23:54:47.977013+0000","last_fullsized":"2024-09-10T23:54:47.977013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496026+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:54:48.496026+0000","last_peered":"2024-09-10T23:54:48.496026+0000","last_clean":"2024-09-10T23:54:48.496026+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:54:48.496026+0000","last_undegraded":"2024-09-10T23:54:48.496026+0000","last_fullsized":"2024-09-10T23:54:48.496026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972417+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:54:47.972417+0000","last_peered":"2024-09-10T23:54:47.972417+0000","last_clean":"2024-09-10T23:54:47.972417+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:54:47.972417+0000","last_undegraded":"2024-09-10T23:54:47.972417+0000","last_fullsized":"2024-09-10T23:54:47.972417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970258+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:54:47.970258+0000","last_peered":"2024-09-10T23:54:47.970258+0000","last_clean":"2024-09-10T23:54:47.970258+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:54:47.970258+0000","last_undegraded":"2024-09-10T23:54:47.970258+0000","last_fullsized":"2024-09-10T23:54:47.970258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.499482+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:54:48.499482+0000","last_peered":"2024-09-10T23:54:48.499482+0000","last_clean":"2024-09-10T23:54:48.499482+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:54:48.499482+0000","last_undegraded":"2024-09-10T23:54:48.499482+0000","last_fullsized":"2024-09-10T23:54:48.499482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971140+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:54:47.971140+0000","last_peered":"2024-09-10T23:54:47.971140+0000","last_clean":"2024-09-10T23:54:47.971140+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:54:47.971140+0000","last_undegraded":"2024-09-10T23:54:47.971140+0000","last_fullsized":"2024-09-10T23:54:47.971140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.497464+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:54:48.497464+0000","last_peered":"2024-09-10T23:54:48.497464+0000","last_clean":"2024-09-10T23:54:48.497464+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:54:48.497464+0000","last_undegraded":"2024-09-10T23:54:48.497464+0000","last_fullsized":"2024-09-10T23:54:48.497464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974120+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:54:47.974120+0000","last_peered":"2024-09-10T23:54:47.974120+0000","last_clean":"2024-09-10T23:54:47.974120+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:54:47.974120+0000","last_undegraded":"2024-09-10T23:54:47.974120+0000","last_fullsized":"2024-09-10T23:54:47.974120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.971718+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:54:47.971718+0000","last_peered":"2024-09-10T23:54:47.971718+0000","last_clean":"2024-09-10T23:54:47.971718+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:54:47.971718+0000","last_undegraded":"2024-09-10T23:54:47.971718+0000","last_fullsized":"2024-09-10T23:54:47.971718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554372+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:54:48.554372+0000","last_peered":"2024-09-10T23:54:48.554372+0000","last_clean":"2024-09-10T23:54:48.554372+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:54:48.554372+0000","last_undegraded":"2024-09-10T23:54:48.554372+0000","last_fullsized":"2024-09-10T23:54:48.554372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554336+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:54:48.554336+0000","last_peered":"2024-09-10T23:54:48.554336+0000","last_clean":"2024-09-10T23:54:48.554336+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:54:48.554336+0000","last_undegraded":"2024-09-10T23:54:48.554336+0000","last_fullsized":"2024-09-10T23:54:48.554336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.970225+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:54:47.970225+0000","last_peered":"2024-09-10T23:54:47.970225+0000","last_clean":"2024-09-10T23:54:47.970225+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:54:47.970225+0000","last_undegraded":"2024-09-10T23:54:47.970225+0000","last_fullsized":"2024-09-10T23:54:47.970225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974804+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:54:47.974804+0000","last_peered":"2024-09-10T23:54:47.974804+0000","last_clean":"2024-09-10T23:54:47.974804+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:54:47.974804+0000","last_undegraded":"2024-09-10T23:54:47.974804+0000","last_fullsized":"2024-09-10T23:54:47.974804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.980645+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:54:47.980645+0000","last_peered":"2024-09-10T23:54:47.980645+0000","last_clean":"2024-09-10T23:54:47.980645+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:54:47.980645+0000","last_undegraded":"2024-09-10T23:54:47.980645+0000","last_fullsized":"2024-09-10T23:54:47.980645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.969340+0000","last_change":"2024-09-10T23:53:55.745654+0000","last_active":"2024-09-10T23:54:47.969340+0000","last_peered":"2024-09-10T23:54:47.969340+0000","last_clean":"2024-09-10T23:54:47.969340+0000","last_became_active":"2024-09-10T23:53:55.744912+0000","last_became_peered":"2024-09-10T23:53:55.744912+0000","last_unstale":"2024-09-10T23:54:47.969340+0000","last_undegraded":"2024-09-10T23:54:47.969340+0000","last_fullsized":"2024-09-10T23:54:47.969340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:14.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.972989+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:54:47.972989+0000","last_peered":"2024-09-10T23:54:47.972989+0000","last_clean":"2024-09-10T23:54:47.972989+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:54:47.972989+0000","last_undegraded":"2024-09-10T23:54:47.972989+0000","last_fullsized":"2024-09-10T23:54:47.972989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.496245+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:54:48.496245+0000","last_peered":"2024-09-10T23:54:48.496245+0000","last_clean":"2024-09-10T23:54:48.496245+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:54:48.496245+0000","last_undegraded":"2024-09-10T23:54:48.496245+0000","last_fullsized":"2024-09-10T23:54:48.496245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.978475+0000","last_change":"2024-09-10T23:53:55.743116+0000","last_active":"2024-09-10T23:54:47.978475+0000","last_peered":"2024-09-10T23:54:47.978475+0000","last_clean":"2024-09-10T23:54:47.978475+0000","last_became_active":"2024-09-10T23:53:55.742780+0000","last_became_peered":"2024-09-10T23:53:55.742780+0000","last_unstale":"2024-09-10T23:54:47.978475+0000","last_undegraded":"2024-09-10T23:54:47.978475+0000","last_fullsized":"2024-09-10T23:54:47.978475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:28:22.503080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.499110+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:54:48.499110+0000","last_peered":"2024-09-10T23:54:48.499110+0000","last_clean":"2024-09-10T23:54:48.499110+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:54:48.499110+0000","last_undegraded":"2024-09-10T23:54:48.499110+0000","last_fullsized":"2024-09-10T23:54:48.499110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.973733+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:54:47.973733+0000","last_peered":"2024-09-10T23:54:47.973733+0000","last_clean":"2024-09-10T23:54:47.973733+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:54:47.973733+0000","last_undegraded":"2024-09-10T23:54:47.973733+0000","last_fullsized":"2024-09-10T23:54:47.973733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974706+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:54:47.974706+0000","last_peered":"2024-09-10T23:54:47.974706+0000","last_clean":"2024-09-10T23:54:47.974706+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:54:47.974706+0000","last_undegraded":"2024-09-10T23:54:47.974706+0000","last_fullsized":"2024-09-10T23:54:47.974706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554717+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:54:48.554717+0000","last_peered":"2024-09-10T23:54:48.554717+0000","last_clean":"2024-09-10T23:54:48.554717+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:54:48.554717+0000","last_undegraded":"2024-09-10T23:54:48.554717+0000","last_fullsized":"2024-09-10T23:54:48.554717+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:48.554843+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:54:48.554843+0000","last_peered":"2024-09-10T23:54:48.554843+0000","last_clean":"2024-09-10T23:54:48.554843+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:54:48.554843+0000","last_undegraded":"2024-09-10T23:54:48.554843+0000","last_fullsized":"2024-09-10T23:54:48.554843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:54:47.974017+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:54:47.974017+0000","last_peered":"2024-09-10T23:54:47.974017+0000","last_clean":"2024-09-10T23:54:47.974017+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:54:47.974017+0000","last_undegraded":"2024-09-10T23:54:47.974017+0000","last_fullsized":"2024-09-10T23:54:47.974017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60552,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":144,"num_read_kb":132,"num_write":165,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710749,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":479143,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906979,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1122940,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070505,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":483453,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":479255,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1075577,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":474533,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1070774,"data_compressed":59942,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":536747,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":474727,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":475171,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":530603,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":475921,"data_compressed":23519,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:55:08.710 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:55:08.711 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T23:55:08.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T23:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:09.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:09 smithi189 ceph-mon[34000]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:09.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:09 smithi033 ceph-mon[30593]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:09.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:09 smithi052 ceph-mon[33526]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 -- 172.21.15.33:0/3009172057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff23410a830 msgr2=0x7ff23410cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 --2- 172.21.15.33:0/3009172057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff23410a830 0x7ff23410cc60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009ca0 tx=0x7ff22c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 -- 172.21.15.33:0/3009172057 shutdown_connections 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 --2- 172.21.15.33:0/3009172057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff23410a830 0x7ff23410cc60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 --2- 172.21.15.33:0/3009172057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff234075aa0 0x7ff234075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 --2- 172.21.15.33:0/3009172057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 0x7ff234075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.691+0000 7ff23b000640 1 -- 172.21.15.33:0/3009172057 >> 172.21.15.33:0/3009172057 conn(0x7ff2340fe150 msgr2=0x7ff234100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.692+0000 7ff23b000640 1 -- 172.21.15.33:0/3009172057 shutdown_connections 2024-09-10T23:55:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.692+0000 7ff23b000640 1 -- 172.21.15.33:0/3009172057 wait complete. 2024-09-10T23:55:09.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.692+0000 7ff23b000640 1 Processor -- start 2024-09-10T23:55:09.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 -- start start 2024-09-10T23:55:09.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:09.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 0x7ff23419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 0x7ff23419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff234110650 con 0x7ff234075aa0 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2341104d0 con 0x7ff23410a830 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff23b000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2341107d0 con 0x7ff234076f00 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff239c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff239c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57810/0 (socket says 172.21.15.33:57810) 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff239c00640 1 -- 172.21.15.33:0/1802278930 learned_addr learned my addr 172.21.15.33:0/1802278930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.693+0000 7ff239200640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 0x7ff23419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff23a600640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 0x7ff23419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 -- 172.21.15.33:0/1802278930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 msgr2=0x7ff23419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 0x7ff23419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 -- 172.21.15.33:0/1802278930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 msgr2=0x7ff23419be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 0x7ff23419be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 -- 172.21.15.33:0/1802278930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23419c730 con 0x7ff234075aa0 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff23a600640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 0x7ff23419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff239c00640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff22800b4a0 tx=0x7ff22800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228015020 con 0x7ff234075aa0 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.694+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff228011cc0 con 0x7ff234075aa0 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.695+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228010d00 con 0x7ff234075aa0 2024-09-10T23:55:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.695+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23419ca20 con 0x7ff234075aa0 2024-09-10T23:55:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.695+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2341a3100 con 0x7ff234075aa0 2024-09-10T23:55:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.696+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23419cc80 con 0x7ff234075aa0 2024-09-10T23:55:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.698+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff228011830 con 0x7ff234075aa0 2024-09-10T23:55:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.700+0000 7ff232000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 0x7ff21c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.700+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7ff2280e5b30 con 0x7ff234075aa0 2024-09-10T23:55:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.701+0000 7ff239200640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 0x7ff21c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.701+0000 7ff239200640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 0x7ff21c0b7950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff22000abe0 tx=0x7ff22000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.704+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff22801f020 con 0x7ff234075aa0 2024-09-10T23:55:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.971+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff234109640 con 0x7ff234075aa0 2024-09-10T23:55:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.974+0000 7ff232000640 1 -- 172.21.15.33:0/1802278930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7ff2280ac4f0 con 0x7ff234075aa0 2024-09-10T23:55:09.975 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-09-10T23:55:09.975 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBd3OBmtNb1ORAAHZRsbqWo7dRsD2TJuhdRpQ== 2024-09-10T23:55:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 msgr2=0x7ff21c0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 0x7ff21c0b7950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff22000abe0 tx=0x7ff22000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 msgr2=0x7ff23419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff22800b4a0 tx=0x7ff22800b8a0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 shutdown_connections 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff21c0b5490 0x7ff21c0b7950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23410a830 0x7ff23419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff234076f00 0x7ff23419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 --2- 172.21.15.33:0/1802278930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff234075aa0 0x7ff23419ac00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 >> 172.21.15.33:0/1802278930 conn(0x7ff2340fe150 msgr2=0x7ff234106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 shutdown_connections 2024-09-10T23:55:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:09.976+0000 7ff23b000640 1 -- 172.21.15.33:0/1802278930 wait complete. 2024-09-10T23:55:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:10 smithi033 ceph-mon[30593]: pgmap v386: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:55:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:55:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:10 smithi189 ceph-mon[34000]: pgmap v386: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:55:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:55:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:10 smithi052 ceph-mon[33526]: pgmap v386: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:10.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T23:55:10.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1802278930' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T23:55:10.917 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-10T23:55:10.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T23:55:10.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:55:11.001 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T23:55:11.419 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 -- 172.21.15.33:0/3394344371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 msgr2=0x7f26f810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 --2- 172.21.15.33:0/3394344371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f810ac60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009900 tx=0x7f26e402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 -- 172.21.15.33:0/3394344371 shutdown_connections 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 --2- 172.21.15.33:0/3394344371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f810b1a0 0x7f26f81119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 --2- 172.21.15.33:0/3394344371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f810ac60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 --2- 172.21.15.33:0/3394344371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f8104e10 0x7f26f81051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 -- 172.21.15.33:0/3394344371 >> 172.21.15.33:0/3394344371 conn(0x7f26f8100840 msgr2=0x7f26f8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 -- 172.21.15.33:0/3394344371 shutdown_connections 2024-09-10T23:55:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.087+0000 7f26f7200640 1 -- 172.21.15.33:0/3394344371 wait complete. 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.088+0000 7f26f7200640 1 Processor -- start 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.088+0000 7f26f7200640 1 -- start start 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8104e10 0x7f26f819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 0x7f26f81a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8114cd0 con 0x7f26f810a820 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8114b50 con 0x7f26f8104e10 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8114e50 con 0x7f26f810b1a0 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32948/0 (socket says 172.21.15.33:32948) 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f5400640 1 -- 172.21.15.33:0/49582256 learned_addr learned my addr 172.21.15.33:0/49582256 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f5e00640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8104e10 0x7f26f819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.089+0000 7f26f6800640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 0x7f26f81a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 -- 172.21.15.33:0/49582256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 msgr2=0x7f26f81a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 0x7f26f81a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 -- 172.21.15.33:0/49582256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8104e10 msgr2=0x7f26f819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8104e10 0x7f26f819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 -- 172.21.15.33:0/49582256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f81a1210 con 0x7f26f810a820 2024-09-10T23:55:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f6800640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 0x7f26f81a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f5400640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009230 tx=0x7f26e40319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e403f030 con 0x7f26f810a820 2024-09-10T23:55:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26e40043d0 con 0x7f26f810a820 2024-09-10T23:55:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4035070 con 0x7f26f810a820 2024-09-10T23:55:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.090+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f81a14a0 con 0x7f26f810a820 2024-09-10T23:55:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.091+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81a7bc0 con 0x7f26f810a820 2024-09-10T23:55:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.092+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f81051f0 con 0x7f26f810a820 2024-09-10T23:55:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.094+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f26e403b880 con 0x7f26f810a820 2024-09-10T23:55:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.095+0000 7f26eea00640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 0x7f26dc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.096+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f26e4106b70 con 0x7f26f810a820 2024-09-10T23:55:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.096+0000 7f26f5e00640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 0x7f26dc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.097+0000 7f26f5e00640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 0x7f26dc0b7950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009bd0 tx=0x7f26e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.097+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26e40cd530 con 0x7f26f810a820 2024-09-10T23:55:12.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:12 smithi033 ceph-mon[30593]: pgmap v387: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:12.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.293+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f26f819c290 con 0x7f26f810a820 2024-09-10T23:55:12.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.293+0000 7f26eea00640 1 -- 172.21.15.33:0/49582256 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7f26f819c290 con 0x7f26f810a820 2024-09-10T23:55:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 msgr2=0x7f26dc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 0x7f26dc0b7950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009bd0 tx=0x7f26e8005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 msgr2=0x7f26f819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009230 tx=0x7f26e40319a0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 shutdown_connections 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f26dc0b5490 0x7f26dc0b7950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f810b1a0 0x7f26f81a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26f810a820 0x7f26f819b6a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 --2- 172.21.15.33:0/49582256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8104e10 0x7f26f819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 >> 172.21.15.33:0/49582256 conn(0x7f26f8100840 msgr2=0x7f26f8102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 shutdown_connections 2024-09-10T23:55:12.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:12.296+0000 7f26f7200640 1 -- 172.21.15.33:0/49582256 wait complete. 2024-09-10T23:55:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:12 smithi189 ceph-mon[34000]: pgmap v387: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:12.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:12 smithi052 ceph-mon[33526]: pgmap v387: 129 pgs: 129 active+clean; 636 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T23:55:13.208 INFO:teuthology.orchestra.run.smithi033.stdout:[{"version":50,"timestamp":"2024-09-10T23:53:44.389353+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T23:55:13.208 INFO:tasks.ceph_manager:config epoch is 50 2024-09-10T23:55:13.208 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:55:13.208 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:55:13.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T23:55:13.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:13 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/49582256' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:55:13.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:13 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/49582256' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:55:13.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:13 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/49582256' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T23:55:13.587 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:14.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 -- 172.21.15.33:0/3895789708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c113990 msgr2=0x7f953c115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 --2- 172.21.15.33:0/3895789708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c113990 0x7f953c115d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9534009ca0 tx=0x7f953402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 -- 172.21.15.33:0/3895789708 shutdown_connections 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 --2- 172.21.15.33:0/3895789708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c113990 0x7f953c115d80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 --2- 172.21.15.33:0/3895789708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c077ff0 0x7f953c113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 --2- 172.21.15.33:0/3895789708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f953c0776d0 0x7f953c077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 -- 172.21.15.33:0/3895789708 >> 172.21.15.33:0/3895789708 conn(0x7f953c100a50 msgr2=0x7f953c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 -- 172.21.15.33:0/3895789708 shutdown_connections 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.203+0000 7f9543000640 1 -- 172.21.15.33:0/3895789708 wait complete. 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.204+0000 7f9543000640 1 Processor -- start 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.204+0000 7f9543000640 1 -- start start 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c0776d0 0x7f953c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:14.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f953c113990 0x7f953c1a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f953c119270 con 0x7f953c077ff0 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f953c1190f0 con 0x7f953c0776d0 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9543000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f953c1193f0 con 0x7f953c113990 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32966/0 (socket says 172.21.15.33:32966) 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 -- 172.21.15.33:0/538199026 learned_addr learned my addr 172.21.15.33:0/538199026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f953be00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c0776d0 0x7f953c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 -- 172.21.15.33:0/538199026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f953c113990 msgr2=0x7f953c1a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f953c113990 0x7f953c1a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 -- 172.21.15.33:0/538199026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c0776d0 msgr2=0x7f953c19f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c0776d0 0x7f953c19f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.205+0000 7f9533e00640 1 -- 172.21.15.33:0/538199026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c1a5830 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9533e00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f952400d950 tx=0x7f952400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524017070 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9524009c30 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c1a5b20 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400f620 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.206+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c1ac3b0 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.207+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c078be0 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.210+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9524010460 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.211+0000 7f9539600640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 0x7f95200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.211+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f95240e5d70 con 0x7f953c077ff0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.211+0000 7f953be00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 0x7f95200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.212+0000 7f953be00640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 0x7f95200b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f952c005fd0 tx=0x7f952c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:14.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.215+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f95240ac730 con 0x7f953c077ff0 2024-09-10T23:55:14.357 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:14 smithi052 ceph-mon[33526]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T23:55:14.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.461+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f953c1ac610 con 0x7f953c077ff0 2024-09-10T23:55:14.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:14 smithi033 ceph-mon[30593]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T23:55:14.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.467+0000 7f9539600640 1 -- 172.21.15.33:0/538199026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294211 (secure 0 0 0) 0x7f9524009de0 con 0x7f953c077ff0 2024-09-10T23:55:14.473 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.472+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 msgr2=0x7f95200b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.472+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 0x7f95200b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f952c005fd0 tx=0x7f952c005850 comp rx=0 tx=0).stop 2024-09-10T23:55:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.472+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 msgr2=0x7f953c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.472+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f952400d950 tx=0x7f952400de10 comp rx=0 tx=0).stop 2024-09-10T23:55:14.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 shutdown_connections 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95200b53f0 0x7f95200b78b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f953c113990 0x7f953c1a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f953c077ff0 0x7f953c19fcc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 --2- 172.21.15.33:0/538199026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f953c0776d0 0x7f953c19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 >> 172.21.15.33:0/538199026 conn(0x7f953c100a50 msgr2=0x7f953c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 shutdown_connections 2024-09-10T23:55:14.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:14.473+0000 7f9543000640 1 -- 172.21.15.33:0/538199026 wait complete. 2024-09-10T23:55:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:14 smithi189 ceph-mon[34000]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-10T23:55:15.357 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:15 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/538199026' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:55:15.359 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":604054582},{"type":"v1","addr":"172.21.15.33:6801","nonce":604054582}]},"active_addr":"172.21.15.33:6801/604054582","active_change":"2024-09-10T23:44:46.663671+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24124,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34145,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":573450865}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1188665581}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1586886077}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3816887957}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":718313124}]}]} 2024-09-10T23:55:15.366 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T23:55:15.367 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T23:55:15.367 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:55:15.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:15 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/538199026' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:55:15.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:15 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/538199026' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T23:55:15.746 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:16.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:16 smithi033 ceph-mon[30593]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T23:55:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 -- 172.21.15.33:0/1095898777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 msgr2=0x7f30f4105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 --2- 172.21.15.33:0/1095898777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f4105380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009900 tx=0x7f30e802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 -- 172.21.15.33:0/1095898777 shutdown_connections 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 --2- 172.21.15.33:0/1095898777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 0x7f30f4111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 --2- 172.21.15.33:0/1095898777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 0x7f30f410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 --2- 172.21.15.33:0/1095898777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f4105380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 -- 172.21.15.33:0/1095898777 >> 172.21.15.33:0/1095898777 conn(0x7f30f4100a50 msgr2=0x7f30f4102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 -- 172.21.15.33:0/1095898777 shutdown_connections 2024-09-10T23:55:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.310+0000 7f30fc200640 1 -- 172.21.15.33:0/1095898777 wait complete. 2024-09-10T23:55:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.311+0000 7f30fc200640 1 Processor -- start 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.311+0000 7f30fc200640 1 -- start start 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 0x7f30f419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 0x7f30f41a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114e70 con 0x7f30f4104fa0 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114cf0 con 0x7f30f410a9b0 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fc200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114ff0 con 0x7f30f410b330 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32994/0 (socket says 172.21.15.33:32994) 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30f9800640 1 -- 172.21.15.33:0/4101164118 learned_addr learned my addr 172.21.15.33:0/4101164118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30fa200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 0x7f30f41a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.312+0000 7f30f8e00640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 0x7f30f419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 -- 172.21.15.33:0/4101164118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 msgr2=0x7f30f41a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 0x7f30f41a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 -- 172.21.15.33:0/4101164118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 msgr2=0x7f30f419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 0x7f30f419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 -- 172.21.15.33:0/4101164118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f41a1570 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f9800640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009230 tx=0x7f30e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.313+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e803f030 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.314+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30e8003a80 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.314+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8035070 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.314+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f41a1800 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.314+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f41a7f20 con 0x7f30f4104fa0 2024-09-10T23:55:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.315+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f4105380 con 0x7f30f4104fa0 2024-09-10T23:55:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.317+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f30e803bc30 con 0x7f30f4104fa0 2024-09-10T23:55:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.318+0000 7f30f2000640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 0x7f30dc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.318+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f30e8106ea0 con 0x7f30f4104fa0 2024-09-10T23:55:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.319+0000 7f30f8e00640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 0x7f30dc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.319+0000 7f30f8e00640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 0x7f30dc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f30e0005fd0 tx=0x7f30e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.320+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f30e80cd860 con 0x7f30f4104fa0 2024-09-10T23:55:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:16 smithi052 ceph-mon[33526]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T23:55:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.518+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30f410cb80 con 0x7f30f4104fa0 2024-09-10T23:55:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.519+0000 7f30f2000640 1 -- 172.21.15.33:0/4101164118 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24676 (secure 0 0 0) 0x7f30e80cd160 con 0x7f30f4104fa0 2024-09-10T23:55:16.521 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:16.522 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:47.963798+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:55:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 msgr2=0x7f30dc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 0x7f30dc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f30e0005fd0 tx=0x7f30e0005850 comp rx=0 tx=0).stop 2024-09-10T23:55:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 msgr2=0x7f30f419b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009230 tx=0x7f30e8004270 comp rx=0 tx=0).stop 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 shutdown_connections 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30dc0b53f0 0x7f30dc0b78b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30f410b330 0x7f30f41a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f410a9b0 0x7f30f419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 --2- 172.21.15.33:0/4101164118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30f4104fa0 0x7f30f419b4c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 >> 172.21.15.33:0/4101164118 conn(0x7f30f4100a50 msgr2=0x7f30f4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 shutdown_connections 2024-09-10T23:55:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:16.523+0000 7f30fc200640 1 -- 172.21.15.33:0/4101164118 wait complete. 2024-09-10T23:55:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:16 smithi189 ceph-mon[34000]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T23:55:17.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:17 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4101164118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:17.342 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T23:55:17.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:55:17.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:17 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4101164118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:17.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:17 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4101164118' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:18.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:18 smithi033 ceph-mon[30593]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T23:55:18.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.328+0000 7f9cafe00640 1 -- 172.21.15.33:0/2690499659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca81087d0 msgr2=0x7f9ca8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.328+0000 7f9cafe00640 1 --2- 172.21.15.33:0/2690499659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca81087d0 0x7f9ca8108c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009900 tx=0x7f9c9402a410 comp rx=0 tx=0).stop 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 -- 172.21.15.33:0/2690499659 shutdown_connections 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 --2- 172.21.15.33:0/2690499659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8109150 0x7f9ca810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 --2- 172.21.15.33:0/2690499659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca81087d0 0x7f9ca8108c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 --2- 172.21.15.33:0/2690499659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca8102dc0 0x7f9ca81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 -- 172.21.15.33:0/2690499659 >> 172.21.15.33:0/2690499659 conn(0x7f9ca80fe830 msgr2=0x7f9ca8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 -- 172.21.15.33:0/2690499659 shutdown_connections 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.329+0000 7f9cafe00640 1 -- 172.21.15.33:0/2690499659 wait complete. 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 Processor -- start 2024-09-10T23:55:18.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 -- start start 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8102dc0 0x7f9ca81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca81087d0 0x7f9ca8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112c50 con 0x7f9ca8109150 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112ad0 con 0x7f9ca8102dc0 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cafe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112dd0 con 0x7f9ca81087d0 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cade00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.330+0000 7f9cade00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33018/0 (socket says 172.21.15.33:33018) 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 -- 172.21.15.33:0/891387778 learned_addr learned my addr 172.21.15.33:0/891387778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cad400640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8102dc0 0x7f9ca81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9caca00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca81087d0 0x7f9ca8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 -- 172.21.15.33:0/891387778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca81087d0 msgr2=0x7f9ca8199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca81087d0 0x7f9ca8199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 -- 172.21.15.33:0/891387778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8102dc0 msgr2=0x7f9ca81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8102dc0 0x7f9ca81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 -- 172.21.15.33:0/891387778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca819f270 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cade00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000eb10 tx=0x7f9ca000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0004b20 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca819f560 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.331+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ca0004cc0 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.332+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0010690 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.332+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca81a5c20 con 0x7f9ca8109150 2024-09-10T23:55:18.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.333+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca81031a0 con 0x7f9ca8109150 2024-09-10T23:55:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.335+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9ca0005020 con 0x7f9ca8109150 2024-09-10T23:55:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.337+0000 7f9ca6000640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 0x7f9c900b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.338+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f9ca00e6770 con 0x7f9ca8109150 2024-09-10T23:55:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.338+0000 7f9cad400640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 0x7f9c900b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.338+0000 7f9cad400640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 0x7f9c900b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00bbe0 tx=0x7f9c9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.341+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9ca00ad130 con 0x7f9ca8109150 2024-09-10T23:55:18.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:18 smithi052 ceph-mon[33526]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T23:55:18.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.539+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ca802e5c0 con 0x7f9ca8109150 2024-09-10T23:55:18.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.541+0000 7f9ca6000640 1 -- 172.21.15.33:0/891387778 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24676 (secure 0 0 0) 0x7f9ca00aca30 con 0x7f9ca8109150 2024-09-10T23:55:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:18.542 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:54:47.963798+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 msgr2=0x7f9c900b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 0x7f9c900b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00bbe0 tx=0x7f9c9c00b390 comp rx=0 tx=0).stop 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 msgr2=0x7f9ca819eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000eb10 tx=0x7f9ca000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 shutdown_connections 2024-09-10T23:55:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9c900b5370 0x7f9c900b7830 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ca8109150 0x7f9ca819eaa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca81087d0 0x7f9ca8199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 --2- 172.21.15.33:0/891387778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca8102dc0 0x7f9ca81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 >> 172.21.15.33:0/891387778 conn(0x7f9ca80fe830 msgr2=0x7f9ca8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 shutdown_connections 2024-09-10T23:55:18.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:18.543+0000 7f9cafe00640 1 -- 172.21.15.33:0/891387778 wait complete. 2024-09-10T23:55:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:18 smithi189 ceph-mon[34000]: pgmap v390: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T23:55:19.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:19 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/891387778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:19.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T23:55:19.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T23:55:19.254 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T23:55:19.254 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T23:55:19.254 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T23:55:19.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T23:55:19.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T23:55:19.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T23:55:19.305 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T23:55:19.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T23:55:19.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T23:55:19.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T23:55:19.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:19 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/891387778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:19.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:19 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/891387778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:55:20.309 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:20 smithi052 ceph-mon[33526]: pgmap v391: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:20.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:20 smithi033 ceph-mon[30593]: pgmap v391: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:20 smithi189 ceph-mon[34000]: pgmap v391: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:20.679 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.684 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.685 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.687 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.698 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:20.700 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:21.015 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:21.016 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:21.016 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 -- 172.21.15.33:0/2709399496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf410a820 msgr2=0x7f3bf410ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 --2- 172.21.15.33:0/2709399496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf410a820 0x7f3bf410ac60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009900 tx=0x7f3be002a410 comp rx=0 tx=0).stop 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 -- 172.21.15.33:0/2709399496 shutdown_connections 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 --2- 172.21.15.33:0/2709399496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410b1a0 0x7f3bf41119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 --2- 172.21.15.33:0/2709399496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf410a820 0x7f3bf410ac60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 --2- 172.21.15.33:0/2709399496 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bf4104e10 0x7f3bf41051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 -- 172.21.15.33:0/2709399496 >> 172.21.15.33:0/2709399496 conn(0x7f3bf4100840 msgr2=0x7f3bf4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 -- 172.21.15.33:0/2709399496 shutdown_connections 2024-09-10T23:55:21.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.017+0000 7f3bf9400640 1 -- 172.21.15.33:0/2709399496 wait complete. 2024-09-10T23:55:21.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.018+0000 7f3bf9400640 1 Processor -- start 2024-09-10T23:55:21.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 -- start start 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf4104e10 0x7f3bf40776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 0x7f3bf4077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bf410b1a0 0x7f3bf4078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4114d60 con 0x7f3bf4104e10 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4114be0 con 0x7f3bf410a820 2024-09-10T23:55:21.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.019+0000 7f3bf9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4114ee0 con 0x7f3bf410b1a0 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.020+0000 7f3bf3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 0x7f3bf4077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.020+0000 7f3bf3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 0x7f3bf4077bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57584/0 (socket says 172.21.15.33:57584) 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.020+0000 7f3bf3400640 1 -- 172.21.15.33:0/1232843351 learned_addr learned my addr 172.21.15.33:0/1232843351 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3e00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf4104e10 0x7f3bf40776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf8a00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bf410b1a0 0x7f3bf4078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3400640 1 -- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bf410b1a0 msgr2=0x7f3bf4078130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3bf410b1a0 0x7f3bf4078130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3400640 1 -- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf4104e10 msgr2=0x7f3bf40776b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf4104e10 0x7f3bf40776b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.021+0000 7f3bf3400640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf41ab760 con 0x7f3bf410a820 2024-09-10T23:55:21.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.022+0000 7f3bf3400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 0x7f3bf4077bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3be002a930 tx=0x7f3be0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.023+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be003f070 con 0x7f3bf410a820 2024-09-10T23:55:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.023+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3be003baf0 con 0x7f3bf410a820 2024-09-10T23:55:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.023+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf41ab9f0 con 0x7f3bf410a820 2024-09-10T23:55:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.023+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf41abf20 con 0x7f3bf410a820 2024-09-10T23:55:21.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.023+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0035030 con 0x7f3bf410a820 2024-09-10T23:55:21.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.024+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bd4001060 con 0x7f3bf410a820 2024-09-10T23:55:21.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.030+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3be003bca0 con 0x7f3bf410a820 2024-09-10T23:55:21.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.032+0000 7f3bf0c00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3bd80b5490 0x7f3bd80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.033+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f3be0106be0 con 0x7f3bf410a820 2024-09-10T23:55:21.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.033+0000 7f3bf3e00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3bd80b5490 0x7f3bd80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.033+0000 7f3bf0c00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] conn(0x7f3bd80c04d0 0x7f3bd80c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.033+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bd80c3040 con 0x7f3bd80c04d0 2024-09-10T23:55:21.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.033+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f3be0107030 con 0x7f3bf410a820 2024-09-10T23:55:21.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.034+0000 7f3bf3e00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3bd80b5490 0x7f3bd80b7950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009bd0 tx=0x7f3be4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.034+0000 7f3bf8a00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] conn(0x7f3bd80c04d0 0x7f3bd80c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.035+0000 7f3bf8a00640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] conn(0x7f3bd80c04d0 0x7f3bd80c2970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.036+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== osd.5 v2:172.21.15.189:6808/4208509833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bd80c3040 con 0x7f3bd80c04d0 2024-09-10T23:55:21.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.052+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 --> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bd4002e00 con 0x7f3bd80c04d0 2024-09-10T23:55:21.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.053+0000 7f3bf0c00640 1 -- 172.21.15.33:0/1232843351 <== osd.5 v2:172.21.15.189:6808/4208509833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3bd4002e00 con 0x7f3bd80c04d0 2024-09-10T23:55:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] conn(0x7f3bd80c04d0 msgr2=0x7f3bd80c2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] conn(0x7f3bd80c04d0 0x7f3bd80c2970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3bd80b5490 msgr2=0x7f3bd80b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3bd80b5490 0x7f3bd80b7950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009bd0 tx=0x7f3be4005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 msgr2=0x7f3bf4077bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 --2- 172.21.15.33:0/1232843351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bf410a820 0x7f3bf4077bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3be002a930 tx=0x7f3be0003b90 comp rx=0 tx=0).stop 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf8a00640 1 -- 172.21.15.33:0/1232843351 reap_dead start 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 shutdown_connections 2024-09-10T23:55:21.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.054+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 >> 172.21.15.33:0/1232843351 conn(0x7f3bf4100840 msgr2=0x7f3bf4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:21.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.055+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 shutdown_connections 2024-09-10T23:55:21.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.055+0000 7f3bf9400640 1 -- 172.21.15.33:0/1232843351 wait complete. 2024-09-10T23:55:21.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 -- 172.21.15.33:0/94896069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075e60 msgr2=0x7fe648113430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 --2- 172.21.15.33:0/94896069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075e60 0x7fe648113430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe634009900 tx=0x7fe63402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 -- 172.21.15.33:0/94896069 shutdown_connections 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 --2- 172.21.15.33:0/94896069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 0x7fe648115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 --2- 172.21.15.33:0/94896069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075e60 0x7fe648113430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 --2- 172.21.15.33:0/94896069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe648075540 0x7fe648075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 -- 172.21.15.33:0/94896069 >> 172.21.15.33:0/94896069 conn(0x7fe6480fe6c0 msgr2=0x7fe648100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 -- 172.21.15.33:0/94896069 shutdown_connections 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.773+0000 7fe64ca00640 1 -- 172.21.15.33:0/94896069 wait complete. 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.774+0000 7fe64ca00640 1 Processor -- start 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.774+0000 7fe64ca00640 1 -- start start 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 0x7fe64819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe648075e60 0x7fe64819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 0x7fe6481a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481190b0 con 0x7fe648075540 2024-09-10T23:55:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe648118f30 con 0x7fe648113970 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe64ca00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe648119230 con 0x7fe648075e60 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe647400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 0x7fe64819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe647400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 0x7fe64819f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44198/0 (socket says 172.21.15.33:44198) 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe647400640 1 -- 172.21.15.33:0/3709776841 learned_addr learned my addr 172.21.15.33:0/3709776841 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe647e00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 0x7fe6481a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.775+0000 7fe646a00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe648075e60 0x7fe64819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 -- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe648075e60 msgr2=0x7fe64819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe648075e60 0x7fe64819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 -- 172.21.15.33:0/3709776841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 msgr2=0x7fe6481a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 0x7fe6481a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6481a55f0 con 0x7fe648075540 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647e00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648113970 0x7fe6481a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe647400640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 0x7fe64819f540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe63800d770 tx=0x7fe63800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638017070 con 0x7fe648075540 2024-09-10T23:55:21.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6380054b0 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638004c60 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.776+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6481a58e0 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.777+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6481abfa0 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.777+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe648100cb0 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.780+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe638004e00 con 0x7fe648075540 2024-09-10T23:55:21.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe63fe00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe62c0b5490 0x7fe62c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fe6380e5e40 con 0x7fe648075540 2024-09-10T23:55:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe646a00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe62c0b5490 0x7fe62c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe63fe00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] conn(0x7fe62c0c04d0 0x7fe62c0c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe638021e50 con 0x7fe62c0c04d0 2024-09-10T23:55:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.782+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe6380e61f0 con 0x7fe648075540 2024-09-10T23:55:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.783+0000 7fe647e00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] conn(0x7fe62c0c04d0 0x7fe62c0c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.783+0000 7fe646a00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe62c0b5490 0x7fe62c0b7950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe6340057c0 tx=0x7fe6340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.783+0000 7fe647e00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] conn(0x7fe62c0c04d0 0x7fe62c0c2970 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.784+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== osd.11 v2:172.21.15.189:6824/3659047878 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe638021e50 con 0x7fe62c0c04d0 2024-09-10T23:55:21.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.803+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 --> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe648076a50 con 0x7fe62c0c04d0 2024-09-10T23:55:21.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.804+0000 7fe63fe00640 1 -- 172.21.15.33:0/3709776841 <== osd.11 v2:172.21.15.189:6824/3659047878 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe648076a50 con 0x7fe62c0c04d0 2024-09-10T23:55:21.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.804+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] conn(0x7fe62c0c04d0 msgr2=0x7fe62c0c2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.804+0000 7fe64ca00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] conn(0x7fe62c0c04d0 0x7fe62c0c2970 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe62c0b5490 msgr2=0x7fe62c0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe62c0b5490 0x7fe62c0b7950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe6340057c0 tx=0x7fe6340058d0 comp rx=0 tx=0).stop 2024-09-10T23:55:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 msgr2=0x7fe64819f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 --2- 172.21.15.33:0/3709776841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe648075540 0x7fe64819f540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe63800d770 tx=0x7fe63800dc30 comp rx=0 tx=0).stop 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe647e00640 1 -- 172.21.15.33:0/3709776841 reap_dead start 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 shutdown_connections 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 >> 172.21.15.33:0/3709776841 conn(0x7fe6480fe6c0 msgr2=0x7fe6480ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 shutdown_connections 2024-09-10T23:55:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:21.805+0000 7fe64ca00640 1 -- 172.21.15.33:0/3709776841 wait complete. 2024-09-10T23:55:22.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:22 smithi052 ceph-mon[33526]: pgmap v392: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:22 smithi033 ceph-mon[30593]: pgmap v392: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:22 smithi189 ceph-mon[34000]: pgmap v392: 129 pgs: 129 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-10T23:55:22.603 INFO:teuthology.orchestra.run.smithi033.stdout:154618822726 2024-09-10T23:55:22.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T23:55:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 -- 172.21.15.33:0/1488610473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 msgr2=0x7f7cb4077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1488610473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb4077ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009900 tx=0x7f7ca802a410 comp rx=0 tx=0).stop 2024-09-10T23:55:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 -- 172.21.15.33:0/1488610473 shutdown_connections 2024-09-10T23:55:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1488610473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb4113990 0x7f7cb4115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1488610473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb4077ff0 0x7f7cb4113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1488610473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb4077ab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 -- 172.21.15.33:0/1488610473 >> 172.21.15.33:0/1488610473 conn(0x7f7cb4100a50 msgr2=0x7f7cb4102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.446+0000 7f7cbb600640 1 -- 172.21.15.33:0/1488610473 shutdown_connections 2024-09-10T23:55:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.447+0000 7f7cbb600640 1 -- 172.21.15.33:0/1488610473 wait complete. 2024-09-10T23:55:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 Processor -- start 2024-09-10T23:55:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 -- start start 2024-09-10T23:55:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb4077ff0 0x7f7cb419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb4113990 0x7f7cb41a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4119250 con 0x7f7cb40776d0 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41190d0 con 0x7f7cb4077ff0 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cbb600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb41193d0 con 0x7f7cb4113990 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cb8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cb8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb419f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44232/0 (socket says 172.21.15.33:44232) 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.448+0000 7f7cb8c00640 1 -- 172.21.15.33:0/1733555850 learned_addr learned my addr 172.21.15.33:0/1733555850 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb9600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb4113990 0x7f7cb41a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb3e00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb4077ff0 0x7f7cb419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 -- 172.21.15.33:0/1733555850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb4113990 msgr2=0x7f7cb41a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7cb4113990 0x7f7cb41a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 -- 172.21.15.33:0/1733555850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb4077ff0 msgr2=0x7f7cb419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb4077ff0 0x7f7cb419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb41a5870 con 0x7f7cb40776d0 2024-09-10T23:55:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.449+0000 7f7cb8c00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb419f7c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009230 tx=0x7f7ca8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.450+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca803f030 con 0x7f7cb40776d0 2024-09-10T23:55:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.450+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ca8003a80 con 0x7f7cb40776d0 2024-09-10T23:55:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.450+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb41a5b00 con 0x7f7cb40776d0 2024-09-10T23:55:23.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.450+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8035070 con 0x7f7cb40776d0 2024-09-10T23:55:23.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.450+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb41ac220 con 0x7f7cb40776d0 2024-09-10T23:55:23.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.451+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7cb40638a0 con 0x7f7cb40776d0 2024-09-10T23:55:23.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.453+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7ca803bb90 con 0x7f7cb40776d0 2024-09-10T23:55:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.454+0000 7f7cb1600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7c9c0b5370 0x7f7c9c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:23.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f7ca8106ec0 con 0x7f7cb40776d0 2024-09-10T23:55:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb3e00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7c9c0b5370 0x7f7c9c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb1600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] conn(0x7f7c9c0c03b0 0x7f7c9c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c9c0c2f20 con 0x7f7c9c0c03b0 2024-09-10T23:55:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f7ca8107270 con 0x7f7cb40776d0 2024-09-10T23:55:23.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.455+0000 7f7cb9600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] conn(0x7f7c9c0c03b0 0x7f7c9c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.456+0000 7f7cb3e00640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7c9c0b5370 0x7f7c9c0b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4116030 tx=0x7f7ca0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:23.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.456+0000 7f7cb9600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] conn(0x7f7c9c0c03b0 0x7f7c9c0c2850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:23.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.457+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== osd.3 v2:172.21.15.33:6810/525214774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c9c0c2f20 con 0x7f7c9c0c03b0 2024-09-10T23:55:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.472+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 --> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7cb4063d20 con 0x7f7c9c0c03b0 2024-09-10T23:55:23.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.472+0000 7f7cb1600640 1 -- 172.21.15.33:0/1733555850 <== osd.3 v2:172.21.15.33:6810/525214774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7cb4063d20 con 0x7f7c9c0c03b0 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] conn(0x7f7c9c0c03b0 msgr2=0x7f7c9c0c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] conn(0x7f7c9c0c03b0 0x7f7c9c0c2850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7c9c0b5370 msgr2=0x7f7c9c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7c9c0b5370 0x7f7c9c0b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4116030 tx=0x7f7ca0005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 msgr2=0x7f7cb419f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 --2- 172.21.15.33:0/1733555850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cb40776d0 0x7f7cb419f7c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009230 tx=0x7f7ca8004270 comp rx=0 tx=0).stop 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cb9600640 1 -- 172.21.15.33:0/1733555850 reap_dead start 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 shutdown_connections 2024-09-10T23:55:23.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 >> 172.21.15.33:0/1733555850 conn(0x7f7cb4100a50 msgr2=0x7f7cb4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 shutdown_connections 2024-09-10T23:55:23.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.473+0000 7f7cbb600640 1 -- 172.21.15.33:0/1733555850 wait complete. 2024-09-10T23:55:24.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:24 smithi033 ceph-mon[30593]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T23:55:24.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:24 smithi052 ceph-mon[33526]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T23:55:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:24 smithi189 ceph-mon[34000]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T23:55:24.596 INFO:teuthology.orchestra.run.smithi033.stdout:107374182483 2024-09-10T23:55:24.596 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 -- 172.21.15.33:0/4290520790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 msgr2=0x7f747c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 --2- 172.21.15.33:0/4290520790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c102fe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f747002a410 comp rx=0 tx=0).stop 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 -- 172.21.15.33:0/4290520790 shutdown_connections 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 --2- 172.21.15.33:0/4290520790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c108f90 0x7f747c10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 --2- 172.21.15.33:0/4290520790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 0x7f747c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 --2- 172.21.15.33:0/4290520790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c102fe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.830+0000 7f7482e00640 1 -- 172.21.15.33:0/4290520790 >> 172.21.15.33:0/4290520790 conn(0x7f747c0fe6d0 msgr2=0x7f747c100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.831+0000 7f7482e00640 1 -- 172.21.15.33:0/4290520790 shutdown_connections 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.831+0000 7f7482e00640 1 -- 172.21.15.33:0/4290520790 wait complete. 2024-09-10T23:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 Processor -- start 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 -- start start 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 0x7f747c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c108f90 0x7f747c075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f747c112ad0 con 0x7f747c102c00 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f747c112950 con 0x7f747c108f90 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.832+0000 7f7482e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f747c112c50 con 0x7f747c108610 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44246/0 (socket says 172.21.15.33:44246) 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481a00640 1 -- 172.21.15.33:0/3475502959 learned_addr learned my addr 172.21.15.33:0/3475502959 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 0x7f747c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7482400640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c108f90 0x7f747c075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 -- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c108f90 msgr2=0x7f747c075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f747c108f90 0x7f747c075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 -- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 msgr2=0x7f747c076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f747c102c00 0x7f747c076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.833+0000 7f7481000640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c1ab8c0 con 0x7f747c108610 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f7481000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 0x7f747c0754a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f746800d6d0 tx=0x7f746800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468017070 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747c1aba90 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7468009820 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004bc0 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.834+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c1abff0 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.835+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f747c0638a0 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.838+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7468005220 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.840+0000 7f747a000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f74640b5490 0x7f74640b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.840+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f74680e5ee0 con 0x7f747c108610 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.840+0000 7f7481a00640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f74640b5490 0x7f74640b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.840+0000 7f747a000640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] conn(0x7f74640c04d0 0x7f74640c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.841+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7468021e50 con 0x7f74640c04d0 2024-09-10T23:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.841+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f74680e6290 con 0x7f747c108610 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.841+0000 7f7482400640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] conn(0x7f74640c04d0 0x7f74640c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.841+0000 7f7481a00640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f74640b5490 0x7f74640b7950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7470000c00 tx=0x7f7470009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.842+0000 7f7482400640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] conn(0x7f74640c04d0 0x7f74640c2970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.843+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== osd.10 v2:172.21.15.52:6824/2130690017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7468021e50 con 0x7f74640c04d0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.861+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 --> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f747c063d20 con 0x7f74640c04d0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.862+0000 7f747a000640 1 -- 172.21.15.33:0/3475502959 <== osd.10 v2:172.21.15.52:6824/2130690017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f747c063d20 con 0x7f74640c04d0 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] conn(0x7f74640c04d0 msgr2=0x7f74640c2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] conn(0x7f74640c04d0 0x7f74640c2970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f74640b5490 msgr2=0x7f74640b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f74640b5490 0x7f74640b7950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7470000c00 tx=0x7f7470009560 comp rx=0 tx=0).stop 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 msgr2=0x7f747c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 --2- 172.21.15.33:0/3475502959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f747c108610 0x7f747c0754a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f746800d6d0 tx=0x7f746800db90 comp rx=0 tx=0).stop 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482400640 1 -- 172.21.15.33:0/3475502959 reap_dead start 2024-09-10T23:55:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 shutdown_connections 2024-09-10T23:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.863+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 >> 172.21.15.33:0/3475502959 conn(0x7f747c0fe6d0 msgr2=0x7f747c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.864+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 shutdown_connections 2024-09-10T23:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.864+0000 7f7482e00640 1 -- 172.21.15.33:0/3475502959 wait complete. 2024-09-10T23:55:25.926 INFO:teuthology.orchestra.run.smithi033.stdout:300647710753 2024-09-10T23:55:25.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T23:55:26.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:26 smithi033 ceph-mon[30593]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 -- 172.21.15.33:0/1994481055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 msgr2=0x7f8ce010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1994481055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce010adf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009860 tx=0x7f8ccc02a340 comp rx=0 tx=0).stop 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 -- 172.21.15.33:0/1994481055 shutdown_connections 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1994481055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1994481055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce010adf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1994481055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ce0104fa0 0x7f8ce0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 -- 172.21.15.33:0/1994481055 >> 172.21.15.33:0/1994481055 conn(0x7f8ce0100a50 msgr2=0x7f8ce0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 -- 172.21.15.33:0/1994481055 shutdown_connections 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.277+0000 7f8ce6200640 1 -- 172.21.15.33:0/1994481055 wait complete. 2024-09-10T23:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 Processor -- start 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 -- start start 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ce0104fa0 0x7f8ce00776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce0077bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0114e00 con 0x7f8ce010b330 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0114c80 con 0x7f8ce010a9b0 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.278+0000 7f8ce6200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0114f80 con 0x7f8ce0104fa0 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce0077bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0078130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44204/0 (socket says 172.21.15.33:44204) 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 -- 172.21.15.33:0/1854365542 learned_addr learned my addr 172.21.15.33:0/1854365542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:26.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdf400640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ce0104fa0 0x7f8ce00776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 -- 172.21.15.33:0/1854365542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ce0104fa0 msgr2=0x7f8ce00776b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ce0104fa0 0x7f8ce00776b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 -- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 msgr2=0x7f8ce0077bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce0077bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdfe00640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce01ab9c0 con 0x7f8ce010b330 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.279+0000 7f8cdea00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce010a9b0 0x7f8ce0077bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8cdfe00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0078130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009fd0 tx=0x7f8cd800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8004b20 con 0x7f8ce010b330 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cd8003e00 con 0x7f8ce010b330 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce01abcb0 con 0x7f8ce010b330 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd80047b0 con 0x7f8ce010b330 2024-09-10T23:55:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.280+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce01ac170 con 0x7f8ce010b330 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.281+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ce0063860 con 0x7f8ce010b330 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.284+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8cd800b040 con 0x7f8ce010b330 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.285+0000 7f8cd7e00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cc40b5370 0x7f8cc40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.285+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f8cd80e6d90 con 0x7f8ce010b330 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.285+0000 7f8cdf400640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cc40b5370 0x7f8cc40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.286+0000 7f8cd7e00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] conn(0x7f8cc40c03b0 0x7f8cc40c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.286+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cd8027ea0 con 0x7f8cc40c03b0 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.286+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f8cd80e71e0 con 0x7f8ce010b330 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.286+0000 7f8cdea00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] conn(0x7f8cc40c03b0 0x7f8cc40c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.286+0000 7f8cdf400640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cc40b5370 0x7f8cc40b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009bd0 tx=0x7f8cd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.287+0000 7f8cdea00640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] conn(0x7f8cc40c03b0 0x7f8cc40c2850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.288+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== osd.7 v2:172.21.15.52:6816/775777717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cd8027ea0 con 0x7f8cc40c03b0 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.302+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 --> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ce0063ce0 con 0x7f8cc40c03b0 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.303+0000 7f8cd7e00640 1 -- 172.21.15.33:0/1854365542 <== osd.7 v2:172.21.15.52:6816/775777717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8ce0063ce0 con 0x7f8cc40c03b0 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] conn(0x7f8cc40c03b0 msgr2=0x7f8cc40c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] conn(0x7f8cc40c03b0 0x7f8cc40c2850 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cc40b5370 msgr2=0x7f8cc40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cc40b5370 0x7f8cc40b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009bd0 tx=0x7f8cd0005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 msgr2=0x7f8ce0078130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 --2- 172.21.15.33:0/1854365542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce010b330 0x7f8ce0078130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009fd0 tx=0x7f8cd800c800 comp rx=0 tx=0).stop 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8cdfe00640 1 -- 172.21.15.33:0/1854365542 reap_dead start 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 shutdown_connections 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.304+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 >> 172.21.15.33:0/1854365542 conn(0x7f8ce0100a50 msgr2=0x7f8ce0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.305+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 shutdown_connections 2024-09-10T23:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:23.305+0000 7f8ce6200640 1 -- 172.21.15.33:0/1854365542 wait complete. 2024-09-10T23:55:26.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:26 smithi052 ceph-mon[33526]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:26 smithi189 ceph-mon[34000]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:27.339 INFO:teuthology.orchestra.run.smithi033.stdout:201863462970 2024-09-10T23:55:27.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T23:55:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 -- 172.21.15.33:0/1492131181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 msgr2=0x7efdf010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 --2- 172.21.15.33:0/1492131181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf010adf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efddc009900 tx=0x7efddc02a410 comp rx=0 tx=0).stop 2024-09-10T23:55:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 -- 172.21.15.33:0/1492131181 shutdown_connections 2024-09-10T23:55:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 --2- 172.21.15.33:0/1492131181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 0x7efdf0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 --2- 172.21.15.33:0/1492131181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf010adf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 --2- 172.21.15.33:0/1492131181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf0104fa0 0x7efdf0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 -- 172.21.15.33:0/1492131181 >> 172.21.15.33:0/1492131181 conn(0x7efdf0100a50 msgr2=0x7efdf0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 -- 172.21.15.33:0/1492131181 shutdown_connections 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.525+0000 7efdf7000640 1 -- 172.21.15.33:0/1492131181 wait complete. 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.526+0000 7efdf7000640 1 Processor -- start 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.526+0000 7efdf7000640 1 -- start start 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf0104fa0 0x7efdf019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 0x7efdf01a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0114e00 con 0x7efdf010a9b0 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0114c80 con 0x7efdf010b330 2024-09-10T23:55:27.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdf7000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0114f80 con 0x7efdf0104fa0 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdef400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdef400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf019b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44288/0 (socket says 172.21.15.33:44288) 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.527+0000 7efdef400640 1 -- 172.21.15.33:0/638850259 learned_addr learned my addr 172.21.15.33:0/638850259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdefe00640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf0104fa0 0x7efdf019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdf5000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 0x7efdf01a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 -- 172.21.15.33:0/638850259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf0104fa0 msgr2=0x7efdf019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdf0104fa0 0x7efdf019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 -- 172.21.15.33:0/638850259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 msgr2=0x7efdf01a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 0x7efdf01a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf01a1500 con 0x7efdf010a9b0 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdf5000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdf010b330 0x7efdf01a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:27.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.528+0000 7efdef400640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf019b990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efddc009230 tx=0x7efddc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.529+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc03f030 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.529+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efddc003a80 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.529+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf01a1790 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.529+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc035070 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.529+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf01a7eb0 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.530+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdf0063860 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.532+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7efddc03bc30 con 0x7efdf010a9b0 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdecc00640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efdd40b53f0 0x7efdd40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7efddc106fd0 con 0x7efdf010a9b0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdefe00640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efdd40b53f0 0x7efdd40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdecc00640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] conn(0x7efdd40c0430 0x7efdd40c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdd40c2fa0 con 0x7efdd40c0430 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7efddc107380 con 0x7efdf010a9b0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.534+0000 7efdf5000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] conn(0x7efdd40c0430 0x7efdd40c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.535+0000 7efdefe00640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efdd40b53f0 0x7efdd40b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efde0005fd0 tx=0x7efde0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.535+0000 7efdf5000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] conn(0x7efdd40c0430 0x7efdd40c28d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:27.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.536+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== osd.9 v2:172.21.15.33:6826/119922777 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdd40c2fa0 con 0x7efdd40c0430 2024-09-10T23:55:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.551+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 --> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efdf0063c60 con 0x7efdd40c0430 2024-09-10T23:55:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdecc00640 1 -- 172.21.15.33:0/638850259 <== osd.9 v2:172.21.15.33:6826/119922777 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efdf0063c60 con 0x7efdd40c0430 2024-09-10T23:55:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] conn(0x7efdd40c0430 msgr2=0x7efdd40c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] conn(0x7efdd40c0430 0x7efdd40c28d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efdd40b53f0 msgr2=0x7efdd40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efdd40b53f0 0x7efdd40b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efde0005fd0 tx=0x7efde0005850 comp rx=0 tx=0).stop 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 msgr2=0x7efdf019b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf7000640 1 --2- 172.21.15.33:0/638850259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf010a9b0 0x7efdf019b990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efddc009230 tx=0x7efddc004270 comp rx=0 tx=0).stop 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.552+0000 7efdf5000640 1 -- 172.21.15.33:0/638850259 reap_dead start 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.553+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 shutdown_connections 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.553+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 >> 172.21.15.33:0/638850259 conn(0x7efdf0100a50 msgr2=0x7efdf0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.553+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 shutdown_connections 2024-09-10T23:55:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:27.553+0000 7efdf7000640 1 -- 172.21.15.33:0/638850259 wait complete. 2024-09-10T23:55:28.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 -- 172.21.15.33:0/3951039772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 msgr2=0x7fd45410ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 --2- 172.21.15.33:0/3951039772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45410ae00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009900 tx=0x7fd43c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 -- 172.21.15.33:0/3951039772 shutdown_connections 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 --2- 172.21.15.33:0/3951039772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd45410b340 0x7fd454111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 --2- 172.21.15.33:0/3951039772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45410ae00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 --2- 172.21.15.33:0/3951039772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd454104fb0 0x7fd454105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 -- 172.21.15.33:0/3951039772 >> 172.21.15.33:0/3951039772 conn(0x7fd454100a20 msgr2=0x7fd454102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 -- 172.21.15.33:0/3951039772 shutdown_connections 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.965+0000 7fd458e00640 1 -- 172.21.15.33:0/3951039772 wait complete. 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.966+0000 7fd458e00640 1 Processor -- start 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.966+0000 7fd458e00640 1 -- start start 2024-09-10T23:55:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd454104fb0 0x7fd45419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd45410b340 0x7fd4541a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd454114e60 con 0x7fd45410a9c0 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd454114ce0 con 0x7fd454104fb0 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd458e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd454114fe0 con 0x7fd45410b340 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd44be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd44be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44268/0 (socket says 172.21.15.33:44268) 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd44be00640 1 -- 172.21.15.33:0/1274254068 learned_addr learned my addr 172.21.15.33:0/1274254068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd452800640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd45410b340 0x7fd4541a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd451e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd454104fb0 0x7fd45419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.967+0000 7fd44be00640 1 -- 172.21.15.33:0/1274254068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd45410b340 msgr2=0x7fd4541a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44be00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd45410b340 0x7fd4541a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44be00640 1 -- 172.21.15.33:0/1274254068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd454104fb0 msgr2=0x7fd45419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44be00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd454104fb0 0x7fd45419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44be00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541a1440 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44be00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45419b8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd43c02a910 tx=0x7fd43c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c03f070 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd43c003e40 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541a16d0 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c035030 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.968+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541a7df0 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.969+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd454063860 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.971+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd43c031400 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.973+0000 7fd44aa00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4380b5370 0x7fd4380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.973+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fd43c106f50 con 0x7fd45410a9c0 2024-09-10T23:55:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.973+0000 7fd451e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4380b5370 0x7fd4380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.973+0000 7fd44aa00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] conn(0x7fd4380c03b0 0x7fd4380c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.973+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd43c00b0b0 con 0x7fd4380c03b0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.974+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fd43c107300 con 0x7fd45410a9c0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.974+0000 7fd452800640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] conn(0x7fd4380c03b0 0x7fd4380c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.974+0000 7fd451e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4380b5370 0x7fd4380b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd444005fd0 tx=0x7fd44400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.974+0000 7fd452800640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] conn(0x7fd4380c03b0 0x7fd4380c2850 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.975+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== osd.0 v2:172.21.15.33:6802/2046959245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd43c00b0b0 con 0x7fd4380c03b0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.990+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 --> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd454063ce0 con 0x7fd4380c03b0 2024-09-10T23:55:28.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.990+0000 7fd44aa00640 1 -- 172.21.15.33:0/1274254068 <== osd.0 v2:172.21.15.33:6802/2046959245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd454063ce0 con 0x7fd4380c03b0 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.990+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] conn(0x7fd4380c03b0 msgr2=0x7fd4380c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.990+0000 7fd458e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] conn(0x7fd4380c03b0 0x7fd4380c2850 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.990+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4380b5370 msgr2=0x7fd4380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4380b5370 0x7fd4380b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd444005fd0 tx=0x7fd44400b390 comp rx=0 tx=0).stop 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 msgr2=0x7fd45419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 --2- 172.21.15.33:0/1274254068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd45410a9c0 0x7fd45419b8d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd43c02a910 tx=0x7fd43c003c20 comp rx=0 tx=0).stop 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd452800640 1 -- 172.21.15.33:0/1274254068 reap_dead start 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 shutdown_connections 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 >> 172.21.15.33:0/1274254068 conn(0x7fd454100a20 msgr2=0x7fd454102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:28.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 shutdown_connections 2024-09-10T23:55:28.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:24.991+0000 7fd458e00640 1 -- 172.21.15.33:0/1274254068 wait complete. 2024-09-10T23:55:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:28 smithi052 ceph-mon[33526]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:28.510 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:28 smithi033 ceph-mon[30593]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:28 smithi189 ceph-mon[34000]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:28.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 -- 172.21.15.33:0/608986721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4104fc0 msgr2=0x7f8cf41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 --2- 172.21.15.33:0/608986721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4104fc0 0x7f8cf41053a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009900 tx=0x7f8ce802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 -- 172.21.15.33:0/608986721 shutdown_connections 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 --2- 172.21.15.33:0/608986721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf410b350 0x7f8cf4111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 --2- 172.21.15.33:0/608986721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf410a9d0 0x7f8cf410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 --2- 172.21.15.33:0/608986721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf4104fc0 0x7f8cf41053a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.622+0000 7f8cfc000640 1 -- 172.21.15.33:0/608986721 >> 172.21.15.33:0/608986721 conn(0x7f8cf41009f0 msgr2=0x7f8cf4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.623+0000 7f8cfc000640 1 -- 172.21.15.33:0/608986721 shutdown_connections 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.623+0000 7f8cfc000640 1 -- 172.21.15.33:0/608986721 wait complete. 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.623+0000 7f8cfc000640 1 Processor -- start 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 -- start start 2024-09-10T23:55:28.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf4104fc0 0x7f8cf419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 0x7f8cf419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf410b350 0x7f8cf41a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114e30 con 0x7f8cf410a9d0 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114cb0 con 0x7f8cf4104fc0 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfc000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114fb0 con 0x7f8cf410b350 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cf8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 0x7f8cf419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cf8c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 0x7f8cf419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44316/0 (socket says 172.21.15.33:44316) 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cf8c00640 1 -- 172.21.15.33:0/2099484356 learned_addr learned my addr 172.21.15.33:0/2099484356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.624+0000 7f8cfa000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf410b350 0x7f8cf41a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf9600640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf4104fc0 0x7f8cf419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 -- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf410b350 msgr2=0x7f8cf41a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf410b350 0x7f8cf41a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 -- 172.21.15.33:0/2099484356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf4104fc0 msgr2=0x7f8cf419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cf4104fc0 0x7f8cf419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf41a1490 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf8c00640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 0x7f8cf419b920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000d770 tx=0x7f8ce000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.625+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0017070 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.626+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ce00054b0 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.626+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0004c60 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.626+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf41a1780 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.626+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf41a7e40 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.627+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cf40638a0 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.629+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8ce0004e00 con 0x7f8cf410a9d0 2024-09-10T23:55:28.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.631+0000 7f8cf2000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cdc0b53f0 0x7f8cdc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.631+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f8ce00e5e30 con 0x7f8cf410a9d0 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cf9600640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cdc0b53f0 0x7f8cdc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cf2000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] conn(0x7f8cdc0c0430 0x7f8cdc0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ce0021e50 con 0x7f8cdc0c0430 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f8ce00e61e0 con 0x7f8cf410a9d0 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cf9600640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cdc0b53f0 0x7f8cdc0b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80057c0 tx=0x7f8ce80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.632+0000 7f8cfa000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] conn(0x7f8cdc0c0430 0x7f8cdc0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:28.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.633+0000 7f8cfa000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] conn(0x7f8cdc0c0430 0x7f8cdc0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.634+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== osd.8 v2:172.21.15.189:6816/3739595846 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ce0021e50 con 0x7f8cdc0c0430 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.648+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 --> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cf4063d20 con 0x7f8cdc0c0430 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cf2000640 1 -- 172.21.15.33:0/2099484356 <== osd.8 v2:172.21.15.189:6816/3739595846 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8cf4063d20 con 0x7f8cdc0c0430 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] conn(0x7f8cdc0c0430 msgr2=0x7f8cdc0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] conn(0x7f8cdc0c0430 0x7f8cdc0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cdc0b53f0 msgr2=0x7f8cdc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8cdc0b53f0 0x7f8cdc0b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80057c0 tx=0x7f8ce80058d0 comp rx=0 tx=0).stop 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 msgr2=0x7f8cf419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 --2- 172.21.15.33:0/2099484356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cf410a9d0 0x7f8cf419b920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000d770 tx=0x7f8ce000dc30 comp rx=0 tx=0).stop 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfa000640 1 -- 172.21.15.33:0/2099484356 reap_dead start 2024-09-10T23:55:28.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 shutdown_connections 2024-09-10T23:55:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.650+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 >> 172.21.15.33:0/2099484356 conn(0x7f8cf41009f0 msgr2=0x7f8cf4102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.651+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 shutdown_connections 2024-09-10T23:55:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:28.651+0000 7f8cfc000640 1 -- 172.21.15.33:0/2099484356 wait complete. 2024-09-10T23:55:29.228 INFO:teuthology.orchestra.run.smithi033.stdout:34359738469 2024-09-10T23:55:29.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T23:55:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 -- 172.21.15.33:0/2434061010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be4075f40 msgr2=0x7f6be410ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 --2- 172.21.15.33:0/2434061010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be4075f40 0x7f6be410ee10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009900 tx=0x7f6bcc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 -- 172.21.15.33:0/2434061010 shutdown_connections 2024-09-10T23:55:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 --2- 172.21.15.33:0/2434061010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6be410f3e0 0x7f6be41117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 --2- 172.21.15.33:0/2434061010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be4075f40 0x7f6be410ee10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 --2- 172.21.15.33:0/2434061010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be4075540 0x7f6be4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 -- 172.21.15.33:0/2434061010 >> 172.21.15.33:0/2434061010 conn(0x7f6be40fe830 msgr2=0x7f6be4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 -- 172.21.15.33:0/2434061010 shutdown_connections 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.010+0000 7f6be9c00640 1 -- 172.21.15.33:0/2434061010 wait complete. 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.011+0000 7f6be9c00640 1 Processor -- start 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.011+0000 7f6be9c00640 1 -- start start 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be4075540 0x7f6be419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6be4075f40 0x7f6be419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 0x7f6be41a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4114e80 con 0x7f6be410f3e0 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4114d00 con 0x7f6be4075f40 2024-09-10T23:55:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be9c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4115000 con 0x7f6be4075540 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 0x7f6be41a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 0x7f6be41a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44344/0 (socket says 172.21.15.33:44344) 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be3400640 1 -- 172.21.15.33:0/889446373 learned_addr learned my addr 172.21.15.33:0/889446373 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be2a00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be4075540 0x7f6be419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6bdbe00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6be4075f40 0x7f6be419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.012+0000 7f6be3400640 1 -- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be4075540 msgr2=0x7f6be419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be3400640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6be4075540 0x7f6be419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be3400640 1 -- 172.21.15.33:0/889446373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6be4075f40 msgr2=0x7f6be419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be3400640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6be4075f40 0x7f6be419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be3400640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be41a14e0 con 0x7f6be410f3e0 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be3400640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 0x7f6be41a0d10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00e9d0 tx=0x7f6bdc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00cd80 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bdc005020 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0116d0 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be41a17d0 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.013+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be41a7e90 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.014+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6be4100ea0 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.016+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6bdc00f040 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6bdb400640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6bc80b53f0 0x7f6bc80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f6bdc0e63a0 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6be2a00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6bc80b53f0 0x7f6bc80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6bdb400640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] conn(0x7f6bc80c0430 0x7f6bc80c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bdc014ec0 con 0x7f6bc80c0430 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.018+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc0e67f0 con 0x7f6be410f3e0 2024-09-10T23:55:30.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.019+0000 7f6bdbe00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] conn(0x7f6bc80c0430 0x7f6bc80c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.019+0000 7f6be2a00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6bc80b53f0 0x7f6bc80b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400bbe0 tx=0x7f6bd400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.019+0000 7f6bdbe00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] conn(0x7f6bc80c0430 0x7f6bc80c28d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.020+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== osd.2 v2:172.21.15.189:6800/2060707768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bdc014ec0 con 0x7f6bc80c0430 2024-09-10T23:55:30.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.035+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 --> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6be4076a50 con 0x7f6bc80c0430 2024-09-10T23:55:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.036+0000 7f6bdb400640 1 -- 172.21.15.33:0/889446373 <== osd.2 v2:172.21.15.189:6800/2060707768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6be4076a50 con 0x7f6bc80c0430 2024-09-10T23:55:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] conn(0x7f6bc80c0430 msgr2=0x7f6bc80c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] conn(0x7f6bc80c0430 0x7f6bc80c28d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6bc80b53f0 msgr2=0x7f6bc80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6bc80b53f0 0x7f6bc80b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400bbe0 tx=0x7f6bd400b390 comp rx=0 tx=0).stop 2024-09-10T23:55:30.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 msgr2=0x7f6be41a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 --2- 172.21.15.33:0/889446373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6be410f3e0 0x7f6be41a0d10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00e9d0 tx=0x7f6bdc00ee90 comp rx=0 tx=0).stop 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be3400640 1 -- 172.21.15.33:0/889446373 reap_dead start 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 shutdown_connections 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 >> 172.21.15.33:0/889446373 conn(0x7f6be40fe830 msgr2=0x7f6be40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 shutdown_connections 2024-09-10T23:55:30.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:30.037+0000 7f6be9c00640 1 -- 172.21.15.33:0/889446373 wait complete. 2024-09-10T23:55:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:30 smithi052 ceph-mon[33526]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:30.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:30 smithi033 ceph-mon[30593]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:30 smithi189 ceph-mon[34000]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 -- 172.21.15.33:0/972259705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 msgr2=0x7f30ec111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 --2- 172.21.15.33:0/972259705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec111b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ca0 tx=0x7f30e402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 -- 172.21.15.33:0/972259705 shutdown_connections 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 --2- 172.21.15.33:0/972259705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec111b50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 --2- 172.21.15.33:0/972259705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30ec10a9d0 0x7f30ec10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 --2- 172.21.15.33:0/972259705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 0x7f30ec1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 -- 172.21.15.33:0/972259705 >> 172.21.15.33:0/972259705 conn(0x7f30ec1009f0 msgr2=0x7f30ec102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 -- 172.21.15.33:0/972259705 shutdown_connections 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.412+0000 7f30f1400640 1 -- 172.21.15.33:0/972259705 wait complete. 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.413+0000 7f30f1400640 1 Processor -- start 2024-09-10T23:55:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.413+0000 7f30f1400640 1 -- start start 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 0x7f30ec19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30ec10a9d0 0x7f30ec19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec1a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec114e80 con 0x7f30ec10b350 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec114d00 con 0x7f30ec104fc0 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30f1400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec115000 con 0x7f30ec10a9d0 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30eb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec1a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30eb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec1a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44332/0 (socket says 172.21.15.33:44332) 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 0x7f30ec19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30eb200640 1 -- 172.21.15.33:0/734685119 learned_addr learned my addr 172.21.15.33:0/734685119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.414+0000 7f30e9e00640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30ec10a9d0 0x7f30ec19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 -- 172.21.15.33:0/734685119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30ec10a9d0 msgr2=0x7f30ec19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f30ec10a9d0 0x7f30ec19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 -- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 msgr2=0x7f30ec19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 0x7f30ec19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec1a13e0 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30ea800640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30ec104fc0 0x7f30ec19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30eb200640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec1a0c10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f30e4005e30 tx=0x7f30e4003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4032c10 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec1a1670 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30e4032db0 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec1a7d90 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.415+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4030a50 con 0x7f30ec10b350 2024-09-10T23:55:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.416+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30ec0638e0 con 0x7f30ec10b350 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.419+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f30e4030bf0 con 0x7f30ec10b350 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30e3400640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30d00b5370 0x7f30d00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f30e41073d0 con 0x7f30ec10b350 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30ea800640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30d00b5370 0x7f30d00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30e3400640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] conn(0x7f30d00c03b0 0x7f30d00c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30e403ee50 con 0x7f30d00c03b0 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.420+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f30e4107780 con 0x7f30ec10b350 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.421+0000 7f30e9e00640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] conn(0x7f30d00c03b0 0x7f30d00c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.421+0000 7f30ea800640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30d00b5370 0x7f30d00b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fc0 tx=0x7f30dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.421+0000 7f30e9e00640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] conn(0x7f30d00c03b0 0x7f30d00c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.422+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== osd.4 v2:172.21.15.52:6808/3474115140 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30e403ee50 con 0x7f30d00c03b0 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.437+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 --> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30ec063d10 con 0x7f30d00c03b0 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30e3400640 1 -- 172.21.15.33:0/734685119 <== osd.4 v2:172.21.15.52:6808/3474115140 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f30ec063d10 con 0x7f30d00c03b0 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] conn(0x7f30d00c03b0 msgr2=0x7f30d00c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] conn(0x7f30d00c03b0 0x7f30d00c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30d00b5370 msgr2=0x7f30d00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f30d00b5370 0x7f30d00b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009fc0 tx=0x7f30dc005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 msgr2=0x7f30ec1a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.438+0000 7f30f1400640 1 --2- 172.21.15.33:0/734685119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30ec10b350 0x7f30ec1a0c10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f30e4005e30 tx=0x7f30e4003f30 comp rx=0 tx=0).stop 2024-09-10T23:55:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.439+0000 7f30eb200640 1 -- 172.21.15.33:0/734685119 reap_dead start 2024-09-10T23:55:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.439+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 shutdown_connections 2024-09-10T23:55:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.439+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 >> 172.21.15.33:0/734685119 conn(0x7f30ec1009f0 msgr2=0x7f30ec102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.439+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 shutdown_connections 2024-09-10T23:55:30.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:29.439+0000 7f30f1400640 1 -- 172.21.15.33:0/734685119 wait complete. 2024-09-10T23:55:31.557 INFO:teuthology.orchestra.run.smithi033.stdout:77309411419 2024-09-10T23:55:31.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T23:55:32.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:32 smithi033 ceph-mon[30593]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:32.414 INFO:teuthology.orchestra.run.smithi033.stdout:274877906983 2024-09-10T23:55:32.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T23:55:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:32 smithi052 ceph-mon[33526]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 -- 172.21.15.33:0/1165080428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 msgr2=0x7fee98105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 --2- 172.21.15.33:0/1165080428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee98105380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fee88009900 tx=0x7fee8802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 -- 172.21.15.33:0/1165080428 shutdown_connections 2024-09-10T23:55:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 --2- 172.21.15.33:0/1165080428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810b330 0x7fee98111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 --2- 172.21.15.33:0/1165080428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9810a9b0 0x7fee9810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 --2- 172.21.15.33:0/1165080428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee98105380 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.575+0000 7fee9d400640 1 -- 172.21.15.33:0/1165080428 >> 172.21.15.33:0/1165080428 conn(0x7fee98100a50 msgr2=0x7fee98102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.576+0000 7fee9d400640 1 -- 172.21.15.33:0/1165080428 shutdown_connections 2024-09-10T23:55:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.576+0000 7fee9d400640 1 -- 172.21.15.33:0/1165080428 wait complete. 2024-09-10T23:55:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.576+0000 7fee9d400640 1 Processor -- start 2024-09-10T23:55:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 -- start start 2024-09-10T23:55:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee9819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810a9b0 0x7fee9819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9810b330 0x7fee981a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fee98114e60 con 0x7fee98104fa0 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee98114ce0 con 0x7fee9810a9b0 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee9d400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee98114fe0 con 0x7fee9810b330 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee96800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee9819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee96800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee9819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58962/0 (socket says 172.21.15.33:58962) 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.577+0000 7fee96800640 1 -- 172.21.15.33:0/4064821382 learned_addr learned my addr 172.21.15.33:0/4064821382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee8fe00640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810a9b0 0x7fee9819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee97200640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9810b330 0x7fee981a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 -- 172.21.15.33:0/4064821382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9810b330 msgr2=0x7fee981a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee9810b330 0x7fee981a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 -- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810a9b0 msgr2=0x7fee9819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810a9b0 0x7fee9819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee981a1420 con 0x7fee98104fa0 2024-09-10T23:55:32.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee8fe00640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee9810a9b0 0x7fee9819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:32.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee96800640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee9819b370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee8802a910 tx=0x7fee88003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:32 smithi189 ceph-mon[34000]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T23:55:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.578+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8803f070 con 0x7fee98104fa0 2024-09-10T23:55:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.579+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee981a16b0 con 0x7fee98104fa0 2024-09-10T23:55:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.579+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee8803baf0 con 0x7fee98104fa0 2024-09-10T23:55:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.579+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee981a7dd0 con 0x7fee98104fa0 2024-09-10T23:55:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.579+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88049060 con 0x7fee98104fa0 2024-09-10T23:55:32.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.580+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee980638a0 con 0x7fee98104fa0 2024-09-10T23:55:32.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.582+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fee8803b660 con 0x7fee98104fa0 2024-09-10T23:55:32.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.585+0000 7fee8f400640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fee7c0b5370 0x7fee7c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.585+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fee88106f30 con 0x7fee98104fa0 2024-09-10T23:55:32.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.585+0000 7fee8fe00640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fee7c0b5370 0x7fee7c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.586+0000 7fee8f400640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] conn(0x7fee7c0c03b0 0x7fee7c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.586+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee8803eec0 con 0x7fee7c0c03b0 2024-09-10T23:55:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.586+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fee88107380 con 0x7fee98104fa0 2024-09-10T23:55:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.586+0000 7fee8fe00640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fee7c0b5370 0x7fee7c0b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee98108400 tx=0x7fee80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.586+0000 7fee97200640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] conn(0x7fee7c0c03b0 0x7fee7c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.587+0000 7fee97200640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] conn(0x7fee7c0c03b0 0x7fee7c0c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.588+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== osd.1 v2:172.21.15.52:6800/3373850910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee8803eec0 con 0x7fee7c0c03b0 2024-09-10T23:55:32.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.603+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 --> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee98063ca0 con 0x7fee7c0c03b0 2024-09-10T23:55:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee8f400640 1 -- 172.21.15.33:0/4064821382 <== osd.1 v2:172.21.15.52:6800/3373850910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fee98063ca0 con 0x7fee7c0c03b0 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] conn(0x7fee7c0c03b0 msgr2=0x7fee7c0c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] conn(0x7fee7c0c03b0 0x7fee7c0c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fee7c0b5370 msgr2=0x7fee7c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fee7c0b5370 0x7fee7c0b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee98108400 tx=0x7fee80005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 msgr2=0x7fee9819b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee9d400640 1 --2- 172.21.15.33:0/4064821382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee98104fa0 0x7fee9819b370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fee8802a910 tx=0x7fee88003b90 comp rx=0 tx=0).stop 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.604+0000 7fee97200640 1 -- 172.21.15.33:0/4064821382 reap_dead start 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.605+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 shutdown_connections 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.605+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 >> 172.21.15.33:0/4064821382 conn(0x7fee98100a50 msgr2=0x7fee98102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.605+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 shutdown_connections 2024-09-10T23:55:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.605+0000 7fee9d400640 1 -- 172.21.15.33:0/4064821382 wait complete. 2024-09-10T23:55:32.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 -- 172.21.15.33:0/2446399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc270102de0 msgr2=0x7fc2701031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 --2- 172.21.15.33:0/2446399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc270102de0 0x7fc2701031c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc260009900 tx=0x7fc26002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 -- 172.21.15.33:0/2446399902 shutdown_connections 2024-09-10T23:55:32.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 --2- 172.21.15.33:0/2446399902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc270109170 0x7fc27010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 --2- 172.21.15.33:0/2446399902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2701087f0 0x7fc270108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 --2- 172.21.15.33:0/2446399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc270102de0 0x7fc2701031c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 -- 172.21.15.33:0/2446399902 >> 172.21.15.33:0/2446399902 conn(0x7fc2700fe830 msgr2=0x7fc270100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 -- 172.21.15.33:0/2446399902 shutdown_connections 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.386+0000 7fc275000640 1 -- 172.21.15.33:0/2446399902 wait complete. 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.387+0000 7fc275000640 1 Processor -- start 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 -- start start 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc270102de0 0x7fc27019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2701087f0 0x7fc27019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc270109170 0x7fc2701a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc270112ce0 con 0x7fc2701087f0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc270112b60 con 0x7fc270109170 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc275000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc270112e60 con 0x7fc270102de0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc26d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2701087f0 0x7fc27019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc26d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2701087f0 0x7fc27019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58936/0 (socket says 172.21.15.33:58936) 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc26d400640 1 -- 172.21.15.33:0/3511083751 learned_addr learned my addr 172.21.15.33:0/3511083751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.388+0000 7fc26de00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc270102de0 0x7fc27019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26e800640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc270109170 0x7fc2701a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 -- 172.21.15.33:0/3511083751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc270109170 msgr2=0x7fc2701a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc270109170 0x7fc2701a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 -- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2701087f0 msgr2=0x7fc27019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2701087f0 0x7fc27019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2701a1450 con 0x7fc270102de0 2024-09-10T23:55:32.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.389+0000 7fc26de00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc270102de0 0x7fc27019b3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc260005940 tx=0x7fc2600040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.390+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26003f070 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.390+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2701a16e0 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.390+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc260003c80 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.390+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260035070 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.390+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2701a7e00 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.391+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2700638a0 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.393+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc26004b060 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc266a00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2540b5370 0x7fc2540b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fc260106f80 con 0x7fc270102de0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc26d400640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2540b5370 0x7fc2540b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc266a00640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] conn(0x7fc2540c03b0 0x7fc2540c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:32.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2540c2f20 con 0x7fc2540c03b0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.395+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fc260107330 con 0x7fc270102de0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.396+0000 7fc26e800640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] conn(0x7fc2540c03b0 0x7fc2540c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.396+0000 7fc26d400640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2540b5370 0x7fc2540b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc270101d90 tx=0x7fc25c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.396+0000 7fc26e800640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] conn(0x7fc2540c03b0 0x7fc2540c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.397+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== osd.6 v2:172.21.15.33:6818/3475374016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2540c2f20 con 0x7fc2540c03b0 2024-09-10T23:55:32.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.414+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 --> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc270063d20 con 0x7fc2540c03b0 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc266a00640 1 -- 172.21.15.33:0/3511083751 <== osd.6 v2:172.21.15.33:6818/3475374016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc270063d20 con 0x7fc2540c03b0 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] conn(0x7fc2540c03b0 msgr2=0x7fc2540c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] conn(0x7fc2540c03b0 0x7fc2540c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2540b5370 msgr2=0x7fc2540b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2540b5370 0x7fc2540b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc270101d90 tx=0x7fc25c00b410 comp rx=0 tx=0).stop 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc270102de0 msgr2=0x7fc27019b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc275000640 1 --2- 172.21.15.33:0/3511083751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc270102de0 0x7fc27019b3a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc260005940 tx=0x7fc2600040e0 comp rx=0 tx=0).stop 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.415+0000 7fc26e800640 1 -- 172.21.15.33:0/3511083751 reap_dead start 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.416+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 shutdown_connections 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.416+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 >> 172.21.15.33:0/3511083751 conn(0x7fc2700fe830 msgr2=0x7fc270104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.416+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 shutdown_connections 2024-09-10T23:55:32.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:32.416+0000 7fc275000640 1 -- 172.21.15.33:0/3511083751 wait complete. 2024-09-10T23:55:33.470 INFO:teuthology.orchestra.run.smithi033.stdout:180388626497 2024-09-10T23:55:33.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T23:55:34.276 INFO:teuthology.orchestra.run.smithi033.stdout:55834574946 2024-09-10T23:55:34.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T23:55:34.292 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:34.395 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:34 smithi033 ceph-mon[30593]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:34 smithi052 ceph-mon[33526]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:34.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:34 smithi189 ceph-mon[34000]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T23:55:34.891 INFO:teuthology.orchestra.run.smithi033.stdout:227633266741 2024-09-10T23:55:34.891 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T23:55:35.262 INFO:teuthology.orchestra.run.smithi033.stdout:133143986254 2024-09-10T23:55:35.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T23:55:35.791 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:35.806 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:35.811 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:35.817 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:35.838 INFO:teuthology.orchestra.run.smithi033.stdout:253403070510 2024-09-10T23:55:35.839 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T23:55:36.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:36 smithi033 ceph-mon[30593]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:55:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:36 smithi052 ceph-mon[33526]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:55:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:36 smithi189 ceph-mon[34000]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 -- 172.21.15.33:0/3672946990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102c10 msgr2=0x7f521c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 --2- 172.21.15.33:0/3672946990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102c10 0x7f521c102ff0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f520c009900 tx=0x7f520c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 -- 172.21.15.33:0/3672946990 shutdown_connections 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 --2- 172.21.15.33:0/3672946990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f521c108fa0 0x7f521c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 --2- 172.21.15.33:0/3672946990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c108620 0x7f521c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 --2- 172.21.15.33:0/3672946990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102c10 0x7f521c102ff0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 -- 172.21.15.33:0/3672946990 >> 172.21.15.33:0/3672946990 conn(0x7f521c0fe660 msgr2=0x7f521c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 -- 172.21.15.33:0/3672946990 shutdown_connections 2024-09-10T23:55:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.723+0000 7f5220c00640 1 -- 172.21.15.33:0/3672946990 wait complete. 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.724+0000 7f5220c00640 1 Processor -- start 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.724+0000 7f5220c00640 1 -- start start 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c102c10 0x7f521c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f521c108fa0 0x7f521c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112b10 con 0x7f521c108620 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112990 con 0x7f521c108fa0 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f5220c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112c90 con 0x7f521c102c10 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f521aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f521aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58998/0 (socket says 172.21.15.33:58998) 2024-09-10T23:55:36.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.725+0000 7f521aa00640 1 -- 172.21.15.33:0/3258616427 learned_addr learned my addr 172.21.15.33:0/3258616427 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 -- 172.21.15.33:0/3258616427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c102c10 msgr2=0x7f521c19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c102c10 0x7f521c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 -- 172.21.15.33:0/3258616427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f521c108fa0 msgr2=0x7f521c1a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f521c108fa0 0x7f521c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 -- 172.21.15.33:0/3258616427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1a1280 con 0x7f521c108620 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f521aa00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f520800d950 tx=0x7f520800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208017030 con 0x7f521c108620 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5208004020 con 0x7f521c108620 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a1570 con 0x7f521c108620 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.726+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080055d0 con 0x7f521c108620 2024-09-10T23:55:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.727+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a7c30 con 0x7f521c108620 2024-09-10T23:55:36.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.728+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c102ff0 con 0x7f521c108620 2024-09-10T23:55:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.731+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5208009a30 con 0x7f521c108620 2024-09-10T23:55:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.733+0000 7f5213e00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 0x7f52000b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.733+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f52080e5b30 con 0x7f521c108620 2024-09-10T23:55:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.733+0000 7f521b400640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 0x7f52000b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.734+0000 7f521b400640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 0x7f52000b7a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f520c005c20 tx=0x7f520c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.737+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52080ac4f0 con 0x7f521c108620 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.606+0000 7f3e37c00640 1 -- 172.21.15.33:0/3130971227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 msgr2=0x7f3e30108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.606+0000 7f3e37c00640 1 --2- 172.21.15.33:0/3130971227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e30108bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009900 tx=0x7f3e1c02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 -- 172.21.15.33:0/3130971227 shutdown_connections 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 --2- 172.21.15.33:0/3130971227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e3010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 --2- 172.21.15.33:0/3130971227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e30108bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 --2- 172.21.15.33:0/3130971227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 0x7f3e30103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 -- 172.21.15.33:0/3130971227 >> 172.21.15.33:0/3130971227 conn(0x7f3e300fe810 msgr2=0x7f3e30100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 -- 172.21.15.33:0/3130971227 shutdown_connections 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.607+0000 7f3e37c00640 1 -- 172.21.15.33:0/3130971227 wait complete. 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 Processor -- start 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 -- start start 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 0x7f3e3019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e301a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30112cf0 con 0x7f3e301087b0 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30112b70 con 0x7f3e30109130 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e37c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30112e70 con 0x7f3e30102da0 2024-09-10T23:55:36.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.608+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58974/0 (socket says 172.21.15.33:58974) 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e301a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 -- 172.21.15.33:0/2586988289 learned_addr learned my addr 172.21.15.33:0/2586988289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e35200640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 0x7f3e3019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 -- 172.21.15.33:0/2586988289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 msgr2=0x7f3e3019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 0x7f3e3019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 -- 172.21.15.33:0/2586988289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 msgr2=0x7f3e301a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e301a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 -- 172.21.15.33:0/2586988289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e301a1460 con 0x7f3e301087b0 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e35c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e301a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.609+0000 7f3e2fe00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c02a910 tx=0x7f3e1c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.610+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c03f070 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.610+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e1c003e40 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.610+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e301a16f0 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.610+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c035030 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.610+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e301a7e10 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.611+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e30103180 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.613+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3e1c031400 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.615+0000 7f3e2d600640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 0x7f3e140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.615+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f3e1c106b40 con 0x7f3e301087b0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.615+0000 7f3e35200640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 0x7f3e140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.616+0000 7f3e35200640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 0x7f3e140b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e20005fd0 tx=0x7f3e20009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.619+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e1c0cceb0 con 0x7f3e301087b0 2024-09-10T23:55:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.842+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3e3010f380 con 0x7f3e301087b0 2024-09-10T23:55:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.842+0000 7f3e2d600640 1 -- 172.21.15.33:0/2586988289 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3e1c0d18e0 con 0x7f3e301087b0 2024-09-10T23:55:36.845 INFO:teuthology.orchestra.run.smithi033.stdout:107374182485 2024-09-10T23:55:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 msgr2=0x7f3e140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 0x7f3e140b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e20005fd0 tx=0x7f3e20009680 comp rx=0 tx=0).stop 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 msgr2=0x7f3e3019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c02a910 tx=0x7f3e1c003c20 comp rx=0 tx=0).stop 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 shutdown_connections 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e140b5370 0x7f3e140b7830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e30109130 0x7f3e301a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e301087b0 0x7f3e3019b8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 --2- 172.21.15.33:0/2586988289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e30102da0 0x7f3e3019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 >> 172.21.15.33:0/2586988289 conn(0x7f3e300fe810 msgr2=0x7f3e30075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 shutdown_connections 2024-09-10T23:55:36.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.845+0000 7f3e37c00640 1 -- 172.21.15.33:0/2586988289 wait complete. 2024-09-10T23:55:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.960+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f521c19c300 con 0x7f521c108620 2024-09-10T23:55:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.961+0000 7f5213e00640 1 -- 172.21.15.33:0/3258616427 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f52080abdf0 con 0x7f521c108620 2024-09-10T23:55:36.963 INFO:teuthology.orchestra.run.smithi033.stdout:300647710756 2024-09-10T23:55:36.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 msgr2=0x7f52000b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 0x7f52000b7a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f520c005c20 tx=0x7f520c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 msgr2=0x7f521c19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:36.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f520800d950 tx=0x7f520800de10 comp rx=0 tx=0).stop 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 shutdown_connections 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f52000b5560 0x7f52000b7a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f521c108fa0 0x7f521c1a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c108620 0x7f521c19b710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 --2- 172.21.15.33:0/3258616427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c102c10 0x7f521c19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 >> 172.21.15.33:0/3258616427 conn(0x7f521c0fe660 msgr2=0x7f521c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 shutdown_connections 2024-09-10T23:55:36.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:36.963+0000 7f5220c00640 1 -- 172.21.15.33:0/3258616427 wait complete. 2024-09-10T23:55:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:37 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2586988289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:55:37.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:37 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3258616427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:55:37.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:37 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2586988289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:55:37.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:37 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3258616427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:55:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:37 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2586988289' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T23:55:37.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:37 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3258616427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 -- 172.21.15.33:0/2119272439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc104fa0 msgr2=0x7f5cfc105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 --2- 172.21.15.33:0/2119272439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc105380 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009900 tx=0x7f5cec02a410 comp rx=0 tx=0).stop 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 -- 172.21.15.33:0/2119272439 shutdown_connections 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 --2- 172.21.15.33:0/2119272439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc10b330 0x7f5cfc111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 --2- 172.21.15.33:0/2119272439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 0x7f5cfc10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 --2- 172.21.15.33:0/2119272439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc105380 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 -- 172.21.15.33:0/2119272439 >> 172.21.15.33:0/2119272439 conn(0x7f5cfc100a50 msgr2=0x7f5cfc102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 -- 172.21.15.33:0/2119272439 shutdown_connections 2024-09-10T23:55:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.200+0000 7f5d03000640 1 -- 172.21.15.33:0/2119272439 wait complete. 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.201+0000 7f5d03000640 1 Processor -- start 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.201+0000 7f5d03000640 1 -- start start 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.201+0000 7f5d03000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.201+0000 7f5d03000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 0x7f5cfc19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d03000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d03000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc114e10 con 0x7f5cfc10b330 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d03000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc114c90 con 0x7f5cfc10a9b0 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d03000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc114f90 con 0x7f5cfc104fa0 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5cfbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59016/0 (socket says 172.21.15.33:59016) 2024-09-10T23:55:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 -- 172.21.15.33:0/1670721575 learned_addr learned my addr 172.21.15.33:0/1670721575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5cf3400640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 0x7f5cfc19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 -- 172.21.15.33:0/1670721575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc104fa0 msgr2=0x7f5cfc19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 -- 172.21.15.33:0/1670721575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 msgr2=0x7f5cfc19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 0x7f5cfc19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.202+0000 7f5d01000640 1 -- 172.21.15.33:0/1670721575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc1a1510 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5d01000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400eaa0 tx=0x7f5cf400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400cdb0 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cf4005020 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc1a1800 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40116d0 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.203+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc1a7ec0 con 0x7f5cfc10b330 2024-09-10T23:55:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.204+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc105380 con 0x7f5cfc10b330 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.206+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5cf400f040 con 0x7f5cfc10b330 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.208+0000 7f5cf9600640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 0x7f5ce00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.208+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f5cf40e5e70 con 0x7f5cfc10b330 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.208+0000 7f5cfbe00640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 0x7f5ce00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.209+0000 7f5cfbe00640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 0x7f5ce00b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0057c0 tx=0x7f5cec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.212+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cf4016030 con 0x7f5cfc10b330 2024-09-10T23:55:38.354 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:38 smithi033 ceph-mon[30593]: pgmap v400: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:38.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.414+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5cfc02e5c0 con 0x7f5cfc10b330 2024-09-10T23:55:38.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.415+0000 7f5cf9600640 1 -- 172.21.15.33:0/1670721575 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5cf40ac1e0 con 0x7f5cfc10b330 2024-09-10T23:55:38.417 INFO:teuthology.orchestra.run.smithi033.stdout:274877906986 2024-09-10T23:55:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 msgr2=0x7f5ce00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 0x7f5ce00b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0057c0 tx=0x7f5cec0058d0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 msgr2=0x7f5cfc1a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400eaa0 tx=0x7f5cf400ef60 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 shutdown_connections 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ce00b5370 0x7f5ce00b7830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cfc10b330 0x7f5cfc1a0d40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cfc10a9b0 0x7f5cfc19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 --2- 172.21.15.33:0/1670721575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5cfc104fa0 0x7f5cfc19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.417+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 >> 172.21.15.33:0/1670721575 conn(0x7f5cfc100a50 msgr2=0x7f5cfc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.418+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 shutdown_connections 2024-09-10T23:55:38.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:38.418+0000 7f5d03000640 1 -- 172.21.15.33:0/1670721575 wait complete. 2024-09-10T23:55:38.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:38 smithi052 ceph-mon[33526]: pgmap v400: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:38 smithi189 ceph-mon[34000]: pgmap v400: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:39.130 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182483 got 107374182485 for osd.3 2024-09-10T23:55:39.130 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 -- 172.21.15.33:0/3706666701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 msgr2=0x7f11ec1097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 --2- 172.21.15.33:0/3706666701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec1097b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009900 tx=0x7f11dc02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 -- 172.21.15.33:0/3706666701 shutdown_connections 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 --2- 172.21.15.33:0/3706666701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 --2- 172.21.15.33:0/3706666701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 0x7f11ec10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 --2- 172.21.15.33:0/3706666701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec1097b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 -- 172.21.15.33:0/3706666701 >> 172.21.15.33:0/3706666701 conn(0x7f11ec078a40 msgr2=0x7f11ec07ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 -- 172.21.15.33:0/3706666701 shutdown_connections 2024-09-10T23:55:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.364+0000 7f11f1000640 1 -- 172.21.15.33:0/3706666701 wait complete. 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 Processor -- start 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 -- start start 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 0x7f11ec19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec1a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec119220 con 0x7f11ec1093d0 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec1190a0 con 0x7f11ec10ede0 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.365+0000 7f11f1000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec1193a0 con 0x7f11ec10f760 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59042/0 (socket says 172.21.15.33:59042) 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 -- 172.21.15.33:0/3653186130 learned_addr learned my addr 172.21.15.33:0/3653186130 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e1400640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 0x7f11ec19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11ea800640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec1a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 -- 172.21.15.33:0/3653186130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 msgr2=0x7f11ec1a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec1a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 -- 172.21.15.33:0/3653186130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 msgr2=0x7f11ec19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 0x7f11ec19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11e9e00640 1 -- 172.21.15.33:0/3653186130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec1a5840 con 0x7f11ec1093d0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.366+0000 7f11ea800640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec1a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11e9e00640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009230 tx=0x7f11dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc03f030 con 0x7f11ec1093d0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11dc003a80 con 0x7f11ec1093d0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ec1a5ad0 con 0x7f11ec1093d0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc035070 con 0x7f11ec1093d0 2024-09-10T23:55:39.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.367+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ec1ac1f0 con 0x7f11ec1093d0 2024-09-10T23:55:39.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.368+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ec1097b0 con 0x7f11ec1093d0 2024-09-10T23:55:39.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.370+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f11dc03bc30 con 0x7f11ec1093d0 2024-09-10T23:55:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.372+0000 7f11e3400640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 0x7f11d00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.372+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f11dc106ae0 con 0x7f11ec1093d0 2024-09-10T23:55:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.372+0000 7f11e1400640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 0x7f11d00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.373+0000 7f11e1400640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 0x7f11d00b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11ec10e9f0 tx=0x7f11d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.376+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f11dc0cd4a0 con 0x7f11ec1093d0 2024-09-10T23:55:39.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:39 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1670721575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:55:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:39.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:39 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1670721575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:55:39.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:39 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1670721575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T23:55:39.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.603+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f11ec110fb0 con 0x7f11ec1093d0 2024-09-10T23:55:39.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.604+0000 7f11e3400640 1 -- 172.21.15.33:0/3653186130 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f11dc0ccda0 con 0x7f11ec1093d0 2024-09-10T23:55:39.606 INFO:teuthology.orchestra.run.smithi033.stdout:154618822730 2024-09-10T23:55:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 msgr2=0x7f11d00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 0x7f11d00b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11ec10e9f0 tx=0x7f11d400b390 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 msgr2=0x7f11ec19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009230 tx=0x7f11dc004270 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 shutdown_connections 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f11d00b53f0 0x7f11d00b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11ec10f760 0x7f11ec1a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11ec10ede0 0x7f11ec19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 --2- 172.21.15.33:0/3653186130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11ec1093d0 0x7f11ec19f790 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 >> 172.21.15.33:0/3653186130 conn(0x7f11ec078a40 msgr2=0x7f11ec0793e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 shutdown_connections 2024-09-10T23:55:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:39.606+0000 7f11f1000640 1 -- 172.21.15.33:0/3653186130 wait complete. 2024-09-10T23:55:40.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:40 smithi033 ceph-mon[30593]: pgmap v401: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:40.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:40 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3653186130' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:55:40.308 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906983 got 274877906986 for osd.10 2024-09-10T23:55:40.308 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:40 smithi052 ceph-mon[33526]: pgmap v401: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:40.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:40 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3653186130' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:55:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:40 smithi189 ceph-mon[34000]: pgmap v401: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:40 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3653186130' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T23:55:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:41.140 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710753 got 300647710756 for osd.11 2024-09-10T23:55:41.140 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 -- 172.21.15.33:0/2077357938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 msgr2=0x7fed88111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 --2- 172.21.15.33:0/2077357938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed88111b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fed80009900 tx=0x7fed8002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 -- 172.21.15.33:0/2077357938 shutdown_connections 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 --2- 172.21.15.33:0/2077357938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed88111b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 --2- 172.21.15.33:0/2077357938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 0x7fed8810ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 --2- 172.21.15.33:0/2077357938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 0x7fed88105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 -- 172.21.15.33:0/2077357938 >> 172.21.15.33:0/2077357938 conn(0x7fed88100a00 msgr2=0x7fed88102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 -- 172.21.15.33:0/2077357938 shutdown_connections 2024-09-10T23:55:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.359+0000 7fed8ee00640 1 -- 172.21.15.33:0/2077357938 wait complete. 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.360+0000 7fed8ee00640 1 Processor -- start 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.360+0000 7fed8ee00640 1 -- start start 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 0x7fed8819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 0x7fed8819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fed88114e50 con 0x7fed8810b320 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed88114cd0 con 0x7fed88104f90 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ee00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed88114fd0 con 0x7fed8810a9a0 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34702/0 (socket says 172.21.15.33:34702) 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed8ce00640 1 -- 172.21.15.33:0/3271192963 learned_addr learned my addr 172.21.15.33:0/3271192963 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed7f400640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 0x7fed8819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.361+0000 7fed87e00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 0x7fed8819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 -- 172.21.15.33:0/3271192963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 msgr2=0x7fed8819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 0x7fed8819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 -- 172.21.15.33:0/3271192963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 msgr2=0x7fed8819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 0x7fed8819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 -- 172.21.15.33:0/3271192963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed881a1390 con 0x7fed8810b320 2024-09-10T23:55:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ce00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed80004770 tx=0x7fed80003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8003f070 con 0x7fed8810b320 2024-09-10T23:55:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed8003bd00 con 0x7fed8810b320 2024-09-10T23:55:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80035030 con 0x7fed8810b320 2024-09-10T23:55:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.362+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed881a1620 con 0x7fed8810b320 2024-09-10T23:55:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.363+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed881a7d40 con 0x7fed8810b320 2024-09-10T23:55:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.364+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed88105370 con 0x7fed8810b320 2024-09-10T23:55:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.367+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fed80031bd0 con 0x7fed8810b320 2024-09-10T23:55:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.368+0000 7fed85600640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 0x7fed6c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.368+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fed80106f70 con 0x7fed8810b320 2024-09-10T23:55:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.369+0000 7fed87e00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 0x7fed6c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.369+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed800cd2e0 con 0x7fed8810b320 2024-09-10T23:55:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.369+0000 7fed87e00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 0x7fed6c0b78b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed7800bbe0 tx=0x7fed7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.570+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fed8819c410 con 0x7fed8810b320 2024-09-10T23:55:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.571+0000 7fed85600640 1 -- 172.21.15.33:0/3271192963 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed8819c410 con 0x7fed8810b320 2024-09-10T23:55:41.573 INFO:teuthology.orchestra.run.smithi033.stdout:77309411421 2024-09-10T23:55:41.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 msgr2=0x7fed6c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:41.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 0x7fed6c0b78b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed7800bbe0 tx=0x7fed7800b390 comp rx=0 tx=0).stop 2024-09-10T23:55:41.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 msgr2=0x7fed881a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:41.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed80004770 tx=0x7fed80003cd0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 shutdown_connections 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fed6c0b53f0 0x7fed6c0b78b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed8810b320 0x7fed881a0bc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed8810a9a0 0x7fed8819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 --2- 172.21.15.33:0/3271192963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed88104f90 0x7fed8819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 >> 172.21.15.33:0/3271192963 conn(0x7fed88100a00 msgr2=0x7fed88102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 shutdown_connections 2024-09-10T23:55:41.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:41.573+0000 7fed8ee00640 1 -- 172.21.15.33:0/3271192963 wait complete. 2024-09-10T23:55:42.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 -- 172.21.15.33:0/1056497905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10a820 msgr2=0x7fe85c10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 --2- 172.21.15.33:0/1056497905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10a820 0x7fe85c10ac60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe848009900 tx=0x7fe84802a410 comp rx=0 tx=0).stop 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 -- 172.21.15.33:0/1056497905 shutdown_connections 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 --2- 172.21.15.33:0/1056497905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 --2- 172.21.15.33:0/1056497905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10a820 0x7fe85c10ac60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 --2- 172.21.15.33:0/1056497905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 -- 172.21.15.33:0/1056497905 >> 172.21.15.33:0/1056497905 conn(0x7fe85c100840 msgr2=0x7fe85c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.142+0000 7fe860c00640 1 -- 172.21.15.33:0/1056497905 shutdown_connections 2024-09-10T23:55:42.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.143+0000 7fe860c00640 1 -- 172.21.15.33:0/1056497905 wait complete. 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 Processor -- start 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 -- start start 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10a820 0x7fe85c19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c114d60 con 0x7fe85c10b1a0 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c114be0 con 0x7fe85c10a820 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.144+0000 7fe860c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c114ee0 con 0x7fe85c104e10 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34720/0 (socket says 172.21.15.33:34720) 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85be00640 1 -- 172.21.15.33:0/3393652726 learned_addr learned my addr 172.21.15.33:0/3393652726 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85aa00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10a820 0x7fe85c19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 -- 172.21.15.33:0/3393652726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10a820 msgr2=0x7fe85c19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10a820 0x7fe85c19b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 -- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 msgr2=0x7fe85c1a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85b400640 1 -- 172.21.15.33:0/3393652726 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c1a1220 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.145+0000 7fe85be00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe85b400640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c19b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e9f0 tx=0x7fe84c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00ccc0 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c1a1510 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe84c005020 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00ce60 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.146+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c1a7bd0 con 0x7fe85c104e10 2024-09-10T23:55:42.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.148+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c1051f0 con 0x7fe85c104e10 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.150+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe84c004a20 con 0x7fe85c104e10 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.151+0000 7fe853e00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 0x7fe8400b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.152+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7fe84c0e60f0 con 0x7fe85c104e10 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.152+0000 7fe85aa00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 0x7fe8400b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.153+0000 7fe85aa00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 0x7fe8400b78d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe848006010 tx=0x7fe848005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:42.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.154+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe84c0acb40 con 0x7fe85c104e10 2024-09-10T23:55:42.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.360+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe85c1a7f30 con 0x7fe85c104e10 2024-09-10T23:55:42.362 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:42 smithi033 ceph-mon[30593]: pgmap v402: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:55:42.362 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3271192963' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:55:42.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.360+0000 7fe853e00640 1 -- 172.21.15.33:0/3393652726 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe84c0ac440 con 0x7fe85c104e10 2024-09-10T23:55:42.363 INFO:teuthology.orchestra.run.smithi033.stdout:201863462974 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 msgr2=0x7fe8400b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 0x7fe8400b78d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe848006010 tx=0x7fe848005e80 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 msgr2=0x7fe85c19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c19b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e9f0 tx=0x7fe84c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 shutdown_connections 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8400b5410 0x7fe8400b78d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe85c10b1a0 0x7fe85c1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe85c10a820 0x7fe85c19b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 --2- 172.21.15.33:0/3393652726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe85c104e10 0x7fe85c19b170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.363+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 >> 172.21.15.33:0/3393652726 conn(0x7fe85c100840 msgr2=0x7fe85c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.364+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 shutdown_connections 2024-09-10T23:55:42.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.364+0000 7fe860c00640 1 -- 172.21.15.33:0/3393652726 wait complete. 2024-09-10T23:55:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:42 smithi052 ceph-mon[33526]: pgmap v402: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:55:42.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:42 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3271192963' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:55:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:42 smithi189 ceph-mon[34000]: pgmap v402: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:55:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:42 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3271192963' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T23:55:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 -- 172.21.15.33:0/3250037681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c103cc0 msgr2=0x7f630c1040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 --2- 172.21.15.33:0/3250037681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c103cc0 0x7f630c1040a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6300009900 tx=0x7f630002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 -- 172.21.15.33:0/3250037681 shutdown_connections 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 --2- 172.21.15.33:0/3250037681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c10d120 0x7f630c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 --2- 172.21.15.33:0/3250037681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 0x7f630c10cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 --2- 172.21.15.33:0/3250037681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c103cc0 0x7f630c1040a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 -- 172.21.15.33:0/3250037681 >> 172.21.15.33:0/3250037681 conn(0x7f630c0fd700 msgr2=0x7f630c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 -- 172.21.15.33:0/3250037681 shutdown_connections 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.256+0000 7f6313600640 1 -- 172.21.15.33:0/3250037681 wait complete. 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.258+0000 7f6313600640 1 Processor -- start 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.258+0000 7f6313600640 1 -- start start 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.258+0000 7f6313600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6313600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 0x7f630c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6313600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c10d120 0x7f630c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6313600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112c40 con 0x7f630c10d120 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6313600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112ac0 con 0x7f630c1045e0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6313600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112dc0 con 0x7f630c103cc0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6310c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6311600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c10d120 0x7f630c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6310c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:48098/0 (socket says 172.21.15.33:48098) 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f6310c00640 1 -- 172.21.15.33:0/3787997501 learned_addr learned my addr 172.21.15.33:0/3787997501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.259+0000 7f630be00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 0x7f630c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 -- 172.21.15.33:0/3787997501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 msgr2=0x7f630c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 0x7f630c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 -- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c10d120 msgr2=0x7f630c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c10d120 0x7f630c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 -- 172.21.15.33:0/3787997501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630c1a1480 con 0x7f630c103cc0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6310c00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6300009230 tx=0x7f6300004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630003f030 con 0x7f630c103cc0 2024-09-10T23:55:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630c1a1710 con 0x7f630c103cc0 2024-09-10T23:55:42.888 INFO:teuthology.orchestra.run.smithi033.stdout:227633266743 2024-09-10T23:55:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6300003a80 con 0x7f630c103cc0 2024-09-10T23:55:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.260+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300035070 con 0x7f630c103cc0 2024-09-10T23:55:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.261+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630c1a7e30 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.262+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c1040a0 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.264+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f63000035f0 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.267+0000 7f6309600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 0x7f62f40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.267+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f6300106a20 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.267+0000 7f630be00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 0x7f62f40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.268+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f63000ccd90 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.268+0000 7f630be00640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 0x7f62f40b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f630c10f6c0 tx=0x7f62f800b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.475+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f630c1a8190 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.476+0000 7f6309600640 1 -- 172.21.15.33:0/3787997501 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f63000d17c0 con 0x7f630c103cc0 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 msgr2=0x7f62f40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 0x7f62f40b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f630c10f6c0 tx=0x7f62f800b360 comp rx=0 tx=0).stop 2024-09-10T23:55:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 msgr2=0x7f630c19b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6300009230 tx=0x7f6300004270 comp rx=0 tx=0).stop 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 shutdown_connections 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f62f40b5370 0x7f62f40b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f630c10d120 0x7f630c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f630c1045e0 0x7f630c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 --2- 172.21.15.33:0/3787997501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f630c103cc0 0x7f630c19b3d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 >> 172.21.15.33:0/3787997501 conn(0x7f630c0fd700 msgr2=0x7f630c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.478+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 shutdown_connections 2024-09-10T23:55:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:42.479+0000 7f6313600640 1 -- 172.21.15.33:0/3787997501 wait complete. 2024-09-10T23:55:43.264 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411419 got 77309411421 for osd.2 2024-09-10T23:55:43.265 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:43.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:43 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3393652726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:55:43.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:43 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3787997501' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:55:43.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3393652726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:55:43.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3787997501' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:55:43.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3393652726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T23:55:43.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3787997501' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T23:55:43.625 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462970 got 201863462974 for osd.7 2024-09-10T23:55:43.625 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:43.870 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:43.871 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:43.873 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:44.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:44 smithi033 ceph-mon[30593]: pgmap v403: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:55:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:44 smithi052 ceph-mon[33526]: pgmap v403: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:55:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:44 smithi189 ceph-mon[34000]: pgmap v403: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T23:55:44.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822726 got 154618822730 for osd.5 2024-09-10T23:55:44.872 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:45.022 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266741 got 227633266743 for osd.8 2024-09-10T23:55:45.022 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:46.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:46 smithi033 ceph-mon[30593]: pgmap v404: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 -- 172.21.15.33:0/3834805549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d4104430 msgr2=0x7f40d410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 --2- 172.21.15.33:0/3834805549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d4104430 0x7f40d410c920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009900 tx=0x7f40c002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 -- 172.21.15.33:0/3834805549 shutdown_connections 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 --2- 172.21.15.33:0/3834805549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d410cf70 0x7f40d410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 --2- 172.21.15.33:0/3834805549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d4104430 0x7f40d410c920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 --2- 172.21.15.33:0/3834805549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 0x7f40d4103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.443+0000 7f40db000640 1 -- 172.21.15.33:0/3834805549 >> 172.21.15.33:0/3834805549 conn(0x7f40d40fd5b0 msgr2=0x7f40d40ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.444+0000 7f40db000640 1 -- 172.21.15.33:0/3834805549 shutdown_connections 2024-09-10T23:55:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.444+0000 7f40db000640 1 -- 172.21.15.33:0/3834805549 wait complete. 2024-09-10T23:55:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 Processor -- start 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 -- start start 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 0x7f40d419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 0x7f40d419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4112a90 con 0x7f40d410cf70 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4112910 con 0x7f40d4104430 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40db000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4112c10 con 0x7f40d4103b10 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.445+0000 7f40da600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 0x7f40d419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34768/0 (socket says 172.21.15.33:34768) 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 0x7f40d419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49786/0 (socket says 172.21.15.33:49786) 2024-09-10T23:55:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 -- 172.21.15.33:0/205702598 learned_addr learned my addr 172.21.15.33:0/205702598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40d9c00640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 0x7f40d419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 -- 172.21.15.33:0/205702598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 msgr2=0x7f40d419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 0x7f40d419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 -- 172.21.15.33:0/205702598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 msgr2=0x7f40d419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 0x7f40d419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 -- 172.21.15.33:0/205702598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41a11f0 con 0x7f40d410cf70 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.446+0000 7f40da600640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00cce0 tx=0x7f40cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.447+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00f450 con 0x7f40d410cf70 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.447+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40cc00fa80 con 0x7f40d410cf70 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.447+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d41a14e0 con 0x7f40d410cf70 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.447+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc018ad0 con 0x7f40d410cf70 2024-09-10T23:55:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.447+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d41a7ba0 con 0x7f40d410cf70 2024-09-10T23:55:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.448+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d4103ef0 con 0x7f40d410cf70 2024-09-10T23:55:46.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:46 smithi052 ceph-mon[33526]: pgmap v404: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T23:55:46.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.451+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f40cc00f5f0 con 0x7f40d410cf70 2024-09-10T23:55:46.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.454+0000 7f40d2000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 0x7f40bc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.454+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f40cc0e68f0 con 0x7f40d410cf70 2024-09-10T23:55:46.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.454+0000 7f40d9c00640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 0x7f40bc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.455+0000 7f40d9c00640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 0x7f40bc0b7950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009bd0 tx=0x7f40c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:46.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.456+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f40cc014030 con 0x7f40d410cf70 2024-09-10T23:55:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:46 smithi189 ceph-mon[34000]: pgmap v404: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-10T23:55:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.666+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f40d41a7e60 con 0x7f40d410cf70 2024-09-10T23:55:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.667+0000 7f40d2000640 1 -- 172.21.15.33:0/205702598 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40cc0ad340 con 0x7f40d410cf70 2024-09-10T23:55:46.672 INFO:teuthology.orchestra.run.smithi033.stdout:55834574948 2024-09-10T23:55:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.669+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 msgr2=0x7f40bc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.669+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 0x7f40bc0b7950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009bd0 tx=0x7f40c8005f90 comp rx=0 tx=0).stop 2024-09-10T23:55:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.669+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 msgr2=0x7f40d41a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.669+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00cce0 tx=0x7f40cc00a620 comp rx=0 tx=0).stop 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.669+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 shutdown_connections 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40bc0b5490 0x7f40bc0b7950 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d410cf70 0x7f40d41a0a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40d4104430 0x7f40d419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 --2- 172.21.15.33:0/205702598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40d4103b10 0x7f40d419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 >> 172.21.15.33:0/205702598 conn(0x7f40d40fd5b0 msgr2=0x7f40d410f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 shutdown_connections 2024-09-10T23:55:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.670+0000 7f40db000640 1 -- 172.21.15.33:0/205702598 wait complete. 2024-09-10T23:55:46.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 -- 172.21.15.33:0/3519498602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 msgr2=0x7f25a0111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 --2- 172.21.15.33:0/3519498602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a0111b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2598009ca0 tx=0x7f259802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 -- 172.21.15.33:0/3519498602 shutdown_connections 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 --2- 172.21.15.33:0/3519498602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a0111b50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 --2- 172.21.15.33:0/3519498602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a010a9d0 0x7f25a010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 --2- 172.21.15.33:0/3519498602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a0104fc0 0x7f25a01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 -- 172.21.15.33:0/3519498602 >> 172.21.15.33:0/3519498602 conn(0x7f25a01009f0 msgr2=0x7f25a0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 -- 172.21.15.33:0/3519498602 shutdown_connections 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.658+0000 7f25a6800640 1 -- 172.21.15.33:0/3519498602 wait complete. 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 Processor -- start 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 -- start start 2024-09-10T23:55:46.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a010a9d0 0x7f25a019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a01a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0114e80 con 0x7f25a010b350 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0114d00 con 0x7f25a010a9d0 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.659+0000 7f25a6800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0115000 con 0x7f25a0104fc0 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f2597e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a010a9d0 0x7f25a019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:48150/0 (socket says 172.21.15.33:48150) 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 -- 172.21.15.33:0/1147102030 learned_addr learned my addr 172.21.15.33:0/1147102030 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259fe00640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a01a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 -- 172.21.15.33:0/1147102030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a010a9d0 msgr2=0x7f25a019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a010a9d0 0x7f25a019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 -- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 msgr2=0x7f25a01a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a01a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.660+0000 7f259f400640 1 -- 172.21.15.33:0/1147102030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a01a13c0 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f259f400640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f259000d950 tx=0x7f259000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590017030 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2590004020 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a01a16b0 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25900055d0 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.661+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01a7d70 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.662+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a01053a0 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.665+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2590009a30 con 0x7f25a0104fc0 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.666+0000 7f259cc00640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 0x7f25840b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:46.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.666+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f25900e6160 con 0x7f25a0104fc0 2024-09-10T23:55:46.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.666+0000 7f2597e00640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 0x7f25840b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:46.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.667+0000 7f2597e00640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 0x7f25840b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25a010a7e0 tx=0x7f258800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:46.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.668+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25900acb20 con 0x7f25a0104fc0 2024-09-10T23:55:46.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.869+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f25a010cba0 con 0x7f25a0104fc0 2024-09-10T23:55:46.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.870+0000 7f259cc00640 1 -- 172.21.15.33:0/1147102030 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f25900ac420 con 0x7f25a0104fc0 2024-09-10T23:55:46.872 INFO:teuthology.orchestra.run.smithi033.stdout:133143986257 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 msgr2=0x7f25840b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 0x7f25840b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25a010a7e0 tx=0x7f258800b390 comp rx=0 tx=0).stop 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 msgr2=0x7f25a019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f259000d950 tx=0x7f259000de10 comp rx=0 tx=0).stop 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 shutdown_connections 2024-09-10T23:55:46.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25840b5370 0x7f25840b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a010b350 0x7f25a01a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25a010a9d0 0x7f25a019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 --2- 172.21.15.33:0/1147102030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25a0104fc0 0x7f25a019b310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 >> 172.21.15.33:0/1147102030 conn(0x7f25a01009f0 msgr2=0x7f25a0102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 shutdown_connections 2024-09-10T23:55:46.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.872+0000 7f25a6800640 1 -- 172.21.15.33:0/1147102030 wait complete. 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3838728536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/205702598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1147102030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-10T23:55:47.420 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:47 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]} : dispatch 2024-09-10T23:55:47.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3838728536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:55:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/205702598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:55:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1147102030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:55:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:55:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-10T23:55:47.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:47 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]} : dispatch 2024-09-10T23:55:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3838728536' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T23:55:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/205702598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T23:55:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1147102030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T23:55:47.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-09-10T23:55:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-10T23:55:47.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:47 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]} : dispatch 2024-09-10T23:55:47.772 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574946 got 55834574948 for osd.1 2024-09-10T23:55:47.773 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 -- 172.21.15.33:0/840101149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 msgr2=0x7fa9300758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 --2- 172.21.15.33:0/840101149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa9300758a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa920009900 tx=0x7fa92002a410 comp rx=0 tx=0).stop 2024-09-10T23:55:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 -- 172.21.15.33:0/840101149 shutdown_connections 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 --2- 172.21.15.33:0/840101149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa930111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 --2- 172.21.15.33:0/840101149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 0x7fa93010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 --2- 172.21.15.33:0/840101149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa9300758a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 -- 172.21.15.33:0/840101149 >> 172.21.15.33:0/840101149 conn(0x7fa9300fe660 msgr2=0x7fa930100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 -- 172.21.15.33:0/840101149 shutdown_connections 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.417+0000 7fa936000640 1 -- 172.21.15.33:0/840101149 wait complete. 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.418+0000 7fa936000640 1 Processor -- start 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 -- start start 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 0x7fa93019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa9301a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa930114d00 con 0x7fa9300754c0 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa930114b80 con 0x7fa930075de0 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa936000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa930114e80 con 0x7fa93010f220 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa934c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa934c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34806/0 (socket says 172.21.15.33:34806) 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa934c00640 1 -- 172.21.15.33:0/3411355102 learned_addr learned my addr 172.21.15.33:0/3411355102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa927e00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 0x7fa93019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.419+0000 7fa935600640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa9301a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 -- 172.21.15.33:0/3411355102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 msgr2=0x7fa9301a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa9301a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 -- 172.21.15.33:0/3411355102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 msgr2=0x7fa93019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 0x7fa93019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 -- 172.21.15.33:0/3411355102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9301a11e0 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa935600640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa9301a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa934c00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa92002a930 tx=0x7fa920003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92003f070 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa920003e40 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9301a1470 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.420+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920035030 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.421+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301a7b90 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.422+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9300758a0 con 0x7fa9300754c0 2024-09-10T23:55:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.426+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa920031b90 con 0x7fa9300754c0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.427+0000 7fa92e000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 0x7fa9140b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.427+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9158+0+0 (secure 0 0 0) 0x7fa920106fb0 con 0x7fa9300754c0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.427+0000 7fa927e00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 0x7fa9140b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.428+0000 7fa927e00640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 0x7fa9140b78d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa930100ea0 tx=0x7fa91800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.429+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa9200cd910 con 0x7fa9300754c0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.626+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9301a7df0 con 0x7fa9300754c0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.626+0000 7fa92e000640 1 -- 172.21.15.33:0/3411355102 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9200cd210 con 0x7fa9300754c0 2024-09-10T23:55:47.901 INFO:teuthology.orchestra.run.smithi033.stdout:34359738474 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.628+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 msgr2=0x7fa9140b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.628+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 0x7fa9140b78d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa930100ea0 tx=0x7fa91800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.628+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 msgr2=0x7fa93019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.628+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa92002a930 tx=0x7fa920003c20 comp rx=0 tx=0).stop 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 shutdown_connections 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa9140b5410 0x7fa9140b78d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa93010f220 0x7fa9301a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa930075de0 0x7fa93019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 --2- 172.21.15.33:0/3411355102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9300754c0 0x7fa93019b130 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 >> 172.21.15.33:0/3411355102 conn(0x7fa9300fe660 msgr2=0x7fa9300feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 shutdown_connections 2024-09-10T23:55:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:47.629+0000 7fa936000640 1 -- 172.21.15.33:0/3411355102 wait complete. 2024-09-10T23:55:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3411355102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:55:48.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:48 smithi052 ceph-mon[33526]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:55:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T23:55:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:55:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-10T23:55:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T23:55:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:55:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3411355102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:55:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:48 smithi033 ceph-mon[30593]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:55:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-10T23:55:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T23:55:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-10T23:55:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-10T23:55:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T23:55:48.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3411355102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T23:55:48.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:48 smithi189 ceph-mon[34000]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T23:55:48.890 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738469 got 34359738474 for osd.0 2024-09-10T23:55:48.890 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:49.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986254 got 133143986257 for osd.4 2024-09-10T23:55:49.376 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 -- 172.21.15.33:0/2340546688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20113990 msgr2=0x7f1a20115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 --2- 172.21.15.33:0/2340546688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20113990 0x7f1a20115d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009ca0 tx=0x7f1a1802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 -- 172.21.15.33:0/2340546688 shutdown_connections 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 --2- 172.21.15.33:0/2340546688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20113990 0x7f1a20115d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 --2- 172.21.15.33:0/2340546688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20077ff0 0x7f1a20113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 --2- 172.21.15.33:0/2340546688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 0x7f1a20077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 -- 172.21.15.33:0/2340546688 >> 172.21.15.33:0/2340546688 conn(0x7f1a20100a50 msgr2=0x7f1a20102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.292+0000 7f1a24c00640 1 -- 172.21.15.33:0/2340546688 shutdown_connections 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.293+0000 7f1a24c00640 1 -- 172.21.15.33:0/2340546688 wait complete. 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.293+0000 7f1a24c00640 1 Processor -- start 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.293+0000 7f1a24c00640 1 -- start start 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 0x7f1a2019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20113990 0x7f1a201a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20119270 con 0x7f1a20077ff0 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a201190f0 con 0x7f1a200776d0 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a24c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a201193f0 con 0x7f1a20113990 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a1d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a1d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34752/0 (socket says 172.21.15.33:34752) 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a1d400640 1 -- 172.21.15.33:0/3838728536 learned_addr learned my addr 172.21.15.33:0/3838728536 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a1de00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 0x7f1a2019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.294+0000 7f1a1e800640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20113990 0x7f1a201a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 -- 172.21.15.33:0/3838728536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20113990 msgr2=0x7f1a201a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20113990 0x7f1a201a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 -- 172.21.15.33:0/3838728536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 msgr2=0x7f1a2019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 0x7f1a2019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 -- 172.21.15.33:0/3838728536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201a5850 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a1d400640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e9f0 tx=0x7f1a0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00cd80 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a0c0054b0 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c010430 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a201a5b40 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.295+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201ac200 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.296+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a20077ab0 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.302+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f1a0c005000 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.303+0000 7f1a16a00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 0x7f1a040b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.303+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9071+0+0 (secure 0 0 0) 0x7f1a0c0e6640 con 0x7f1a20077ff0 2024-09-10T23:55:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.303+0000 7f1a1de00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 0x7f1a040b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:49.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.304+0000 7f1a1de00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 0x7f1a040b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005d00 tx=0x7f1a1000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:49.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.304+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1a0c056220 con 0x7f1a20077ff0 2024-09-10T23:55:49.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.510+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1a201ac630 con 0x7f1a20077ff0 2024-09-10T23:55:49.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.511+0000 7f1a16a00640 1 -- 172.21.15.33:0/3838728536 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1a0c0ad000 con 0x7f1a20077ff0 2024-09-10T23:55:49.539 INFO:teuthology.orchestra.run.smithi033.stdout:180388626499 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 msgr2=0x7f1a040b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 0x7f1a040b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1a10005d00 tx=0x7f1a1000b410 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 msgr2=0x7f1a2019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e9f0 tx=0x7f1a0c00edf0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 shutdown_connections 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1a040b53f0 0x7f1a040b78b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a20113990 0x7f1a201a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a20077ff0 0x7f1a2019fce0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 --2- 172.21.15.33:0/3838728536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a200776d0 0x7f1a2019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.513+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 >> 172.21.15.33:0/3838728536 conn(0x7f1a20100a50 msgr2=0x7f1a20102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.514+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 shutdown_connections 2024-09-10T23:55:49.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:46.514+0000 7f1a24c00640 1 -- 172.21.15.33:0/3838728536 wait complete. 2024-09-10T23:55:50.394 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:50 smithi033 ceph-mon[30593]: pgmap v408: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:50.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626497 got 180388626499 for osd.6 2024-09-10T23:55:50.433 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:50.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:50 smithi052 ceph-mon[33526]: pgmap v408: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:50 smithi189 ceph-mon[34000]: pgmap v408: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 -- 172.21.15.33:0/2580911029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 msgr2=0x7f2570103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 --2- 172.21.15.33:0/2580911029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f2570103180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2564009900 tx=0x7f256402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 -- 172.21.15.33:0/2580911029 shutdown_connections 2024-09-10T23:55:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 --2- 172.21.15.33:0/2580911029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2570109130 0x7f257010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 --2- 172.21.15.33:0/2580911029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25701087b0 0x7f2570108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 --2- 172.21.15.33:0/2580911029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f2570103180 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.699+0000 7f2578400640 1 -- 172.21.15.33:0/2580911029 >> 172.21.15.33:0/2580911029 conn(0x7f25700fe810 msgr2=0x7f2570100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.700+0000 7f2578400640 1 -- 172.21.15.33:0/2580911029 shutdown_connections 2024-09-10T23:55:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.700+0000 7f2578400640 1 -- 172.21.15.33:0/2580911029 wait complete. 2024-09-10T23:55:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 Processor -- start 2024-09-10T23:55:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 -- start start 2024-09-10T23:55:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 0x7f25700759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2570109130 0x7f2570075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2570112cb0 con 0x7f2570102da0 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2570112b30 con 0x7f2570109130 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2578400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2570112e30 con 0x7f25701087b0 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2575a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.701+0000 7f2575a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34818/0 (socket says 172.21.15.33:34818) 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 -- 172.21.15.33:0/2390254756 learned_addr learned my addr 172.21.15.33:0/2390254756 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575000640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 0x7f25700759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2576400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2570109130 0x7f2570075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 -- 172.21.15.33:0/2390254756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 msgr2=0x7f25700759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 0x7f25700759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 -- 172.21.15.33:0/2390254756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2570109130 msgr2=0x7f2570075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2570109130 0x7f2570075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 -- 172.21.15.33:0/2390254756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25701a74e0 con 0x7f2570102da0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575000640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 0x7f25700759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.702+0000 7f2575a00640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f256402a910 tx=0x7f2564003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.703+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256403f070 con 0x7f2570102da0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.703+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f256403bdc0 con 0x7f2570102da0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.703+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25701a7770 con 0x7f2570102da0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.703+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564035030 con 0x7f2570102da0 2024-09-10T23:55:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.703+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25701a7c50 con 0x7f2570102da0 2024-09-10T23:55:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.704+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2570103180 con 0x7f2570102da0 2024-09-10T23:55:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.706+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2564031500 con 0x7f2570102da0 2024-09-10T23:55:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.707+0000 7f256e000640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 0x7f25580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.708+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f2564107330 con 0x7f2570102da0 2024-09-10T23:55:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.708+0000 7f2575000640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 0x7f25580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.708+0000 7f2575000640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 0x7f25580b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2570076f90 tx=0x7f255c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.709+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25640cdd20 con 0x7f2570102da0 2024-09-10T23:55:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.907+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f257002e5c0 con 0x7f2570102da0 2024-09-10T23:55:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.908+0000 7f256e000640 1 -- 172.21.15.33:0/2390254756 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f25640cd620 con 0x7f2570102da0 2024-09-10T23:55:50.910 INFO:teuthology.orchestra.run.smithi033.stdout:253403070514 2024-09-10T23:55:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 msgr2=0x7f25580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 0x7f25580b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2570076f90 tx=0x7f255c00a5c0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 msgr2=0x7f25700754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f256402a910 tx=0x7f2564003d60 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 shutdown_connections 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25580b5370 0x7f25580b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2570109130 0x7f2570075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25701087b0 0x7f25700759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 --2- 172.21.15.33:0/2390254756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570102da0 0x7f25700754a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 >> 172.21.15.33:0/2390254756 conn(0x7f25700fe810 msgr2=0x7f2570100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 shutdown_connections 2024-09-10T23:55:50.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:50.910+0000 7f2578400640 1 -- 172.21.15.33:0/2390254756 wait complete. 2024-09-10T23:55:51.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:51 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2390254756' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:55:51.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:51 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2390254756' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:55:51.699 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070510 got 253403070514 for osd.9 2024-09-10T23:55:51.699 DEBUG:teuthology.parallel:result is None 2024-09-10T23:55:51.699 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:55:51.700 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:55:51.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:51 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2390254756' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T23:55:52.079 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:52 smithi033 ceph-mon[30593]: pgmap v409: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:52 smithi189 ceph-mon[34000]: pgmap v409: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:52 smithi052 ceph-mon[33526]: pgmap v409: 129 pgs: 129 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:55:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 -- 172.21.15.33:0/358620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f24104fa0 msgr2=0x7f7f24105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:52.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 --2- 172.21.15.33:0/358620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f24104fa0 0x7f7f24105380 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009900 tx=0x7f7f1402a410 comp rx=0 tx=0).stop 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 -- 172.21.15.33:0/358620568 shutdown_connections 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 --2- 172.21.15.33:0/358620568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410b330 0x7f7f24111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 --2- 172.21.15.33:0/358620568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2410a9b0 0x7f7f2410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 --2- 172.21.15.33:0/358620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f24104fa0 0x7f7f24105380 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 -- 172.21.15.33:0/358620568 >> 172.21.15.33:0/358620568 conn(0x7f7f24100a50 msgr2=0x7f7f24102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 -- 172.21.15.33:0/358620568 shutdown_connections 2024-09-10T23:55:52.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.723+0000 7f7f29a00640 1 -- 172.21.15.33:0/358620568 wait complete. 2024-09-10T23:55:52.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.724+0000 7f7f29a00640 1 Processor -- start 2024-09-10T23:55:52.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.724+0000 7f7f29a00640 1 -- start start 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.724+0000 7f7f29a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.724+0000 7f7f29a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410a9b0 0x7f7f2419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f29a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 0x7f7f241a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f29a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24114e60 con 0x7f7f2410b330 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f29a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24114ce0 con 0x7f7f24104fa0 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f29a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24114fe0 con 0x7f7f2410a9b0 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f22a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f22a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51384/0 (socket says 172.21.15.33:51384) 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f22a00640 1 -- 172.21.15.33:0/2305969022 learned_addr learned my addr 172.21.15.33:0/2305969022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f22000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410a9b0 0x7f7f2419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f23400640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 0x7f7f241a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f23400640 1 -- 172.21.15.33:0/2305969022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410a9b0 msgr2=0x7f7f2419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f23400640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410a9b0 0x7f7f2419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f23400640 1 -- 172.21.15.33:0/2305969022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 msgr2=0x7f7f2419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.725+0000 7f7f23400640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f23400640 1 -- 172.21.15.33:0/2305969022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f241a1520 con 0x7f7f2410b330 2024-09-10T23:55:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f22a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f23400640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 0x7f7f241a0d50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e940 tx=0x7f7f1c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c004d20 con 0x7f7f2410b330 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f1c005020 con 0x7f7f2410b330 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0116d0 con 0x7f7f2410b330 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f241a1810 con 0x7f7f2410b330 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.726+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f241a7ed0 con 0x7f7f2410b330 2024-09-10T23:55:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.728+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f24105380 con 0x7f7f2410b330 2024-09-10T23:55:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.730+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7f1c00f040 con 0x7f7f2410b330 2024-09-10T23:55:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.731+0000 7f7f1b400640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 0x7f7f080b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.732+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f7f1c0e6080 con 0x7f7f2410b330 2024-09-10T23:55:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.732+0000 7f7f22a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 0x7f7f080b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.732+0000 7f7f22a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 0x7f7f080b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f140096c0 tx=0x7f7f14005e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.733+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7f1c016030 con 0x7f7f2410b330 2024-09-10T23:55:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.928+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f24063590 con 0x7f7f080b53f0 2024-09-10T23:55:52.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.934+0000 7f7f1b400640 1 -- 172.21.15.33:0/2305969022 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340651 (secure 0 0 0) 0x7f7f24063590 con 0x7f7f080b53f0 2024-09-10T23:55:52.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:52.943 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:55:52.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 msgr2=0x7f7f080b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:52.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 0x7f7f080b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7f140096c0 tx=0x7f7f14005e60 comp rx=0 tx=0).stop 2024-09-10T23:55:52.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 msgr2=0x7f7f241a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:52.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 0x7f7f241a0d50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e940 tx=0x7f7f1c00ee00 comp rx=0 tx=0).stop 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 shutdown_connections 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f080b53f0 0x7f7f080b78b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f2410b330 0x7f7f241a0d50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f2410a9b0 0x7f7f2419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 --2- 172.21.15.33:0/2305969022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f24104fa0 0x7f7f2419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.938+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 >> 172.21.15.33:0/2305969022 conn(0x7f7f24100a50 msgr2=0x7f7f241014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.939+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 shutdown_connections 2024-09-10T23:55:52.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:52.939+0000 7f7f29a00640 1 -- 172.21.15.33:0/2305969022 wait complete. 2024-09-10T23:55:53.848 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-09-10T23:55:52.807296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":491,"num_read_kb":339,"num_write":297,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361004,"kb_used_data":11672,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580820,"statfs":{"total":1151940427776,"available":1151570759680,"internally_reserved":0,"allocated":11952128,"data_stored":7920760,"data_compressed":460022,"data_compressed_allocated":622592,"data_compressed_original":2744320,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002476"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195900+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:55:48.195900+0000","last_peered":"2024-09-10T23:55:48.195900+0000","last_clean":"2024-09-10T23:55:48.195900+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:55:48.195900+0000","last_undegraded":"2024-09-10T23:55:48.195900+0000","last_fullsized":"2024-09-10T23:55:48.195900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190899+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:55:47.190899+0000","last_peered":"2024-09-10T23:55:47.190899+0000","last_clean":"2024-09-10T23:55:47.190899+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:55:47.190899+0000","last_undegraded":"2024-09-10T23:55:47.190899+0000","last_fullsized":"2024-09-10T23:55:47.190899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431669+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:55:48.431669+0000","last_peered":"2024-09-10T23:55:48.431669+0000","last_clean":"2024-09-10T23:55:48.431669+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:55:48.431669+0000","last_undegraded":"2024-09-10T23:55:48.431669+0000","last_fullsized":"2024-09-10T23:55:48.431669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.191384+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:55:47.191384+0000","last_peered":"2024-09-10T23:55:47.191384+0000","last_clean":"2024-09-10T23:55:47.191384+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:55:47.191384+0000","last_undegraded":"2024-09-10T23:55:47.191384+0000","last_fullsized":"2024-09-10T23:55:47.191384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192983+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:55:48.192983+0000","last_peered":"2024-09-10T23:55:48.192983+0000","last_clean":"2024-09-10T23:55:48.192983+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:55:48.192983+0000","last_undegraded":"2024-09-10T23:55:48.192983+0000","last_fullsized":"2024-09-10T23:55:48.192983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191171+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:55:48.191171+0000","last_peered":"2024-09-10T23:55:48.191171+0000","last_clean":"2024-09-10T23:55:48.191171+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:55:48.191171+0000","last_undegraded":"2024-09-10T23:55:48.191171+0000","last_fullsized":"2024-09-10T23:55:48.191171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433246+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:55:48.433246+0000","last_peered":"2024-09-10T23:55:48.433246+0000","last_clean":"2024-09-10T23:55:48.433246+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:55:48.433246+0000","last_undegraded":"2024-09-10T23:55:48.433246+0000","last_fullsized":"2024-09-10T23:55:48.433246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389333+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:55:48.389333+0000","last_peered":"2024-09-10T23:55:48.389333+0000","last_clean":"2024-09-10T23:55:48.389333+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:55:48.389333+0000","last_undegraded":"2024-09-10T23:55:48.389333+0000","last_fullsized":"2024-09-10T23:55:48.389333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191609+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:55:48.191609+0000","last_peered":"2024-09-10T23:55:48.191609+0000","last_clean":"2024-09-10T23:55:48.191609+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:55:48.191609+0000","last_undegraded":"2024-09-10T23:55:48.191609+0000","last_fullsized":"2024-09-10T23:55:48.191609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192011+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:55:48.192011+0000","last_peered":"2024-09-10T23:55:48.192011+0000","last_clean":"2024-09-10T23:55:48.192011+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:55:48.192011+0000","last_undegraded":"2024-09-10T23:55:48.192011+0000","last_fullsized":"2024-09-10T23:55:48.192011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432596+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:55:48.432596+0000","last_peered":"2024-09-10T23:55:48.432596+0000","last_clean":"2024-09-10T23:55:48.432596+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:55:48.432596+0000","last_undegraded":"2024-09-10T23:55:48.432596+0000","last_fullsized":"2024-09-10T23:55:48.432596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191237+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:55:48.191237+0000","last_peered":"2024-09-10T23:55:48.191237+0000","last_clean":"2024-09-10T23:55:48.191237+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:55:48.191237+0000","last_undegraded":"2024-09-10T23:55:48.191237+0000","last_fullsized":"2024-09-10T23:55:48.191237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196646+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:55:48.196646+0000","last_peered":"2024-09-10T23:55:48.196646+0000","last_clean":"2024-09-10T23:55:48.196646+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:55:48.196646+0000","last_undegraded":"2024-09-10T23:55:48.196646+0000","last_fullsized":"2024-09-10T23:55:48.196646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191511+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:55:48.191511+0000","last_peered":"2024-09-10T23:55:48.191511+0000","last_clean":"2024-09-10T23:55:48.191511+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:55:48.191511+0000","last_undegraded":"2024-09-10T23:55:48.191511+0000","last_fullsized":"2024-09-10T23:55:48.191511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191666+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:55:48.191666+0000","last_peered":"2024-09-10T23:55:48.191666+0000","last_clean":"2024-09-10T23:55:48.191666+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:55:48.191666+0000","last_undegraded":"2024-09-10T23:55:48.191666+0000","last_fullsized":"2024-09-10T23:55:48.191666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.191016+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:55:47.191016+0000","last_peered":"2024-09-10T23:55:47.191016+0000","last_clean":"2024-09-10T23:55:47.191016+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:55:47.191016+0000","last_undegraded":"2024-09-10T23:55:47.191016+0000","last_fullsized":"2024-09-10T23:55:47.191016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431886+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:55:48.431886+0000","last_peered":"2024-09-10T23:55:48.431886+0000","last_clean":"2024-09-10T23:55:48.431886+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:55:48.431886+0000","last_undegraded":"2024-09-10T23:55:48.431886+0000","last_fullsized":"2024-09-10T23:55:48.431886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191666+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:55:48.191666+0000","last_peered":"2024-09-10T23:55:48.191666+0000","last_clean":"2024-09-10T23:55:48.191666+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:55:48.191666+0000","last_undegraded":"2024-09-10T23:55:48.191666+0000","last_fullsized":"2024-09-10T23:55:48.191666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432485+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:55:48.432485+0000","last_peered":"2024-09-10T23:55:48.432485+0000","last_clean":"2024-09-10T23:55:48.432485+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:55:48.432485+0000","last_undegraded":"2024-09-10T23:55:48.432485+0000","last_fullsized":"2024-09-10T23:55:48.432485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190818+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:55:47.190818+0000","last_peered":"2024-09-10T23:55:47.190818+0000","last_clean":"2024-09-10T23:55:47.190818+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:55:47.190818+0000","last_undegraded":"2024-09-10T23:55:47.190818+0000","last_fullsized":"2024-09-10T23:55:47.190818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195709+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:55:48.195709+0000","last_peered":"2024-09-10T23:55:48.195709+0000","last_clean":"2024-09-10T23:55:48.195709+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:55:48.195709+0000","last_undegraded":"2024-09-10T23:55:48.195709+0000","last_fullsized":"2024-09-10T23:55:48.195709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191419+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:55:48.191419+0000","last_peered":"2024-09-10T23:55:48.191419+0000","last_clean":"2024-09-10T23:55:48.191419+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:55:48.191419+0000","last_undegraded":"2024-09-10T23:55:48.191419+0000","last_fullsized":"2024-09-10T23:55:48.191419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389127+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:55:48.389127+0000","last_peered":"2024-09-10T23:55:48.389127+0000","last_clean":"2024-09-10T23:55:48.389127+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:55:48.389127+0000","last_undegraded":"2024-09-10T23:55:48.389127+0000","last_fullsized":"2024-09-10T23:55:48.389127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191745+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:55:48.191745+0000","last_peered":"2024-09-10T23:55:48.191745+0000","last_clean":"2024-09-10T23:55:48.191745+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:55:48.191745+0000","last_undegraded":"2024-09-10T23:55:48.191745+0000","last_fullsized":"2024-09-10T23:55:48.191745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193132+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:55:48.193132+0000","last_peered":"2024-09-10T23:55:48.193132+0000","last_clean":"2024-09-10T23:55:48.193132+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:55:48.193132+0000","last_undegraded":"2024-09-10T23:55:48.193132+0000","last_fullsized":"2024-09-10T23:55:48.193132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192097+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:55:48.192097+0000","last_peered":"2024-09-10T23:55:48.192097+0000","last_clean":"2024-09-10T23:55:48.192097+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:55:48.192097+0000","last_undegraded":"2024-09-10T23:55:48.192097+0000","last_fullsized":"2024-09-10T23:55:48.192097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431813+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:55:48.431813+0000","last_peered":"2024-09-10T23:55:48.431813+0000","last_clean":"2024-09-10T23:55:48.431813+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:55:48.431813+0000","last_undegraded":"2024-09-10T23:55:48.431813+0000","last_fullsized":"2024-09-10T23:55:48.431813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.191654+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:55:47.191654+0000","last_peered":"2024-09-10T23:55:47.191654+0000","last_clean":"2024-09-10T23:55:47.191654+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:55:47.191654+0000","last_undegraded":"2024-09-10T23:55:47.191654+0000","last_fullsized":"2024-09-10T23:55:47.191654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195765+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:55:48.195765+0000","last_peered":"2024-09-10T23:55:48.195765+0000","last_clean":"2024-09-10T23:55:48.195765+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:55:48.195765+0000","last_undegraded":"2024-09-10T23:55:48.195765+0000","last_fullsized":"2024-09-10T23:55:48.195765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190397+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:55:47.190397+0000","last_peered":"2024-09-10T23:55:47.190397+0000","last_clean":"2024-09-10T23:55:47.190397+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:55:47.190397+0000","last_undegraded":"2024-09-10T23:55:47.190397+0000","last_fullsized":"2024-09-10T23:55:47.190397+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228531+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:55:48.228531+0000","last_peered":"2024-09-10T23:55:48.228531+0000","last_clean":"2024-09-10T23:55:48.228531+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:55:48.228531+0000","last_undegraded":"2024-09-10T23:55:48.228531+0000","last_fullsized":"2024-09-10T23:55:48.228531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191941+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:55:48.191941+0000","last_peered":"2024-09-10T23:55:48.191941+0000","last_clean":"2024-09-10T23:55:48.191941+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:55:48.191941+0000","last_undegraded":"2024-09-10T23:55:48.191941+0000","last_fullsized":"2024-09-10T23:55:48.191941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433123+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:55:48.433123+0000","last_peered":"2024-09-10T23:55:48.433123+0000","last_clean":"2024-09-10T23:55:48.433123+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:55:48.433123+0000","last_undegraded":"2024-09-10T23:55:48.433123+0000","last_fullsized":"2024-09-10T23:55:48.433123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194207+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:55:48.194207+0000","last_peered":"2024-09-10T23:55:48.194207+0000","last_clean":"2024-09-10T23:55:48.194207+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:55:48.194207+0000","last_undegraded":"2024-09-10T23:55:48.194207+0000","last_fullsized":"2024-09-10T23:55:48.194207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195409+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:55:48.195409+0000","last_peered":"2024-09-10T23:55:48.195409+0000","last_clean":"2024-09-10T23:55:48.195409+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:55:48.195409+0000","last_undegraded":"2024-09-10T23:55:48.195409+0000","last_fullsized":"2024-09-10T23:55:48.195409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191518+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:55:48.191518+0000","last_peered":"2024-09-10T23:55:48.191518+0000","last_clean":"2024-09-10T23:55:48.191518+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:55:48.191518+0000","last_undegraded":"2024-09-10T23:55:48.191518+0000","last_fullsized":"2024-09-10T23:55:48.191518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194288+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:55:48.194288+0000","last_peered":"2024-09-10T23:55:48.194288+0000","last_clean":"2024-09-10T23:55:48.194288+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:55:48.194288+0000","last_undegraded":"2024-09-10T23:55:48.194288+0000","last_fullsized":"2024-09-10T23:55:48.194288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196736+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:55:48.196736+0000","last_peered":"2024-09-10T23:55:48.196736+0000","last_clean":"2024-09-10T23:55:48.196736+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:55:48.196736+0000","last_undegraded":"2024-09-10T23:55:48.196736+0000","last_fullsized":"2024-09-10T23:55:48.196736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228412+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:55:48.228412+0000","last_peered":"2024-09-10T23:55:48.228412+0000","last_clean":"2024-09-10T23:55:48.228412+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:55:48.228412+0000","last_undegraded":"2024-09-10T23:55:48.228412+0000","last_fullsized":"2024-09-10T23:55:48.228412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432026+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:55:48.432026+0000","last_peered":"2024-09-10T23:55:48.432026+0000","last_clean":"2024-09-10T23:55:48.432026+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:55:48.432026+0000","last_undegraded":"2024-09-10T23:55:48.432026+0000","last_fullsized":"2024-09-10T23:55:48.432026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":110,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228386+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:55:48.228386+0000","last_peered":"2024-09-10T23:55:48.228386+0000","last_clean":"2024-09-10T23:55:48.228386+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:55:48.228386+0000","last_undegraded":"2024-09-10T23:55:48.228386+0000","last_fullsized":"2024-09-10T23:55:48.228386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228754+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:55:48.228754+0000","last_peered":"2024-09-10T23:55:48.228754+0000","last_clean":"2024-09-10T23:55:48.228754+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:55:48.228754+0000","last_undegraded":"2024-09-10T23:55:48.228754+0000","last_fullsized":"2024-09-10T23:55:48.228754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228178+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:55:48.228178+0000","last_peered":"2024-09-10T23:55:48.228178+0000","last_clean":"2024-09-10T23:55:48.228178+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:55:48.228178+0000","last_undegraded":"2024-09-10T23:55:48.228178+0000","last_fullsized":"2024-09-10T23:55:48.228178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196282+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:55:48.196282+0000","last_peered":"2024-09-10T23:55:48.196282+0000","last_clean":"2024-09-10T23:55:48.196282+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:55:48.196282+0000","last_undegraded":"2024-09-10T23:55:48.196282+0000","last_fullsized":"2024-09-10T23:55:48.196282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191644+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:55:48.191644+0000","last_peered":"2024-09-10T23:55:48.191644+0000","last_clean":"2024-09-10T23:55:48.191644+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:55:48.191644+0000","last_undegraded":"2024-09-10T23:55:48.191644+0000","last_fullsized":"2024-09-10T23:55:48.191644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.435207+0000","last_change":"2024-09-10T23:55:48.434804+0000","last_active":"2024-09-10T23:55:48.435207+0000","last_peered":"2024-09-10T23:55:48.435207+0000","last_clean":"2024-09-10T23:55:48.435207+0000","last_became_active":"2024-09-10T23:55:48.434451+0000","last_became_peered":"2024-09-10T23:55:48.434451+0000","last_unstale":"2024-09-10T23:55:48.435207+0000","last_undegraded":"2024-09-10T23:55:48.435207+0000","last_fullsized":"2024-09-10T23:55:48.435207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.587382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191841+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:55:48.191841+0000","last_peered":"2024-09-10T23:55:48.191841+0000","last_clean":"2024-09-10T23:55:48.191841+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:55:48.191841+0000","last_undegraded":"2024-09-10T23:55:48.191841+0000","last_fullsized":"2024-09-10T23:55:48.191841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196441+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:55:48.196441+0000","last_peered":"2024-09-10T23:55:48.196441+0000","last_clean":"2024-09-10T23:55:48.196441+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:55:48.196441+0000","last_undegraded":"2024-09-10T23:55:48.196441+0000","last_fullsized":"2024-09-10T23:55:48.196441+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197128+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:55:48.197128+0000","last_peered":"2024-09-10T23:55:48.197128+0000","last_clean":"2024-09-10T23:55:48.197128+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:55:48.197128+0000","last_undegraded":"2024-09-10T23:55:48.197128+0000","last_fullsized":"2024-09-10T23:55:48.197128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197281+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:55:48.197281+0000","last_peered":"2024-09-10T23:55:48.197281+0000","last_clean":"2024-09-10T23:55:48.197281+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:55:48.197281+0000","last_undegraded":"2024-09-10T23:55:48.197281+0000","last_fullsized":"2024-09-10T23:55:48.197281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432299+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:55:48.432299+0000","last_peered":"2024-09-10T23:55:48.432299+0000","last_clean":"2024-09-10T23:55:48.432299+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:55:48.432299+0000","last_undegraded":"2024-09-10T23:55:48.432299+0000","last_fullsized":"2024-09-10T23:55:48.432299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389171+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:55:48.389171+0000","last_peered":"2024-09-10T23:55:48.389171+0000","last_clean":"2024-09-10T23:55:48.389171+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:55:48.389171+0000","last_undegraded":"2024-09-10T23:55:48.389171+0000","last_fullsized":"2024-09-10T23:55:48.389171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197094+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:55:48.197094+0000","last_peered":"2024-09-10T23:55:48.197094+0000","last_clean":"2024-09-10T23:55:48.197094+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:55:48.197094+0000","last_undegraded":"2024-09-10T23:55:48.197094+0000","last_fullsized":"2024-09-10T23:55:48.197094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432795+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:55:48.432795+0000","last_peered":"2024-09-10T23:55:48.432795+0000","last_clean":"2024-09-10T23:55:48.432795+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:55:48.432795+0000","last_undegraded":"2024-09-10T23:55:48.432795+0000","last_fullsized":"2024-09-10T23:55:48.432795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192840+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:55:48.192840+0000","last_peered":"2024-09-10T23:55:48.192840+0000","last_clean":"2024-09-10T23:55:48.192840+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:55:48.192840+0000","last_undegraded":"2024-09-10T23:55:48.192840+0000","last_fullsized":"2024-09-10T23:55:48.192840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197335+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:55:48.197335+0000","last_peered":"2024-09-10T23:55:48.197335+0000","last_clean":"2024-09-10T23:55:48.197335+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:55:48.197335+0000","last_undegraded":"2024-09-10T23:55:48.197335+0000","last_fullsized":"2024-09-10T23:55:48.197335+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228788+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:55:48.228788+0000","last_peered":"2024-09-10T23:55:48.228788+0000","last_clean":"2024-09-10T23:55:48.228788+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:55:48.228788+0000","last_undegraded":"2024-09-10T23:55:48.228788+0000","last_fullsized":"2024-09-10T23:55:48.228788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431708+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:55:48.431708+0000","last_peered":"2024-09-10T23:55:48.431708+0000","last_clean":"2024-09-10T23:55:48.431708+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:55:48.431708+0000","last_undegraded":"2024-09-10T23:55:48.431708+0000","last_fullsized":"2024-09-10T23:55:48.431708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433848+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:55:48.433848+0000","last_peered":"2024-09-10T23:55:48.433848+0000","last_clean":"2024-09-10T23:55:48.433848+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:55:48.433848+0000","last_undegraded":"2024-09-10T23:55:48.433848+0000","last_fullsized":"2024-09-10T23:55:48.433848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433955+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:55:48.433955+0000","last_peered":"2024-09-10T23:55:48.433955+0000","last_clean":"2024-09-10T23:55:48.433955+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:55:48.433955+0000","last_undegraded":"2024-09-10T23:55:48.433955+0000","last_fullsized":"2024-09-10T23:55:48.433955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432622+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:55:48.432622+0000","last_peered":"2024-09-10T23:55:48.432622+0000","last_clean":"2024-09-10T23:55:48.432622+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:55:48.432622+0000","last_undegraded":"2024-09-10T23:55:48.432622+0000","last_fullsized":"2024-09-10T23:55:48.432622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432444+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:55:48.432444+0000","last_peered":"2024-09-10T23:55:48.432444+0000","last_clean":"2024-09-10T23:55:48.432444+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:55:48.432444+0000","last_undegraded":"2024-09-10T23:55:48.432444+0000","last_fullsized":"2024-09-10T23:55:48.432444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191447+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:55:48.191447+0000","last_peered":"2024-09-10T23:55:48.191447+0000","last_clean":"2024-09-10T23:55:48.191447+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:55:48.191447+0000","last_undegraded":"2024-09-10T23:55:48.191447+0000","last_fullsized":"2024-09-10T23:55:48.191447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228787+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:55:48.228787+0000","last_peered":"2024-09-10T23:55:48.228787+0000","last_clean":"2024-09-10T23:55:48.228787+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:55:48.228787+0000","last_undegraded":"2024-09-10T23:55:48.228787+0000","last_fullsized":"2024-09-10T23:55:48.228787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196218+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:55:48.196218+0000","last_peered":"2024-09-10T23:55:48.196218+0000","last_clean":"2024-09-10T23:55:48.196218+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:55:48.196218+0000","last_undegraded":"2024-09-10T23:55:48.196218+0000","last_fullsized":"2024-09-10T23:55:48.196218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089796+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:55:50.089796+0000","last_peered":"2024-09-10T23:55:50.089796+0000","last_clean":"2024-09-10T23:55:50.089796+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:55:50.089796+0000","last_undegraded":"2024-09-10T23:55:50.089796+0000","last_fullsized":"2024-09-10T23:55:50.089796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195743+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:55:48.195743+0000","last_peered":"2024-09-10T23:55:48.195743+0000","last_clean":"2024-09-10T23:55:48.195743+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:55:48.195743+0000","last_undegraded":"2024-09-10T23:55:48.195743+0000","last_fullsized":"2024-09-10T23:55:48.195743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196901+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:55:48.196901+0000","last_peered":"2024-09-10T23:55:48.196901+0000","last_clean":"2024-09-10T23:55:48.196901+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:55:48.196901+0000","last_undegraded":"2024-09-10T23:55:48.196901+0000","last_fullsized":"2024-09-10T23:55:48.196901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431781+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:55:48.431781+0000","last_peered":"2024-09-10T23:55:48.431781+0000","last_clean":"2024-09-10T23:55:48.431781+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:55:48.431781+0000","last_undegraded":"2024-09-10T23:55:48.431781+0000","last_fullsized":"2024-09-10T23:55:48.431781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433330+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:55:48.433330+0000","last_peered":"2024-09-10T23:55:48.433330+0000","last_clean":"2024-09-10T23:55:48.433330+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:55:48.433330+0000","last_undegraded":"2024-09-10T23:55:48.433330+0000","last_fullsized":"2024-09-10T23:55:48.433330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228323+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:55:48.228323+0000","last_peered":"2024-09-10T23:55:48.228323+0000","last_clean":"2024-09-10T23:55:48.228323+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:55:48.228323+0000","last_undegraded":"2024-09-10T23:55:48.228323+0000","last_fullsized":"2024-09-10T23:55:48.228323+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432416+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:55:48.432416+0000","last_peered":"2024-09-10T23:55:48.432416+0000","last_clean":"2024-09-10T23:55:48.432416+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:55:48.432416+0000","last_undegraded":"2024-09-10T23:55:48.432416+0000","last_fullsized":"2024-09-10T23:55:48.432416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432568+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:55:48.432568+0000","last_peered":"2024-09-10T23:55:48.432568+0000","last_clean":"2024-09-10T23:55:48.432568+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:55:48.432568+0000","last_undegraded":"2024-09-10T23:55:48.432568+0000","last_fullsized":"2024-09-10T23:55:48.432568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191867+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:55:48.191867+0000","last_peered":"2024-09-10T23:55:48.191867+0000","last_clean":"2024-09-10T23:55:48.191867+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:55:48.191867+0000","last_undegraded":"2024-09-10T23:55:48.191867+0000","last_fullsized":"2024-09-10T23:55:48.191867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":236,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:51.090601+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:55:51.090601+0000","last_peered":"2024-09-10T23:55:51.090601+0000","last_clean":"2024-09-10T23:55:51.090601+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:55:51.090601+0000","last_undegraded":"2024-09-10T23:55:51.090601+0000","last_fullsized":"2024-09-10T23:55:51.090601+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":127,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195355+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:55:48.195355+0000","last_peered":"2024-09-10T23:55:48.195355+0000","last_clean":"2024-09-10T23:55:48.195355+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:55:48.195355+0000","last_undegraded":"2024-09-10T23:55:48.195355+0000","last_fullsized":"2024-09-10T23:55:48.195355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389415+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:55:48.389415+0000","last_peered":"2024-09-10T23:55:48.389415+0000","last_clean":"2024-09-10T23:55:48.389415+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:55:48.389415+0000","last_undegraded":"2024-09-10T23:55:48.389415+0000","last_fullsized":"2024-09-10T23:55:48.389415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432735+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:55:48.432735+0000","last_peered":"2024-09-10T23:55:48.432735+0000","last_clean":"2024-09-10T23:55:48.432735+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:55:48.432735+0000","last_undegraded":"2024-09-10T23:55:48.432735+0000","last_fullsized":"2024-09-10T23:55:48.432735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191472+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:55:48.191472+0000","last_peered":"2024-09-10T23:55:48.191472+0000","last_clean":"2024-09-10T23:55:48.191472+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:55:48.191472+0000","last_undegraded":"2024-09-10T23:55:48.191472+0000","last_fullsized":"2024-09-10T23:55:48.191472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193033+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:55:48.193033+0000","last_peered":"2024-09-10T23:55:48.193033+0000","last_clean":"2024-09-10T23:55:48.193033+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:55:48.193033+0000","last_undegraded":"2024-09-10T23:55:48.193033+0000","last_fullsized":"2024-09-10T23:55:48.193033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197228+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:55:48.197228+0000","last_peered":"2024-09-10T23:55:48.197228+0000","last_clean":"2024-09-10T23:55:48.197228+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:55:48.197228+0000","last_undegraded":"2024-09-10T23:55:48.197228+0000","last_fullsized":"2024-09-10T23:55:48.197228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194983+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:55:48.194983+0000","last_peered":"2024-09-10T23:55:48.194983+0000","last_clean":"2024-09-10T23:55:48.194983+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:55:48.194983+0000","last_undegraded":"2024-09-10T23:55:48.194983+0000","last_fullsized":"2024-09-10T23:55:48.194983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389772+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:55:48.389772+0000","last_peered":"2024-09-10T23:55:48.389772+0000","last_clean":"2024-09-10T23:55:48.389772+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:55:48.389772+0000","last_undegraded":"2024-09-10T23:55:48.389772+0000","last_fullsized":"2024-09-10T23:55:48.389772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":109,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089031+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:55:50.089031+0000","last_peered":"2024-09-10T23:55:50.089031+0000","last_clean":"2024-09-10T23:55:50.089031+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:55:50.089031+0000","last_undegraded":"2024-09-10T23:55:50.089031+0000","last_fullsized":"2024-09-10T23:55:50.089031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190523+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:55:47.190523+0000","last_peered":"2024-09-10T23:55:47.190523+0000","last_clean":"2024-09-10T23:55:47.190523+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:55:47.190523+0000","last_undegraded":"2024-09-10T23:55:47.190523+0000","last_fullsized":"2024-09-10T23:55:47.190523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193037+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:55:48.193037+0000","last_peered":"2024-09-10T23:55:48.193037+0000","last_clean":"2024-09-10T23:55:48.193037+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:55:48.193037+0000","last_undegraded":"2024-09-10T23:55:48.193037+0000","last_fullsized":"2024-09-10T23:55:48.193037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195072+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:55:48.195072+0000","last_peered":"2024-09-10T23:55:48.195072+0000","last_clean":"2024-09-10T23:55:48.195072+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:55:48.195072+0000","last_undegraded":"2024-09-10T23:55:48.195072+0000","last_fullsized":"2024-09-10T23:55:48.195072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432219+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:55:48.432219+0000","last_peered":"2024-09-10T23:55:48.432219+0000","last_clean":"2024-09-10T23:55:48.432219+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:55:48.432219+0000","last_undegraded":"2024-09-10T23:55:48.432219+0000","last_fullsized":"2024-09-10T23:55:48.432219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433830+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:55:48.433830+0000","last_peered":"2024-09-10T23:55:48.433830+0000","last_clean":"2024-09-10T23:55:48.433830+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:55:48.433830+0000","last_undegraded":"2024-09-10T23:55:48.433830+0000","last_fullsized":"2024-09-10T23:55:48.433830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190543+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:55:47.190543+0000","last_peered":"2024-09-10T23:55:47.190543+0000","last_clean":"2024-09-10T23:55:47.190543+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:55:47.190543+0000","last_undegraded":"2024-09-10T23:55:47.190543+0000","last_fullsized":"2024-09-10T23:55:47.190543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228393+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:55:48.228393+0000","last_peered":"2024-09-10T23:55:48.228393+0000","last_clean":"2024-09-10T23:55:48.228393+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:55:48.228393+0000","last_undegraded":"2024-09-10T23:55:48.228393+0000","last_fullsized":"2024-09-10T23:55:48.228393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194166+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:55:48.194166+0000","last_peered":"2024-09-10T23:55:48.194166+0000","last_clean":"2024-09-10T23:55:48.194166+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:55:48.194166+0000","last_undegraded":"2024-09-10T23:55:48.194166+0000","last_fullsized":"2024-09-10T23:55:48.194166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431899+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:55:48.431899+0000","last_peered":"2024-09-10T23:55:48.431899+0000","last_clean":"2024-09-10T23:55:48.431899+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:55:48.431899+0000","last_undegraded":"2024-09-10T23:55:48.431899+0000","last_fullsized":"2024-09-10T23:55:48.431899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431968+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:55:48.431968+0000","last_peered":"2024-09-10T23:55:48.431968+0000","last_clean":"2024-09-10T23:55:48.431968+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:55:48.431968+0000","last_undegraded":"2024-09-10T23:55:48.431968+0000","last_fullsized":"2024-09-10T23:55:48.431968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089736+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:55:50.089736+0000","last_peered":"2024-09-10T23:55:50.089736+0000","last_clean":"2024-09-10T23:55:50.089736+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:55:50.089736+0000","last_undegraded":"2024-09-10T23:55:50.089736+0000","last_fullsized":"2024-09-10T23:55:50.089736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":1,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191689+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:55:48.191689+0000","last_peered":"2024-09-10T23:55:48.191689+0000","last_clean":"2024-09-10T23:55:48.191689+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:55:48.191689+0000","last_undegraded":"2024-09-10T23:55:48.191689+0000","last_fullsized":"2024-09-10T23:55:48.191689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432974+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:55:48.432974+0000","last_peered":"2024-09-10T23:55:48.432974+0000","last_clean":"2024-09-10T23:55:48.432974+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:55:48.432974+0000","last_undegraded":"2024-09-10T23:55:48.432974+0000","last_fullsized":"2024-09-10T23:55:48.432974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432360+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:55:48.432360+0000","last_peered":"2024-09-10T23:55:48.432360+0000","last_clean":"2024-09-10T23:55:48.432360+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:55:48.432360+0000","last_undegraded":"2024-09-10T23:55:48.432360+0000","last_fullsized":"2024-09-10T23:55:48.432360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432126+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:55:48.432126+0000","last_peered":"2024-09-10T23:55:48.432126+0000","last_clean":"2024-09-10T23:55:48.432126+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:55:48.432126+0000","last_undegraded":"2024-09-10T23:55:48.432126+0000","last_fullsized":"2024-09-10T23:55:48.432126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431765+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:55:48.431765+0000","last_peered":"2024-09-10T23:55:48.431765+0000","last_clean":"2024-09-10T23:55:48.431765+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:55:48.431765+0000","last_undegraded":"2024-09-10T23:55:48.431765+0000","last_fullsized":"2024-09-10T23:55:48.431765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192842+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:55:48.192842+0000","last_peered":"2024-09-10T23:55:48.192842+0000","last_clean":"2024-09-10T23:55:48.192842+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:55:48.192842+0000","last_undegraded":"2024-09-10T23:55:48.192842+0000","last_fullsized":"2024-09-10T23:55:48.192842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228526+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:55:48.228526+0000","last_peered":"2024-09-10T23:55:48.228526+0000","last_clean":"2024-09-10T23:55:48.228526+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:55:48.228526+0000","last_undegraded":"2024-09-10T23:55:48.228526+0000","last_fullsized":"2024-09-10T23:55:48.228526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433591+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:55:48.433591+0000","last_peered":"2024-09-10T23:55:48.433591+0000","last_clean":"2024-09-10T23:55:48.433591+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:55:48.433591+0000","last_undegraded":"2024-09-10T23:55:48.433591+0000","last_fullsized":"2024-09-10T23:55:48.433591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433120+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:55:48.433120+0000","last_peered":"2024-09-10T23:55:48.433120+0000","last_clean":"2024-09-10T23:55:48.433120+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:55:48.433120+0000","last_undegraded":"2024-09-10T23:55:48.433120+0000","last_fullsized":"2024-09-10T23:55:48.433120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.191542+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:55:47.191542+0000","last_peered":"2024-09-10T23:55:47.191542+0000","last_clean":"2024-09-10T23:55:47.191542+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:55:47.191542+0000","last_undegraded":"2024-09-10T23:55:47.191542+0000","last_fullsized":"2024-09-10T23:55:47.191542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431899+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:55:48.431899+0000","last_peered":"2024-09-10T23:55:48.431899+0000","last_clean":"2024-09-10T23:55:48.431899+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:55:48.431899+0000","last_undegraded":"2024-09-10T23:55:48.431899+0000","last_fullsized":"2024-09-10T23:55:48.431899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190618+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:55:47.190618+0000","last_peered":"2024-09-10T23:55:47.190618+0000","last_clean":"2024-09-10T23:55:47.190618+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:55:47.190618+0000","last_undegraded":"2024-09-10T23:55:47.190618+0000","last_fullsized":"2024-09-10T23:55:47.190618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389522+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:55:48.389522+0000","last_peered":"2024-09-10T23:55:48.389522+0000","last_clean":"2024-09-10T23:55:48.389522+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:55:48.389522+0000","last_undegraded":"2024-09-10T23:55:48.389522+0000","last_fullsized":"2024-09-10T23:55:48.389522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228352+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:55:48.228352+0000","last_peered":"2024-09-10T23:55:48.228352+0000","last_clean":"2024-09-10T23:55:48.228352+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:55:48.228352+0000","last_undegraded":"2024-09-10T23:55:48.228352+0000","last_fullsized":"2024-09-10T23:55:48.228352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433493+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:55:48.433493+0000","last_peered":"2024-09-10T23:55:48.433493+0000","last_clean":"2024-09-10T23:55:48.433493+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:55:48.433493+0000","last_undegraded":"2024-09-10T23:55:48.433493+0000","last_fullsized":"2024-09-10T23:55:48.433493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433135+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:55:48.433135+0000","last_peered":"2024-09-10T23:55:48.433135+0000","last_clean":"2024-09-10T23:55:48.433135+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:55:48.433135+0000","last_undegraded":"2024-09-10T23:55:48.433135+0000","last_fullsized":"2024-09-10T23:55:48.433135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195668+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:55:48.195668+0000","last_peered":"2024-09-10T23:55:48.195668+0000","last_clean":"2024-09-10T23:55:48.195668+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:55:48.195668+0000","last_undegraded":"2024-09-10T23:55:48.195668+0000","last_fullsized":"2024-09-10T23:55:48.195668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434071+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:55:48.434071+0000","last_peered":"2024-09-10T23:55:48.434071+0000","last_clean":"2024-09-10T23:55:48.434071+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:55:48.434071+0000","last_undegraded":"2024-09-10T23:55:48.434071+0000","last_fullsized":"2024-09-10T23:55:48.434071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.388982+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:55:48.388982+0000","last_peered":"2024-09-10T23:55:48.388982+0000","last_clean":"2024-09-10T23:55:48.388982+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:55:48.388982+0000","last_undegraded":"2024-09-10T23:55:48.388982+0000","last_fullsized":"2024-09-10T23:55:48.388982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192561+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:55:48.192561+0000","last_peered":"2024-09-10T23:55:48.192561+0000","last_clean":"2024-09-10T23:55:48.192561+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:55:48.192561+0000","last_undegraded":"2024-09-10T23:55:48.192561+0000","last_fullsized":"2024-09-10T23:55:48.192561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192588+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:55:48.192588+0000","last_peered":"2024-09-10T23:55:48.192588+0000","last_clean":"2024-09-10T23:55:48.192588+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:55:48.192588+0000","last_undegraded":"2024-09-10T23:55:48.192588+0000","last_fullsized":"2024-09-10T23:55:48.192588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228353+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:55:48.228353+0000","last_peered":"2024-09-10T23:55:48.228353+0000","last_clean":"2024-09-10T23:55:48.228353+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:55:48.228353+0000","last_undegraded":"2024-09-10T23:55:48.228353+0000","last_fullsized":"2024-09-10T23:55:48.228353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191942+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:55:48.191942+0000","last_peered":"2024-09-10T23:55:48.191942+0000","last_clean":"2024-09-10T23:55:48.191942+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:55:48.191942+0000","last_undegraded":"2024-09-10T23:55:48.191942+0000","last_fullsized":"2024-09-10T23:55:48.191942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197267+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:55:48.197267+0000","last_peered":"2024-09-10T23:55:48.197267+0000","last_clean":"2024-09-10T23:55:48.197267+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:55:48.197267+0000","last_undegraded":"2024-09-10T23:55:48.197267+0000","last_fullsized":"2024-09-10T23:55:48.197267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434342+0000","last_change":"2024-09-10T23:55:48.434274+0000","last_active":"2024-09-10T23:55:48.434342+0000","last_peered":"2024-09-10T23:55:48.434342+0000","last_clean":"2024-09-10T23:55:48.434342+0000","last_became_active":"2024-09-10T23:55:48.433970+0000","last_became_peered":"2024-09-10T23:55:48.433970+0000","last_unstale":"2024-09-10T23:55:48.434342+0000","last_undegraded":"2024-09-10T23:55:48.434342+0000","last_fullsized":"2024-09-10T23:55:48.434342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.612639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389794+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:55:48.389794+0000","last_peered":"2024-09-10T23:55:48.389794+0000","last_clean":"2024-09-10T23:55:48.389794+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:55:48.389794+0000","last_undegraded":"2024-09-10T23:55:48.389794+0000","last_fullsized":"2024-09-10T23:55:48.389794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:55:47.190495+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:55:47.190495+0000","last_peered":"2024-09-10T23:55:47.190495+0000","last_clean":"2024-09-10T23:55:47.190495+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:55:47.190495+0000","last_undegraded":"2024-09-10T23:55:47.190495+0000","last_fullsized":"2024-09-10T23:55:47.190495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.229895+0000","last_change":"2024-09-10T23:55:48.229813+0000","last_active":"2024-09-10T23:55:48.229895+0000","last_peered":"2024-09-10T23:55:48.229895+0000","last_clean":"2024-09-10T23:55:48.229895+0000","last_became_active":"2024-09-10T23:55:48.229420+0000","last_became_peered":"2024-09-10T23:55:48.229420+0000","last_unstale":"2024-09-10T23:55:48.229895+0000","last_undegraded":"2024-09-10T23:55:48.229895+0000","last_fullsized":"2024-09-10T23:55:48.229895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:47.584330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194068+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:55:48.194068+0000","last_peered":"2024-09-10T23:55:48.194068+0000","last_clean":"2024-09-10T23:55:48.194068+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:55:48.194068+0000","last_undegraded":"2024-09-10T23:55:48.194068+0000","last_fullsized":"2024-09-10T23:55:48.194068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191502+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:55:48.191502+0000","last_peered":"2024-09-10T23:55:48.191502+0000","last_clean":"2024-09-10T23:55:48.191502+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:55:48.191502+0000","last_undegraded":"2024-09-10T23:55:48.191502+0000","last_fullsized":"2024-09-10T23:55:48.191502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191815+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:55:48.191815+0000","last_peered":"2024-09-10T23:55:48.191815+0000","last_clean":"2024-09-10T23:55:48.191815+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:55:48.191815+0000","last_undegraded":"2024-09-10T23:55:48.191815+0000","last_fullsized":"2024-09-10T23:55:48.191815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192685+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:55:48.192685+0000","last_peered":"2024-09-10T23:55:48.192685+0000","last_clean":"2024-09-10T23:55:48.192685+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:55:48.192685+0000","last_undegraded":"2024-09-10T23:55:48.192685+0000","last_fullsized":"2024-09-10T23:55:48.192685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193086+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:55:48.193086+0000","last_peered":"2024-09-10T23:55:48.193086+0000","last_clean":"2024-09-10T23:55:48.193086+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:55:48.193086+0000","last_undegraded":"2024-09-10T23:55:48.193086+0000","last_fullsized":"2024-09-10T23:55:48.193086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434064+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:55:48.434064+0000","last_peered":"2024-09-10T23:55:48.434064+0000","last_clean":"2024-09-10T23:55:48.434064+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:55:48.434064+0000","last_undegraded":"2024-09-10T23:55:48.434064+0000","last_fullsized":"2024-09-10T23:55:48.434064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":415,"num_read_kb":275,"num_write":172,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710760,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":497970,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906989,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":1150225,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070515,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":502280,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":966656,"data_stored":498082,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":1094404,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":493360,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822733,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":1089601,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986259,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":564032,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":484172,"data_compressed":26495,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":493998,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":557888,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":494748,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:55:53.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:55:54.242 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:54 smithi033 ceph-mon[30593]: pgmap v410: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:54 smithi033 ceph-mon[30593]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:54 smithi189 ceph-mon[34000]: pgmap v410: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:54 smithi189 ceph-mon[34000]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:54.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:54 smithi052 ceph-mon[33526]: pgmap v410: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:55:54.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:54 smithi052 ceph-mon[33526]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:54.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 -- 172.21.15.33:0/1470609882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075540 msgr2=0x7f75d8075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 --2- 172.21.15.33:0/1470609882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075540 0x7f75d8075920 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009900 tx=0x7f75cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 -- 172.21.15.33:0/1470609882 shutdown_connections 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 --2- 172.21.15.33:0/1470609882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 0x7f75d8115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 --2- 172.21.15.33:0/1470609882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075e60 0x7f75d8113430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 --2- 172.21.15.33:0/1470609882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075540 0x7f75d8075920 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 -- 172.21.15.33:0/1470609882 >> 172.21.15.33:0/1470609882 conn(0x7f75d80fe660 msgr2=0x7f75d8100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 -- 172.21.15.33:0/1470609882 shutdown_connections 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.836+0000 7f75dee00640 1 -- 172.21.15.33:0/1470609882 wait complete. 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.837+0000 7f75dee00640 1 Processor -- start 2024-09-10T23:55:54.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 -- start start 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075540 0x7f75d819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 0x7f75d81a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f75d81190a0 con 0x7f75d8075e60 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8118f20 con 0x7f75d8075540 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dee00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8119220 con 0x7f75d8113970 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59256/0 (socket says 172.21.15.33:59256) 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dd000640 1 -- 172.21.15.33:0/1471960110 learned_addr learned my addr 172.21.15.33:0/1471960110 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.838+0000 7f75dda00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075540 0x7f75d819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75de400640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 0x7f75d81a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 -- 172.21.15.33:0/1471960110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 msgr2=0x7f75d81a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 0x7f75d81a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 -- 172.21.15.33:0/1471960110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075540 msgr2=0x7f75d819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075540 0x7f75d819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 -- 172.21.15.33:0/1471960110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d81a5700 con 0x7f75d8075e60 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dd000640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d950 tx=0x7f75c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4017070 con 0x7f75d8075e60 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75c4009c30 con 0x7f75d8075e60 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.839+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d81a59f0 con 0x7f75d8075e60 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.840+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c400f620 con 0x7f75d8075e60 2024-09-10T23:55:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.840+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d81ac0b0 con 0x7f75d8075e60 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.841+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8075920 con 0x7f75d8075e60 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.843+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f75c4010460 con 0x7f75d8075e60 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.845+0000 7f75d6000640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 0x7f75c00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.845+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f75c40e5cf0 con 0x7f75d8075e60 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.846+0000 7f75dda00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 0x7f75c00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.846+0000 7f75dda00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 0x7f75c00b78d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0057c0 tx=0x7f75cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:54.848+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f75c4009de0 con 0x7f75d8075e60 2024-09-10T23:55:55.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.041+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75d8063590 con 0x7f75c00b5410 2024-09-10T23:55:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.048+0000 7f75d6000640 1 -- 172.21.15.33:0/1471960110 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340651 (secure 0 0 0) 0x7f75d8063590 con 0x7f75c00b5410 2024-09-10T23:55:55.052 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:55.054 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.052+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 msgr2=0x7f75c00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.052+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 0x7f75c00b78d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0057c0 tx=0x7f75cc0058d0 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 msgr2=0x7f75d819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d950 tx=0x7f75c400de10 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 shutdown_connections 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75c00b5410 0x7f75c00b78d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75d8113970 0x7f75d81a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75d8075e60 0x7f75d819fb90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 --2- 172.21.15.33:0/1471960110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75d8075540 0x7f75d819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 >> 172.21.15.33:0/1471960110 conn(0x7f75d80fe660 msgr2=0x7f75d80ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 shutdown_connections 2024-09-10T23:55:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:55.053+0000 7f75dee00640 1 -- 172.21.15.33:0/1471960110 wait complete. 2024-09-10T23:55:55.962 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-10T23:55:54.807878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659612,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":491,"num_read_kb":339,"num_write":297,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361016,"kb_used_data":11684,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580808,"statfs":{"total":1151940427776,"available":1151570747392,"internally_reserved":0,"allocated":11964416,"data_stored":7930142,"data_compressed":463005,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002336"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195900+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:55:48.195900+0000","last_peered":"2024-09-10T23:55:48.195900+0000","last_clean":"2024-09-10T23:55:48.195900+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:55:48.195900+0000","last_undegraded":"2024-09-10T23:55:48.195900+0000","last_fullsized":"2024-09-10T23:55:48.195900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431688+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:55:48.431688+0000","last_peered":"2024-09-10T23:55:48.431688+0000","last_clean":"2024-09-10T23:55:48.431688+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:55:48.431688+0000","last_undegraded":"2024-09-10T23:55:48.431688+0000","last_fullsized":"2024-09-10T23:55:48.431688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431669+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:55:48.431669+0000","last_peered":"2024-09-10T23:55:48.431669+0000","last_clean":"2024-09-10T23:55:48.431669+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:55:48.431669+0000","last_undegraded":"2024-09-10T23:55:48.431669+0000","last_fullsized":"2024-09-10T23:55:48.431669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431965+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:55:48.431965+0000","last_peered":"2024-09-10T23:55:48.431965+0000","last_clean":"2024-09-10T23:55:48.431965+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:55:48.431965+0000","last_undegraded":"2024-09-10T23:55:48.431965+0000","last_fullsized":"2024-09-10T23:55:48.431965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192983+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:55:48.192983+0000","last_peered":"2024-09-10T23:55:48.192983+0000","last_clean":"2024-09-10T23:55:48.192983+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:55:48.192983+0000","last_undegraded":"2024-09-10T23:55:48.192983+0000","last_fullsized":"2024-09-10T23:55:48.192983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191171+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:55:48.191171+0000","last_peered":"2024-09-10T23:55:48.191171+0000","last_clean":"2024-09-10T23:55:48.191171+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:55:48.191171+0000","last_undegraded":"2024-09-10T23:55:48.191171+0000","last_fullsized":"2024-09-10T23:55:48.191171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433246+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:55:48.433246+0000","last_peered":"2024-09-10T23:55:48.433246+0000","last_clean":"2024-09-10T23:55:48.433246+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:55:48.433246+0000","last_undegraded":"2024-09-10T23:55:48.433246+0000","last_fullsized":"2024-09-10T23:55:48.433246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389333+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:55:48.389333+0000","last_peered":"2024-09-10T23:55:48.389333+0000","last_clean":"2024-09-10T23:55:48.389333+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:55:48.389333+0000","last_undegraded":"2024-09-10T23:55:48.389333+0000","last_fullsized":"2024-09-10T23:55:48.389333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191609+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:55:48.191609+0000","last_peered":"2024-09-10T23:55:48.191609+0000","last_clean":"2024-09-10T23:55:48.191609+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:55:48.191609+0000","last_undegraded":"2024-09-10T23:55:48.191609+0000","last_fullsized":"2024-09-10T23:55:48.191609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192011+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:55:48.192011+0000","last_peered":"2024-09-10T23:55:48.192011+0000","last_clean":"2024-09-10T23:55:48.192011+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:55:48.192011+0000","last_undegraded":"2024-09-10T23:55:48.192011+0000","last_fullsized":"2024-09-10T23:55:48.192011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432596+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:55:48.432596+0000","last_peered":"2024-09-10T23:55:48.432596+0000","last_clean":"2024-09-10T23:55:48.432596+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:55:48.432596+0000","last_undegraded":"2024-09-10T23:55:48.432596+0000","last_fullsized":"2024-09-10T23:55:48.432596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191237+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:55:48.191237+0000","last_peered":"2024-09-10T23:55:48.191237+0000","last_clean":"2024-09-10T23:55:48.191237+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:55:48.191237+0000","last_undegraded":"2024-09-10T23:55:48.191237+0000","last_fullsized":"2024-09-10T23:55:48.191237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196646+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:55:48.196646+0000","last_peered":"2024-09-10T23:55:48.196646+0000","last_clean":"2024-09-10T23:55:48.196646+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:55:48.196646+0000","last_undegraded":"2024-09-10T23:55:48.196646+0000","last_fullsized":"2024-09-10T23:55:48.196646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191511+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:55:48.191511+0000","last_peered":"2024-09-10T23:55:48.191511+0000","last_clean":"2024-09-10T23:55:48.191511+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:55:48.191511+0000","last_undegraded":"2024-09-10T23:55:48.191511+0000","last_fullsized":"2024-09-10T23:55:48.191511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191666+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:55:48.191666+0000","last_peered":"2024-09-10T23:55:48.191666+0000","last_clean":"2024-09-10T23:55:48.191666+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:55:48.191666+0000","last_undegraded":"2024-09-10T23:55:48.191666+0000","last_fullsized":"2024-09-10T23:55:48.191666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431517+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:55:48.431517+0000","last_peered":"2024-09-10T23:55:48.431517+0000","last_clean":"2024-09-10T23:55:48.431517+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:55:48.431517+0000","last_undegraded":"2024-09-10T23:55:48.431517+0000","last_fullsized":"2024-09-10T23:55:48.431517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431886+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:55:48.431886+0000","last_peered":"2024-09-10T23:55:48.431886+0000","last_clean":"2024-09-10T23:55:48.431886+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:55:48.431886+0000","last_undegraded":"2024-09-10T23:55:48.431886+0000","last_fullsized":"2024-09-10T23:55:48.431886+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191666+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:55:48.191666+0000","last_peered":"2024-09-10T23:55:48.191666+0000","last_clean":"2024-09-10T23:55:48.191666+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:55:48.191666+0000","last_undegraded":"2024-09-10T23:55:48.191666+0000","last_fullsized":"2024-09-10T23:55:48.191666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432485+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:55:48.432485+0000","last_peered":"2024-09-10T23:55:48.432485+0000","last_clean":"2024-09-10T23:55:48.432485+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:55:48.432485+0000","last_undegraded":"2024-09-10T23:55:48.432485+0000","last_fullsized":"2024-09-10T23:55:48.432485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431548+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:55:48.431548+0000","last_peered":"2024-09-10T23:55:48.431548+0000","last_clean":"2024-09-10T23:55:48.431548+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:55:48.431548+0000","last_undegraded":"2024-09-10T23:55:48.431548+0000","last_fullsized":"2024-09-10T23:55:48.431548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195709+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:55:48.195709+0000","last_peered":"2024-09-10T23:55:48.195709+0000","last_clean":"2024-09-10T23:55:48.195709+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:55:48.195709+0000","last_undegraded":"2024-09-10T23:55:48.195709+0000","last_fullsized":"2024-09-10T23:55:48.195709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191419+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:55:48.191419+0000","last_peered":"2024-09-10T23:55:48.191419+0000","last_clean":"2024-09-10T23:55:48.191419+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:55:48.191419+0000","last_undegraded":"2024-09-10T23:55:48.191419+0000","last_fullsized":"2024-09-10T23:55:48.191419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389127+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:55:48.389127+0000","last_peered":"2024-09-10T23:55:48.389127+0000","last_clean":"2024-09-10T23:55:48.389127+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:55:48.389127+0000","last_undegraded":"2024-09-10T23:55:48.389127+0000","last_fullsized":"2024-09-10T23:55:48.389127+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191745+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:55:48.191745+0000","last_peered":"2024-09-10T23:55:48.191745+0000","last_clean":"2024-09-10T23:55:48.191745+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:55:48.191745+0000","last_undegraded":"2024-09-10T23:55:48.191745+0000","last_fullsized":"2024-09-10T23:55:48.191745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193132+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:55:48.193132+0000","last_peered":"2024-09-10T23:55:48.193132+0000","last_clean":"2024-09-10T23:55:48.193132+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:55:48.193132+0000","last_undegraded":"2024-09-10T23:55:48.193132+0000","last_fullsized":"2024-09-10T23:55:48.193132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192097+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:55:48.192097+0000","last_peered":"2024-09-10T23:55:48.192097+0000","last_clean":"2024-09-10T23:55:48.192097+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:55:48.192097+0000","last_undegraded":"2024-09-10T23:55:48.192097+0000","last_fullsized":"2024-09-10T23:55:48.192097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431813+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:55:48.431813+0000","last_peered":"2024-09-10T23:55:48.431813+0000","last_clean":"2024-09-10T23:55:48.431813+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:55:48.431813+0000","last_undegraded":"2024-09-10T23:55:48.431813+0000","last_fullsized":"2024-09-10T23:55:48.431813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431976+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:55:48.431976+0000","last_peered":"2024-09-10T23:55:48.431976+0000","last_clean":"2024-09-10T23:55:48.431976+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:55:48.431976+0000","last_undegraded":"2024-09-10T23:55:48.431976+0000","last_fullsized":"2024-09-10T23:55:48.431976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'12","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195765+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:55:48.195765+0000","last_peered":"2024-09-10T23:55:48.195765+0000","last_clean":"2024-09-10T23:55:48.195765+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:55:48.195765+0000","last_undegraded":"2024-09-10T23:55:48.195765+0000","last_fullsized":"2024-09-10T23:55:48.195765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431234+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:55:48.431234+0000","last_peered":"2024-09-10T23:55:48.431234+0000","last_clean":"2024-09-10T23:55:48.431234+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:55:48.431234+0000","last_undegraded":"2024-09-10T23:55:48.431234+0000","last_fullsized":"2024-09-10T23:55:48.431234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228531+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:55:48.228531+0000","last_peered":"2024-09-10T23:55:48.228531+0000","last_clean":"2024-09-10T23:55:48.228531+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:55:48.228531+0000","last_undegraded":"2024-09-10T23:55:48.228531+0000","last_fullsized":"2024-09-10T23:55:48.228531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191941+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:55:48.191941+0000","last_peered":"2024-09-10T23:55:48.191941+0000","last_clean":"2024-09-10T23:55:48.191941+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:55:48.191941+0000","last_undegraded":"2024-09-10T23:55:48.191941+0000","last_fullsized":"2024-09-10T23:55:48.191941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433123+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:55:48.433123+0000","last_peered":"2024-09-10T23:55:48.433123+0000","last_clean":"2024-09-10T23:55:48.433123+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:55:48.433123+0000","last_undegraded":"2024-09-10T23:55:48.433123+0000","last_fullsized":"2024-09-10T23:55:48.433123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194207+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:55:48.194207+0000","last_peered":"2024-09-10T23:55:48.194207+0000","last_clean":"2024-09-10T23:55:48.194207+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:55:48.194207+0000","last_undegraded":"2024-09-10T23:55:48.194207+0000","last_fullsized":"2024-09-10T23:55:48.194207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195409+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:55:48.195409+0000","last_peered":"2024-09-10T23:55:48.195409+0000","last_clean":"2024-09-10T23:55:48.195409+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:55:48.195409+0000","last_undegraded":"2024-09-10T23:55:48.195409+0000","last_fullsized":"2024-09-10T23:55:48.195409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191518+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:55:48.191518+0000","last_peered":"2024-09-10T23:55:48.191518+0000","last_clean":"2024-09-10T23:55:48.191518+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:55:48.191518+0000","last_undegraded":"2024-09-10T23:55:48.191518+0000","last_fullsized":"2024-09-10T23:55:48.191518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194288+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:55:48.194288+0000","last_peered":"2024-09-10T23:55:48.194288+0000","last_clean":"2024-09-10T23:55:48.194288+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:55:48.194288+0000","last_undegraded":"2024-09-10T23:55:48.194288+0000","last_fullsized":"2024-09-10T23:55:48.194288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196736+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:55:48.196736+0000","last_peered":"2024-09-10T23:55:48.196736+0000","last_clean":"2024-09-10T23:55:48.196736+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:55:48.196736+0000","last_undegraded":"2024-09-10T23:55:48.196736+0000","last_fullsized":"2024-09-10T23:55:48.196736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228412+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:55:48.228412+0000","last_peered":"2024-09-10T23:55:48.228412+0000","last_clean":"2024-09-10T23:55:48.228412+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:55:48.228412+0000","last_undegraded":"2024-09-10T23:55:48.228412+0000","last_fullsized":"2024-09-10T23:55:48.228412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432026+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:55:48.432026+0000","last_peered":"2024-09-10T23:55:48.432026+0000","last_clean":"2024-09-10T23:55:48.432026+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:55:48.432026+0000","last_undegraded":"2024-09-10T23:55:48.432026+0000","last_fullsized":"2024-09-10T23:55:48.432026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'4","reported_seq":110,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228386+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:55:48.228386+0000","last_peered":"2024-09-10T23:55:48.228386+0000","last_clean":"2024-09-10T23:55:48.228386+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:55:48.228386+0000","last_undegraded":"2024-09-10T23:55:48.228386+0000","last_fullsized":"2024-09-10T23:55:48.228386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228754+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:55:48.228754+0000","last_peered":"2024-09-10T23:55:48.228754+0000","last_clean":"2024-09-10T23:55:48.228754+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:55:48.228754+0000","last_undegraded":"2024-09-10T23:55:48.228754+0000","last_fullsized":"2024-09-10T23:55:48.228754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228178+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:55:48.228178+0000","last_peered":"2024-09-10T23:55:48.228178+0000","last_clean":"2024-09-10T23:55:48.228178+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:55:48.228178+0000","last_undegraded":"2024-09-10T23:55:48.228178+0000","last_fullsized":"2024-09-10T23:55:48.228178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196282+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:55:48.196282+0000","last_peered":"2024-09-10T23:55:48.196282+0000","last_clean":"2024-09-10T23:55:48.196282+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:55:48.196282+0000","last_undegraded":"2024-09-10T23:55:48.196282+0000","last_fullsized":"2024-09-10T23:55:48.196282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191644+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:55:48.191644+0000","last_peered":"2024-09-10T23:55:48.191644+0000","last_clean":"2024-09-10T23:55:48.191644+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:55:48.191644+0000","last_undegraded":"2024-09-10T23:55:48.191644+0000","last_fullsized":"2024-09-10T23:55:48.191644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.435207+0000","last_change":"2024-09-10T23:55:48.434804+0000","last_active":"2024-09-10T23:55:48.435207+0000","last_peered":"2024-09-10T23:55:48.435207+0000","last_clean":"2024-09-10T23:55:48.435207+0000","last_became_active":"2024-09-10T23:55:48.434451+0000","last_became_peered":"2024-09-10T23:55:48.434451+0000","last_unstale":"2024-09-10T23:55:48.435207+0000","last_undegraded":"2024-09-10T23:55:48.435207+0000","last_fullsized":"2024-09-10T23:55:48.435207+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.587382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191841+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:55:48.191841+0000","last_peered":"2024-09-10T23:55:48.191841+0000","last_clean":"2024-09-10T23:55:48.191841+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:55:48.191841+0000","last_undegraded":"2024-09-10T23:55:48.191841+0000","last_fullsized":"2024-09-10T23:55:48.191841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196441+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:55:48.196441+0000","last_peered":"2024-09-10T23:55:48.196441+0000","last_clean":"2024-09-10T23:55:48.196441+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:55:48.196441+0000","last_undegraded":"2024-09-10T23:55:48.196441+0000","last_fullsized":"2024-09-10T23:55:48.196441+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197128+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:55:48.197128+0000","last_peered":"2024-09-10T23:55:48.197128+0000","last_clean":"2024-09-10T23:55:48.197128+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:55:48.197128+0000","last_undegraded":"2024-09-10T23:55:48.197128+0000","last_fullsized":"2024-09-10T23:55:48.197128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197281+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:55:48.197281+0000","last_peered":"2024-09-10T23:55:48.197281+0000","last_clean":"2024-09-10T23:55:48.197281+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:55:48.197281+0000","last_undegraded":"2024-09-10T23:55:48.197281+0000","last_fullsized":"2024-09-10T23:55:48.197281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432299+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:55:48.432299+0000","last_peered":"2024-09-10T23:55:48.432299+0000","last_clean":"2024-09-10T23:55:48.432299+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:55:48.432299+0000","last_undegraded":"2024-09-10T23:55:48.432299+0000","last_fullsized":"2024-09-10T23:55:48.432299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389171+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:55:48.389171+0000","last_peered":"2024-09-10T23:55:48.389171+0000","last_clean":"2024-09-10T23:55:48.389171+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:55:48.389171+0000","last_undegraded":"2024-09-10T23:55:48.389171+0000","last_fullsized":"2024-09-10T23:55:48.389171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197094+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:55:48.197094+0000","last_peered":"2024-09-10T23:55:48.197094+0000","last_clean":"2024-09-10T23:55:48.197094+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:55:48.197094+0000","last_undegraded":"2024-09-10T23:55:48.197094+0000","last_fullsized":"2024-09-10T23:55:48.197094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432795+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:55:48.432795+0000","last_peered":"2024-09-10T23:55:48.432795+0000","last_clean":"2024-09-10T23:55:48.432795+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:55:48.432795+0000","last_undegraded":"2024-09-10T23:55:48.432795+0000","last_fullsized":"2024-09-10T23:55:48.432795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192840+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:55:48.192840+0000","last_peered":"2024-09-10T23:55:48.192840+0000","last_clean":"2024-09-10T23:55:48.192840+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:55:48.192840+0000","last_undegraded":"2024-09-10T23:55:48.192840+0000","last_fullsized":"2024-09-10T23:55:48.192840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197335+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:55:48.197335+0000","last_peered":"2024-09-10T23:55:48.197335+0000","last_clean":"2024-09-10T23:55:48.197335+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:55:48.197335+0000","last_undegraded":"2024-09-10T23:55:48.197335+0000","last_fullsized":"2024-09-10T23:55:48.197335+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228788+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:55:48.228788+0000","last_peered":"2024-09-10T23:55:48.228788+0000","last_clean":"2024-09-10T23:55:48.228788+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:55:48.228788+0000","last_undegraded":"2024-09-10T23:55:48.228788+0000","last_fullsized":"2024-09-10T23:55:48.228788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431708+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:55:48.431708+0000","last_peered":"2024-09-10T23:55:48.431708+0000","last_clean":"2024-09-10T23:55:48.431708+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:55:48.431708+0000","last_undegraded":"2024-09-10T23:55:48.431708+0000","last_fullsized":"2024-09-10T23:55:48.431708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433848+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:55:48.433848+0000","last_peered":"2024-09-10T23:55:48.433848+0000","last_clean":"2024-09-10T23:55:48.433848+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:55:48.433848+0000","last_undegraded":"2024-09-10T23:55:48.433848+0000","last_fullsized":"2024-09-10T23:55:48.433848+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433955+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:55:48.433955+0000","last_peered":"2024-09-10T23:55:48.433955+0000","last_clean":"2024-09-10T23:55:48.433955+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:55:48.433955+0000","last_undegraded":"2024-09-10T23:55:48.433955+0000","last_fullsized":"2024-09-10T23:55:48.433955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432622+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:55:48.432622+0000","last_peered":"2024-09-10T23:55:48.432622+0000","last_clean":"2024-09-10T23:55:48.432622+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:55:48.432622+0000","last_undegraded":"2024-09-10T23:55:48.432622+0000","last_fullsized":"2024-09-10T23:55:48.432622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432444+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:55:48.432444+0000","last_peered":"2024-09-10T23:55:48.432444+0000","last_clean":"2024-09-10T23:55:48.432444+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:55:48.432444+0000","last_undegraded":"2024-09-10T23:55:48.432444+0000","last_fullsized":"2024-09-10T23:55:48.432444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191447+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:55:48.191447+0000","last_peered":"2024-09-10T23:55:48.191447+0000","last_clean":"2024-09-10T23:55:48.191447+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:55:48.191447+0000","last_undegraded":"2024-09-10T23:55:48.191447+0000","last_fullsized":"2024-09-10T23:55:48.191447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228787+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:55:48.228787+0000","last_peered":"2024-09-10T23:55:48.228787+0000","last_clean":"2024-09-10T23:55:48.228787+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:55:48.228787+0000","last_undegraded":"2024-09-10T23:55:48.228787+0000","last_fullsized":"2024-09-10T23:55:48.228787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196218+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:55:48.196218+0000","last_peered":"2024-09-10T23:55:48.196218+0000","last_clean":"2024-09-10T23:55:48.196218+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:55:48.196218+0000","last_undegraded":"2024-09-10T23:55:48.196218+0000","last_fullsized":"2024-09-10T23:55:48.196218+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089796+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:55:50.089796+0000","last_peered":"2024-09-10T23:55:50.089796+0000","last_clean":"2024-09-10T23:55:50.089796+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:55:50.089796+0000","last_undegraded":"2024-09-10T23:55:50.089796+0000","last_fullsized":"2024-09-10T23:55:50.089796+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195743+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:55:48.195743+0000","last_peered":"2024-09-10T23:55:48.195743+0000","last_clean":"2024-09-10T23:55:48.195743+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:55:48.195743+0000","last_undegraded":"2024-09-10T23:55:48.195743+0000","last_fullsized":"2024-09-10T23:55:48.195743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196901+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:55:48.196901+0000","last_peered":"2024-09-10T23:55:48.196901+0000","last_clean":"2024-09-10T23:55:48.196901+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:55:48.196901+0000","last_undegraded":"2024-09-10T23:55:48.196901+0000","last_fullsized":"2024-09-10T23:55:48.196901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431781+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:55:48.431781+0000","last_peered":"2024-09-10T23:55:48.431781+0000","last_clean":"2024-09-10T23:55:48.431781+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:55:48.431781+0000","last_undegraded":"2024-09-10T23:55:48.431781+0000","last_fullsized":"2024-09-10T23:55:48.431781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433330+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:55:48.433330+0000","last_peered":"2024-09-10T23:55:48.433330+0000","last_clean":"2024-09-10T23:55:48.433330+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:55:48.433330+0000","last_undegraded":"2024-09-10T23:55:48.433330+0000","last_fullsized":"2024-09-10T23:55:48.433330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228323+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:55:48.228323+0000","last_peered":"2024-09-10T23:55:48.228323+0000","last_clean":"2024-09-10T23:55:48.228323+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:55:48.228323+0000","last_undegraded":"2024-09-10T23:55:48.228323+0000","last_fullsized":"2024-09-10T23:55:48.228323+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432416+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:55:48.432416+0000","last_peered":"2024-09-10T23:55:48.432416+0000","last_clean":"2024-09-10T23:55:48.432416+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:55:48.432416+0000","last_undegraded":"2024-09-10T23:55:48.432416+0000","last_fullsized":"2024-09-10T23:55:48.432416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432568+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:55:48.432568+0000","last_peered":"2024-09-10T23:55:48.432568+0000","last_clean":"2024-09-10T23:55:48.432568+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:55:48.432568+0000","last_undegraded":"2024-09-10T23:55:48.432568+0000","last_fullsized":"2024-09-10T23:55:48.432568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191867+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:55:48.191867+0000","last_peered":"2024-09-10T23:55:48.191867+0000","last_clean":"2024-09-10T23:55:48.191867+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:55:48.191867+0000","last_undegraded":"2024-09-10T23:55:48.191867+0000","last_fullsized":"2024-09-10T23:55:48.191867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":236,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:51.090601+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:55:51.090601+0000","last_peered":"2024-09-10T23:55:51.090601+0000","last_clean":"2024-09-10T23:55:51.090601+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:55:51.090601+0000","last_undegraded":"2024-09-10T23:55:51.090601+0000","last_fullsized":"2024-09-10T23:55:51.090601+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":127,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195355+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:55:48.195355+0000","last_peered":"2024-09-10T23:55:48.195355+0000","last_clean":"2024-09-10T23:55:48.195355+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:55:48.195355+0000","last_undegraded":"2024-09-10T23:55:48.195355+0000","last_fullsized":"2024-09-10T23:55:48.195355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389415+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:55:48.389415+0000","last_peered":"2024-09-10T23:55:48.389415+0000","last_clean":"2024-09-10T23:55:48.389415+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:55:48.389415+0000","last_undegraded":"2024-09-10T23:55:48.389415+0000","last_fullsized":"2024-09-10T23:55:48.389415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432735+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:55:48.432735+0000","last_peered":"2024-09-10T23:55:48.432735+0000","last_clean":"2024-09-10T23:55:48.432735+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:55:48.432735+0000","last_undegraded":"2024-09-10T23:55:48.432735+0000","last_fullsized":"2024-09-10T23:55:48.432735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191472+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:55:48.191472+0000","last_peered":"2024-09-10T23:55:48.191472+0000","last_clean":"2024-09-10T23:55:48.191472+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:55:48.191472+0000","last_undegraded":"2024-09-10T23:55:48.191472+0000","last_fullsized":"2024-09-10T23:55:48.191472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193033+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:55:48.193033+0000","last_peered":"2024-09-10T23:55:48.193033+0000","last_clean":"2024-09-10T23:55:48.193033+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:55:48.193033+0000","last_undegraded":"2024-09-10T23:55:48.193033+0000","last_fullsized":"2024-09-10T23:55:48.193033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197228+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:55:48.197228+0000","last_peered":"2024-09-10T23:55:48.197228+0000","last_clean":"2024-09-10T23:55:48.197228+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:55:48.197228+0000","last_undegraded":"2024-09-10T23:55:48.197228+0000","last_fullsized":"2024-09-10T23:55:48.197228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194983+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:55:48.194983+0000","last_peered":"2024-09-10T23:55:48.194983+0000","last_clean":"2024-09-10T23:55:48.194983+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:55:48.194983+0000","last_undegraded":"2024-09-10T23:55:48.194983+0000","last_fullsized":"2024-09-10T23:55:48.194983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389772+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:55:48.389772+0000","last_peered":"2024-09-10T23:55:48.389772+0000","last_clean":"2024-09-10T23:55:48.389772+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:55:48.389772+0000","last_undegraded":"2024-09-10T23:55:48.389772+0000","last_fullsized":"2024-09-10T23:55:48.389772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'3","reported_seq":109,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089031+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:55:50.089031+0000","last_peered":"2024-09-10T23:55:50.089031+0000","last_clean":"2024-09-10T23:55:50.089031+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:55:50.089031+0000","last_undegraded":"2024-09-10T23:55:50.089031+0000","last_fullsized":"2024-09-10T23:55:50.089031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431377+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:55:48.431377+0000","last_peered":"2024-09-10T23:55:48.431377+0000","last_clean":"2024-09-10T23:55:48.431377+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:55:48.431377+0000","last_undegraded":"2024-09-10T23:55:48.431377+0000","last_fullsized":"2024-09-10T23:55:48.431377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193037+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:55:48.193037+0000","last_peered":"2024-09-10T23:55:48.193037+0000","last_clean":"2024-09-10T23:55:48.193037+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:55:48.193037+0000","last_undegraded":"2024-09-10T23:55:48.193037+0000","last_fullsized":"2024-09-10T23:55:48.193037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195072+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:55:48.195072+0000","last_peered":"2024-09-10T23:55:48.195072+0000","last_clean":"2024-09-10T23:55:48.195072+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:55:48.195072+0000","last_undegraded":"2024-09-10T23:55:48.195072+0000","last_fullsized":"2024-09-10T23:55:48.195072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432219+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:55:48.432219+0000","last_peered":"2024-09-10T23:55:48.432219+0000","last_clean":"2024-09-10T23:55:48.432219+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:55:48.432219+0000","last_undegraded":"2024-09-10T23:55:48.432219+0000","last_fullsized":"2024-09-10T23:55:48.432219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433830+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:55:48.433830+0000","last_peered":"2024-09-10T23:55:48.433830+0000","last_clean":"2024-09-10T23:55:48.433830+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:55:48.433830+0000","last_undegraded":"2024-09-10T23:55:48.433830+0000","last_fullsized":"2024-09-10T23:55:48.433830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431365+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:55:48.431365+0000","last_peered":"2024-09-10T23:55:48.431365+0000","last_clean":"2024-09-10T23:55:48.431365+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:55:48.431365+0000","last_undegraded":"2024-09-10T23:55:48.431365+0000","last_fullsized":"2024-09-10T23:55:48.431365+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228393+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:55:48.228393+0000","last_peered":"2024-09-10T23:55:48.228393+0000","last_clean":"2024-09-10T23:55:48.228393+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:55:48.228393+0000","last_undegraded":"2024-09-10T23:55:48.228393+0000","last_fullsized":"2024-09-10T23:55:48.228393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194166+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:55:48.194166+0000","last_peered":"2024-09-10T23:55:48.194166+0000","last_clean":"2024-09-10T23:55:48.194166+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:55:48.194166+0000","last_undegraded":"2024-09-10T23:55:48.194166+0000","last_fullsized":"2024-09-10T23:55:48.194166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431899+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:55:48.431899+0000","last_peered":"2024-09-10T23:55:48.431899+0000","last_clean":"2024-09-10T23:55:48.431899+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:55:48.431899+0000","last_undegraded":"2024-09-10T23:55:48.431899+0000","last_fullsized":"2024-09-10T23:55:48.431899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431968+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:55:48.431968+0000","last_peered":"2024-09-10T23:55:48.431968+0000","last_clean":"2024-09-10T23:55:48.431968+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:55:48.431968+0000","last_undegraded":"2024-09-10T23:55:48.431968+0000","last_fullsized":"2024-09-10T23:55:48.431968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:50.089736+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:55:50.089736+0000","last_peered":"2024-09-10T23:55:50.089736+0000","last_clean":"2024-09-10T23:55:50.089736+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:55:50.089736+0000","last_undegraded":"2024-09-10T23:55:50.089736+0000","last_fullsized":"2024-09-10T23:55:50.089736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":1,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191689+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:55:48.191689+0000","last_peered":"2024-09-10T23:55:48.191689+0000","last_clean":"2024-09-10T23:55:48.191689+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:55:48.191689+0000","last_undegraded":"2024-09-10T23:55:48.191689+0000","last_fullsized":"2024-09-10T23:55:48.191689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432974+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:55:48.432974+0000","last_peered":"2024-09-10T23:55:48.432974+0000","last_clean":"2024-09-10T23:55:48.432974+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:55:48.432974+0000","last_undegraded":"2024-09-10T23:55:48.432974+0000","last_fullsized":"2024-09-10T23:55:48.432974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432360+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:55:48.432360+0000","last_peered":"2024-09-10T23:55:48.432360+0000","last_clean":"2024-09-10T23:55:48.432360+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:55:48.432360+0000","last_undegraded":"2024-09-10T23:55:48.432360+0000","last_fullsized":"2024-09-10T23:55:48.432360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432126+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:55:48.432126+0000","last_peered":"2024-09-10T23:55:48.432126+0000","last_clean":"2024-09-10T23:55:48.432126+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:55:48.432126+0000","last_undegraded":"2024-09-10T23:55:48.432126+0000","last_fullsized":"2024-09-10T23:55:48.432126+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431765+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:55:48.431765+0000","last_peered":"2024-09-10T23:55:48.431765+0000","last_clean":"2024-09-10T23:55:48.431765+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:55:48.431765+0000","last_undegraded":"2024-09-10T23:55:48.431765+0000","last_fullsized":"2024-09-10T23:55:48.431765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192842+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:55:48.192842+0000","last_peered":"2024-09-10T23:55:48.192842+0000","last_clean":"2024-09-10T23:55:48.192842+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:55:48.192842+0000","last_undegraded":"2024-09-10T23:55:48.192842+0000","last_fullsized":"2024-09-10T23:55:48.192842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228526+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:55:48.228526+0000","last_peered":"2024-09-10T23:55:48.228526+0000","last_clean":"2024-09-10T23:55:48.228526+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:55:48.228526+0000","last_undegraded":"2024-09-10T23:55:48.228526+0000","last_fullsized":"2024-09-10T23:55:48.228526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433591+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:55:48.433591+0000","last_peered":"2024-09-10T23:55:48.433591+0000","last_clean":"2024-09-10T23:55:48.433591+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:55:48.433591+0000","last_undegraded":"2024-09-10T23:55:48.433591+0000","last_fullsized":"2024-09-10T23:55:48.433591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433120+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:55:48.433120+0000","last_peered":"2024-09-10T23:55:48.433120+0000","last_clean":"2024-09-10T23:55:48.433120+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:55:48.433120+0000","last_undegraded":"2024-09-10T23:55:48.433120+0000","last_fullsized":"2024-09-10T23:55:48.433120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431927+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:55:48.431927+0000","last_peered":"2024-09-10T23:55:48.431927+0000","last_clean":"2024-09-10T23:55:48.431927+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:55:48.431927+0000","last_undegraded":"2024-09-10T23:55:48.431927+0000","last_fullsized":"2024-09-10T23:55:48.431927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431899+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:55:48.431899+0000","last_peered":"2024-09-10T23:55:48.431899+0000","last_clean":"2024-09-10T23:55:48.431899+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:55:48.431899+0000","last_undegraded":"2024-09-10T23:55:48.431899+0000","last_fullsized":"2024-09-10T23:55:48.431899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431442+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:55:48.431442+0000","last_peered":"2024-09-10T23:55:48.431442+0000","last_clean":"2024-09-10T23:55:48.431442+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:55:48.431442+0000","last_undegraded":"2024-09-10T23:55:48.431442+0000","last_fullsized":"2024-09-10T23:55:48.431442+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389522+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:55:48.389522+0000","last_peered":"2024-09-10T23:55:48.389522+0000","last_clean":"2024-09-10T23:55:48.389522+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:55:48.389522+0000","last_undegraded":"2024-09-10T23:55:48.389522+0000","last_fullsized":"2024-09-10T23:55:48.389522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228352+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:55:48.228352+0000","last_peered":"2024-09-10T23:55:48.228352+0000","last_clean":"2024-09-10T23:55:48.228352+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:55:48.228352+0000","last_undegraded":"2024-09-10T23:55:48.228352+0000","last_fullsized":"2024-09-10T23:55:48.228352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433493+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:55:48.433493+0000","last_peered":"2024-09-10T23:55:48.433493+0000","last_clean":"2024-09-10T23:55:48.433493+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:55:48.433493+0000","last_undegraded":"2024-09-10T23:55:48.433493+0000","last_fullsized":"2024-09-10T23:55:48.433493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433135+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:55:48.433135+0000","last_peered":"2024-09-10T23:55:48.433135+0000","last_clean":"2024-09-10T23:55:48.433135+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:55:48.433135+0000","last_undegraded":"2024-09-10T23:55:48.433135+0000","last_fullsized":"2024-09-10T23:55:48.433135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195668+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:55:48.195668+0000","last_peered":"2024-09-10T23:55:48.195668+0000","last_clean":"2024-09-10T23:55:48.195668+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:55:48.195668+0000","last_undegraded":"2024-09-10T23:55:48.195668+0000","last_fullsized":"2024-09-10T23:55:48.195668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434071+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:55:48.434071+0000","last_peered":"2024-09-10T23:55:48.434071+0000","last_clean":"2024-09-10T23:55:48.434071+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:55:48.434071+0000","last_undegraded":"2024-09-10T23:55:48.434071+0000","last_fullsized":"2024-09-10T23:55:48.434071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.388982+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:55:48.388982+0000","last_peered":"2024-09-10T23:55:48.388982+0000","last_clean":"2024-09-10T23:55:48.388982+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:55:48.388982+0000","last_undegraded":"2024-09-10T23:55:48.388982+0000","last_fullsized":"2024-09-10T23:55:48.388982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192561+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:55:48.192561+0000","last_peered":"2024-09-10T23:55:48.192561+0000","last_clean":"2024-09-10T23:55:48.192561+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:55:48.192561+0000","last_undegraded":"2024-09-10T23:55:48.192561+0000","last_fullsized":"2024-09-10T23:55:48.192561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192588+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:55:48.192588+0000","last_peered":"2024-09-10T23:55:48.192588+0000","last_clean":"2024-09-10T23:55:48.192588+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:55:48.192588+0000","last_undegraded":"2024-09-10T23:55:48.192588+0000","last_fullsized":"2024-09-10T23:55:48.192588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228353+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:55:48.228353+0000","last_peered":"2024-09-10T23:55:48.228353+0000","last_clean":"2024-09-10T23:55:48.228353+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:55:48.228353+0000","last_undegraded":"2024-09-10T23:55:48.228353+0000","last_fullsized":"2024-09-10T23:55:48.228353+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191942+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:55:48.191942+0000","last_peered":"2024-09-10T23:55:48.191942+0000","last_clean":"2024-09-10T23:55:48.191942+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:55:48.191942+0000","last_undegraded":"2024-09-10T23:55:48.191942+0000","last_fullsized":"2024-09-10T23:55:48.191942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197267+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:55:48.197267+0000","last_peered":"2024-09-10T23:55:48.197267+0000","last_clean":"2024-09-10T23:55:48.197267+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:55:48.197267+0000","last_undegraded":"2024-09-10T23:55:48.197267+0000","last_fullsized":"2024-09-10T23:55:48.197267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434342+0000","last_change":"2024-09-10T23:55:48.434274+0000","last_active":"2024-09-10T23:55:48.434342+0000","last_peered":"2024-09-10T23:55:48.434342+0000","last_clean":"2024-09-10T23:55:48.434342+0000","last_became_active":"2024-09-10T23:55:48.433970+0000","last_became_peered":"2024-09-10T23:55:48.433970+0000","last_unstale":"2024-09-10T23:55:48.434342+0000","last_undegraded":"2024-09-10T23:55:48.434342+0000","last_fullsized":"2024-09-10T23:55:48.434342+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.612639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389794+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:55:48.389794+0000","last_peered":"2024-09-10T23:55:48.389794+0000","last_clean":"2024-09-10T23:55:48.389794+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:55:48.389794+0000","last_undegraded":"2024-09-10T23:55:48.389794+0000","last_fullsized":"2024-09-10T23:55:48.389794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431342+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:55:48.431342+0000","last_peered":"2024-09-10T23:55:48.431342+0000","last_clean":"2024-09-10T23:55:48.431342+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:55:48.431342+0000","last_undegraded":"2024-09-10T23:55:48.431342+0000","last_fullsized":"2024-09-10T23:55:48.431342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.229895+0000","last_change":"2024-09-10T23:55:48.229813+0000","last_active":"2024-09-10T23:55:48.229895+0000","last_peered":"2024-09-10T23:55:48.229895+0000","last_clean":"2024-09-10T23:55:48.229895+0000","last_became_active":"2024-09-10T23:55:48.229420+0000","last_became_peered":"2024-09-10T23:55:48.229420+0000","last_unstale":"2024-09-10T23:55:48.229895+0000","last_undegraded":"2024-09-10T23:55:48.229895+0000","last_fullsized":"2024-09-10T23:55:48.229895+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:47.584330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194068+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:55:48.194068+0000","last_peered":"2024-09-10T23:55:48.194068+0000","last_clean":"2024-09-10T23:55:48.194068+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:55:48.194068+0000","last_undegraded":"2024-09-10T23:55:48.194068+0000","last_fullsized":"2024-09-10T23:55:48.194068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191502+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:55:48.191502+0000","last_peered":"2024-09-10T23:55:48.191502+0000","last_clean":"2024-09-10T23:55:48.191502+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:55:48.191502+0000","last_undegraded":"2024-09-10T23:55:48.191502+0000","last_fullsized":"2024-09-10T23:55:48.191502+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191815+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:55:48.191815+0000","last_peered":"2024-09-10T23:55:48.191815+0000","last_clean":"2024-09-10T23:55:48.191815+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:55:48.191815+0000","last_undegraded":"2024-09-10T23:55:48.191815+0000","last_fullsized":"2024-09-10T23:55:48.191815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192685+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:55:48.192685+0000","last_peered":"2024-09-10T23:55:48.192685+0000","last_clean":"2024-09-10T23:55:48.192685+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:55:48.192685+0000","last_undegraded":"2024-09-10T23:55:48.192685+0000","last_fullsized":"2024-09-10T23:55:48.192685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193086+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:55:48.193086+0000","last_peered":"2024-09-10T23:55:48.193086+0000","last_clean":"2024-09-10T23:55:48.193086+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:55:48.193086+0000","last_undegraded":"2024-09-10T23:55:48.193086+0000","last_fullsized":"2024-09-10T23:55:48.193086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434064+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:55:48.434064+0000","last_peered":"2024-09-10T23:55:48.434064+0000","last_clean":"2024-09-10T23:55:48.434064+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:55:48.434064+0000","last_undegraded":"2024-09-10T23:55:48.434064+0000","last_fullsized":"2024-09-10T23:55:48.434064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69010,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":415,"num_read_kb":275,"num_write":172,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":207030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710760,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":497970,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906989,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1101824,"data_stored":1150225,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070516,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":502280,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":966656,"data_stored":498082,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":1094404,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":493360,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822733,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":1089601,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986259,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":564032,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182489,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":493554,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":493998,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1019904,"data_stored":557888,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":494748,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":66666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:55:55.967 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:55:55.968 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:55:55.968 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:55:55.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T23:55:56.351 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:56.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:56 smithi033 ceph-mon[30593]: pgmap v411: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T23:55:56.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:56 smithi033 ceph-mon[30593]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:56 smithi189 ceph-mon[34000]: pgmap v411: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T23:55:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:56 smithi189 ceph-mon[34000]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:56 smithi052 ceph-mon[33526]: pgmap v411: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-10T23:55:56.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:56 smithi052 ceph-mon[33526]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:55:57.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 -- 172.21.15.33:0/3581228646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa824104fa0 msgr2=0x7fa824105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:57.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 --2- 172.21.15.33:0/3581228646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa824104fa0 0x7fa824105380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa818009900 tx=0x7fa81802a3f0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 -- 172.21.15.33:0/3581228646 shutdown_connections 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 --2- 172.21.15.33:0/3581228646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa82410b330 0x7fa824111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 --2- 172.21.15.33:0/3581228646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410a9b0 0x7fa82410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 --2- 172.21.15.33:0/3581228646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa824104fa0 0x7fa824105380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 -- 172.21.15.33:0/3581228646 >> 172.21.15.33:0/3581228646 conn(0x7fa824100a50 msgr2=0x7fa824102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 -- 172.21.15.33:0/3581228646 shutdown_connections 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.012+0000 7fa82ba00640 1 -- 172.21.15.33:0/3581228646 wait complete. 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.013+0000 7fa82ba00640 1 Processor -- start 2024-09-10T23:55:57.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.013+0000 7fa82ba00640 1 -- start start 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa824104fa0 0x7fa82419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410b330 0x7fa8241a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa824114e40 con 0x7fa82410a9b0 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa824114cc0 con 0x7fa82410b330 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa82ba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa824114fc0 con 0x7fa824104fa0 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59278/0 (socket says 172.21.15.33:59278) 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa823e00640 1 -- 172.21.15.33:0/2869978935 learned_addr learned my addr 172.21.15.33:0/2869978935 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa829000640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa824104fa0 0x7fa82419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:57.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.014+0000 7fa829a00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410b330 0x7fa8241a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 -- 172.21.15.33:0/2869978935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa824104fa0 msgr2=0x7fa82419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa824104fa0 0x7fa82419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 -- 172.21.15.33:0/2869978935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410b330 msgr2=0x7fa8241a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410b330 0x7fa8241a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 -- 172.21.15.33:0/2869978935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8241a1480 con 0x7fa82410a9b0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa823e00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d950 tx=0x7fa81000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810017070 con 0x7fa82410a9b0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8241a1770 con 0x7fa82410a9b0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa810009c30 con 0x7fa82410a9b0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81000f620 con 0x7fa82410a9b0 2024-09-10T23:55:57.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.015+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8241a7e30 con 0x7fa82410a9b0 2024-09-10T23:55:57.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.017+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa824105380 con 0x7fa82410a9b0 2024-09-10T23:55:57.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.019+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa810010460 con 0x7fa82410a9b0 2024-09-10T23:55:57.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.021+0000 7fa821600640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 0x7fa80c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:57.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.021+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa8100e5d20 con 0x7fa82410a9b0 2024-09-10T23:55:57.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.021+0000 7fa829000640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 0x7fa80c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:57.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.022+0000 7fa829000640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 0x7fa80c0b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa818006010 tx=0x7fa818005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:57.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.024+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8100ac680 con 0x7fa82410a9b0 2024-09-10T23:55:57.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.263+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa82410cb80 con 0x7fa82410a9b0 2024-09-10T23:55:57.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.263+0000 7fa821600640 1 -- 172.21.15.33:0/2869978935 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa810009de0 con 0x7fa82410a9b0 2024-09-10T23:55:57.265 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:57.265 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 msgr2=0x7fa80c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 0x7fa80c0b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa818006010 tx=0x7fa818005e80 comp rx=0 tx=0).stop 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 msgr2=0x7fa82419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d950 tx=0x7fa81000de10 comp rx=0 tx=0).stop 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 shutdown_connections 2024-09-10T23:55:57.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa80c0b53f0 0x7fa80c0b78b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.265+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa82410b330 0x7fa8241a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.266+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa82410a9b0 0x7fa82419b910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.266+0000 7fa82ba00640 1 --2- 172.21.15.33:0/2869978935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa824104fa0 0x7fa82419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.266+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 >> 172.21.15.33:0/2869978935 conn(0x7fa824100a50 msgr2=0x7fa824101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.266+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 shutdown_connections 2024-09-10T23:55:57.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:57.266+0000 7fa82ba00640 1 -- 172.21.15.33:0/2869978935 wait complete. 2024-09-10T23:55:58.130 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:55:58.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:55:58.515 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:55:58.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:58 smithi033 ceph-mon[30593]: pgmap v412: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:58 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2869978935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:55:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:58 smithi189 ceph-mon[34000]: pgmap v412: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:58 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2869978935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:55:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:58 smithi052 ceph-mon[33526]: pgmap v412: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-10T23:55:58.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:58 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2869978935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T23:55:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 -- 172.21.15.33:0/243169748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c10f3c0 msgr2=0x7f272c1117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 --2- 172.21.15.33:0/243169748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c10f3c0 0x7f272c1117b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2724009ca0 tx=0x7f272402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 -- 172.21.15.33:0/243169748 shutdown_connections 2024-09-10T23:55:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 --2- 172.21.15.33:0/243169748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c10f3c0 0x7f272c1117b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 --2- 172.21.15.33:0/243169748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075f40 0x7f272c10edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 --2- 172.21.15.33:0/243169748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c075540 0x7f272c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 -- 172.21.15.33:0/243169748 >> 172.21.15.33:0/243169748 conn(0x7f272c0fe810 msgr2=0x7f272c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 -- 172.21.15.33:0/243169748 shutdown_connections 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.130+0000 7f2733400640 1 -- 172.21.15.33:0/243169748 wait complete. 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 Processor -- start 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 -- start start 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075540 0x7f272c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:59.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c10f3c0 0x7f272c1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f272c114eb0 con 0x7f272c075f40 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f272c114d30 con 0x7f272c10f3c0 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.131+0000 7f2733400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f272c115030 con 0x7f272c075540 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:59.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59296/0 (socket says 172.21.15.33:59296) 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 -- 172.21.15.33:0/3299610755 learned_addr learned my addr 172.21.15.33:0/3299610755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2730a00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075540 0x7f272c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2731400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c10f3c0 0x7f272c1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 -- 172.21.15.33:0/3299610755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075540 msgr2=0x7f272c19b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075540 0x7f272c19b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 -- 172.21.15.33:0/3299610755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c10f3c0 msgr2=0x7f272c1a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c10f3c0 0x7f272c1a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 -- 172.21.15.33:0/3299610755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c1a14b0 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.132+0000 7f2723e00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f271400b4a0 tx=0x7f271400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.133+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714014070 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.133+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2714010aa0 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.133+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c1a17a0 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.133+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714017b70 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.133+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c1a7e60 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.134+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c075920 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.136+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2714010610 con 0x7f272c075f40 2024-09-10T23:55:59.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.138+0000 7f272a000640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 0x7f27100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:55:59.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.138+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f27140e58a0 con 0x7f272c075f40 2024-09-10T23:55:59.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.139+0000 7f2730a00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 0x7f27100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:55:59.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.139+0000 7f2730a00640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 0x7f27100b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f271c00bbe0 tx=0x7f271c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:55:59.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.139+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f27140abbb0 con 0x7f272c075f40 2024-09-10T23:55:59.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:55:59 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:59.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.408+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f272c19c530 con 0x7f272c075f40 2024-09-10T23:55:59.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.409+0000 7f272a000640 1 -- 172.21.15.33:0/3299610755 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7f272c19c530 con 0x7f272c075f40 2024-09-10T23:55:59.410 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:55:59.410 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:55:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.411+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 msgr2=0x7f27100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.411+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 0x7f27100b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f271c00bbe0 tx=0x7f271c00b390 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.411+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 msgr2=0x7f272c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.411+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f271400b4a0 tx=0x7f271400b960 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.411+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 shutdown_connections 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f27100b53f0 0x7f27100b78b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f272c10f3c0 0x7f272c1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f272c075f40 0x7f272c19b940 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 --2- 172.21.15.33:0/3299610755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f272c075540 0x7f272c19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 >> 172.21.15.33:0/3299610755 conn(0x7f272c0fe810 msgr2=0x7f272c0ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:55:59.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 shutdown_connections 2024-09-10T23:55:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:55:59.412+0000 7f2733400640 1 -- 172.21.15.33:0/3299610755 wait complete. 2024-09-10T23:55:59.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:55:59 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:55:59.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:55:59 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:56:00.225 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: pgmap v413: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3299610755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.493 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: pgmap v413: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3299610755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.512 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: pgmap v413: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-10T23:56:00.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3299610755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 -- 172.21.15.33:0/2047067663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d90104fa0 msgr2=0x7f9d90105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 --2- 172.21.15.33:0/2047067663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d90104fa0 0x7f9d90105380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009ca0 tx=0x7f9d8002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 -- 172.21.15.33:0/2047067663 shutdown_connections 2024-09-10T23:56:02.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 --2- 172.21.15.33:0/2047067663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 0x7f9d90111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 --2- 172.21.15.33:0/2047067663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9010a9b0 0x7f9d9010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 --2- 172.21.15.33:0/2047067663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d90104fa0 0x7f9d90105380 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 -- 172.21.15.33:0/2047067663 >> 172.21.15.33:0/2047067663 conn(0x7f9d90100a50 msgr2=0x7f9d90102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 -- 172.21.15.33:0/2047067663 shutdown_connections 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.044+0000 7f9d96400640 1 -- 172.21.15.33:0/2047067663 wait complete. 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.045+0000 7f9d96400640 1 Processor -- start 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 -- start start 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d90104fa0 0x7f9d9019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 0x7f9d901a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90114e60 con 0x7f9d9010a9b0 2024-09-10T23:56:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90114ce0 con 0x7f9d9010b330 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d96400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90114fe0 con 0x7f9d90104fa0 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d8f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d90104fa0 0x7f9d9019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d86a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43388/0 (socket says 172.21.15.33:43388) 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d86a00640 1 -- 172.21.15.33:0/2696596934 learned_addr learned my addr 172.21.15.33:0/2696596934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.046+0000 7f9d8fe00640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 0x7f9d901a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 -- 172.21.15.33:0/2696596934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d90104fa0 msgr2=0x7f9d9019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d90104fa0 0x7f9d9019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 -- 172.21.15.33:0/2696596934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 msgr2=0x7f9d901a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 0x7f9d901a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 -- 172.21.15.33:0/2696596934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d901a1480 con 0x7f9d9010a9b0 2024-09-10T23:56:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d86a00640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800d770 tx=0x7f9d7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.047+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78017070 con 0x7f9d9010a9b0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.048+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d780054b0 con 0x7f9d9010a9b0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.048+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78004c60 con 0x7f9d9010a9b0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.048+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901a1770 con 0x7f9d9010a9b0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.048+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d901a7e30 con 0x7f9d9010a9b0 2024-09-10T23:56:02.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.049+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d90105380 con 0x7f9d9010a9b0 2024-09-10T23:56:02.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.051+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9d78004e00 con 0x7f9d9010a9b0 2024-09-10T23:56:02.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.053+0000 7f9d8cc00640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 0x7f9d740b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:02.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.053+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9d780e5eb0 con 0x7f9d9010a9b0 2024-09-10T23:56:02.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.053+0000 7f9d8f400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 0x7f9d740b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.054+0000 7f9d8f400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 0x7f9d740b78b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000f80 tx=0x7f9d80031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:02.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.054+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9d780ac240 con 0x7f9d9010a9b0 2024-09-10T23:56:02.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.303+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d9019c500 con 0x7f9d9010a9b0 2024-09-10T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:02 smithi033 ceph-mon[30593]: pgmap v414: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:02 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.304+0000 7f9d8cc00640 1 -- 172.21.15.33:0/2696596934 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7f9d9019c500 con 0x7f9d9010a9b0 2024-09-10T23:56:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:02.306 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:56:02.306 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:56:02.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 msgr2=0x7f9d740b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:02.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 0x7f9d740b78b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000f80 tx=0x7f9d80031000 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 msgr2=0x7f9d9019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800d770 tx=0x7f9d7800dc30 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 shutdown_connections 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d740b53f0 0x7f9d740b78b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d9010b330 0x7f9d901a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d9010a9b0 0x7f9d9019b910 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 --2- 172.21.15.33:0/2696596934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d90104fa0 0x7f9d9019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 >> 172.21.15.33:0/2696596934 conn(0x7f9d90100a50 msgr2=0x7f9d90102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.308+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 shutdown_connections 2024-09-10T23:56:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:02.309+0000 7f9d96400640 1 -- 172.21.15.33:0/2696596934 wait complete. 2024-09-10T23:56:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:02 smithi189 ceph-mon[34000]: pgmap v414: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:02 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:02 smithi052 ceph-mon[33526]: pgmap v414: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:02.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:02 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:03.163 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:56:03.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:03 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2696596934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:03.569 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:03.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:03 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2696596934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:03 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2696596934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 -- 172.21.15.33:0/3718548078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 msgr2=0x7fd72810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 --2- 172.21.15.33:0/3718548078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd72810c920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd710009900 tx=0x7fd71002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 -- 172.21.15.33:0/3718548078 shutdown_connections 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 --2- 172.21.15.33:0/3718548078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd72810cf70 0x7fd72810f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 --2- 172.21.15.33:0/3718548078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd72810c920 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 --2- 172.21.15.33:0/3718548078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd728103b10 0x7fd728103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 -- 172.21.15.33:0/3718548078 >> 172.21.15.33:0/3718548078 conn(0x7fd7280fd5b0 msgr2=0x7fd7280ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 -- 172.21.15.33:0/3718548078 shutdown_connections 2024-09-10T23:56:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.167+0000 7fd727200640 1 -- 172.21.15.33:0/3718548078 wait complete. 2024-09-10T23:56:04.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 Processor -- start 2024-09-10T23:56:04.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 -- start start 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 0x7fd7281017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 0x7fd728102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd728112a90 con 0x7fd728104430 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd728112910 con 0x7fd728103b10 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.169+0000 7fd727200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd728112c10 con 0x7fd72810cf70 2024-09-10T23:56:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd725e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 0x7fd7281017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43400/0 (socket says 172.21.15.33:43400) 2024-09-10T23:56:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 -- 172.21.15.33:0/3951266713 learned_addr learned my addr 172.21.15.33:0/3951266713 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd726800640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 0x7fd728102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 -- 172.21.15.33:0/3951266713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 msgr2=0x7fd728102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 0x7fd728102240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 -- 172.21.15.33:0/3951266713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 msgr2=0x7fd7281017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.170+0000 7fd71fe00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 0x7fd7281017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd71fe00640 1 -- 172.21.15.33:0/3951266713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7281a72a0 con 0x7fd728104430 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd726800640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 0x7fd728102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd725e00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 0x7fd7281017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd71fe00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd710005940 tx=0x7fd7100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71003f030 con 0x7fd728104430 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7281a7530 con 0x7fd728104430 2024-09-10T23:56:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd710031840 con 0x7fd728104430 2024-09-10T23:56:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710035070 con 0x7fd728104430 2024-09-10T23:56:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.171+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7281a7a60 con 0x7fd728104430 2024-09-10T23:56:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.173+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd728103ef0 con 0x7fd728104430 2024-09-10T23:56:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.175+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd71003b980 con 0x7fd728104430 2024-09-10T23:56:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.176+0000 7fd71ea00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 0x7fd70c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.177+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd710106930 con 0x7fd728104430 2024-09-10T23:56:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.177+0000 7fd725e00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 0x7fd70c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.178+0000 7fd725e00640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 0x7fd70c0b7950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd71800afb0 tx=0x7fd71800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.181+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7100cd290 con 0x7fd728104430 2024-09-10T23:56:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.380+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd72802e5c0 con 0x7fd728104430 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: pgmap v415: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:04.382 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.382+0000 7fd71ea00640 1 -- 172.21.15.33:0/3951266713 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24816 (secure 0 0 0) 0x7fd7100ccb90 con 0x7fd728104430 2024-09-10T23:56:04.384 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:04.384 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:55:48.186249+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 msgr2=0x7fd70c0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 0x7fd70c0b7950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd71800afb0 tx=0x7fd71800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 msgr2=0x7fd728101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd710005940 tx=0x7fd7100042f0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 shutdown_connections 2024-09-10T23:56:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd70c0b5490 0x7fd70c0b7950 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd72810cf70 0x7fd728102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd728104430 0x7fd728101d00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 --2- 172.21.15.33:0/3951266713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd728103b10 0x7fd7281017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 >> 172.21.15.33:0/3951266713 conn(0x7fd7280fd5b0 msgr2=0x7fd7280fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 shutdown_connections 2024-09-10T23:56:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:04.385+0000 7fd727200640 1 -- 172.21.15.33:0/3951266713 wait complete. 2024-09-10T23:56:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: pgmap v415: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:04.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:04.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: pgmap v415: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:56:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:56:05.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:05.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3951266713' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:05.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3951266713' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:05.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3951266713' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 -- 172.21.15.33:0/2996955065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10a9b0 msgr2=0x7f5b4c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2996955065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c10adf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009900 tx=0x7f5b3402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 -- 172.21.15.33:0/2996955065 shutdown_connections 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2996955065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10b330 0x7f5b4c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2996955065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c10adf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2996955065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 0x7f5b4c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 -- 172.21.15.33:0/2996955065 >> 172.21.15.33:0/2996955065 conn(0x7f5b4c100a50 msgr2=0x7f5b4c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 -- 172.21.15.33:0/2996955065 shutdown_connections 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.178+0000 7f5b50c00640 1 -- 172.21.15.33:0/2996955065 wait complete. 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 Processor -- start 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 -- start start 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 0x7f5b4c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c114e60 con 0x7f5b4c10b330 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c114ce0 con 0x7f5b4c10a9b0 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.179+0000 7f5b50c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c114fe0 con 0x7f5b4c104fa0 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43418/0 (socket says 172.21.15.33:43418) 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 -- 172.21.15.33:0/2537688317 learned_addr learned my addr 172.21.15.33:0/2537688317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b43e00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b49e00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 0x7f5b4c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 -- 172.21.15.33:0/2537688317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 msgr2=0x7f5b4c19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 0x7f5b4c19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 -- 172.21.15.33:0/2537688317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10a9b0 msgr2=0x7f5b4c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 -- 172.21.15.33:0/2537688317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c1a14a0 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.180+0000 7f5b4a800640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400eb10 tx=0x7f5b4400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.181+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400ce20 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.181+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b44005020 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.181+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44010690 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.181+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4c1a1790 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.181+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4c1a7ed0 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.182+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4c105380 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.184+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5b44004a40 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.186+0000 7f5b42a00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 0x7f5b300b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.186+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5b440e6830 con 0x7f5b4c10b330 2024-09-10T23:56:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.186+0000 7f5b49e00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 0x7f5b300b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.187+0000 7f5b49e00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 0x7f5b300b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009990 tx=0x7f5b3c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.189+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5b440ad190 con 0x7f5b4c10b330 2024-09-10T23:56:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.425+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b4c02e5c0 con 0x7f5b4c10b330 2024-09-10T23:56:06.427 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:06 smithi033 ceph-mon[30593]: pgmap v416: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.427+0000 7f5b42a00640 1 -- 172.21.15.33:0/2537688317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7f5b440aca90 con 0x7f5b4c10b330 2024-09-10T23:56:06.428 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:06.428 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:56:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 msgr2=0x7f5b300b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 0x7f5b300b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009990 tx=0x7f5b3c009110 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 msgr2=0x7f5b4c1a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400eb10 tx=0x7f5b4400ef10 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 shutdown_connections 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5b300b53f0 0x7f5b300b78b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4c10b330 0x7f5b4c1a0cd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b4c10a9b0 0x7f5b4c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 --2- 172.21.15.33:0/2537688317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b4c104fa0 0x7f5b4c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.430+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 >> 172.21.15.33:0/2537688317 conn(0x7f5b4c100a50 msgr2=0x7f5b4c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.431+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 shutdown_connections 2024-09-10T23:56:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:06.431+0000 7f5b50c00640 1 -- 172.21.15.33:0/2537688317 wait complete. 2024-09-10T23:56:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:06 smithi189 ceph-mon[34000]: pgmap v416: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:06 smithi052 ceph-mon[33526]: pgmap v416: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:07.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:53:56.754883+0000', 'modified': '2024-09-10T23:54:47.231868+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34688, 'mds_1': 34649, 'mds_2': 34622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24622': {'gid': 24622, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3755759093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3755759093}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3755759093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3553481852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3553481852}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3553481852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34595': {'gid': 34595, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/1634418949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 1634418949}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 1634418949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34622': {'gid': 34622, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.52:6835/3258065233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3258065233}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3258065233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34649': {'gid': 34649, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.52:6837/106203237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 106203237}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 106203237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34688': {'gid': 34688, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.52:6839/2315099444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 2315099444}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 2315099444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34688, 'qdb_cluster': [34688, 34649, 34622]} 2024-09-10T23:56:07.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:56:07.280 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:56:07.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:07 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2537688317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:07.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:07 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2537688317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:07.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:07 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2537688317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:08.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 -- 172.21.15.33:0/572280141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4105ef0 msgr2=0x7f73f410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 --2- 172.21.15.33:0/572280141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4105ef0 0x7f73f410f930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ca0 tx=0x7f73ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 -- 172.21.15.33:0/572280141 shutdown_connections 2024-09-10T23:56:08.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 --2- 172.21.15.33:0/572280141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4105ef0 0x7f73f410f930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 --2- 172.21.15.33:0/572280141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 0x7f73f41059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 --2- 172.21.15.33:0/572280141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4101220 0x7f73f4101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 -- 172.21.15.33:0/572280141 >> 172.21.15.33:0/572280141 conn(0x7f73f4078100 msgr2=0x7f73f40ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 -- 172.21.15.33:0/572280141 shutdown_connections 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.272+0000 7f73fb200640 1 -- 172.21.15.33:0/572280141 wait complete. 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 Processor -- start 2024-09-10T23:56:08.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 -- start start 2024-09-10T23:56:08.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 0x7f73f4102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4105ef0 0x7f73f4102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4112cf0 con 0x7f73f4101220 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4112b70 con 0x7f73f4105ef0 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.273+0000 7f73fb200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4112e70 con 0x7f73f4105570 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43446/0 (socket says 172.21.15.33:43446) 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 -- 172.21.15.33:0/1128880936 learned_addr learned my addr 172.21.15.33:0/1128880936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73eb400640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 0x7f73f4102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f9200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4105ef0 0x7f73f4102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 -- 172.21.15.33:0/1128880936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 msgr2=0x7f73f4102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 0x7f73f4102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 -- 172.21.15.33:0/1128880936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4105ef0 msgr2=0x7f73f4102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4105ef0 0x7f73f4102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.274+0000 7f73f3e00640 1 -- 172.21.15.33:0/1128880936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f41a7560 con 0x7f73f4101220 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73f3e00640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9f0 tx=0x7f73e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73f1600640 1 -- 172.21.15.33:0/1128880936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e400cd80 con 0x7f73f4101220 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73f1600640 1 -- 172.21.15.33:0/1128880936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73e40108c0 con 0x7f73f4101220 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f41a7850 con 0x7f73f4101220 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73f1600640 1 -- 172.21.15.33:0/1128880936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40187c0 con 0x7f73f4101220 2024-09-10T23:56:08.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.275+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f41a7de0 con 0x7f73f4101220 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.278+0000 7f73fde05740 1 Processor -- start 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.278+0000 7f73fde05740 1 -- start start 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.278+0000 7f73f1600640 1 -- 172.21.15.33:0/1128880936 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f73e4010430 con 0x7f73f4101220 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 0x560ab0a76ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560ab09dfd50 con 0x560ab0a68240 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ab09cf180 con 0x560ab0a74af0 2024-09-10T23:56:08.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73fde05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ab09d2f90 con 0x560ab0a68b60 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43450/0 (socket says 172.21.15.33:43450) 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 -- 172.21.15.33:0/205464299 learned_addr learned my addr 172.21.15.33:0/205464299 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f3e00640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73eb400640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 0x560ab0a76ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 -- 172.21.15.33:0/205464299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 msgr2=0x560ab0a745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 -- 172.21.15.33:0/205464299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 msgr2=0x560ab0a76ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 0x560ab0a76ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.279+0000 7f73f9200640 1 -- 172.21.15.33:0/205464299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab0999a70 con 0x560ab0a68240 2024-09-10T23:56:08.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.280+0000 7f73eb400640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 0x560ab0a76ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:56:08.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.280+0000 7f73f9200640 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ca0 tx=0x7f73ec031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17a28e4f040167f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.280+0000 7f73e9600640 1 -- 172.21.15.33:0/205464299 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec031980 con 0x560ab0a68240 2024-09-10T23:56:08.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.280+0000 7f73e9600640 1 -- 172.21.15.33:0/205464299 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73ec036070 con 0x560ab0a68240 2024-09-10T23:56:08.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.280+0000 7f73e9600640 1 -- 172.21.15.33:0/205464299 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec004330 con 0x560ab0a68240 2024-09-10T23:56:08.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73f1600640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 0x7f73d80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73f1600640 1 -- 172.21.15.33:0/1128880936 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f73e40e6340 con 0x7f73f4101220 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73f3e00640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 0x7f73d80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 -- 172.21.15.33:0/205464299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 msgr2=0x560ab0a68620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ca0 tx=0x7f73ec031450 comp rx=0 tx=0).stop 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 -- 172.21.15.33:0/205464299 shutdown_connections 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a74af0 0x560ab0a76ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 --2- 172.21.15.33:0/205464299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68240 0x560ab0a68620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 -- 172.21.15.33:0/205464299 >> 172.21.15.33:0/205464299 conn(0x560ab0a66020 msgr2=0x560ab0a67210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 -- 172.21.15.33:0/205464299 shutdown_connections 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.281+0000 7f73fde05740 1 -- 172.21.15.33:0/205464299 wait complete. 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.282+0000 7f73f3e00640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 0x7f73d80b78b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x560ab0a6b3c0 tx=0x7f73e40e88c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.282+0000 7f73fde05740 1 -- start start 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.282+0000 7f73fde05740 1 Processor -- start 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a71ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a72020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560ab08305f0 con 0x560ab0a74af0 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ab096a460 con 0x560ab0a68240 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a77660 con 0x560ab0a68b60 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73fde05740 10 client.0 _ll_register_callbacks cb 0x560ab097a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43458/0 (socket says 172.21.15.33:43458) 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73f9200640 1 -- 172.21.15.33:0/1087306620 learned_addr learned my addr 172.21.15.33:0/1087306620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73f9200640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a71ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.283+0000 7f73eb400640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a72020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 -- 172.21.15.33:0/1087306620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 msgr2=0x560ab0a72020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a72020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 -- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 msgr2=0x560ab0a71ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a71ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 -- 172.21.15.33:0/1087306620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ab072d540 con 0x560ab0a74af0 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73f9200640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f73ec031920 tx=0x7f73ec0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6896d9f06d22c48c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73e2000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec003b80 con 0x560ab0a74af0 2024-09-10T23:56:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f73ec003d20 con 0x560ab0a74af0 2024-09-10T23:56:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.284+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560ab096ca70 con 0x560ab0a74af0 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73ec004b40 con 0x560ab0a74af0 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 10 client.15261 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560ab09876f0 con 0x560ab0a74af0 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560ab096ca70 con 0x560ab0a74af0 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f73ec043020 con 0x560ab0a74af0 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 10 client.15261 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 10 client.15261 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 20 client.15261 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0a852b0 0x560ab0a86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 4 client.15261 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.288+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ab09e1ca0 con 0x560ab0a852b0 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.289+0000 7f73eb400640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0a852b0 0x560ab0a86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.289+0000 7f73eb400640 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0a852b0 0x560ab0a86720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c57c811dcc2d2fe server_cookie=c12880b18f935e6e in_seq=0 out_seq=0 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.289+0000 7f73e2000640 10 client.15261 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.290+0000 7f73e2000640 1 -- 172.21.15.33:0/1087306620 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ab09e1ca0 con 0x560ab0a852b0 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.290+0000 7f73e2000640 10 client.15261 handle_command_reply: tid=0 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.290+0000 7f73fde05740 1 client.15261 shutdown 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 msgr2=0x560ab0a72560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f73ec031920 tx=0x7f73ec0095c0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 shutdown_connections 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0a852b0 0x560ab0a86720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a72560 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68b60 0x560ab0a72020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 --2- 172.21.15.33:0/1087306620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a71ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 >> 172.21.15.33:0/1087306620 conn(0x560ab0a66020 msgr2=0x560ab0a6bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73e2000640 0 client.15261 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 shutdown_connections 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 1 -- 172.21.15.33:0/1087306620 wait complete. 2024-09-10T23:56:08.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.291+0000 7f73fde05740 20 client.15261 trim_cache size 0 max 16384 2024-09-10T23:56:08.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.310+0000 7f73fde05740 1 Processor -- start 2024-09-10T23:56:08.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.310+0000 7f73fde05740 1 -- start start 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68240 0x560ab0a852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a6ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a84a60 con 0x560ab0a74af0 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a85130 con 0x560ab0a68b60 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73fde05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a85800 con 0x560ab0a68240 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a6ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73f9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a6ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43462/0 (socket says 172.21.15.33:43462) 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73f9200640 1 -- 172.21.15.33:0/3348059186 learned_addr learned my addr 172.21.15.33:0/3348059186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:39034/0 (socket says 172.21.15.33:39034) 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.311+0000 7f73f9200640 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68240 0x560ab0a852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 -- 172.21.15.33:0/3348059186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68240 msgr2=0x560ab0a852b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68240 0x560ab0a852b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 -- 172.21.15.33:0/3348059186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 msgr2=0x560ab0a6ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a6ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 -- 172.21.15.33:0/3348059186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ab0a6ffe0 con 0x560ab0a68b60 2024-09-10T23:56:08.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73eb400640 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560ab0a74a60 tx=0x7f73dc014a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeaaa1684dede210 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73e8c00640 1 -- 172.21.15.33:0/3348059186 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc014190 con 0x560ab0a68b60 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73e8c00640 1 -- 172.21.15.33:0/3348059186 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73dc0035f0 con 0x560ab0a68b60 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.312+0000 7f73e8c00640 1 -- 172.21.15.33:0/3348059186 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0126b0 con 0x560ab0a68b60 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 -- 172.21.15.33:0/3348059186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 msgr2=0x560ab0a6c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560ab0a74a60 tx=0x7f73dc014a00 comp rx=0 tx=0).stop 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 -- 172.21.15.33:0/3348059186 shutdown_connections 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a74af0 0x560ab0a6ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68b60 0x560ab0a6c400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 --2- 172.21.15.33:0/3348059186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a68240 0x560ab0a852b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 -- 172.21.15.33:0/3348059186 >> 172.21.15.33:0/3348059186 conn(0x560ab0a66020 msgr2=0x560ab0a6cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 -- 172.21.15.33:0/3348059186 shutdown_connections 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.313+0000 7f73fde05740 1 -- 172.21.15.33:0/3348059186 wait complete. 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.314+0000 7f73fde05740 1 -- start start 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.314+0000 7f73fde05740 1 Processor -- start 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68b60 0x560ab0a89d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a74af0 0x560ab0a8e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a865a0 con 0x560ab0a68b60 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a85ed0 con 0x560ab0a68240 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ab0a86c70 con 0x560ab0a74af0 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73fde05740 10 client.0 _ll_register_callbacks cb 0x7f73ec004740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73eb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68b60 0x560ab0a89d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73f9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73f9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:39050/0 (socket says 172.21.15.33:39050) 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73f9200640 1 -- 172.21.15.33:0/3648047978 learned_addr learned my addr 172.21.15.33:0/3648047978 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.315+0000 7f73f9200640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a74af0 0x560ab0a8e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 -- 172.21.15.33:0/3648047978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a74af0 msgr2=0x560ab0a8e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a74af0 0x560ab0a8e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 -- 172.21.15.33:0/3648047978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68b60 msgr2=0x560ab0a89d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68b60 0x560ab0a89d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 -- 172.21.15.33:0/3648047978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ab0a8a610 con 0x560ab0a68240 2024-09-10T23:56:08.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73f9200640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004660 tx=0x7f73ec0098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43329d7dd33a0a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73e2000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0309e0 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73dc0035f0 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.316+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f73ec002030 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73ec069050 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 10 client.35075 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560ab0af21f0 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73dc0035f0 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f73ec043040 con 0x560ab0a68240 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 10 client.35075 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 10 client.35075 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:56:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 20 client.35075 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0af6d80 0x560ab0af5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 4 client.35075 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.317+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "status"}) -- 0x560ab09dd750 con 0x560ab0af6d80 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.318+0000 7f73eb400640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0af6d80 0x560ab0af5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73eb400640 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0af6d80 0x560ab0af5a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8e2f9ec17830ec server_cookie=b638c5f4b9b85fed in_seq=0 out_seq=0 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73e2000640 10 client.35075 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73e2000640 1 -- 172.21.15.33:0/3648047978 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560ab09dd750 con 0x560ab0af6d80 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73e2000640 10 client.35075 handle_command_reply: tid=0 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 client.35075 shutdown 2024-09-10T23:56:08.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 msgr2=0x560ab0a89840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004660 tx=0x7f73ec0098c0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 shutdown_connections 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x560ab0af6d80 0x560ab0af5a90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ab0a74af0 0x560ab0a8e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560ab0a68b60 0x560ab0a89d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 --2- 172.21.15.33:0/3648047978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ab0a68240 0x560ab0a89840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73e2000640 0 client.35075 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 >> 172.21.15.33:0/3648047978 conn(0x560ab0a66020 msgr2=0x560ab0a73110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 shutdown_connections 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.319+0000 7f73fde05740 1 -- 172.21.15.33:0/3648047978 wait complete. 2024-09-10T23:56:08.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fde05740 20 client.35075 trim_cache size 0 max 16384 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34622, 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 85.374186120999994, 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 170.490341242 2024-09-10T23:56:08.326 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:08.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 msgr2=0x7f73d80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 0x7f73d80b78b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x560ab0a6b3c0 tx=0x7f73e40e88c0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 msgr2=0x7f73f41021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9f0 tx=0x7f73e400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 shutdown_connections 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f73d80b53f0 0x7f73d80b78b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73f4105ef0 0x7f73f4102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73f4105570 0x7f73f4102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 --2- 172.21.15.33:0/1128880936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73f4101220 0x7f73f41021f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.320+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 >> 172.21.15.33:0/1128880936 conn(0x7f73f4078100 msgr2=0x7f73f4108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.321+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 shutdown_connections 2024-09-10T23:56:08.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:08.321+0000 7f73fb200640 1 -- 172.21.15.33:0/1128880936 wait complete. 2024-09-10T23:56:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:08 smithi033 ceph-mon[30593]: pgmap v417: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:08 smithi189 ceph-mon[34000]: pgmap v417: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:08 smithi052 ceph-mon[33526]: pgmap v417: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:09.151 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:56:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 -- 172.21.15.33:0/1593347359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01041087d0 msgr2=0x7f0104108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 --2- 172.21.15.33:0/1593347359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01041087d0 0x7f0104108c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009900 tx=0x7f00ec02a410 comp rx=0 tx=0).stop 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 -- 172.21.15.33:0/1593347359 shutdown_connections 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 --2- 172.21.15.33:0/1593347359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104109150 0x7f010410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 --2- 172.21.15.33:0/1593347359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01041087d0 0x7f0104108c10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 --2- 172.21.15.33:0/1593347359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0104102dc0 0x7f01041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 -- 172.21.15.33:0/1593347359 >> 172.21.15.33:0/1593347359 conn(0x7f01040fe830 msgr2=0x7f0104100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 -- 172.21.15.33:0/1593347359 shutdown_connections 2024-09-10T23:56:10.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.216+0000 7f010ae00640 1 -- 172.21.15.33:0/1593347359 wait complete. 2024-09-10T23:56:10.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.217+0000 7f010ae00640 1 Processor -- start 2024-09-10T23:56:10.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.217+0000 7f010ae00640 1 -- start start 2024-09-10T23:56:10.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 0x7f01041991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01041087d0 0x7f0104199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 0x7f010419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0104112d10 con 0x7f0104109150 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0104112b90 con 0x7f01041087d0 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f010ae00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0104112e90 con 0x7f0104102dc0 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f0108e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 0x7f010419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f0103e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 0x7f01041991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f0103e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 0x7f01041991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:49868/0 (socket says 172.21.15.33:49868) 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f0103e00640 1 -- 172.21.15.33:0/3934117495 learned_addr learned my addr 172.21.15.33:0/3934117495 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.218+0000 7f00fb400640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01041087d0 0x7f0104199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 -- 172.21.15.33:0/3934117495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 msgr2=0x7f01041991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 0x7f01041991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 -- 172.21.15.33:0/3934117495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01041087d0 msgr2=0x7f0104199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01041087d0 0x7f0104199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 -- 172.21.15.33:0/3934117495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010419f290 con 0x7f0104109150 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0108e00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 0x7f010419eac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00da10 tx=0x7f00fc00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0101600640 1 -- 172.21.15.33:0/3934117495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00bd70 con 0x7f0104109150 2024-09-10T23:56:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0101600640 1 -- 172.21.15.33:0/3934117495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00fc003e00 con 0x7f0104109150 2024-09-10T23:56:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f0101600640 1 -- 172.21.15.33:0/3934117495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0106c0 con 0x7f0104109150 2024-09-10T23:56:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010419f580 con 0x7f0104109150 2024-09-10T23:56:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.219+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041a5c40 con 0x7f0104109150 2024-09-10T23:56:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.222+0000 7f010d81b740 1 Processor -- start 2024-09-10T23:56:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f0101600640 1 -- 172.21.15.33:0/3934117495 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f00fc024060 con 0x7f0104109150 2024-09-10T23:56:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 -- start start 2024-09-10T23:56:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55562c044d50 con 0x55562c0d1f70 2024-09-10T23:56:10.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55562c034180 con 0x55562c0ddf00 2024-09-10T23:56:10.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.223+0000 7f010d81b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55562c037f90 con 0x55562c0d1650 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43486/0 (socket says 172.21.15.33:43486) 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 -- 172.21.15.33:0/3438275888 learned_addr learned my addr 172.21.15.33:0/3438275888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f00fb400640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f00fb400640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 -- 172.21.15.33:0/3438275888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 msgr2=0x55562c0d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 -- 172.21.15.33:0/3438275888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 msgr2=0x55562c0e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f0103e00640 1 -- 172.21.15.33:0/3438275888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55562bffea70 con 0x55562c0d1f70 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.224+0000 7f00fb400640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f0103e00640 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009dc0 tx=0x7f00f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66777cccc39a29d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f0101600640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 0x7f00e80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f0101600640 1 -- 172.21.15.33:0/3934117495 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00fc0e6220 con 0x7f0104109150 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f00f9600640 1 -- 172.21.15.33:0/3438275888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4005220 con 0x55562c0d1f70 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f00f9600640 1 -- 172.21.15.33:0/3438275888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f4004c30 con 0x55562c0d1f70 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f00f9600640 1 -- 172.21.15.33:0/3438275888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4019780 con 0x55562c0d1f70 2024-09-10T23:56:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.225+0000 7f00fb400640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 0x7f00e80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f00fb400640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 0x7f00e80b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 -- 172.21.15.33:0/3438275888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 msgr2=0x55562c0dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009dc0 tx=0x7f00f4011810 comp rx=0 tx=0).stop 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 -- 172.21.15.33:0/3438275888 shutdown_connections 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0dd9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 --2- 172.21.15.33:0/3438275888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 -- 172.21.15.33:0/3438275888 >> 172.21.15.33:0/3438275888 conn(0x55562c0cf430 msgr2=0x55562c0d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 -- 172.21.15.33:0/3438275888 shutdown_connections 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.226+0000 7f010d81b740 1 -- 172.21.15.33:0/3438275888 wait complete. 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 -- start start 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 Processor -- start 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1f70 0x55562c0db390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0db8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55562be955f0 con 0x55562c0d1650 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55562bfcf460 con 0x55562c0ddf00 2024-09-10T23:56:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55562c0e0c20 con 0x55562c0d1f70 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.227+0000 7f010d81b740 10 client.0 _ll_register_callbacks cb 0x55562bfdf210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43490/0 (socket says 172.21.15.33:43490) 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 -- 172.21.15.33:0/3514235309 learned_addr learned my addr 172.21.15.33:0/3514235309 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f00fb400640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1f70 0x55562c0db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0108e00640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0db8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 -- 172.21.15.33:0/3514235309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1f70 msgr2=0x55562c0db390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1f70 0x55562c0db390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 -- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 msgr2=0x55562c0db8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0db8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0103e00640 1 -- 172.21.15.33:0/3514235309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55562bd92540 con 0x55562c0d1650 2024-09-10T23:56:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.228+0000 7f0108e00640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0db8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f0103e00640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000c00 tx=0x7f00f4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f748754f906f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f00f2000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4027070 con 0x55562c0d1650 2024-09-10T23:56:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00f4003da0 con 0x55562c0d1650 2024-09-10T23:56:10.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55562bfd1a70 con 0x55562c0d1650 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00f4033050 con 0x55562c0d1650 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f010d81b740 10 client.15279 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55562bfec6f0 con 0x55562c0d1650 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.229+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55562bfd1a70 con 0x55562c0d1650 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f00f4023460 con 0x55562c0d1650 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 10 client.15279 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 10 client.15279 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 20 client.15279 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ee940 0x55562c0efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 4 client.15279 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55562c046ca0 con 0x55562c0ee940 2024-09-10T23:56:10.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.230+0000 7f00fb400640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ee940 0x55562c0efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.231+0000 7f00fb400640 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ee940 0x55562c0efdb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87af72ff80925314 server_cookie=cf2a37427c7e65b6 in_seq=0 out_seq=0 2024-09-10T23:56:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.231+0000 7f00f2000640 10 client.15279 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f00f2000640 1 -- 172.21.15.33:0/3514235309 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55562c046ca0 con 0x55562c0ee940 2024-09-10T23:56:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f00f2000640 10 client.15279 handle_command_reply: tid=0 2024-09-10T23:56:10.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 client.15279 shutdown 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 msgr2=0x55562c0dae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000c00 tx=0x7f00f4003820 comp rx=0 tx=0).stop 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 shutdown_connections 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ee940 0x55562c0efdb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0ddf00 0x55562c0db8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.232+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1f70 0x55562c0db390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f010d81b740 1 --2- 172.21.15.33:0/3514235309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1650 0x55562c0dae50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 >> 172.21.15.33:0/3514235309 conn(0x55562c0cf430 msgr2=0x55562c0ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f00f2000640 0 client.15279 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 shutdown_connections 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f010d81b740 1 -- 172.21.15.33:0/3514235309 wait complete. 2024-09-10T23:56:10.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.233+0000 7f010d81b740 20 client.15279 trim_cache size 0 max 16384 2024-09-10T23:56:10.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 Processor -- start 2024-09-10T23:56:10.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 -- start start 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55562c0ee0f0 con 0x55562c0d1f70 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55562c0ee7c0 con 0x55562c0cf430 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f010d81b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55562c0eee90 con 0x55562c0d1650 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f0108e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.252+0000 7f0108e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43496/0 (socket says 172.21.15.33:43496) 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 -- 172.21.15.33:0/794684769 learned_addr learned my addr 172.21.15.33:0/794684769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f00fb400640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0103e00640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 -- 172.21.15.33:0/794684769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 msgr2=0x55562c0d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 -- 172.21.15.33:0/794684769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 msgr2=0x55562c0efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 -- 172.21.15.33:0/794684769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55562c0da670 con 0x55562c0d1f70 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f00fb400640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0103e00640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f0108e00640 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ac180 tx=0x7f00fc0abe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194fd578ab50fb98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f00f8c00640 1 -- 172.21.15.33:0/794684769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0cde60 con 0x55562c0d1f70 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f00f8c00640 1 -- 172.21.15.33:0/794684769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00fc0acb80 con 0x55562c0d1f70 2024-09-10T23:56:10.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.253+0000 7f00f8c00640 1 -- 172.21.15.33:0/794684769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0a86f0 con 0x55562c0d1f70 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 -- 172.21.15.33:0/794684769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 msgr2=0x55562c0d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ac180 tx=0x7f00fc0abe90 comp rx=0 tx=0).stop 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 -- 172.21.15.33:0/794684769 shutdown_connections 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0d0a60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 --2- 172.21.15.33:0/794684769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 -- 172.21.15.33:0/794684769 >> 172.21.15.33:0/794684769 conn(0x55562c0edd10 msgr2=0x55562c0d96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 -- 172.21.15.33:0/794684769 shutdown_connections 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.254+0000 7f010d81b740 1 -- 172.21.15.33:0/794684769 wait complete. 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 -- start start 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 Processor -- start 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55562c0efc30 con 0x55562c0d1f70 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55562c0ef560 con 0x55562c0cf430 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55562c0f0300 con 0x55562c0d1650 2024-09-10T23:56:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.255+0000 7f010d81b740 10 client.0 _ll_register_callbacks cb 0x7f00f4004490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0103e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0103e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:39104/0 (socket says 172.21.15.33:39104) 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0103e00640 1 -- 172.21.15.33:0/3510047643 learned_addr learned my addr 172.21.15.33:0/3510047643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f00fb400640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 -- 172.21.15.33:0/3510047643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 msgr2=0x55562c0f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 -- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 msgr2=0x55562c0f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 -- 172.21.15.33:0/3510047643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55562c0f4f50 con 0x55562c0d1f70 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0103e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:10.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f0108e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0f4a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0a96f0 tx=0x7f00fc0abf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39582420ae2c630 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.256+0000 7f00f2000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0cde60 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00fc0d31d0 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00fc0acb80 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00fc0ac480 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 10 client.15285 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55562c15b9f0 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00fc0acb80 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f00fc0b5580 con 0x55562c0d1f70 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 10 client.15285 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.257+0000 7f010d81b740 20 client.15285 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:10.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.258+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ddf00 0x55562c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:10.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.258+0000 7f010d81b740 4 client.15285 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:10.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.258+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "status"}) -- 0x55562c042750 con 0x55562c0ddf00 2024-09-10T23:56:10.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.258+0000 7f0103e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ddf00 0x55562c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f0103e00640 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ddf00 0x55562c15ecf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c415f74bebe877f2 server_cookie=a89255281be2cfaa in_seq=0 out_seq=0 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f00f2000640 10 client.15285 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f00f2000640 1 -- 172.21.15.33:0/3510047643 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55562c042750 con 0x55562c0ddf00 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f00f2000640 10 client.15285 handle_command_reply: tid=0 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 client.15285 shutdown 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 msgr2=0x55562c0f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0f4a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0a96f0 tx=0x7f00fc0abf00 comp rx=0 tx=0).stop 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 shutdown_connections 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55562c0ddf00 0x55562c15ecf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55562c0d1f70 0x55562c0f4a10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55562c0d1650 0x55562c0f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f00f2000640 0 client.15285 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 --2- 172.21.15.33:0/3510047643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55562c0cf430 0x55562c0f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 >> 172.21.15.33:0/3510047643 conn(0x55562c0edd10 msgr2=0x55562c0e8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 shutdown_connections 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.259+0000 7f010d81b740 1 -- 172.21.15.33:0/3510047643 wait complete. 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010d81b740 20 client.15285 trim_cache size 0 max 16384 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-09-10T23:56:10.265 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34649, 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 88.320815302, 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 161.763684106 2024-09-10T23:56:10.266 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 msgr2=0x7f00e80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 0x7f00e80b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec005e80 comp rx=0 tx=0).stop 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 msgr2=0x7f010419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 0x7f010419eac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00da10 tx=0x7f00fc00ded0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 shutdown_connections 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00e80b5370 0x7f00e80b7830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0104109150 0x7f010419eac0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01041087d0 0x7f0104199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 --2- 172.21.15.33:0/3934117495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0104102dc0 0x7f01041991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:10.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 >> 172.21.15.33:0/3934117495 conn(0x7f01040fe830 msgr2=0x7f0104100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:10.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 shutdown_connections 2024-09-10T23:56:10.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:10.260+0000 7f010ae00640 1 -- 172.21.15.33:0/3934117495 wait complete. 2024-09-10T23:56:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:10 smithi033 ceph-mon[30593]: pgmap v418: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:10 smithi189 ceph-mon[34000]: pgmap v418: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:10 smithi052 ceph-mon[33526]: pgmap v418: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:11.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:56:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 -- 172.21.15.33:0/2698987031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc95010f3c0 msgr2=0x7fc9501117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 --2- 172.21.15.33:0/2698987031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc95010f3c0 0x7fc9501117b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc948009ca0 tx=0x7fc94802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 -- 172.21.15.33:0/2698987031 shutdown_connections 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 --2- 172.21.15.33:0/2698987031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc95010f3c0 0x7fc9501117b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 --2- 172.21.15.33:0/2698987031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075f40 0x7fc95010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 --2- 172.21.15.33:0/2698987031 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc950075540 0x7fc950075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 -- 172.21.15.33:0/2698987031 >> 172.21.15.33:0/2698987031 conn(0x7fc9500fe810 msgr2=0x7fc950100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 -- 172.21.15.33:0/2698987031 shutdown_connections 2024-09-10T23:56:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.069+0000 7fc958400640 1 -- 172.21.15.33:0/2698987031 wait complete. 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 Processor -- start 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 -- start start 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc95010f3c0 0x7fc9501a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc950114e60 con 0x7fc950075f40 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc950114ce0 con 0x7fc950075540 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.070+0000 7fc958400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc950114fe0 con 0x7fc95010f3c0 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42010/0 (socket says 172.21.15.33:42010) 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955a00640 1 -- 172.21.15.33:0/2124871411 learned_addr learned my addr 172.21.15.33:0/2124871411 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47784/0 (socket says 172.21.15.33:47784) 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc956400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc95010f3c0 0x7fc9501a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 -- 172.21.15.33:0/2124871411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc95010f3c0 msgr2=0x7fc9501a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc95010f3c0 0x7fc9501a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 -- 172.21.15.33:0/2124871411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 msgr2=0x7fc95019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955000640 1 -- 172.21.15.33:0/2124871411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9501a1460 con 0x7fc950075f40 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.071+0000 7fc955a00640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc955000640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d6d0 tx=0x7fc93c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc94e000640 1 -- 172.21.15.33:0/2124871411 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c017070 con 0x7fc950075f40 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc94e000640 1 -- 172.21.15.33:0/2124871411 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc93c009820 con 0x7fc950075f40 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc94e000640 1 -- 172.21.15.33:0/2124871411 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c004bc0 con 0x7fc950075f40 2024-09-10T23:56:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9501a1750 con 0x7fc950075f40 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.072+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a7e10 con 0x7fc950075f40 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 Processor -- start 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 -- start start 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 0x564396516620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396522af0 0x564396524ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc94e000640 1 -- 172.21.15.33:0/2124871411 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc93c005220 con 0x7fc950075f40 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56439648dd50 con 0x564396516b60 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56439647d180 con 0x564396522af0 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.075+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564396480f90 con 0x564396516240 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47800/0 (socket says 172.21.15.33:47800) 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 0x564396516620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc955a00640 1 -- 172.21.15.33:0/2366774517 learned_addr learned my addr 172.21.15.33:0/2366774517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc955000640 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396522af0 0x564396524ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 -- 172.21.15.33:0/2366774517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396522af0 msgr2=0x564396524ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396522af0 0x564396524ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 -- 172.21.15.33:0/2366774517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 msgr2=0x5643965225b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc956400640 1 -- 172.21.15.33:0/2366774517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564396447a70 con 0x564396516240 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.076+0000 7fc955a00640 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.077+0000 7fc956400640 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 0x564396516620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc94802aeb0 tx=0x7fc948009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b9559c6061dfbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.077+0000 7fc942a00640 1 -- 172.21.15.33:0/2366774517 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948031980 con 0x564396516240 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.077+0000 7fc942a00640 1 -- 172.21.15.33:0/2366774517 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc948036070 con 0x564396516240 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.077+0000 7fc942a00640 1 -- 172.21.15.33:0/2366774517 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9480042a0 con 0x564396516240 2024-09-10T23:56:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.077+0000 7fc94e000640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 0x7fc9380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc94e000640 1 -- 172.21.15.33:0/2124871411 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc93c0e5bd0 con 0x7fc950075f40 2024-09-10T23:56:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc955a00640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 0x7fc9380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 -- 172.21.15.33:0/2366774517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 msgr2=0x564396516620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 0x564396516620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc94802aeb0 tx=0x7fc948009a20 comp rx=0 tx=0).stop 2024-09-10T23:56:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 -- 172.21.15.33:0/2366774517 shutdown_connections 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396522af0 0x564396524ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x5643965225b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/2366774517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396516240 0x564396516620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 -- 172.21.15.33:0/2366774517 >> 172.21.15.33:0/2366774517 conn(0x564396514020 msgr2=0x564396515210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.078+0000 7fc95aeb7740 1 -- 172.21.15.33:0/2366774517 shutdown_connections 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.079+0000 7fc95aeb7740 1 -- 172.21.15.33:0/2366774517 wait complete. 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.079+0000 7fc955a00640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 0x7fc9380b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5643965193c0 tx=0x7fc94400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.079+0000 7fc95aeb7740 1 -- start start 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.079+0000 7fc95aeb7740 1 Processor -- start 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516240 0x56439651fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x5643965204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5643962de5f0 con 0x564396516b60 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564396418460 con 0x564396516240 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564396525660 con 0x564396522af0 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc95aeb7740 10 client.0 _ll_register_callbacks cb 0x564396428210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc955000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc955000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47804/0 (socket says 172.21.15.33:47804) 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc955000640 1 -- 172.21.15.33:0/459482431 learned_addr learned my addr 172.21.15.33:0/459482431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc956400640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x5643965204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.080+0000 7fc955a00640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516240 0x56439651fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 -- 172.21.15.33:0/459482431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 msgr2=0x5643965204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x5643965204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 -- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516240 msgr2=0x56439651fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516240 0x56439651fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 -- 172.21.15.33:0/459482431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643961db540 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc955000640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0abe70 tx=0x7fc93c0ab830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8705204aa72bcc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc937400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c020050 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56439641aa70 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.081+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc93c0930e0 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc93c005540 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 10 client.15297 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5643964356f0 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56439641aa70 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc93c0a7830 con 0x564396516b60 2024-09-10T23:56:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 10 client.15297 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 20 client.15297 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564396533680 0x564396534af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 4 client.15297 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.082+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56439648fca0 con 0x564396533680 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.083+0000 7fc955a00640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564396533680 0x564396534af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.083+0000 7fc955a00640 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564396533680 0x564396534af0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea9d14723303167 server_cookie=53b2b4c1a428a0e2 in_seq=0 out_seq=0 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.083+0000 7fc937400640 10 client.15297 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.084+0000 7fc937400640 1 -- 172.21.15.33:0/459482431 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56439648fca0 con 0x564396533680 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.084+0000 7fc937400640 10 client.15297 handle_command_reply: tid=0 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.084+0000 7fc95aeb7740 1 client.15297 shutdown 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 msgr2=0x56439651ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0abe70 tx=0x7fc93c0ab830 comp rx=0 tx=0).stop 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 shutdown_connections 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564396533680 0x564396534af0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x5643965204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516b60 0x56439651ff60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/459482431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516240 0x56439651fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 >> 172.21.15.33:0/459482431 conn(0x564396514020 msgr2=0x564396519c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc937400640 0 client.15297 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 shutdown_connections 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 1 -- 172.21.15.33:0/459482431 wait complete. 2024-09-10T23:56:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.085+0000 7fc95aeb7740 20 client.15297 trim_cache size 0 max 16384 2024-09-10T23:56:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 Processor -- start 2024-09-10T23:56:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 -- start start 2024-09-10T23:56:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x56439651a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396514d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564396532e30 con 0x564396516240 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564396533500 con 0x564396516b60 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.104+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564396533bd0 con 0x564396522af0 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47816/0 (socket says 172.21.15.33:47816) 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 -- 172.21.15.33:0/1734096231 learned_addr learned my addr 172.21.15.33:0/1734096231 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955000640 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x56439651a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc956400640 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396514d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 -- 172.21.15.33:0/1734096231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 msgr2=0x564396514d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396514d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 -- 172.21.15.33:0/1734096231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 msgr2=0x56439651a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x56439651a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.105+0000 7fc955a00640 1 -- 172.21.15.33:0/1734096231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439650e4b0 con 0x564396516240 2024-09-10T23:56:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc955a00640 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc94400be60 tx=0x7fc944016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72522227133991c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc942000640 1 -- 172.21.15.33:0/1734096231 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944020110 con 0x564396516240 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc942000640 1 -- 172.21.15.33:0/1734096231 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc944020e50 con 0x564396516240 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc942000640 1 -- 172.21.15.33:0/1734096231 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944029a30 con 0x564396516240 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1734096231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 msgr2=0x564396533d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.106+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc94400be60 tx=0x7fc944016000 comp rx=0 tx=0).stop 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1734096231 shutdown_connections 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396514d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x56439651a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1734096231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x564396533d50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1734096231 >> 172.21.15.33:0/1734096231 conn(0x564396514020 msgr2=0x56439651acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1734096231 shutdown_connections 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1734096231 wait complete. 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 -- start start 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.107+0000 7fc95aeb7740 1 Processor -- start 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x564396536a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396536fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564396534970 con 0x564396516240 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5643965342a0 con 0x564396516b60 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564396535040 con 0x564396522af0 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc95aeb7740 10 client.0 _ll_register_callbacks cb 0x7fc93c0a7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47832/0 (socket says 172.21.15.33:47832) 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 -- 172.21.15.33:0/1687695684 learned_addr learned my addr 172.21.15.33:0/1687695684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955000640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x564396536a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc956400640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396536fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 -- 172.21.15.33:0/1687695684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 msgr2=0x564396536fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396536fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 -- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 msgr2=0x564396536a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x564396536a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc955a00640 1 -- 172.21.15.33:0/1687695684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564396537800 con 0x564396516240 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.108+0000 7fc956400640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396536fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc955a00640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc94402e040 tx=0x7fc944020270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71431e2215d3d840 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc937400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:12.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944037070 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc944020e50 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc9440209c0 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc944043050 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc95aeb7740 10 client.15303 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.109+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5643965a0080 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc944020e50 con 0x564396516240 2024-09-10T23:56:12.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc9440316f0 con 0x564396516240 2024-09-10T23:56:12.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 10 client.15303 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 20 client.15303 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5643965a48a0 0x5643965a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 4 client.15303 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.110+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "status"}) -- 0x56439648b750 con 0x5643965a48a0 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.111+0000 7fc955000640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5643965a48a0 0x5643965a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.111+0000 7fc955000640 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5643965a48a0 0x5643965a35b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21397c8e055b506d server_cookie=caed35c88b1a8619 in_seq=0 out_seq=0 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.111+0000 7fc937400640 10 client.15303 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc937400640 1 -- 172.21.15.33:0/1687695684 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56439648b750 con 0x5643965a48a0 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc937400640 10 client.15303 handle_command_reply: tid=0 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 client.15303 shutdown 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 msgr2=0x56439653d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc94402e040 tx=0x7fc944020270 comp rx=0 tx=0).stop 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 shutdown_connections 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5643965a48a0 0x5643965a35b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564396522af0 0x564396536fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564396516b60 0x564396536a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 --2- 172.21.15.33:0/1687695684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564396516240 0x56439653d580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc937400640 0 client.15303 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 >> 172.21.15.33:0/1687695684 conn(0x564396514020 msgr2=0x564396514d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 shutdown_connections 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 1 -- 172.21.15.33:0/1687695684 wait complete. 2024-09-10T23:56:12.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.112+0000 7fc95aeb7740 20 client.15303 trim_cache size 0 max 16384 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34688, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 134.37297139099999, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 147.902955582 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 msgr2=0x7fc9380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 0x7fc9380b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5643965193c0 tx=0x7fc94400b410 comp rx=0 tx=0).stop 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 msgr2=0x7fc95019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d6d0 tx=0x7fc93c00db90 comp rx=0 tx=0).stop 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 shutdown_connections 2024-09-10T23:56:12.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9380b5370 0x7fc9380b7830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc95010f3c0 0x7fc9501a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc950075f40 0x7fc95019b8f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 --2- 172.21.15.33:0/2124871411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc950075540 0x7fc95019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 >> 172.21.15.33:0/2124871411 conn(0x7fc9500fe810 msgr2=0x7fc9500ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 shutdown_connections 2024-09-10T23:56:12.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:12.113+0000 7fc958400640 1 -- 172.21.15.33:0/2124871411 wait complete. 2024-09-10T23:56:12.549 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:12 smithi033 ceph-mon[30593]: pgmap v419: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:12 smithi189 ceph-mon[34000]: pgmap v419: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:12.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:12 smithi052 ceph-mon[33526]: pgmap v419: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:12.922 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T23:56:12.922 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:56:12.931 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:56:12.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T23:56:13.310 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 -- 172.21.15.33:0/2062846896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb48076f80 msgr2=0x7fcb480755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2062846896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb48076f80 0x7fcb480755e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009900 tx=0x7fcb3802a410 comp rx=0 tx=0).stop 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 -- 172.21.15.33:0/2062846896 shutdown_connections 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2062846896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48106540 0x7fcb48111200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2062846896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48075b20 0x7fcb48075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2062846896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb48076f80 0x7fcb480755e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 -- 172.21.15.33:0/2062846896 >> 172.21.15.33:0/2062846896 conn(0x7fcb480fe2f0 msgr2=0x7fcb48100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 -- 172.21.15.33:0/2062846896 shutdown_connections 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.959+0000 7fcb4d000640 1 -- 172.21.15.33:0/2062846896 wait complete. 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.960+0000 7fcb4d000640 1 Processor -- start 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.960+0000 7fcb4d000640 1 -- start start 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48075b20 0x7fcb4819f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48076f80 0x7fcb4819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48114b30 con 0x7fcb481a05d0 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb481149b0 con 0x7fcb48075b20 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb4d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48114cb0 con 0x7fcb48076f80 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47846/0 (socket says 172.21.15.33:47846) 2024-09-10T23:56:13.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb46800640 1 -- 172.21.15.33:0/2682843331 learned_addr learned my addr 172.21.15.33:0/2682843331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb45e00640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48075b20 0x7fcb4819f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.961+0000 7fcb45400640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48076f80 0x7fcb4819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 -- 172.21.15.33:0/2682843331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48076f80 msgr2=0x7fcb4819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48076f80 0x7fcb4819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 -- 172.21.15.33:0/2682843331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48075b20 msgr2=0x7fcb4819f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48075b20 0x7fcb4819f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 -- 172.21.15.33:0/2682843331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481a1250 con 0x7fcb481a05d0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb46800640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009fd0 tx=0x7fcb4000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40017070 con 0x7fcb481a05d0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb40003e00 con 0x7fcb481a05d0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40010460 con 0x7fcb481a05d0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481a7670 con 0x7fcb481a05d0 2024-09-10T23:56:13.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.962+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481a7b20 con 0x7fcb481a05d0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.964+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48106540 con 0x7fcb481a05d0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.966+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fcb40003970 con 0x7fcb481a05d0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.967+0000 7fcb3ea00640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 0x7fcb2c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.967+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcb400e61c0 con 0x7fcb481a05d0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.968+0000 7fcb45e00640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 0x7fcb2c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.968+0000 7fcb45e00640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 0x7fcb2c0b78b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006010 tx=0x7fcb38031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:13.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:13.971+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcb400ac4d0 con 0x7fcb481a05d0 2024-09-10T23:56:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.187+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fcb48063590 con 0x7fcb2c0b53f0 2024-09-10T23:56:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.188+0000 7fcb3ea00640 1 -- 172.21.15.33:0/2682843331 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcb48063590 con 0x7fcb2c0b53f0 2024-09-10T23:56:14.189 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-09-10T23:56:14.189 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-09-10T23:56:14.189 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-09-10T23:56:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 msgr2=0x7fcb2c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 0x7fcb2c0b78b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006010 tx=0x7fcb38031400 comp rx=0 tx=0).stop 2024-09-10T23:56:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 msgr2=0x7fcb481a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009fd0 tx=0x7fcb4000b260 comp rx=0 tx=0).stop 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 shutdown_connections 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb2c0b53f0 0x7fcb2c0b78b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb481a05d0 0x7fcb481a0a80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb48076f80 0x7fcb4819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 --2- 172.21.15.33:0/2682843331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48075b20 0x7fcb4819f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 >> 172.21.15.33:0/2682843331 conn(0x7fcb480fe2f0 msgr2=0x7fcb481006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 shutdown_connections 2024-09-10T23:56:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:14.190+0000 7fcb4d000640 1 -- 172.21.15.33:0/2682843331 wait complete. 2024-09-10T23:56:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:14 smithi189 ceph-mon[34000]: pgmap v420: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:14.583 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:14 smithi033 ceph-mon[30593]: pgmap v420: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:14 smithi052 ceph-mon[33526]: pgmap v420: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:15.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T23:56:15.504 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:15.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:15 smithi033 ceph-mon[30593]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:15.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:15 smithi189 ceph-mon[34000]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:15 smithi052 ceph-mon[33526]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 -- 172.21.15.33:0/352114967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88741065c0 msgr2=0x7f887410cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 --2- 172.21.15.33:0/352114967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88741065c0 0x7f887410cf40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f886c009cd0 tx=0x7f886c02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 -- 172.21.15.33:0/352114967 shutdown_connections 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 --2- 172.21.15.33:0/352114967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88741065c0 0x7f887410cf40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 --2- 172.21.15.33:0/352114967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8874105c00 0x7f8874106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 --2- 172.21.15.33:0/352114967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874104aa0 0x7f8874104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 -- 172.21.15.33:0/352114967 >> 172.21.15.33:0/352114967 conn(0x7f8874100370 msgr2=0x7f88741027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 -- 172.21.15.33:0/352114967 shutdown_connections 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.078+0000 7f887a600640 1 -- 172.21.15.33:0/352114967 wait complete. 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 Processor -- start 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 -- start start 2024-09-10T23:56:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 0x7f887419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 0x7f887419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88741105d0 con 0x7f8874104aa0 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8874110450 con 0x7f88741065c0 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.079+0000 7f887a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8874110750 con 0x7f8874105c00 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47868/0 (socket says 172.21.15.33:47868) 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 -- 172.21.15.33:0/2865007703 learned_addr learned my addr 172.21.15.33:0/2865007703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8873e00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 0x7f887419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879c00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 0x7f887419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:16.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 -- 172.21.15.33:0/2865007703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 msgr2=0x7f887419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 0x7f887419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 -- 172.21.15.33:0/2865007703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 msgr2=0x7f887419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 0x7f887419beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 -- 172.21.15.33:0/2865007703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887419c750 con 0x7f8874104aa0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8873e00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 0x7f887419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879c00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 0x7f887419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.080+0000 7f8879200640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f886800d770 tx=0x7f886800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.081+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868017070 con 0x7f8874104aa0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.081+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88680054b0 con 0x7f8874104aa0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.081+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887419ca40 con 0x7f8874104aa0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.081+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8868004c60 con 0x7f8874104aa0 2024-09-10T23:56:16.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.081+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88741a3120 con 0x7f8874104aa0 2024-09-10T23:56:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.082+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887419cca0 con 0x7f8874104aa0 2024-09-10T23:56:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.084+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8868004e00 con 0x7f8874104aa0 2024-09-10T23:56:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.086+0000 7f8871600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 0x7f885c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.086+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f88680e5c80 con 0x7f8874104aa0 2024-09-10T23:56:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.086+0000 7f8873e00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 0x7f885c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.087+0000 7f8873e00640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 0x7f885c0b78d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f88600058c0 tx=0x7f8860005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.089+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88680ac5e0 con 0x7f8874104aa0 2024-09-10T23:56:16.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.293+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8874063590 con 0x7f885c0b5410 2024-09-10T23:56:16.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.305+0000 7f8871600640 1 -- 172.21.15.33:0/2865007703 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f8874063590 con 0x7f885c0b5410 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.a smithi033 running (2m) 13s ago 2m 13.2M - 19.3.0-4854-g8f219c47 589dd18248e4 add0be645d59 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.b smithi052 running (2m) 14s ago 2m 25.3M - 19.3.0-4854-g8f219c47 589dd18248e4 d60ece56d4ab 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.c smithi189 running (2m) 14s ago 2m 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 870ed63c353b 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.d smithi033 running (3m) 13s ago 3m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 0672ce1d918e 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.e smithi052 running (2m) 14s ago 2m 18.1M - 19.3.0-4854-g8f219c47 589dd18248e4 46fdbd10f1ed 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.f smithi189 running (2m) 14s ago 2m 17.2M - 19.3.0-4854-g8f219c47 589dd18248e4 adfda705a087 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.g smithi033 running (2m) 13s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 d6f27b2c73a3 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.h smithi052 running (2m) 14s ago 2m 18.1M - 19.3.0-4854-g8f219c47 589dd18248e4 ae71f83257d9 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.i smithi189 running (2m) 14s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 84a998f4ca3f 2024-09-10T23:56:16.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.j smithi033 running (3m) 13s ago 3m 13.5M - 19.3.0-4854-g8f219c47 589dd18248e4 60fdc02714d5 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mds.k smithi052 running (3m) 14s ago 3m 18.4M - 19.3.0-4854-g8f219c47 589dd18248e4 b92d1624b1f4 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mds.l smithi189 running (3m) 14s ago 3m 13.5M - 19.3.0-4854-g8f219c47 589dd18248e4 3d8573bde488 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi033 *:9283,8765 running (12m) 13s ago 12m 525M - 19.3.0-4854-g8f219c47 589dd18248e4 d5e83021c923 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi052 *:8443,8765 running (10m) 14s ago 10m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 65194799183b 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.z smithi189 *:8443,8765 running (10m) 14s ago 10m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 69677b0d04d0 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (12m) 13s ago 12m 51.5M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 0aca1138a05f 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi052 running (10m) 14s ago 10m 40.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 d69079c54758 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi189 running (10m) 14s ago 10m 41.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 8d5288a513d7 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 13s ago 9m 56.0M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 87493da49fb1 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi052 running (8m) 14s ago 8m 45.6M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 fe261c3f2871 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi189 running (8m) 14s ago 8m 55.6M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 7e55e04ee0b6 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (7m) 13s ago 7m 54.7M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 b219487a3e31 2024-09-10T23:56:16.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi052 running (7m) 14s ago 7m 43.2M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 6227fe1e2d64 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi189 running (6m) 14s ago 6m 43.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 f08edb820f2f 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi033 running (6m) 13s ago 6m 42.2M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 50af67c1ca87 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi052 running (5m) 14s ago 5m 43.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 53e9acd1db1c 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 smithi189 running (5m) 14s ago 5m 52.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 ef4a2c7e4622 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 smithi033 running (4m) 13s ago 4m 53.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 da36a338a977 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 smithi052 running (4m) 14s ago 4m 54.7M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 52201543a2dc 2024-09-10T23:56:16.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 smithi189 running (3m) 14s ago 3m 41.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 afbef574c2f4 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.308+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 msgr2=0x7f885c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.308+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 0x7f885c0b78d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f88600058c0 tx=0x7f8860005850 comp rx=0 tx=0).stop 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.308+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 msgr2=0x7f887419ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.308+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f886800d770 tx=0x7f886800dc30 comp rx=0 tx=0).stop 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 shutdown_connections 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f885c0b5410 0x7f885c0b78d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88741065c0 0x7f887419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8874105c00 0x7f887419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 --2- 172.21.15.33:0/2865007703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8874104aa0 0x7f887419ac20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 >> 172.21.15.33:0/2865007703 conn(0x7f8874100370 msgr2=0x7f8874108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 shutdown_connections 2024-09-10T23:56:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:16.309+0000 7f887a600640 1 -- 172.21.15.33:0/2865007703 wait complete. 2024-09-10T23:56:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:16 smithi189 ceph-mon[34000]: pgmap v421: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:16.667 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:16 smithi033 ceph-mon[30593]: pgmap v421: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:16 smithi052 ceph-mon[33526]: pgmap v421: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:17.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T23:56:17.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:17 smithi033 ceph-mon[30593]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:17.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:17 smithi189 ceph-mon[34000]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:17.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:17 smithi052 ceph-mon[33526]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.309+0000 7f9873200640 1 -- 172.21.15.33:0/3572002385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c105da0 msgr2=0x7f986c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.309+0000 7f9873200640 1 --2- 172.21.15.33:0/3572002385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c105da0 0x7f986c106220 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9854009930 tx=0x7f985402a420 comp rx=0 tx=0).stop 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 -- 172.21.15.33:0/3572002385 shutdown_connections 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 --2- 172.21.15.33:0/3572002385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 0x7f986c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 --2- 172.21.15.33:0/3572002385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c105da0 0x7f986c106220 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 --2- 172.21.15.33:0/3572002385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c104c40 0x7f986c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 -- 172.21.15.33:0/3572002385 >> 172.21.15.33:0/3572002385 conn(0x7f986c100510 msgr2=0x7f986c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:18.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 -- 172.21.15.33:0/3572002385 shutdown_connections 2024-09-10T23:56:18.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.310+0000 7f9873200640 1 -- 172.21.15.33:0/3572002385 wait complete. 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 Processor -- start 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 -- start start 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 0x7f986c19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 0x7f986c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 0x7f986c19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f986c110750 con 0x7f986c104c40 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1105d0 con 0x7f986c105da0 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.311+0000 7f9873200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f986c1108d0 con 0x7f986c106760 2024-09-10T23:56:18.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 0x7f986c19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f9863400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 0x7f986c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f9863400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 0x7f986c19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42104/0 (socket says 172.21.15.33:42104) 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f9863400640 1 -- 172.21.15.33:0/951977145 learned_addr learned my addr 172.21.15.33:0/951977145 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f9871200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 0x7f986c19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 -- 172.21.15.33:0/951977145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 msgr2=0x7f986c19c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:18.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 0x7f986c19c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 -- 172.21.15.33:0/951977145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 msgr2=0x7f986c19b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:18.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 0x7f986c19b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.312+0000 7f986be00640 1 -- 172.21.15.33:0/951977145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c19ca60 con 0x7f986c104c40 2024-09-10T23:56:18.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.313+0000 7f986be00640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 0x7f986c19af30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d6d0 tx=0x7f985c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:18.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.316+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c017070 con 0x7f986c104c40 2024-09-10T23:56:18.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.316+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f985c009820 con 0x7f986c104c40 2024-09-10T23:56:18.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.316+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986c19cd50 con 0x7f986c104c40 2024-09-10T23:56:18.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.316+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c004bc0 con 0x7f986c104c40 2024-09-10T23:56:18.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.316+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986c1a3430 con 0x7f986c104c40 2024-09-10T23:56:18.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.317+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986c10c090 con 0x7f986c104c40 2024-09-10T23:56:18.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.319+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f985c005220 con 0x7f986c104c40 2024-09-10T23:56:18.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.320+0000 7f9869600640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 0x7f98500b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.321+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f985c0e5b50 con 0x7f986c104c40 2024-09-10T23:56:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.321+0000 7f9863400640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 0x7f98500b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:18.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.321+0000 7f9863400640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 0x7f98500b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98540096c0 tx=0x7f9854031610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:18.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.324+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f985c005540 con 0x7f986c104c40 2024-09-10T23:56:18.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:18 smithi033 ceph-mon[30593]: pgmap v422: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.529+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f986c063590 con 0x7f98500b53f0 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.535+0000 7f9869600640 1 -- 172.21.15.33:0/951977145 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f986c063590 con 0x7f98500b53f0 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stdout:mds.all 12/12 16s ago 3m smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 3/3 16s ago 10m smithi033=x;smithi052=y;smithi189=z;count:3 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stdout:mon 3/3 16s ago 10m smithi033:172.21.15.33=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T23:56:18.536 INFO:teuthology.orchestra.run.smithi033.stdout:osd 12 16s ago - 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 msgr2=0x7f98500b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 0x7f98500b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98540096c0 tx=0x7f9854031610 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 msgr2=0x7f986c19af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 0x7f986c19af30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d6d0 tx=0x7f985c00db90 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 shutdown_connections 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f98500b53f0 0x7f98500b78b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f986c106760 0x7f986c19c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f986c105da0 0x7f986c19b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 --2- 172.21.15.33:0/951977145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c104c40 0x7f986c19af30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.537+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 >> 172.21.15.33:0/951977145 conn(0x7f986c100510 msgr2=0x7f986c109260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.538+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 shutdown_connections 2024-09-10T23:56:18.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:18.538+0000 7f9873200640 1 -- 172.21.15.33:0/951977145 wait complete. 2024-09-10T23:56:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:18 smithi189 ceph-mon[34000]: pgmap v422: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:18 smithi052 ceph-mon[33526]: pgmap v422: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:19.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T23:56:19.907 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 -- 172.21.15.33:0/193327679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d4076f80 msgr2=0x7f10d40755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 --2- 172.21.15.33:0/193327679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d4076f80 0x7f10d40755e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009900 tx=0x7f10c402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 -- 172.21.15.33:0/193327679 shutdown_connections 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 --2- 172.21.15.33:0/193327679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4106550 0x7f10d4111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 --2- 172.21.15.33:0/193327679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4075b20 0x7f10d4075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 --2- 172.21.15.33:0/193327679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d4076f80 0x7f10d40755e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 -- 172.21.15.33:0/193327679 >> 172.21.15.33:0/193327679 conn(0x7f10d40fe320 msgr2=0x7f10d4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.528+0000 7f10d8a00640 1 -- 172.21.15.33:0/193327679 shutdown_connections 2024-09-10T23:56:20.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.529+0000 7f10d8a00640 1 -- 172.21.15.33:0/193327679 wait complete. 2024-09-10T23:56:20.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.529+0000 7f10d8a00640 1 Processor -- start 2024-09-10T23:56:20.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 -- start start 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4075b20 0x7f10d419f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4076f80 0x7f10d419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4114b70 con 0x7f10d41a0590 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41149f0 con 0x7f10d4075b20 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d8a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4114cf0 con 0x7f10d4076f80 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47914/0 (socket says 172.21.15.33:47914) 2024-09-10T23:56:20.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d2800640 1 -- 172.21.15.33:0/3535576336 learned_addr learned my addr 172.21.15.33:0/3535576336 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10cbe00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4076f80 0x7f10d419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.530+0000 7f10d1e00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4075b20 0x7f10d419f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 -- 172.21.15.33:0/3535576336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4076f80 msgr2=0x7f10d419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4076f80 0x7f10d419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 -- 172.21.15.33:0/3535576336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4075b20 msgr2=0x7f10d419f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4075b20 0x7f10d419f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 -- 172.21.15.33:0/3535576336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d41a1210 con 0x7f10d41a0590 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.531+0000 7f10d2800640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00eaa0 tx=0x7f10cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.532+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00cdb0 con 0x7f10d41a0590 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.532+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41a7630 con 0x7f10d41a0590 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.532+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10cc005020 con 0x7f10d41a0590 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.532+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0116d0 con 0x7f10d41a0590 2024-09-10T23:56:20.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.532+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d41a7a90 con 0x7f10d41a0590 2024-09-10T23:56:20.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.533+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d4104ad0 con 0x7f10d41a0590 2024-09-10T23:56:20.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.535+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f10cc00f040 con 0x7f10d41a0590 2024-09-10T23:56:20.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.536+0000 7f10caa00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 0x7f10b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.537+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f10cc0e5dd0 con 0x7f10d41a0590 2024-09-10T23:56:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.537+0000 7f10d1e00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 0x7f10b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:20.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.537+0000 7f10d1e00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 0x7f10b80b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f10c4006010 tx=0x7f10c4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:20.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.540+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10cc016030 con 0x7f10d41a0590 2024-09-10T23:56:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:20 smithi189 ceph-mon[34000]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:20 smithi189 ceph-mon[34000]: pgmap v423: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:20 smithi189 ceph-mon[34000]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-09-10T23:56:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:20 smithi052 ceph-mon[33526]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:20 smithi052 ceph-mon[33526]: pgmap v423: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:20 smithi052 ceph-mon[33526]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-09-10T23:56:20.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.741+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f10d402e700 con 0x7f10b80b52e0 2024-09-10T23:56:20.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:20 smithi033 ceph-mon[30593]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:20.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:20 smithi033 ceph-mon[30593]: pgmap v423: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:20.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:20 smithi033 ceph-mon[30593]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.743+0000 7f10caa00640 1 -- 172.21.15.33:0/3535576336 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f10d402e700 con 0x7f10b80b52e0 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stdout:smithi052 172.21.15.52 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stdout:smithi189 172.21.15.189 2024-09-10T23:56:20.883 INFO:teuthology.orchestra.run.smithi033.stdout:3 hosts in cluster 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 msgr2=0x7f10b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 0x7f10b80b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f10c4006010 tx=0x7f10c4031400 comp rx=0 tx=0).stop 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 msgr2=0x7f10d41a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00eaa0 tx=0x7f10cc00ef60 comp rx=0 tx=0).stop 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 shutdown_connections 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10b80b52e0 0x7f10b80b77a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d41a0590 0x7f10d41a0a40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10d4076f80 0x7f10d419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 --2- 172.21.15.33:0/3535576336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10d4075b20 0x7f10d419f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 >> 172.21.15.33:0/3535576336 conn(0x7f10d40fe320 msgr2=0x7f10d4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 shutdown_connections 2024-09-10T23:56:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:20.746+0000 7f10d8a00640 1 -- 172.21.15.33:0/3535576336 wait complete. 2024-09-10T23:56:21.575 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T23:56:21.954 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:22.356 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:22 smithi033 ceph-mon[30593]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:22.356 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:22 smithi033 ceph-mon[30593]: pgmap v424: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:56:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:22 smithi189 ceph-mon[34000]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:22 smithi189 ceph-mon[34000]: pgmap v424: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 -- 172.21.15.33:0/3719736018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930076f80 msgr2=0x7fd9300755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 --2- 172.21.15.33:0/3719736018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930076f80 0x7fd9300755e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd920009900 tx=0x7fd92002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 -- 172.21.15.33:0/3719736018 shutdown_connections 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 --2- 172.21.15.33:0/3719736018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 0x7fd93010ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 --2- 172.21.15.33:0/3719736018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930075b20 0x7fd930075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 --2- 172.21.15.33:0/3719736018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930076f80 0x7fd9300755e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 -- 172.21.15.33:0/3719736018 >> 172.21.15.33:0/3719736018 conn(0x7fd9300fe320 msgr2=0x7fd930100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 -- 172.21.15.33:0/3719736018 shutdown_connections 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.595+0000 7fd935600640 1 -- 172.21.15.33:0/3719736018 wait complete. 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 Processor -- start 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 -- start start 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930076f80 0x7fd93019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 0x7fd93019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd930110790 con 0x7fd930075b20 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd930110610 con 0x7fd930076f80 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.597+0000 7fd935600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd930110910 con 0x7fd93010a960 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52226/0 (socket says 172.21.15.33:52226) 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 -- 172.21.15.33:0/3973165320 learned_addr learned my addr 172.21.15.33:0/3973165320 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92e000640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930076f80 0x7fd93019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92f400640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 0x7fd93019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 -- 172.21.15.33:0/3973165320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 msgr2=0x7fd93019c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 0x7fd93019c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 -- 172.21.15.33:0/3973165320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930076f80 msgr2=0x7fd93019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930076f80 0x7fd93019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 -- 172.21.15.33:0/3973165320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93019ca40 con 0x7fd930075b20 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.598+0000 7fd92ea00640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd920031460 tx=0x7fd920003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.599+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92003f070 con 0x7fd930075b20 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.599+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd920031ba0 con 0x7fd930075b20 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.599+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920035030 con 0x7fd930075b20 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.599+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93019ccd0 con 0x7fd930075b20 2024-09-10T23:56:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.599+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301a3240 con 0x7fd930075b20 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.600+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd930109770 con 0x7fd930075b20 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.602+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd92003b460 con 0x7fd930075b20 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.603+0000 7fd927400640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.604+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd920106dd0 con 0x7fd930075b20 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.604+0000 7fd92e000640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.604+0000 7fd92e000640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 0x7fd9140b7820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005d00 tx=0x7fd91c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.607+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd9200cd240 con 0x7fd930075b20 2024-09-10T23:56:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:22 smithi052 ceph-mon[33526]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:22 smithi052 ceph-mon[33526]: pgmap v424: 129 pgs: 129 active+clean; 644 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T23:56:22.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.812+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd930063590 con 0x7fd9140b5360 2024-09-10T23:56:22.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.814+0000 7fd927400640 1 -- 172.21.15.33:0/3973165320 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd930063590 con 0x7fd9140b5360 2024-09-10T23:56:22.815 INFO:teuthology.orchestra.run.smithi033.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T23:56:22.815 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-10T23:56:22.815 INFO:teuthology.orchestra.run.smithi033.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-09-10T23:56:22.815 INFO:teuthology.orchestra.run.smithi033.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 msgr2=0x7fd9140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 0x7fd9140b7820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005d00 tx=0x7fd91c00b410 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 msgr2=0x7fd93019af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd920031460 tx=0x7fd920003c10 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 shutdown_connections 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd9140b5360 0x7fd9140b7820 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd93010a960 0x7fd93019c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930076f80 0x7fd93019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 --2- 172.21.15.33:0/3973165320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd930075b20 0x7fd93019af10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.816+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 >> 172.21.15.33:0/3973165320 conn(0x7fd9300fe320 msgr2=0x7fd930106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.817+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 shutdown_connections 2024-09-10T23:56:22.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:22.817+0000 7fd935600640 1 -- 172.21.15.33:0/3973165320 wait complete. 2024-09-10T23:56:23.790 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T23:56:23.799 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:56:23.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T23:56:24.181 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:24 smithi189 ceph-mon[34000]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:24 smithi189 ceph-mon[34000]: pgmap v425: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:24.674 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:24 smithi033 ceph-mon[30593]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:24.674 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:24 smithi033 ceph-mon[30593]: pgmap v425: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:24 smithi052 ceph-mon[33526]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:24.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:24 smithi052 ceph-mon[33526]: pgmap v425: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:24.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.791+0000 7f5d4cc00640 1 -- 172.21.15.33:0/157330902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 msgr2=0x7f5d48106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:24.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.791+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/157330902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d48106220 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009930 tx=0x7f5d3002a420 comp rx=0 tx=0).stop 2024-09-10T23:56:24.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 -- 172.21.15.33:0/157330902 shutdown_connections 2024-09-10T23:56:24.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/157330902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48106760 0x7f5d4810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/157330902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d48106220 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/157330902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48104c40 0x7f5d48105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 -- 172.21.15.33:0/157330902 >> 172.21.15.33:0/157330902 conn(0x7f5d48100510 msgr2=0x7f5d48102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 -- 172.21.15.33:0/157330902 shutdown_connections 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.792+0000 7f5d4cc00640 1 -- 172.21.15.33:0/157330902 wait complete. 2024-09-10T23:56:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.793+0000 7f5d4cc00640 1 Processor -- start 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.793+0000 7f5d4cc00640 1 -- start start 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.793+0000 7f5d4cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48104c40 0x7f5d4819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d4cc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d4cc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48106760 0x7f5d4819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d4cc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d48110750 con 0x7f5d48105da0 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d4cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481105d0 con 0x7f5d48104c40 2024-09-10T23:56:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d4cc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d481108d0 con 0x7f5d48106760 2024-09-10T23:56:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d3d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d3d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52232/0 (socket says 172.21.15.33:52232) 2024-09-10T23:56:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d3d400640 1 -- 172.21.15.33:0/828358660 learned_addr learned my addr 172.21.15.33:0/828358660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d45e00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48104c40 0x7f5d4819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d46800640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48106760 0x7f5d4819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d3d400640 1 -- 172.21.15.33:0/828358660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48106760 msgr2=0x7f5d4819c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.794+0000 7f5d3d400640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48106760 0x7f5d4819c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3d400640 1 -- 172.21.15.33:0/828358660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48104c40 msgr2=0x7f5d4819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3d400640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48104c40 0x7f5d4819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3d400640 1 -- 172.21.15.33:0/828358660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4819c9d0 con 0x7f5d48105da0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3d400640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009a50 tx=0x7f5d30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3003f030 con 0x7f5d48105da0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d30003a80 con 0x7f5d48105da0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30035070 con 0x7f5d48105da0 2024-09-10T23:56:24.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.795+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4819cc60 con 0x7f5d48105da0 2024-09-10T23:56:24.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.796+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d481a33a0 con 0x7f5d48105da0 2024-09-10T23:56:24.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.797+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4810bfc0 con 0x7f5d48105da0 2024-09-10T23:56:24.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.799+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5d3003bcb0 con 0x7f5d48105da0 2024-09-10T23:56:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.800+0000 7f5d3f400640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 0x7f5d2c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.801+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5d30106ad0 con 0x7f5d48105da0 2024-09-10T23:56:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.801+0000 7f5d45e00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 0x7f5d2c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.801+0000 7f5d45e00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 0x7f5d2c0b7820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d38007ec0 tx=0x7f5d380075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:24.804+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5d300ccf40 con 0x7f5d48105da0 2024-09-10T23:56:25.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.042+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5d48063d50 con 0x7f5d48105da0 2024-09-10T23:56:25.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.043+0000 7f5d3f400640 1 -- 172.21.15.33:0/828358660 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3086 (secure 0 0 0) 0x7f5d300d1970 con 0x7f5d48105da0 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:e25 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:btime 2024-09-10T23:54:47:964548+0000 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 25 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-10T23:53:56.754883+0000 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-09-10T23:54:47.231868+0000 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 300 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-09-10T23:56:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 3 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1,2 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34688,1=34649,2=34622} 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3,4] 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-09-10T23:56:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:qdb_cluster leader: 34688 members: 34688,34649,34622 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b{0:34688} state up:active seq 5 addr [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.k{0:34595} state up:standby-replay seq 1 addr [v2:172.21.15.52:6832/1634418949,v1:172.21.15.52:6833/1634418949] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.h{1:34649} state up:active seq 20 addr [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c{1:24634} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/3553481852,v1:172.21.15.189:6837/3553481852] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.e{2:34622} state up:active seq 23 addr [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.f{2:24622} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/3755759093,v1:172.21.15.189:6835/3755759093] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.j{-1:14724} state up:standby seq 1 addr [v2:172.21.15.33:6834/1700135488,v1:172.21.15.33:6835/1700135488] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d{-1:14730} state up:standby seq 1 addr [v2:172.21.15.33:6836/3156147972,v1:172.21.15.33:6837/3156147972] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.i{-1:14775} state up:standby seq 1 addr [v2:172.21.15.189:6838/317615852,v1:172.21.15.189:6839/317615852] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.g{-1:14787} state up:standby seq 1 addr [v2:172.21.15.33:6838/1714634262,v1:172.21.15.33:6839/1714634262] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a{-1:14799} state up:standby seq 1 addr [v2:172.21.15.33:6840/1697461712,v1:172.21.15.33:6841/1697461712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.l{-1:24577} state up:standby seq 1 addr [v2:172.21.15.189:6832/588474684,v1:172.21.15.189:6833/588474684] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T23:56:25.048 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:56:25.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 msgr2=0x7f5d2c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 0x7f5d2c0b7820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d38007ec0 tx=0x7f5d380075b0 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 msgr2=0x7f5d4819b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009a50 tx=0x7f5d30004270 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 shutdown_connections 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5d2c0b5360 0x7f5d2c0b7820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d48106760 0x7f5d4819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d48105da0 0x7f5d4819b4f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 --2- 172.21.15.33:0/828358660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d48104c40 0x7f5d4819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 >> 172.21.15.33:0/828358660 conn(0x7f5d48100510 msgr2=0x7f5d48109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 shutdown_connections 2024-09-10T23:56:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:25.045+0000 7f5d4cc00640 1 -- 172.21.15.33:0/828358660 wait complete. 2024-09-10T23:56:25.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:25 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/828358660' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:56:25.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:25 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/828358660' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:56:25.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:25 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/828358660' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T23:56:25.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T23:56:26.249 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:26.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:26 smithi033 ceph-mon[30593]: pgmap v426: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:26 smithi052 ceph-mon[33526]: pgmap v426: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:26 smithi189 ceph-mon[34000]: pgmap v426: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 -- 172.21.15.33:0/3432759492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410ab40 msgr2=0x7f29d41114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 --2- 172.21.15.33:0/3432759492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410ab40 0x7f29d41114c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009ca0 tx=0x7f29cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 -- 172.21.15.33:0/3432759492 shutdown_connections 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 --2- 172.21.15.33:0/3432759492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410ab40 0x7f29d41114c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 --2- 172.21.15.33:0/3432759492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410a180 0x7f29d410a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 --2- 172.21.15.33:0/3432759492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 0x7f29d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 -- 172.21.15.33:0/3432759492 >> 172.21.15.33:0/3432759492 conn(0x7f29d40783a0 msgr2=0x7f29d407a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 -- 172.21.15.33:0/3432759492 shutdown_connections 2024-09-10T23:56:26.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.994+0000 7f29da800640 1 -- 172.21.15.33:0/3432759492 wait complete. 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.995+0000 7f29da800640 1 Processor -- start 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.995+0000 7f29da800640 1 -- start start 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 0x7f29d419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410ab40 0x7f29d41a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4114b70 con 0x7f29d410a180 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41149f0 con 0x7f29d410ab40 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29da800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4114cf0 con 0x7f29d4109250 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:26.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52246/0 (socket says 172.21.15.33:52246) 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 -- 172.21.15.33:0/3282347259 learned_addr learned my addr 172.21.15.33:0/3282347259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d3400640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 0x7f29d419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d3e00640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410ab40 0x7f29d41a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 -- 172.21.15.33:0/3282347259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 msgr2=0x7f29d419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 0x7f29d419f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 -- 172.21.15.33:0/3282347259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410ab40 msgr2=0x7f29d41a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.996+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410ab40 0x7f29d41a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29d2a00640 1 -- 172.21.15.33:0/3282347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d41a0dc0 con 0x7f29d410a180 2024-09-10T23:56:26.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f29c000e9f0 tx=0x7f29c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c000cd80 con 0x7f29d410a180 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c00108c0 con 0x7f29d410a180 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00187c0 con 0x7f29d410a180 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d41a10b0 con 0x7f29d410a180 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.997+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d41a7790 con 0x7f29d410a180 2024-09-10T23:56:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:26.999+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d4110380 con 0x7f29d410a180 2024-09-10T23:56:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.002+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f29c0010430 con 0x7f29d410a180 2024-09-10T23:56:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.003+0000 7f29cbe00640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.004+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f29c00e62c0 con 0x7f29d410a180 2024-09-10T23:56:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.004+0000 7f29d3400640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:27.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.004+0000 7f29d3400640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29c400bbe0 tx=0x7f29c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.007+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f29c00ac730 con 0x7f29d410a180 2024-09-10T23:56:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.206+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f29d4063d50 con 0x7f29d410a180 2024-09-10T23:56:27.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.207+0000 7f29cbe00640 1 -- 172.21.15.33:0/3282347259 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5643 (secure 0 0 0) 0x7f29c00b1160 con 0x7f29d410a180 2024-09-10T23:56:27.212 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 87 2024-09-10T23:56:27.212 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 63242646-6fce-11ef-bcea-c7b262605968 2024-09-10T23:56:27.212 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-09-10T23:43:51.795198+0000 2024-09-10T23:56:27.212 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-09-10T23:55:48.186249+0000 2024-09-10T23:56:27.212 INFO:teuthology.orchestra.run.smithi033.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:crush_version 27 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:full_ratio 0.95 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:backfillfull_ratio 0.9 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:nearfull_ratio 0.85 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:require_min_compat_client luminous 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:min_compat_client luminous 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:require_osd_release squid 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:stretch_mode_enabled false 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-10T23:56:27.213 INFO:teuthology.orchestra.run.smithi033.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:max_osd 12 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6802/2046959245,v1:172.21.15.33:6803/2046959245] [v2:172.21.15.33:6804/2046959245,v1:172.21.15.33:6805/2046959245] exists,up 770a7315-b2b7-4916-8b58-841896f5c42d 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6800/3373850910,v1:172.21.15.52:6801/3373850910] [v2:172.21.15.52:6802/3373850910,v1:172.21.15.52:6803/3373850910] exists,up fb29230e-70a8-47b9-bcb0-615a6af7ac0e 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/2060707768,v1:172.21.15.189:6801/2060707768] [v2:172.21.15.189:6802/2060707768,v1:172.21.15.189:6803/2060707768] exists,up d681ac2c-445f-4d58-9e24-1dbdf6f3eb27 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6810/525214774,v1:172.21.15.33:6811/525214774] [v2:172.21.15.33:6812/525214774,v1:172.21.15.33:6813/525214774] exists,up b7e5a213-1488-4280-81e2-70d506b36fb2 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 up in weight 1 up_from 31 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6808/3474115140,v1:172.21.15.52:6809/3474115140] [v2:172.21.15.52:6810/3474115140,v1:172.21.15.52:6811/3474115140] exists,up a411ce7d-b2de-4483-bad6-22a7514a2712 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 up in weight 1 up_from 36 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/4208509833,v1:172.21.15.189:6809/4208509833] [v2:172.21.15.189:6810/4208509833,v1:172.21.15.189:6811/4208509833] exists,up 2091d686-673d-429d-935b-6516891b8d6a 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 up in weight 1 up_from 42 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6818/3475374016,v1:172.21.15.33:6819/3475374016] [v2:172.21.15.33:6820/3475374016,v1:172.21.15.33:6821/3475374016] exists,up 8a9a4975-39c8-4996-94a0-a0b119b61b99 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6816/775777717,v1:172.21.15.52:6817/775777717] [v2:172.21.15.52:6818/775777717,v1:172.21.15.52:6819/775777717] exists,up 266fe9b2-62df-4671-81b3-100dc5abd315 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 up in weight 1 up_from 53 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/3739595846,v1:172.21.15.189:6817/3739595846] [v2:172.21.15.189:6818/3739595846,v1:172.21.15.189:6819/3739595846] exists,up 56e0c2a1-9cff-40f2-9dad-5119984743e4 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 up in weight 1 up_from 59 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6826/119922777,v1:172.21.15.33:6827/119922777] [v2:172.21.15.33:6828/119922777,v1:172.21.15.33:6829/119922777] exists,up 7c1eb7a4-412e-46b0-830c-138a45e0cc38 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 up in weight 1 up_from 64 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6824/2130690017,v1:172.21.15.52:6825/2130690017] [v2:172.21.15.52:6826/2130690017,v1:172.21.15.52:6827/2130690017] exists,up c44b0d1e-3875-477b-96ce-3e82126df19e 2024-09-10T23:56:27.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 up in weight 1 up_from 70 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/3659047878,v1:172.21.15.189:6825/3659047878] [v2:172.21.15.189:6826/3659047878,v1:172.21.15.189:6827/3659047878] exists,up 9ac102b3-44aa-4de6-a636-1fd62a7c05eb 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.14 [2,4] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.1b [2,4] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.1d [8,11] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.2 [3,9] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.2c [4,9] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.36 [4,9] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.39 [5,6] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.3a [4,8] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.2 [9,1] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.6 [5,8,9,11] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.18 [9,8] 2024-09-10T23:56:27.215 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/391857889 expires 2024-09-11T23:44:46.663521+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3555926237 expires 2024-09-11T23:44:46.663521+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/1526717857 expires 2024-09-11T23:44:46.663521+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/1302943839 expires 2024-09-11T23:44:46.663521+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/4044788418 expires 2024-09-11T23:44:17.611833+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/4044788418 expires 2024-09-11T23:44:17.611833+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/1302943839 expires 2024-09-11T23:44:46.663521+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3494052248 expires 2024-09-11T23:44:17.611833+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2678027127 expires 2024-09-11T23:44:17.611833+0000 2024-09-10T23:56:27.216 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2864911126 expires 2024-09-11T23:44:17.611833+0000 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 msgr2=0x7f29b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29c400bbe0 tx=0x7f29c400b390 comp rx=0 tx=0).stop 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 msgr2=0x7f29d419f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f29c000e9f0 tx=0x7f29c000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 shutdown_connections 2024-09-10T23:56:27.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:27.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d410ab40 0x7f29d41a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:27.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d410a180 0x7f29d419f8e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:27.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 --2- 172.21.15.33:0/3282347259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4109250 0x7f29d419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:27.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 >> 172.21.15.33:0/3282347259 conn(0x7f29d40783a0 msgr2=0x7f29d410d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:27.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.209+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 shutdown_connections 2024-09-10T23:56:27.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:27.210+0000 7f29da800640 1 -- 172.21.15.33:0/3282347259 wait complete. 2024-09-10T23:56:27.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:27 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3282347259' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:56:27.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:27 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3282347259' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:56:27.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:27 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3282347259' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T23:56:28.173 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T23:56:28.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:28.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:28 smithi033 ceph-mon[30593]: pgmap v427: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:28.568 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:28.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:28 smithi052 ceph-mon[33526]: pgmap v427: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:28 smithi189 ceph-mon[34000]: pgmap v427: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T23:56:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 -- 172.21.15.33:0/631851429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094102c10 msgr2=0x7fe094102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 --2- 172.21.15.33:0/631851429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094102c10 0x7fe094102ff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe084009900 tx=0x7fe08402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 -- 172.21.15.33:0/631851429 shutdown_connections 2024-09-10T23:56:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 --2- 172.21.15.33:0/631851429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 0x7fe09410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 --2- 172.21.15.33:0/631851429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094108620 0x7fe094108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 --2- 172.21.15.33:0/631851429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094102c10 0x7fe094102ff0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 -- 172.21.15.33:0/631851429 >> 172.21.15.33:0/631851429 conn(0x7fe0940fe660 msgr2=0x7fe094100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 -- 172.21.15.33:0/631851429 shutdown_connections 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.182+0000 7fe099400640 1 -- 172.21.15.33:0/631851429 wait complete. 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 Processor -- start 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 -- start start 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 0x7fe094198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 0x7fe09419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe094112b60 con 0x7fe094108620 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941129e0 con 0x7fe094102c10 2024-09-10T23:56:29.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.184+0000 7fe099400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe094112ce0 con 0x7fe094108fa0 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52260/0 (socket says 172.21.15.33:52260) 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 -- 172.21.15.33:0/2218101376 learned_addr learned my addr 172.21.15.33:0/2218101376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe098a00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 0x7fe09419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe093e00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 0x7fe094198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 -- 172.21.15.33:0/2218101376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 msgr2=0x7fe09419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 0x7fe09419e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 -- 172.21.15.33:0/2218101376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 msgr2=0x7fe094198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 0x7fe094198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 -- 172.21.15.33:0/2218101376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09419f000 con 0x7fe094108620 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe093e00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 0x7fe094198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.185+0000 7fe08be00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00e9f0 tx=0x7fe07c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:29.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.186+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c00cd80 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.186+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe07c0108c0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.186+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09419f2f0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.186+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0187c0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.186+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0941a59b0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.187+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe094102ff0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.191+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe07c010430 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.192+0000 7fe091600640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 0x7fe0780b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.192+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe07c0e68c0 con 0x7fe094108620 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.192+0000 7fe093e00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 0x7fe0780b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.193+0000 7fe093e00640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 0x7fe0780b7850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe084006010 tx=0x7fe084005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:29.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.194+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe07c0ad380 con 0x7fe094108620 2024-09-10T23:56:29.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.429+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0941a5ca0 con 0x7fe094108620 2024-09-10T23:56:29.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.430+0000 7fe091600640 1 -- 172.21.15.33:0/2218101376 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7fe07c0acc80 con 0x7fe094108620 2024-09-10T23:56:29.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:29.432 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:56:29.432 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 msgr2=0x7fe0780b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 0x7fe0780b7850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe084006010 tx=0x7fe084005a20 comp rx=0 tx=0).stop 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 msgr2=0x7fe094199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00e9f0 tx=0x7fe07c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 shutdown_connections 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe0780b5390 0x7fe0780b7850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe094108fa0 0x7fe09419e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe094108620 0x7fe094199490 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 --2- 172.21.15.33:0/2218101376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe094102c10 0x7fe094198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:29.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 >> 172.21.15.33:0/2218101376 conn(0x7fe0940fe660 msgr2=0x7fe0940ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:29.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 shutdown_connections 2024-09-10T23:56:29.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:29.433+0000 7fe099400640 1 -- 172.21.15.33:0/2218101376 wait complete. 2024-09-10T23:56:30.391 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:30.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:30 smithi052 ceph-mon[33526]: pgmap v428: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:30.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:30 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2218101376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:30.768 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:30.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:30 smithi033 ceph-mon[30593]: pgmap v428: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:30.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:30 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2218101376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:30 smithi189 ceph-mon[34000]: pgmap v428: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:30 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2218101376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 -- 172.21.15.33:0/102496674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 msgr2=0x7f080410ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 --2- 172.21.15.33:0/102496674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080410ee10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009900 tx=0x7f07ec02a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 -- 172.21.15.33:0/102496674 shutdown_connections 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 --2- 172.21.15.33:0/102496674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f080410f3e0 0x7f08041117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 --2- 172.21.15.33:0/102496674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080410ee10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 --2- 172.21.15.33:0/102496674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0804075540 0x7f0804075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.350+0000 7f0809600640 1 -- 172.21.15.33:0/102496674 >> 172.21.15.33:0/102496674 conn(0x7f08040fe830 msgr2=0x7f0804100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.351+0000 7f0809600640 1 -- 172.21.15.33:0/102496674 shutdown_connections 2024-09-10T23:56:31.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.351+0000 7f0809600640 1 -- 172.21.15.33:0/102496674 wait complete. 2024-09-10T23:56:31.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.352+0000 7f0809600640 1 Processor -- start 2024-09-10T23:56:31.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.352+0000 7f0809600640 1 -- start start 2024-09-10T23:56:31.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 0x7f080419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f080410f3e0 0x7f08041a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0804114e30 con 0x7f0804075f40 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0804114cb0 con 0x7f0804075540 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0809600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0804114fb0 con 0x7f080410f3e0 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f07fbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0802a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 0x7f080419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0802a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 0x7f080419b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:50596/0 (socket says 172.21.15.33:50596) 2024-09-10T23:56:31.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0802a00640 1 -- 172.21.15.33:0/1248206380 learned_addr learned my addr 172.21.15.33:0/1248206380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:31.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f07fbe00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55328/0 (socket says 172.21.15.33:55328) 2024-09-10T23:56:31.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.353+0000 7f0803400640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f080410f3e0 0x7f08041a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 -- 172.21.15.33:0/1248206380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f080410f3e0 msgr2=0x7f08041a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f080410f3e0 0x7f08041a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 -- 172.21.15.33:0/1248206380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 msgr2=0x7f080419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 0x7f080419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 -- 172.21.15.33:0/1248206380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08041a1370 con 0x7f0804075f40 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fbe00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005940 tx=0x7f07ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:31.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec03f070 con 0x7f0804075f40 2024-09-10T23:56:31.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ec03b460 con 0x7f0804075f40 2024-09-10T23:56:31.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec035070 con 0x7f0804075f40 2024-09-10T23:56:31.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.354+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08041a1600 con 0x7f0804075f40 2024-09-10T23:56:31.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.355+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08041a7d20 con 0x7f0804075f40 2024-09-10T23:56:31.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.356+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0804075920 con 0x7f0804075f40 2024-09-10T23:56:31.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.358+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f07ec04b060 con 0x7f0804075f40 2024-09-10T23:56:31.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.359+0000 7f07fb400640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:31.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.360+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f07ec106600 con 0x7f0804075f40 2024-09-10T23:56:31.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.360+0000 7f0802a00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:31.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.361+0000 7f0802a00640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 0x7f07e80b7820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ac90 tx=0x7f07f400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:31.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.365+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07ec0cca70 con 0x7f0804075f40 2024-09-10T23:56:31.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.597+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08041a7fb0 con 0x7f0804075f40 2024-09-10T23:56:31.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.598+0000 7f07fb400640 1 -- 172.21.15.33:0/1248206380 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11910 (secure 0 0 0) 0x7f07ec0d14a0 con 0x7f0804075f40 2024-09-10T23:56:31.600 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:31.600 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"btime":"2024-09-10T23:54:47:964548+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:54:47.231868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34688,34649,34622]},"id":1}]} 2024-09-10T23:56:31.600 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-09-10T23:56:31.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 msgr2=0x7f07e80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:31.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 0x7f07e80b7820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ac90 tx=0x7f07f400a380 comp rx=0 tx=0).stop 2024-09-10T23:56:31.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 msgr2=0x7f080419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005940 tx=0x7f07ec0042f0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 shutdown_connections 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f080410f3e0 0x7f08041a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0804075f40 0x7f080419b800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 --2- 172.21.15.33:0/1248206380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0804075540 0x7f080419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 >> 172.21.15.33:0/1248206380 conn(0x7f08040fe830 msgr2=0x7f0804111580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 shutdown_connections 2024-09-10T23:56:31.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:31.601+0000 7f0809600640 1 -- 172.21.15.33:0/1248206380 wait complete. 2024-09-10T23:56:32.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:56:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:32 smithi052 ceph-mon[33526]: pgmap v429: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:32.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:32 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1248206380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:32.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:32 smithi033 ceph-mon[30593]: pgmap v429: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:32 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1248206380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:32 smithi189 ceph-mon[34000]: pgmap v429: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T23:56:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:32 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1248206380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:32.847 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 -- 172.21.15.33:0/2184855977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 msgr2=0x7f1b20075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 --2- 172.21.15.33:0/2184855977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b20075920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009900 tx=0x7f1b1002a410 comp rx=0 tx=0).stop 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 -- 172.21.15.33:0/2184855977 shutdown_connections 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 --2- 172.21.15.33:0/2184855977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 --2- 172.21.15.33:0/2184855977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 0x7f1b2010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 --2- 172.21.15.33:0/2184855977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b20075920 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 -- 172.21.15.33:0/2184855977 >> 172.21.15.33:0/2184855977 conn(0x7f1b200fe830 msgr2=0x7f1b20100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 -- 172.21.15.33:0/2184855977 shutdown_connections 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.462+0000 7f1b25a00640 1 -- 172.21.15.33:0/2184855977 wait complete. 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.463+0000 7f1b25a00640 1 Processor -- start 2024-09-10T23:56:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.463+0000 7f1b25a00640 1 -- start start 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 0x7f1b2019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20114e20 con 0x7f1b20075540 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20114ca0 con 0x7f1b20075f40 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b25a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20114fa0 con 0x7f1b2010f3e0 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b1ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b1ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55358/0 (socket says 172.21.15.33:55358) 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b1ea00640 1 -- 172.21.15.33:0/347015867 learned_addr learned my addr 172.21.15.33:0/347015867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b16000640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 0x7f1b2019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.464+0000 7f1b1f400640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 -- 172.21.15.33:0/347015867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 msgr2=0x7f1b201a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 -- 172.21.15.33:0/347015867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 msgr2=0x7f1b2019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 0x7f1b2019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 -- 172.21.15.33:0/347015867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b201a1420 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1f400640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b1ea00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009230 tx=0x7f1b10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1003f030 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1b10003a80 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10035070 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.465+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b201a16b0 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.466+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b201a7dd0 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.466+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b20075920 con 0x7f1b20075540 2024-09-10T23:56:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.469+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1b1003bc30 con 0x7f1b20075540 2024-09-10T23:56:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.470+0000 7f1b17e00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 0x7f1b040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.470+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1b10106990 con 0x7f1b20075540 2024-09-10T23:56:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.470+0000 7f1b16000640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 0x7f1b040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.471+0000 7f1b16000640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 0x7f1b040b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b20111a00 tx=0x7f1b0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.474+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b100cd450 con 0x7f1b20075540 2024-09-10T23:56:33.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.670+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b201a8030 con 0x7f1b20075540 2024-09-10T23:56:33.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.671+0000 7f1b17e00640 1 -- 172.21.15.33:0/347015867 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24816 (secure 0 0 0) 0x7f1b100ccd50 con 0x7f1b20075540 2024-09-10T23:56:33.674 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:33.674 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:55:48.186249+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:56:33.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 msgr2=0x7f1b040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:33.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 0x7f1b040b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b20111a00 tx=0x7f1b0800b390 comp rx=0 tx=0).stop 2024-09-10T23:56:33.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 msgr2=0x7f1b2019b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009230 tx=0x7f1b10004270 comp rx=0 tx=0).stop 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 shutdown_connections 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1b040b5360 0x7f1b040b7820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b2010f3e0 0x7f1b201a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b20075f40 0x7f1b2019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 --2- 172.21.15.33:0/347015867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b20075540 0x7f1b2019b370 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 >> 172.21.15.33:0/347015867 conn(0x7f1b200fe830 msgr2=0x7f1b200ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 shutdown_connections 2024-09-10T23:56:33.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:33.674+0000 7f1b25a00640 1 -- 172.21.15.33:0/347015867 wait complete. 2024-09-10T23:56:34.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:53:56.754883+0000', 'modified': '2024-09-10T23:54:47.231868+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34688, 'mds_1': 34649, 'mds_2': 34622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24622': {'gid': 24622, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3755759093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3755759093}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3755759093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3553481852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3553481852}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3553481852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34595': {'gid': 34595, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/1634418949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 1634418949}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 1634418949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34622': {'gid': 34622, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.52:6835/3258065233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3258065233}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3258065233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34649': {'gid': 34649, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.52:6837/106203237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 106203237}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 106203237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34688': {'gid': 34688, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.52:6839/2315099444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 2315099444}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 2315099444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34688, 'qdb_cluster': [34688, 34649, 34622]} 2024-09-10T23:56:34.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:56:34.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:56:34.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:34 smithi033 ceph-mon[30593]: pgmap v430: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T23:56:34.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:34 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/347015867' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:34.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:34 smithi189 ceph-mon[34000]: pgmap v430: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T23:56:34.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:34 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/347015867' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:34 smithi052 ceph-mon[33526]: pgmap v430: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T23:56:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:34 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/347015867' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 -- 172.21.15.33:0/3667528223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a010b330 msgr2=0x7fd1a0111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 --2- 172.21.15.33:0/3667528223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a010b330 0x7fd1a0111b30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd198009ca0 tx=0x7fd19802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 -- 172.21.15.33:0/3667528223 shutdown_connections 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 --2- 172.21.15.33:0/3667528223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a010b330 0x7fd1a0111b30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 --2- 172.21.15.33:0/3667528223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 --2- 172.21.15.33:0/3667528223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a0104fa0 0x7fd1a0105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 -- 172.21.15.33:0/3667528223 >> 172.21.15.33:0/3667528223 conn(0x7fd1a0100a50 msgr2=0x7fd1a0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 -- 172.21.15.33:0/3667528223 shutdown_connections 2024-09-10T23:56:35.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.571+0000 7fd1a7800640 1 -- 172.21.15.33:0/3667528223 wait complete. 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.572+0000 7fd1a7800640 1 Processor -- start 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.572+0000 7fd1a7800640 1 -- start start 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a010b330 0x7fd1a01a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0114e60 con 0x7fd1a0104fa0 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0114ce0 con 0x7fd1a010a9b0 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a7800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0114fe0 con 0x7fd1a010b330 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55386/0 (socket says 172.21.15.33:55386) 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a4e00640 1 -- 172.21.15.33:0/4240413279 learned_addr learned my addr 172.21.15.33:0/4240413279 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd1a5800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a010b330 0x7fd1a01a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.573+0000 7fd19fe00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 -- 172.21.15.33:0/4240413279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a010b330 msgr2=0x7fd1a01a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a010b330 0x7fd1a01a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 -- 172.21.15.33:0/4240413279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 msgr2=0x7fd1a019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 -- 172.21.15.33:0/4240413279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a01a1400 con 0x7fd1a0104fa0 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd19fe00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd19400d950 tx=0x7fd19400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd19d600640 1 -- 172.21.15.33:0/4240413279 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194017070 con 0x7fd1a0104fa0 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd19d600640 1 -- 172.21.15.33:0/4240413279 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd194009c30 con 0x7fd1a0104fa0 2024-09-10T23:56:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd19d600640 1 -- 172.21.15.33:0/4240413279 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400f620 con 0x7fd1a0104fa0 2024-09-10T23:56:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.574+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01a16f0 con 0x7fd1a0104fa0 2024-09-10T23:56:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.575+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a01a7f80 con 0x7fd1a0104fa0 2024-09-10T23:56:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 Processor -- start 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 -- start start 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e9996fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9996fcb60 0x55e9997085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e999673d50 con 0x55e999708af0 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e999663180 con 0x55e9996fc240 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd1aa214740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e999666f90 con 0x55e9996fcb60 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55394/0 (socket says 172.21.15.33:55394) 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd19fe00640 1 -- 172.21.15.33:0/1735891661 learned_addr learned my addr 172.21.15.33:0/1735891661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.578+0000 7fd19d600640 1 -- 172.21.15.33:0/4240413279 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd194010460 con 0x7fd1a0104fa0 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd1a5800640 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e9996fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 -- 172.21.15.33:0/1735891661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9996fcb60 msgr2=0x55e9997085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9996fcb60 0x55e9997085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 -- 172.21.15.33:0/1735891661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 msgr2=0x55e9996fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e9996fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 -- 172.21.15.33:0/1735891661 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99962da70 con 0x55e999708af0 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.579+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009c30 tx=0x7fd18c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bf33338278debd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd192000640 1 -- 172.21.15.33:0/1735891661 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c004030 con 0x55e999708af0 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd192000640 1 -- 172.21.15.33:0/1735891661 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd18c0035f0 con 0x55e999708af0 2024-09-10T23:56:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd192000640 1 -- 172.21.15.33:0/1735891661 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c012670 con 0x55e999708af0 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 -- 172.21.15.33:0/1735891661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 msgr2=0x55e99970aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009c30 tx=0x7fd18c010740 comp rx=0 tx=0).stop 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 -- 172.21.15.33:0/1735891661 shutdown_connections 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e999708af0 0x55e99970aee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9996fcb60 0x55e9997085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1735891661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e9996fc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.580+0000 7fd1aa214740 1 -- 172.21.15.33:0/1735891661 >> 172.21.15.33:0/1735891661 conn(0x55e9996fa020 msgr2=0x55e9996fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd19d600640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 0x7fd1880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd1aa214740 1 -- 172.21.15.33:0/1735891661 shutdown_connections 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd1aa214740 1 -- 172.21.15.33:0/1735891661 wait complete. 2024-09-10T23:56:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd19d600640 1 -- 172.21.15.33:0/4240413279 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd1940e5c40 con 0x7fd1a0104fa0 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd19fe00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 0x7fd1880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.581+0000 7fd1aa214740 1 -- start start 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 Processor -- start 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd19fe00640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 0x7fd1880b7820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00a010 tx=0x7fd18c003f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999705ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e999706020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999706560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e9994c45f0 con 0x55e9996fcb60 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9995fe460 con 0x55e9996fc240 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e99970b840 con 0x55e999708af0 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.582+0000 7fd1aa214740 10 client.0 _ll_register_callbacks cb 0x55e99960e210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e999706020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e999706020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55404/0 (socket says 172.21.15.33:55404) 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd19fe00640 1 -- 172.21.15.33:0/1108829863 learned_addr learned my addr 172.21.15.33:0/1108829863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999705ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a5800640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999706560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1108829863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 msgr2=0x55e999706560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999706560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1108829863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 msgr2=0x55e999706020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e999706020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1108829863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9993c1540 con 0x55e9996fc240 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999705ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e9996ff3c0 tx=0x7fd1940aba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0cf50c992482f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.583+0000 7fd186a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:56:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194020070 con 0x55e9996fc240 2024-09-10T23:56:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e999600a70 con 0x55e9996fc240 2024-09-10T23:56:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd1940b07a0 con 0x55e9996fc240 2024-09-10T23:56:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd1940ac700 con 0x55e9996fc240 2024-09-10T23:56:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd1aa214740 10 client.35174 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e99961b6f0 con 0x55e9996fc240 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e999600a70 con 0x55e9996fc240 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.584+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd194097190 con 0x55e9996fc240 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 10 client.35174 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 10 client.35174 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 20 client.35174 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999722060 0x55e9997234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 4 client.35174 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e999675ca0 con 0x55e999722060 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.585+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999722060 0x55e9997234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.586+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999722060 0x55e9997234d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da4625f3fdb644ea server_cookie=d0c93fe4d5e20dd9 in_seq=0 out_seq=0 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.586+0000 7fd186a00640 10 client.35174 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd186a00640 1 -- 172.21.15.33:0/1108829863 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e999675ca0 con 0x55e999722060 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd186a00640 10 client.35174 handle_command_reply: tid=0 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 client.35174 shutdown 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 msgr2=0x55e999705ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999705ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e9996ff3c0 tx=0x7fd1940aba40 comp rx=0 tx=0).stop 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 shutdown_connections 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999722060 0x55e9997234d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999706560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e999706020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd186a00640 0 client.35174 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:35.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1108829863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999705ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 >> 172.21.15.33:0/1108829863 conn(0x55e9996fa020 msgr2=0x55e9996ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.587+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 shutdown_connections 2024-09-10T23:56:35.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.588+0000 7fd1aa214740 1 -- 172.21.15.33:0/1108829863 wait complete. 2024-09-10T23:56:35.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.588+0000 7fd1aa214740 20 client.35174 trim_cache size 0 max 16384 2024-09-10T23:56:35.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.606+0000 7fd1aa214740 1 Processor -- start 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.606+0000 7fd1aa214740 1 -- start start 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999700400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999704360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e999721810 con 0x55e9996fcb60 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e999721ee0 con 0x55e9996fc240 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1aa214740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9997225b0 con 0x55e999708af0 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd19fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55420/0 (socket says 172.21.15.33:55420) 2024-09-10T23:56:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd19fe00640 1 -- 172.21.15.33:0/2391358221 learned_addr learned my addr 172.21.15.33:0/2391358221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999700400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.607+0000 7fd1a5800640 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999704360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 -- 172.21.15.33:0/2391358221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 msgr2=0x55e999704360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999704360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 -- 172.21.15.33:0/2391358221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 msgr2=0x55e999700400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999700400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 -- 172.21.15.33:0/2391358221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99970b840 con 0x55e9996fcb60 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd19fe00640 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd18c003f80 tx=0x7fd18c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c4bd3099b0e39c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd191600640 1 -- 172.21.15.33:0/2391358221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c003a40 con 0x55e9996fcb60 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd191600640 1 -- 172.21.15.33:0/2391358221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd18c003be0 con 0x55e9996fcb60 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.608+0000 7fd191600640 1 -- 172.21.15.33:0/2391358221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c012c50 con 0x55e9996fcb60 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- 172.21.15.33:0/2391358221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 msgr2=0x55e9996fb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd18c003f80 tx=0x7fd18c024000 comp rx=0 tx=0).stop 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- 172.21.15.33:0/2391358221 shutdown_connections 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e999704360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fcb60 0x55e9996fb180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 --2- 172.21.15.33:0/2391358221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fc240 0x55e999700400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- 172.21.15.33:0/2391358221 >> 172.21.15.33:0/2391358221 conn(0x55e9996fa020 msgr2=0x55e999700d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- 172.21.15.33:0/2391358221 shutdown_connections 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- 172.21.15.33:0/2391358221 wait complete. 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.609+0000 7fd1aa214740 1 -- start start 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 Processor -- start 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fcb60 0x55e999726a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e99972b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e999723350 con 0x55e9996fc240 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e999722c80 con 0x55e9996fcb60 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e999723a20 con 0x55e999708af0 2024-09-10T23:56:35.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1aa214740 10 client.0 _ll_register_callbacks cb 0x7fd1940abe40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1a4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1a4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55430/0 (socket says 172.21.15.33:55430) 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1039321884 learned_addr learned my addr 172.21.15.33:0/1039321884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.610+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fcb60 0x55e999726a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a5800640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e99972b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1039321884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 msgr2=0x55e99972b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e99972b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fcb60 msgr2=0x55e999726a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fcb60 0x55e999726a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 -- 172.21.15.33:0/1039321884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99972bab0 con 0x55e9996fc240 2024-09-10T23:56:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1a4e00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd1940a85d0 tx=0x7fd1940abc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa13ef737d4f248a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd186a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194020070 con 0x55e9996fc240 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd1940ab260 con 0x55e9996fc240 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.611+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd18c003be0 con 0x55e9996fc240 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd1940a8650 con 0x55e9996fc240 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e99978f010 con 0x55e9996fc240 2024-09-10T23:56:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd18c003be0 con 0x55e9996fc240 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd1940c1b80 con 0x55e9996fc240 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 10 client.15381 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 20 client.15381 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999793a90 0x55e9997927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 4 client.15381 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.612+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "status"}) -- 0x55e999671750 con 0x55e999793a90 2024-09-10T23:56:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.613+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999793a90 0x55e9997927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.613+0000 7fd19fe00640 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999793a90 0x55e9997927a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e5015c20648cbe49 server_cookie=7f90eef08a2c2fc3 in_seq=0 out_seq=0 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.613+0000 7fd186a00640 10 client.15381 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd186a00640 1 -- 172.21.15.33:0/1039321884 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55e999671750 con 0x55e999793a90 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd186a00640 10 client.15381 handle_command_reply: tid=0 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 client.15381 shutdown 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 msgr2=0x55e999726520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd1940a85d0 tx=0x7fd1940abc70 comp rx=0 tx=0).stop 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 shutdown_connections 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55e999793a90 0x55e9997927a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e999708af0 0x55e99972b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9996fcb60 0x55e999726a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 --2- 172.21.15.33:0/1039321884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9996fc240 0x55e999726520 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 >> 172.21.15.33:0/1039321884 conn(0x55e9996fa020 msgr2=0x55e999707110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd186a00640 0 client.15381 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 shutdown_connections 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 1 -- 172.21.15.33:0/1039321884 wait complete. 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.614+0000 7fd1aa214740 20 client.15381 trim_cache size 0 max 16384 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34622, 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:35.622 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 112.669680529, 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 197.785837947 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:35.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 msgr2=0x7fd1880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 0x7fd1880b7820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00a010 tx=0x7fd18c003f10 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 msgr2=0x7fd1a019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd19400d950 tx=0x7fd19400de10 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 shutdown_connections 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1880b5360 0x7fd1880b7820 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1a010b330 0x7fd1a01a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1a010a9b0 0x7fd1a019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 --2- 172.21.15.33:0/4240413279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1a0104fa0 0x7fd1a019b350 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 >> 172.21.15.33:0/4240413279 conn(0x7fd1a0100a50 msgr2=0x7fd1a0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 shutdown_connections 2024-09-10T23:56:35.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:35.615+0000 7fd1a7800640 1 -- 172.21.15.33:0/4240413279 wait complete. 2024-09-10T23:56:36.428 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:56:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:36 smithi052 ceph-mon[33526]: pgmap v431: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:36 smithi033 ceph-mon[30593]: pgmap v431: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:36.810 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:36 smithi189 ceph-mon[34000]: pgmap v431: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 -- 172.21.15.33:0/3129645330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 msgr2=0x7fa6d410ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 --2- 172.21.15.33:0/3129645330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d410ecc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009900 tx=0x7fa6c002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 -- 172.21.15.33:0/3129645330 shutdown_connections 2024-09-10T23:56:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 --2- 172.21.15.33:0/3129645330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d410f200 0x7fa6d41115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 --2- 172.21.15.33:0/3129645330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d410ecc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 --2- 172.21.15.33:0/3129645330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d40754e0 0x7fa6d40758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 -- 172.21.15.33:0/3129645330 >> 172.21.15.33:0/3129645330 conn(0x7fa6d40fe660 msgr2=0x7fa6d4100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 -- 172.21.15.33:0/3129645330 shutdown_connections 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.405+0000 7fa6dac00640 1 -- 172.21.15.33:0/3129645330 wait complete. 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.406+0000 7fa6dac00640 1 Processor -- start 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.406+0000 7fa6dac00640 1 -- start start 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d40754e0 0x7fa6d419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d410f200 0x7fa6d41a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d4114c90 con 0x7fa6d4075e00 2024-09-10T23:56:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d4114b10 con 0x7fa6d410f200 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6dac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d4114e10 con 0x7fa6d40754e0 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55456/0 (socket says 172.21.15.33:55456) 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 -- 172.21.15.33:0/1425961630 learned_addr learned my addr 172.21.15.33:0/1425961630 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d9800640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d40754e0 0x7fa6d419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6da200640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d410f200 0x7fa6d41a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 -- 172.21.15.33:0/1425961630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d40754e0 msgr2=0x7fa6d419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d40754e0 0x7fa6d419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 -- 172.21.15.33:0/1425961630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d410f200 msgr2=0x7fa6d41a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d410f200 0x7fa6d41a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.407+0000 7fa6d8e00640 1 -- 172.21.15.33:0/1425961630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d41a1250 con 0x7fa6d4075e00 2024-09-10T23:56:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009230 tx=0x7fa6c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6d2000640 1 -- 172.21.15.33:0/1425961630 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c003f030 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6d2000640 1 -- 172.21.15.33:0/1425961630 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c0003a80 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6d2000640 1 -- 172.21.15.33:0/1425961630 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0035070 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d41a14e0 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.408+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d41a7c00 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.411+0000 7fa6dedc4740 1 Processor -- start 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.411+0000 7fa6dedc4740 1 -- start start 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6d2000640 1 -- 172.21.15.33:0/1425961630 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa6c003bbb0 con 0x7fa6d4075e00 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 0x55a7895487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548d20 0x55a789554770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a7895570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7894bfd50 con 0x55a789554cb0 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7894af180 con 0x55a789548400 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7894b2f90 con 0x55a789548d20 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a7895570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6da200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 0x55a7895487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a7895570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55458/0 (socket says 172.21.15.33:55458) 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6d8e00640 1 -- 172.21.15.33:0/1356754464 learned_addr learned my addr 172.21.15.33:0/1356754464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.412+0000 7fa6d9800640 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548d20 0x55a789554770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 -- 172.21.15.33:0/1356754464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548d20 msgr2=0x55a789554770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548d20 0x55a789554770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 -- 172.21.15.33:0/1356754464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 msgr2=0x55a7895570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a7895570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 -- 172.21.15.33:0/1356754464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a789479a70 con 0x55a789548400 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6da200640 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 0x55a7895487e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005fd0 tx=0x7fa6cc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b268a21c1d35f449 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6c6a00640 1 -- 172.21.15.33:0/1356754464 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc016070 con 0x55a789548400 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6c6a00640 1 -- 172.21.15.33:0/1356754464 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6cc004d20 con 0x55a789548400 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.413+0000 7fa6c6a00640 1 -- 172.21.15.33:0/1356754464 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc012740 con 0x55a789548400 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6d2000640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 0x7fa6bc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1356754464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 msgr2=0x55a7895487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 0x55a7895487e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005fd0 tx=0x7fa6cc010740 comp rx=0 tx=0).stop 2024-09-10T23:56:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6d2000640 1 -- 172.21.15.33:0/1425961630 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa6c01068d0 con 0x7fa6d4075e00 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1356754464 shutdown_connections 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a7895570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548d20 0x55a789554770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1356754464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548400 0x55a7895487e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1356754464 >> 172.21.15.33:0/1356754464 conn(0x55a789546230 msgr2=0x55a7895473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6d9800640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 0x7fa6bc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1356754464 shutdown_connections 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.414+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1356754464 wait complete. 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.415+0000 7fa6d9800640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 0x7fa6bc0b78d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a78954b580 tx=0x7fa6c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.415+0000 7fa6dedc4740 1 -- start start 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.415+0000 7fa6dedc4740 1 Processor -- start 2024-09-10T23:56:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a789551c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a789552680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7893105f0 con 0x55a789554cb0 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a78944a460 con 0x55a789548d20 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a789557a00 con 0x55a789548400 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6dedc4740 10 client.0 _ll_register_callbacks cb 0x55a78945a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a789552680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:50684/0 (socket says 172.21.15.33:50684) 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6d8e00640 1 -- 172.21.15.33:0/3529289825 learned_addr learned my addr 172.21.15.33:0/3529289825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6d9800640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a789551c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 -- 172.21.15.33:0/3529289825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 msgr2=0x55a789551c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a789551c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 -- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 msgr2=0x55a789552140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6da200640 1 -- 172.21.15.33:0/3529289825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a78920d540 con 0x55a789554cb0 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.416+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6da200640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a789552680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005a20 tx=0x7fa6cc012540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9e5a4e4bfcfa56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc029060 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa6cc012d80 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a78944ca70 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6cc030050 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6dedc4740 10 client.15393 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.417+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7894676f0 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a78944ca70 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x55a789554cb0 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 10 client.15393 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 10 client.15393 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 20 client.15393 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a789565610 0x55a789566a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 4 client.15393 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7894c1ca0 con 0x55a789565610 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.418+0000 7fa6d9800640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a789565610 0x55a789566a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.419+0000 7fa6d9800640 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a789565610 0x55a789566a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac3745e390c05c1a server_cookie=6f8e2da3007554ca in_seq=0 out_seq=0 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.419+0000 7fa6bb400640 10 client.15393 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6bb400640 1 -- 172.21.15.33:0/3529289825 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7894c1ca0 con 0x55a789565610 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6bb400640 10 client.15393 handle_command_reply: tid=0 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 client.15393 shutdown 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 msgr2=0x55a789552680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a789552680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005a20 tx=0x7fa6cc012540 comp rx=0 tx=0).stop 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 shutdown_connections 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a789565610 0x55a789566a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a789552680 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789552140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/3529289825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a789551c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 >> 172.21.15.33:0/3529289825 conn(0x55a789546230 msgr2=0x55a78954bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.420+0000 7fa6bb400640 0 client.15393 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.421+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 shutdown_connections 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.421+0000 7fa6dedc4740 1 -- 172.21.15.33:0/3529289825 wait complete. 2024-09-10T23:56:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.421+0000 7fa6dedc4740 20 client.15393 trim_cache size 0 max 16384 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 Processor -- start 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 -- start start 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a78954c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789547850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a789564dc0 con 0x55a789554cb0 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a789565490 con 0x55a789548d20 2024-09-10T23:56:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a789565b60 con 0x55a789548400 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6da200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6da200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55468/0 (socket says 172.21.15.33:55468) 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6da200640 1 -- 172.21.15.33:0/1777186150 learned_addr learned my addr 172.21.15.33:0/1777186150 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.440+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789547850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6d9800640 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a78954c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 -- 172.21.15.33:0/1777186150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 msgr2=0x55a78954c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a78954c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 -- 172.21.15.33:0/1777186150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 msgr2=0x55a789547850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789547850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 -- 172.21.15.33:0/1777186150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a789546cb0 con 0x55a789554cb0 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6da200640 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc0093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e871a8b15ccc9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6c6000640 1 -- 172.21.15.33:0/1777186150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc029030 con 0x55a789554cb0 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6c6000640 1 -- 172.21.15.33:0/1777186150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6cc010c40 con 0x55a789554cb0 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.441+0000 7fa6c6000640 1 -- 172.21.15.33:0/1777186150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc016070 con 0x55a789554cb0 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1777186150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 msgr2=0x55a78954ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc0093c0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1777186150 shutdown_connections 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789554cb0 0x55a78954ee10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789547850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/1777186150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789548400 0x55a78954c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1777186150 >> 172.21.15.33:0/1777186150 conn(0x55a789546230 msgr2=0x55a789547140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1777186150 shutdown_connections 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.442+0000 7fa6dedc4740 1 -- 172.21.15.33:0/1777186150 wait complete. 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 -- start start 2024-09-10T23:56:37.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 Processor -- start 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789568a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789554cb0 0x55a789569080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a789566900 con 0x55a789548400 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a789566230 con 0x55a789548d20 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a789566fd0 con 0x55a789554cb0 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.443+0000 7fa6dedc4740 10 client.0 _ll_register_callbacks cb 0x7fa6cc005840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789568a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55484/0 (socket says 172.21.15.33:55484) 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 -- 172.21.15.33:0/2061777598 learned_addr learned my addr 172.21.15.33:0/2061777598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6da200640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789554cb0 0x55a789569080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 -- 172.21.15.33:0/2061777598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789554cb0 msgr2=0x55a789569080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789554cb0 0x55a789569080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 -- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 msgr2=0x55a789568a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789568a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 -- 172.21.15.33:0/2061777598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7895418c0 con 0x55a789548400 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789568a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6d9800640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55a7895544f0 tx=0x7fa6c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d81011b4b1ab91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.444+0000 7fa6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8003a40 con 0x55a789548400 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa6c8003be0 con 0x55a789548400 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6cc010c40 con 0x55a789548400 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8039050 con 0x55a789548400 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6dedc4740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7895d1f50 con 0x55a789548400 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6cc010c40 con 0x55a789548400 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.445+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa6c802a450 con 0x55a789548400 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 10 client.15399 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 20 client.15399 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a7895d6ae0 0x55a7895d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 4 client.15399 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "status"}) -- 0x55a7894bd750 con 0x55a7895d6ae0 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.446+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a7895d6ae0 0x55a7895d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6d8e00640 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a7895d6ae0 0x55a7895d57f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=898e59d29b1f06fd server_cookie=1bc9196ef025853d in_seq=0 out_seq=0 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6bb400640 10 client.15399 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6bb400640 1 -- 172.21.15.33:0/2061777598 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a7894bd750 con 0x55a7895d6ae0 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6bb400640 10 client.15399 handle_command_reply: tid=0 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 client.15399 shutdown 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 msgr2=0x55a78956f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55a7895544f0 tx=0x7fa6c80046c0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 shutdown_connections 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55a7895d6ae0 0x55a7895d57f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a789554cb0 0x55a789569080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a789548d20 0x55a789568a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 --2- 172.21.15.33:0/2061777598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a789548400 0x55a78956f580 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 >> 172.21.15.33:0/2061777598 conn(0x55a789546230 msgr2=0x55a78955fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6bb400640 0 client.15399 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 shutdown_connections 2024-09-10T23:56:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.447+0000 7fa6dedc4740 1 -- 172.21.15.33:0/2061777598 wait complete. 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dedc4740 20 client.15399 trim_cache size 0 max 16384 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34649, 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:37.465 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 115.50978422599999, 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 188.952653672 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 msgr2=0x7fa6bc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 0x7fa6bc0b78d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a78954b580 tx=0x7fa6c8005f90 comp rx=0 tx=0).stop 2024-09-10T23:56:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 msgr2=0x7fa6d419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009230 tx=0x7fa6c0004270 comp rx=0 tx=0).stop 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 shutdown_connections 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6bc0b5410 0x7fa6bc0b78d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d410f200 0x7fa6d41a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d4075e00 0x7fa6d419b6e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 --2- 172.21.15.33:0/1425961630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6d40754e0 0x7fa6d419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 >> 172.21.15.33:0/1425961630 conn(0x7fa6d40fe660 msgr2=0x7fa6d40ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.448+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 shutdown_connections 2024-09-10T23:56:37.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:37.449+0000 7fa6dac00640 1 -- 172.21.15.33:0/1425961630 wait complete. 2024-09-10T23:56:38.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:56:38.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:38 smithi033 ceph-mon[30593]: pgmap v432: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:38 smithi052 ceph-mon[33526]: pgmap v432: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:38 smithi189 ceph-mon[34000]: pgmap v432: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T23:56:39.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 -- 172.21.15.33:0/2698401397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560102da0 msgr2=0x7f8560103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 --2- 172.21.15.33:0/2698401397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560102da0 0x7f8560103180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8550009900 tx=0x7f855002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 -- 172.21.15.33:0/2698401397 shutdown_connections 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 --2- 172.21.15.33:0/2698401397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560109130 0x7f856010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 --2- 172.21.15.33:0/2698401397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 0x7f8560108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 --2- 172.21.15.33:0/2698401397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560102da0 0x7f8560103180 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.358+0000 7f8566a00640 1 -- 172.21.15.33:0/2698401397 >> 172.21.15.33:0/2698401397 conn(0x7f85600fe810 msgr2=0x7f8560100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.359+0000 7f8566a00640 1 -- 172.21.15.33:0/2698401397 shutdown_connections 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.359+0000 7f8566a00640 1 -- 172.21.15.33:0/2698401397 wait complete. 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.359+0000 7f8566a00640 1 Processor -- start 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 -- start start 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560102da0 0x7f8560199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 0x7f8560199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8560112cb0 con 0x7f8560109130 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8560112b30 con 0x7f8560102da0 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8566a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8560112e30 con 0x7f85601087b0 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8564a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8564a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55498/0 (socket says 172.21.15.33:55498) 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8564a00640 1 -- 172.21.15.33:0/3559739634 learned_addr learned my addr 172.21.15.33:0/3559739634 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f855fe00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560102da0 0x7f8560199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.360+0000 7f8557e00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 0x7f8560199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 -- 172.21.15.33:0/3559739634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 msgr2=0x7f8560199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 0x7f8560199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 -- 172.21.15.33:0/3559739634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560102da0 msgr2=0x7f8560199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560102da0 0x7f8560199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 -- 172.21.15.33:0/3559739634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856019f1f0 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f8564a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f855800eaa0 tx=0x7f855800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f855d600640 1 -- 172.21.15.33:0/3559739634 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558004d20 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.361+0000 7f855d600640 1 -- 172.21.15.33:0/3559739634 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8558005020 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.362+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856019f4e0 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.362+0000 7f855d600640 1 -- 172.21.15.33:0/3559739634 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85580116d0 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.362+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85601a5ba0 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.365+0000 7f8569618740 1 Processor -- start 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f855d600640 1 -- 172.21.15.33:0/3559739634 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f855800f040 con 0x7f8560109130 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 -- start start 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 0x563353d4c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563353cb3d50 con 0x563353d4cf00 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563353ca3180 con 0x563353d40f70 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.366+0000 7f8569618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563353ca6f90 con 0x563353d40650 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f8557e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f8557e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55514/0 (socket says 172.21.15.33:55514) 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 0x563353d4c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f8557e00640 1 -- 172.21.15.33:0/3873401024 learned_addr learned my addr 172.21.15.33:0/3873401024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f8557e00640 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 -- 172.21.15.33:0/3873401024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 msgr2=0x563353d40a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d40a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 -- 172.21.15.33:0/3873401024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 msgr2=0x563353d4f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f855fe00640 1 -- 172.21.15.33:0/3873401024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563353c6da70 con 0x563353d40f70 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.367+0000 7f8557e00640 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f855fe00640 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 0x563353d4c9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f855002a910 tx=0x7f8550000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9ad51499cb5cd2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f8555200640 1 -- 172.21.15.33:0/3873401024 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550040070 con 0x563353d40f70 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f855d600640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 0x7f85440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f8555200640 1 -- 172.21.15.33:0/3873401024 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8550004490 con 0x563353d40f70 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f8555200640 1 -- 172.21.15.33:0/3873401024 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550035040 con 0x563353d40f70 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f855d600640 1 -- 172.21.15.33:0/3559739634 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f85580e5df0 con 0x7f8560109130 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.368+0000 7f8557e00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 0x7f85440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 -- 172.21.15.33:0/3873401024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 msgr2=0x563353d4c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 0x563353d4c9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f855002a910 tx=0x7f8550000bc0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8557e00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 0x7f85440b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f854800a5c0 tx=0x7f854800a760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 -- 172.21.15.33:0/3873401024 shutdown_connections 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d4cf00 0x563353d4f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d40f70 0x563353d4c9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 --2- 172.21.15.33:0/3873401024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d40a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 -- 172.21.15.33:0/3873401024 >> 172.21.15.33:0/3873401024 conn(0x563353d3e430 msgr2=0x563353d3f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 -- 172.21.15.33:0/3873401024 shutdown_connections 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.369+0000 7f8569618740 1 -- 172.21.15.33:0/3873401024 wait complete. 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 -- start start 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 Processor -- start 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d4a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d4a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563353b045f0 con 0x563353d40650 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563353c3e460 con 0x563353d4cf00 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563353d4fbc0 con 0x563353d40f70 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.370+0000 7f8569618740 10 client.0 _ll_register_callbacks cb 0x563353c4e210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55526/0 (socket says 172.21.15.33:55526) 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 -- 172.21.15.33:0/3046061863 learned_addr learned my addr 172.21.15.33:0/3046061863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f8557e00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d4a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f8564a00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d4a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 -- 172.21.15.33:0/3046061863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 msgr2=0x563353d4a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d4a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 -- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 msgr2=0x563353d4a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d4a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.371+0000 7f855fe00640 1 -- 172.21.15.33:0/3046061863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563353a01540 con 0x563353d40650 2024-09-10T23:56:39.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f855fe00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f85500045f0 tx=0x7f85500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4367147f3bf91a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f854d600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550040070 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8550005200 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563353c40a70 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8550056050 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f8569618740 10 client.15411 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563353c5b6f0 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.372+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563353c40a70 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f855003cc70 con 0x563353d40650 2024-09-10T23:56:39.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 10 client.15411 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 10 client.15411 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 20 client.15411 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353d5d6d0 0x563353d5eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 4 client.15411 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563353cb5ca0 con 0x563353d5d6d0 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.373+0000 7f8557e00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353d5d6d0 0x563353d5eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.374+0000 7f8557e00640 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353d5d6d0 0x563353d5eb40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5913c6c5de702934 server_cookie=cd20b7dd898ee16d in_seq=0 out_seq=0 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.374+0000 7f854d600640 10 client.15411 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f854d600640 1 -- 172.21.15.33:0/3046061863 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563353cb5ca0 con 0x563353d5d6d0 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f854d600640 10 client.15411 handle_command_reply: tid=0 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 client.15411 shutdown 2024-09-10T23:56:39.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 msgr2=0x563353d49e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f85500045f0 tx=0x7f85500046c0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 shutdown_connections 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d4a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353d5d6d0 0x563353d5eb40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d4a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 --2- 172.21.15.33:0/3046061863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d49e90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 >> 172.21.15.33:0/3046061863 conn(0x563353d3e430 msgr2=0x563353d44020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f854d600640 0 client.15411 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.375+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 shutdown_connections 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.376+0000 7f8569618740 1 -- 172.21.15.33:0/3046061863 wait complete. 2024-09-10T23:56:39.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.376+0000 7f8569618740 20 client.15411 trim_cache size 0 max 16384 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 Processor -- start 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 -- start start 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d44730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d475e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563353d5ce80 con 0x563353d40f70 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563353d5d550 con 0x563353d4cf00 2024-09-10T23:56:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8569618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563353d5dc20 con 0x563353d40650 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8557e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8557e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55530/0 (socket says 172.21.15.33:55530) 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.395+0000 7f8557e00640 1 -- 172.21.15.33:0/4254391256 learned_addr learned my addr 172.21.15.33:0/4254391256 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f855fe00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d44730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 -- 172.21.15.33:0/4254391256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 msgr2=0x563353d44730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d44730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 -- 172.21.15.33:0/4254391256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 msgr2=0x563353d475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8564a00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 -- 172.21.15.33:0/4254391256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563353d3eeb0 con 0x563353d40f70 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8564a00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:56:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f8557e00640 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f854800fb00 tx=0x7f85480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d707147cc7a5fba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f854fe00640 1 -- 172.21.15.33:0/4254391256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85480241d0 con 0x563353d40f70 2024-09-10T23:56:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f854fe00640 1 -- 172.21.15.33:0/4254391256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8548024db0 con 0x563353d40f70 2024-09-10T23:56:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.396+0000 7f854fe00640 1 -- 172.21.15.33:0/4254391256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548022740 con 0x563353d40f70 2024-09-10T23:56:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 -- 172.21.15.33:0/4254391256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 msgr2=0x563353d470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f854800fb00 tx=0x7f85480046c0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 -- 172.21.15.33:0/4254391256 shutdown_connections 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40f70 0x563353d470a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 --2- 172.21.15.33:0/4254391256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40650 0x563353d44730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 -- 172.21.15.33:0/4254391256 >> 172.21.15.33:0/4254391256 conn(0x563353d3e430 msgr2=0x563353d45140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 -- 172.21.15.33:0/4254391256 shutdown_connections 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.397+0000 7f8569618740 1 -- 172.21.15.33:0/4254391256 wait complete. 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 -- start start 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 Processor -- start 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d61a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563353d5e9c0 con 0x563353d40650 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563353d5e2f0 con 0x563353d4cf00 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563353d5f090 con 0x563353d40f70 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.398+0000 7f8569618740 10 client.0 _ll_register_callbacks cb 0x7f8550004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55546/0 (socket says 172.21.15.33:55546) 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 -- 172.21.15.33:0/857989000 learned_addr learned my addr 172.21.15.33:0/857989000 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f8564a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d61a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f8557e00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 -- 172.21.15.33:0/857989000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 msgr2=0x563353d614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 -- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 msgr2=0x563353d61a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:56:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d61a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 -- 172.21.15.33:0/857989000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563353d669d0 con 0x563353d40650 2024-09-10T23:56:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f855fe00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f855002a430 tx=0x7f8550005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06ae76dd3574403 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.399+0000 7f854d600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855005f060 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8550003e80 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8548024db0 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8550066050 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f8569618740 10 client.15417 fetch_fsmap learned FSMap version 25 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563353dca510 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8548024db0 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.400+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f855003c440 con 0x563353d40650 2024-09-10T23:56:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 10 client.15417 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 10 client.15417 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 20 client.15417 populate_metadata read hostname 'smithi033' 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353dcf070 0x563353dcdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 4 client.15417 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "status"}) -- 0x563353cb1750 con 0x563353dcf070 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.401+0000 7f8557e00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353dcf070 0x563353dcdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8557e00640 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353dcf070 0x563353dcdd80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd58877848ed45de server_cookie=97b3d8cce1eff969 in_seq=0 out_seq=0 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f854d600640 10 client.15417 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f854d600640 1 -- 172.21.15.33:0/857989000 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563353cb1750 con 0x563353dcf070 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f854d600640 10 client.15417 handle_command_reply: tid=0 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 client.15417 shutdown 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 msgr2=0x563353d60fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f855002a430 tx=0x7f8550005dc0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 shutdown_connections 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563353d4cf00 0x563353d61a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563353dcf070 0x563353dcdd80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563353d40f70 0x563353d614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 --2- 172.21.15.33:0/857989000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563353d40650 0x563353d60fa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f854d600640 0 client.15417 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.402+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 >> 172.21.15.33:0/857989000 conn(0x563353d3e430 msgr2=0x563353d38920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 shutdown_connections 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8569618740 1 -- 172.21.15.33:0/857989000 wait complete. 2024-09-10T23:56:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8569618740 20 client.15417 trim_cache size 0 max 16384 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34688, 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 161.664403561, 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 25, 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:56:39.409 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 85, 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 175.19438822699999 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 msgr2=0x7f85440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 0x7f85440b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f854800a5c0 tx=0x7f854800a760 comp rx=0 tx=0).stop 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 msgr2=0x7f856019ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f855800eaa0 tx=0x7f855800eea0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 shutdown_connections 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f85440b52e0 0x7f85440b77a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8560109130 0x7f856019ea20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f85601087b0 0x7f8560199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.403+0000 7f8566a00640 1 --2- 172.21.15.33:0/3559739634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8560102da0 0x7f8560199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.404+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 >> 172.21.15.33:0/3559739634 conn(0x7f85600fe810 msgr2=0x7f8560100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.404+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 shutdown_connections 2024-09-10T23:56:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:39.404+0000 7f8566a00640 1 -- 172.21.15.33:0/3559739634 wait complete. 2024-09-10T23:56:40.284 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T23:56:40.296 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T23:56:40.296 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-10T23:56:40.296 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-10T23:56:40.296 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:56:40.297 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-10T23:56:40.297 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-10T23:56:40.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:40.297 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-10T23:56:40.334 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T23:56:40.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:40.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:56:40.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:40.434 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-10T23:56:40.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:40 smithi033 ceph-mon[30593]: pgmap v433: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:40 smithi052 ceph-mon[33526]: pgmap v433: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:40.759 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T23:56:40.759 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:56:40.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T23:56:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:40 smithi189 ceph-mon[34000]: pgmap v433: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:41.141 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 -- 172.21.15.33:0/216028007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5938077ff0 msgr2=0x7f59381132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 --2- 172.21.15.33:0/216028007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5938077ff0 0x7f59381132a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5924009900 tx=0x7f592402a410 comp rx=0 tx=0).stop 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 -- 172.21.15.33:0/216028007 shutdown_connections 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 --2- 172.21.15.33:0/216028007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59381137e0 0x7f5938115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 --2- 172.21.15.33:0/216028007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5938077ff0 0x7f59381132a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 --2- 172.21.15.33:0/216028007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59380776d0 0x7f5938077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 -- 172.21.15.33:0/216028007 >> 172.21.15.33:0/216028007 conn(0x7f5938100840 msgr2=0x7f5938102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 -- 172.21.15.33:0/216028007 shutdown_connections 2024-09-10T23:56:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.963+0000 7f593ea00640 1 -- 172.21.15.33:0/216028007 wait complete. 2024-09-10T23:56:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.964+0000 7f593ea00640 1 Processor -- start 2024-09-10T23:56:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.964+0000 7f593ea00640 1 -- start start 2024-09-10T23:56:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 0x7f593819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 0x7f593819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f59381190c0 con 0x7f59381137e0 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5938118f40 con 0x7f5938077ff0 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5938119240 con 0x7f59380776d0 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 0x7f593819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40496/0 (socket says 172.21.15.33:40496) 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593e000640 1 -- 172.21.15.33:0/20436973 learned_addr learned my addr 172.21.15.33:0/20436973 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.965+0000 7f593d600640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 0x7f593819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 -- 172.21.15.33:0/20436973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 msgr2=0x7f593819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 0x7f593819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 -- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 msgr2=0x7f59381a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 -- 172.21.15.33:0/20436973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59381a5580 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593d600640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 0x7f593819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593e000640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.966+0000 7f593cc00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 0x7f593819fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f592402a930 tx=0x7f5924003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.967+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592403f070 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.967+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f592403baf0 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.967+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59381a5810 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.967+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924035030 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.967+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59381abf30 con 0x7f5938077ff0 2024-09-10T23:56:41.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.968+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5938077ab0 con 0x7f5938077ff0 2024-09-10T23:56:41.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.970+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f592403b660 con 0x7f5938077ff0 2024-09-10T23:56:41.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.972+0000 7f5936000640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 0x7f59200b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:41.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.972+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5924106f20 con 0x7f5938077ff0 2024-09-10T23:56:41.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.972+0000 7f593d600640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 0x7f59200b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:41.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.973+0000 7f593d600640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 0x7f59200b78d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f592c009c20 tx=0x7f592c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:41.974+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f59240cd9e0 con 0x7f5938077ff0 2024-09-10T23:56:42.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.208+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f59381a0600 con 0x7f5938077ff0 2024-09-10T23:56:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.209+0000 7f5936000640 1 -- 172.21.15.33:0/20436973 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7f59240cd2e0 con 0x7f5938077ff0 2024-09-10T23:56:42.211 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:56:42.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 msgr2=0x7f59200b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:42.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 0x7f59200b78d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f592c009c20 tx=0x7f592c005f90 comp rx=0 tx=0).stop 2024-09-10T23:56:42.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 msgr2=0x7f593819fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:42.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 0x7f593819fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f592402a930 tx=0x7f5924003b90 comp rx=0 tx=0).stop 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 shutdown_connections 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f59200b5410 0x7f59200b78d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59381137e0 0x7f59381a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5938077ff0 0x7f593819fa10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 --2- 172.21.15.33:0/20436973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f59380776d0 0x7f593819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 >> 172.21.15.33:0/20436973 conn(0x7f5938100840 msgr2=0x7f5938102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 shutdown_connections 2024-09-10T23:56:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:42.211+0000 7f593ea00640 1 -- 172.21.15.33:0/20436973 wait complete. 2024-09-10T23:56:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:42 smithi033 ceph-mon[30593]: pgmap v434: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/20436973' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:56:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:42 smithi052 ceph-mon[33526]: pgmap v434: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:42 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/20436973' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:56:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:42 smithi189 ceph-mon[34000]: pgmap v434: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T23:56:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:42 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/20436973' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-10T23:56:43.167 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:56:43.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:56:43.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:56:43.168 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-10T23:56:43.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:43.168 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:56:43.206 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41899sec preferred_lft 41899sec 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:56:43.207 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-09-10T23:56:43.208 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:56:43.208 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:56:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:56:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:43.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:43.434 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:56:43.491 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-09-10T23:56:43.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:43.494 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-09-10T23:56:43.531 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-09-10T23:56:43.531 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:56:43.531 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T23:56:43.531 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T23:56:43.531 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:56:43.531 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:56:43.532 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:56:43.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:56:43.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:56:43.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:56:43.532 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:56:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:56:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:43.731 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-10T23:56:43.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:43.770 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-09-10T23:56:43.846 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:56:43.846 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:56:43.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-10T23:56:43.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-10T23:56:43.846 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:56:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:56:44.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:44.023 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-10T23:56:44.023 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:56:44.023 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:56:44.023 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-10T23:56:44.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:56:44.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-10T23:56:44.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-10T23:56:44.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-10T23:56:44.024 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:56:44.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:56:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:44.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:56:44.244 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-09-10T23:56:44.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-09-10T23:56:44.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:56:44.244 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-09-10T23:56:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:56:44.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:44.413 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-10T23:56:44.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:56:44.413 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /tmp/cephfs 2024-09-10T23:56:44.449 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-10T23:56:44.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:56:44.450 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /tmp/cephfs 2024-09-10T23:56:44.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-10T23:56:44.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:44 smithi033 ceph-mon[30593]: pgmap v435: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:44.582 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:56:44.619 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-10T23:56:44.619 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-10T23:56:44.619 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-10T23:56:44.619 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-10T23:56:44.620 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/437b4d012036d8e3af53a023523cce54ac31ed96826d8160f06091a1e02047c9/merged 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/085d82ac78b4762fcce28eb773044281472f5b3a7eaa86eae6180251ddb1647d/merged 2024-09-10T23:56:44.621 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ecc68c373b467fb5798dbd35f04b9dc0807fa04870fda58548a08ee2210a883e/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/6cd0914955d8c45c80d646495269c19810a2703a67cd70de091bee394028df86/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c1520af8389fe03b1b0169460a2b41f889bd48168b8e57f5051f152da3640d22/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/938483e170c5c2711581d0c09d07bfe535acc9d75679ae5e49a68ee4b8212b7c/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/4901f7d0058de69266e4753965f0253b8b2a1ada6d307792f03032e10c8eb511/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f4a70eeb387e14bc2f9b9ab21574e68b3f2b7852a0a2ad752870f62a52982392/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/fd697faf9c5292486f7c4a6750a1ed3d2888b4edbc864d21e03578952a7e3d4c/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/0cb546a2397883b1c46cc26aded6a710a1d66144a17be23c4d76218bae519e82/merged 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-10T23:56:44.622 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-10T23:56:44.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:44.623 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-10T23:56:44.699 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:56:44.699 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/ff3e19cf-8017-4e6a-ab1d-9470571e50c1 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-09-10T23:56:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:44 smithi052 ceph-mon[33526]: pgmap v435: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:44.745 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-09-10T23:56:44.802 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:56:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:44 smithi189 ceph-mon[34000]: pgmap v435: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T23:56:44.840 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-09-10T23:56:44.840 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:56:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-09-10T23:56:44.842 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/437b4d012036d8e3af53a023523cce54ac31ed96826d8160f06091a1e02047c9/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/085d82ac78b4762fcce28eb773044281472f5b3a7eaa86eae6180251ddb1647d/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ecc68c373b467fb5798dbd35f04b9dc0807fa04870fda58548a08ee2210a883e/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/6cd0914955d8c45c80d646495269c19810a2703a67cd70de091bee394028df86/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/c1520af8389fe03b1b0169460a2b41f889bd48168b8e57f5051f152da3640d22/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/938483e170c5c2711581d0c09d07bfe535acc9d75679ae5e49a68ee4b8212b7c/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/4901f7d0058de69266e4753965f0253b8b2a1ada6d307792f03032e10c8eb511/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f4a70eeb387e14bc2f9b9ab21574e68b3f2b7852a0a2ad752870f62a52982392/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/fd697faf9c5292486f7c4a6750a1ed3d2888b4edbc864d21e03578952a7e3d4c/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/0cb546a2397883b1c46cc26aded6a710a1d66144a17be23c4d76218bae519e82/merged 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-09-10T23:56:44.843 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-10T23:56:44.844 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-10T23:56:44.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:44.845 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-09-10T23:56:44.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:2024-09-10T23:56:44.895+0000 7fc74540c480 -1 init, newargv = 0x562faf366f50 newargc=17 2024-09-10T23:56:44.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[86608]: starting ceph client 2024-09-10T23:56:44.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[86608]: starting fuse 2024-09-10T23:56:44.922 INFO:teuthology.orchestra.run.smithi033.stdout:120 2024-09-10T23:56:44.923 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:56:44.923 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/tmp/cephfs" 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:56:44.924 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.0")) 2024-09-10T23:56:44.925 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-09-10T23:56:45.087 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.0.86608.asok 2024-09-10T23:56:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:56:45.101 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86608.asok 2024-09-10T23:56:45.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:45.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86608.asok status 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "0", 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-09-10T23:56:45.287 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/tmp/cephfs", 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "86608", 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/volumes/qa/sv_0/ff3e19cf-8017-4e6a-ab1d-9470571e50c1" 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 15429, 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 15429 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:56:45.288 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3590068642 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3590068642 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.15429 192.168.0.1:0/3590068642", 2024-09-10T23:56:45.289 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/3590068642", 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 5, 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 25, 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 87, 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-09-10T23:56:45.290 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:56:45.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:45.300 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-09-10T23:56:45.300 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /tmp/cephfs 2024-09-10T23:56:45.336 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-09-10T23:56:45.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-09-10T23:56:45.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:56:45.336 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /tmp/cephfs 2024-09-10T23:56:45.434 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:56:45.448 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:56:45.448 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:56:45.449 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-10T23:56:45.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 -- 172.21.15.33:0/33412914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc103ac0 msgr2=0x7f81bc103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:45.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 --2- 172.21.15.33:0/33412914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc103ac0 0x7f81bc103f40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009930 tx=0x7f81a802a420 comp rx=0 tx=0).stop 2024-09-10T23:56:45.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 -- 172.21.15.33:0/33412914 shutdown_connections 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 --2- 172.21.15.33:0/33412914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 0x7f81bc10ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 --2- 172.21.15.33:0/33412914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc103ac0 0x7f81bc103f40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 --2- 172.21.15.33:0/33412914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc102970 0x7f81bc102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 -- 172.21.15.33:0/33412914 >> 172.21.15.33:0/33412914 conn(0x7f81bc0fe250 msgr2=0x7f81bc100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 -- 172.21.15.33:0/33412914 shutdown_connections 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.602+0000 7f81c2a00640 1 -- 172.21.15.33:0/33412914 wait complete. 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.603+0000 7f81c2a00640 1 Processor -- start 2024-09-10T23:56:45.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.603+0000 7f81c2a00640 1 -- start start 2024-09-10T23:56:45.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc103ac0 0x7f81bc19b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 0x7f81bc19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10e490 con 0x7f81bc102970 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10e310 con 0x7f81bc104480 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c2a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10e610 con 0x7f81bc103ac0 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40520/0 (socket says 172.21.15.33:40520) 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 -- 172.21.15.33:0/294708407 learned_addr learned my addr 172.21.15.33:0/294708407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:45.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bb400640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc103ac0 0x7f81bc19b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81c0a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 0x7f81bc19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 -- 172.21.15.33:0/294708407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc103ac0 msgr2=0x7f81bc19b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc103ac0 0x7f81bc19b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 -- 172.21.15.33:0/294708407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 msgr2=0x7f81bc19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 0x7f81bc19c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.604+0000 7f81bbe00640 1 -- 172.21.15.33:0/294708407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc19c9e0 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81bbe00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9f0 tx=0x7f81ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00cd80 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc19ccd0 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81ac0054b0 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac010430 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.605+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc1a33a0 con 0x7f81bc102970 2024-09-10T23:56:45.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.606+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc1a3570 con 0x7f81bc102970 2024-09-10T23:56:45.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.608+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f81ac005020 con 0x7f81bc102970 2024-09-10T23:56:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.610+0000 7f81b8c00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 0x7f81a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.610+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f81ac0e6510 con 0x7f81bc102970 2024-09-10T23:56:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.610+0000 7f81bb400640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 0x7f81a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:45.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.611+0000 7f81bb400640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 0x7f81a00b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81a8006010 tx=0x7f81a80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:45.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.614+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f81ac0acfd0 con 0x7f81bc102970 2024-09-10T23:56:45.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:45.852+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f81bc1a3740 con 0x7f81bc102970 2024-09-10T23:56:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.383+0000 7f81b8c00640 1 -- 172.21.15.33:0/294708407 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f81ac0ac8d0 con 0x7f81bc102970 2024-09-10T23:56:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 msgr2=0x7f81a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 0x7f81a00b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81a8006010 tx=0x7f81a80095f0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 msgr2=0x7f81bc19aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9f0 tx=0x7f81ac00edf0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 shutdown_connections 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f81a00b52e0 0x7f81a00b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81bc104480 0x7f81bc19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81bc103ac0 0x7f81bc19b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 --2- 172.21.15.33:0/294708407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81bc102970 0x7f81bc19aea0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 >> 172.21.15.33:0/294708407 conn(0x7f81bc0fe250 msgr2=0x7f81bc104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 shutdown_connections 2024-09-10T23:56:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.386+0000 7f81c2a00640 1 -- 172.21.15.33:0/294708407 wait complete. 2024-09-10T23:56:46.407 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-10T23:56:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 -- 172.21.15.33:0/3947051754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a241064c0 msgr2=0x7f3a2410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 --2- 172.21.15.33:0/3947051754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a241064c0 0x7f3a2410ce40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009cd0 tx=0x7f3a1c02a8f0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 -- 172.21.15.33:0/3947051754 shutdown_connections 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 --2- 172.21.15.33:0/3947051754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a241064c0 0x7f3a2410ce40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 --2- 172.21.15.33:0/3947051754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a24105b00 0x7f3a24105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 --2- 172.21.15.33:0/3947051754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 0x7f3a24104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 -- 172.21.15.33:0/3947051754 >> 172.21.15.33:0/3947051754 conn(0x7f3a24100270 msgr2=0x7f3a24102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 -- 172.21.15.33:0/3947051754 shutdown_connections 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.566+0000 7f3a29800640 1 -- 172.21.15.33:0/3947051754 wait complete. 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 Processor -- start 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 -- start start 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 0x7f3a2419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a241064c0 0x7f3a2419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24110500 con 0x7f3a24105b00 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24110380 con 0x7f3a241064c0 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.567+0000 7f3a29800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24110680 con 0x7f3a241049b0 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40540/0 (socket says 172.21.15.33:40540) 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 -- 172.21.15.33:0/26636915 learned_addr learned my addr 172.21.15.33:0/26636915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23e00640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 0x7f3a2419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a28e00640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a241064c0 0x7f3a2419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 -- 172.21.15.33:0/26636915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 msgr2=0x7f3a2419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 0x7f3a2419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 -- 172.21.15.33:0/26636915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a241064c0 msgr2=0x7f3a2419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a241064c0 0x7f3a2419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.568+0000 7f3a23400640 1 -- 172.21.15.33:0/26636915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2419c7c0 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a23400640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d950 tx=0x7f3a1000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10017070 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2419cab0 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a1000de80 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10020060 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.569+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241a3180 con 0x7f3a24105b00 2024-09-10T23:56:46.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.570+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a24104db0 con 0x7f3a24105b00 2024-09-10T23:56:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.573+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3a10010460 con 0x7f3a24105b00 2024-09-10T23:56:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.574+0000 7f3a20c00640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 0x7f3a080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.574+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3a100e5b90 con 0x7f3a24105b00 2024-09-10T23:56:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.574+0000 7f3a23e00640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 0x7f3a080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:46.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.575+0000 7f3a23e00640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 0x7f3a080b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400abe0 tx=0x7f3a1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.578+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a100ac650 con 0x7f3a24105b00 2024-09-10T23:56:46.712 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:46 smithi052 ceph-mon[33526]: pgmap v436: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:46.713 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:46 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:56:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-mon[30593]: pgmap v436: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:56:46.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.800+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f3a241075c0 con 0x7f3a080b52e0 2024-09-10T23:56:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.822+0000 7f3a20c00640 1 -- 172.21.15.33:0/26636915 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f3a241075c0 con 0x7f3a080b52e0 2024-09-10T23:56:46.824 INFO:teuthology.orchestra.run.smithi033.stdout:{} 2024-09-10T23:56:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.824+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 msgr2=0x7f3a080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.824+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 0x7f3a080b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400abe0 tx=0x7f3a1400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.824+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 msgr2=0x7f3a2419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.824+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d950 tx=0x7f3a1000dd50 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 shutdown_connections 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3a080b52e0 0x7f3a080b77a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a241064c0 0x7f3a2419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a24105b00 0x7f3a2419b2d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 --2- 172.21.15.33:0/26636915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3a241049b0 0x7f3a2419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 >> 172.21.15.33:0/26636915 conn(0x7f3a24100270 msgr2=0x7f3a24106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 shutdown_connections 2024-09-10T23:56:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:46.825+0000 7f3a29800640 1 -- 172.21.15.33:0/26636915 wait complete. 2024-09-10T23:56:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:46 smithi189 ceph-mon[34000]: pgmap v436: 129 pgs: 129 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T23:56:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:46 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T23:56:46.843 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T23:56:47.226 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T23:56:47.343 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:56:47.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T23:56:47.344 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:56:46.806+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:56:47.344 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:56:46.806+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:56:47.344 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:56:46.806+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:56:47.344 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:56:46.806+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:56:47.344 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 10 23:56:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-10T23:56:46.806+0000 7fd7c1000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T23:56:47.348 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-10T23:56:47.360 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T23:56:47.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:56:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:56:47.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:47 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:56:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:47.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:56:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:47 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:56:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/294708407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T23:56:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:47 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:56:48.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 -- 172.21.15.33:0/392154303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 msgr2=0x7f7a7c111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 --2- 172.21.15.33:0/392154303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c111980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009ca0 tx=0x7f7a7402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 -- 172.21.15.33:0/392154303 shutdown_connections 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 --2- 172.21.15.33:0/392154303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c111980 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 --2- 172.21.15.33:0/392154303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c10a800 0x7f7a7c10ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 --2- 172.21.15.33:0/392154303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c104df0 0x7f7a7c1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 -- 172.21.15.33:0/392154303 >> 172.21.15.33:0/392154303 conn(0x7f7a7c100840 msgr2=0x7f7a7c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 -- 172.21.15.33:0/392154303 shutdown_connections 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.352+0000 7f7a82000640 1 -- 172.21.15.33:0/392154303 wait complete. 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.353+0000 7f7a82000640 1 Processor -- start 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.353+0000 7f7a82000640 1 -- start start 2024-09-10T23:56:48.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c104df0 0x7f7a7c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c10a800 0x7f7a7c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c114d00 con 0x7f7a7c10b180 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c114b80 con 0x7f7a7c10a800 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a82000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c114e80 con 0x7f7a7c104df0 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40574/0 (socket says 172.21.15.33:40574) 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 -- 172.21.15.33:0/3399617518 learned_addr learned my addr 172.21.15.33:0/3399617518 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a7be00640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c10a800 0x7f7a7c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a80c00640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c104df0 0x7f7a7c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 -- 172.21.15.33:0/3399617518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c104df0 msgr2=0x7f7a7c19b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:48.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c104df0 0x7f7a7c19b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 -- 172.21.15.33:0/3399617518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c10a800 msgr2=0x7f7a7c19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c10a800 0x7f7a7c19b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.354+0000 7f7a81600640 1 -- 172.21.15.33:0/3399617518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c1a1140 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a81600640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031040 tx=0x7f7a74003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74032c90 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a74032e30 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74030b30 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c1a13d0 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.355+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c1a7af0 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.356+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7c1051d0 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.360+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f7a74030cd0 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.361+0000 7f7a79600640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 0x7f7a600b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.362+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f7a741072d0 con 0x7f7a7c10b180 2024-09-10T23:56:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.362+0000 7f7a80c00640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 0x7f7a600b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.362+0000 7f7a80c00640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 0x7f7a600b7950 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005d00 tx=0x7f7a6c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.364+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a740cdc90 con 0x7f7a7c10b180 2024-09-10T23:56:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:48 smithi033 ceph-mon[30593]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:48 smithi033 ceph-mon[30593]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-10T23:56:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:48 smithi033 ceph-mon[30593]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-09-10T23:56:48.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.560+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a7c109e40 con 0x7f7a600b5490 2024-09-10T23:56:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.566+0000 7f7a79600640 1 -- 172.21.15.33:0/3399617518 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340745 (secure 0 0 0) 0x7f7a7c109e40 con 0x7f7a600b5490 2024-09-10T23:56:48.572 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:56:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 msgr2=0x7f7a600b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 0x7f7a600b7950 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005d00 tx=0x7f7a6c00b410 comp rx=0 tx=0).stop 2024-09-10T23:56:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 msgr2=0x7f7a7c1a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031040 tx=0x7f7a74003f80 comp rx=0 tx=0).stop 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 shutdown_connections 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7a600b5490 0x7f7a600b7950 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a7c10b180 0x7f7a7c1a0970 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a7c10a800 0x7f7a7c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 --2- 172.21.15.33:0/3399617518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a7c104df0 0x7f7a7c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.571+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 >> 172.21.15.33:0/3399617518 conn(0x7f7a7c100840 msgr2=0x7f7a7c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.572+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 shutdown_connections 2024-09-10T23:56:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:48.572+0000 7f7a82000640 1 -- 172.21.15.33:0/3399617518 wait complete. 2024-09-10T23:56:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:48 smithi052 ceph-mon[33526]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:48 smithi052 ceph-mon[33526]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-10T23:56:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:48 smithi052 ceph-mon[33526]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-09-10T23:56:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:48 smithi189 ceph-mon[34000]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:48.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:48 smithi189 ceph-mon[34000]: pgmap v437: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-10T23:56:48.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:48 smithi189 ceph-mon[34000]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-09-10T23:56:49.554 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-09-10T23:56:46.826419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661574,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":828,"num_read_kb":511,"num_write":312,"num_write_kb":2287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":755,"ondisk_log_size":755,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360932,"kb_used_data":11684,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580892,"statfs":{"total":1151940427776,"available":1151570833408,"internally_reserved":0,"allocated":11964416,"data_stored":7935074,"data_compressed":463005,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1431,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":48,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003107"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195931+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:55:48.195931+0000","last_peered":"2024-09-10T23:55:48.195931+0000","last_clean":"2024-09-10T23:55:48.195931+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:55:48.195931+0000","last_undegraded":"2024-09-10T23:55:48.195931+0000","last_fullsized":"2024-09-10T23:55:48.195931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181257+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:56:17.181257+0000","last_peered":"2024-09-10T23:56:17.181257+0000","last_clean":"2024-09-10T23:56:17.181257+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:56:17.181257+0000","last_undegraded":"2024-09-10T23:56:17.181257+0000","last_fullsized":"2024-09-10T23:56:17.181257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431740+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:55:48.431740+0000","last_peered":"2024-09-10T23:55:48.431740+0000","last_clean":"2024-09-10T23:55:48.431740+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:55:48.431740+0000","last_undegraded":"2024-09-10T23:55:48.431740+0000","last_fullsized":"2024-09-10T23:55:48.431740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431965+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:55:48.431965+0000","last_peered":"2024-09-10T23:55:48.431965+0000","last_clean":"2024-09-10T23:55:48.431965+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:55:48.431965+0000","last_undegraded":"2024-09-10T23:55:48.431965+0000","last_fullsized":"2024-09-10T23:55:48.431965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198453+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:56:17.198453+0000","last_peered":"2024-09-10T23:56:17.198453+0000","last_clean":"2024-09-10T23:56:17.198453+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:56:17.198453+0000","last_undegraded":"2024-09-10T23:56:17.198453+0000","last_fullsized":"2024-09-10T23:56:17.198453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191244+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:55:48.191244+0000","last_peered":"2024-09-10T23:55:48.191244+0000","last_clean":"2024-09-10T23:55:48.191244+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:55:48.191244+0000","last_undegraded":"2024-09-10T23:55:48.191244+0000","last_fullsized":"2024-09-10T23:55:48.191244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433246+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:55:48.433246+0000","last_peered":"2024-09-10T23:55:48.433246+0000","last_clean":"2024-09-10T23:55:48.433246+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:55:48.433246+0000","last_undegraded":"2024-09-10T23:55:48.433246+0000","last_fullsized":"2024-09-10T23:55:48.433246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197336+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:56:17.197336+0000","last_peered":"2024-09-10T23:56:17.197336+0000","last_clean":"2024-09-10T23:56:17.197336+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:56:17.197336+0000","last_undegraded":"2024-09-10T23:56:17.197336+0000","last_fullsized":"2024-09-10T23:56:17.197336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191675+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:55:48.191675+0000","last_peered":"2024-09-10T23:55:48.191675+0000","last_clean":"2024-09-10T23:55:48.191675+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:55:48.191675+0000","last_undegraded":"2024-09-10T23:55:48.191675+0000","last_fullsized":"2024-09-10T23:55:48.191675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192047+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:55:48.192047+0000","last_peered":"2024-09-10T23:55:48.192047+0000","last_clean":"2024-09-10T23:55:48.192047+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:55:48.192047+0000","last_undegraded":"2024-09-10T23:55:48.192047+0000","last_fullsized":"2024-09-10T23:55:48.192047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197601+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:56:17.197601+0000","last_peered":"2024-09-10T23:56:17.197601+0000","last_clean":"2024-09-10T23:56:17.197601+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:56:17.197601+0000","last_undegraded":"2024-09-10T23:56:17.197601+0000","last_fullsized":"2024-09-10T23:56:17.197601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191309+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:55:48.191309+0000","last_peered":"2024-09-10T23:55:48.191309+0000","last_clean":"2024-09-10T23:55:48.191309+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:55:48.191309+0000","last_undegraded":"2024-09-10T23:55:48.191309+0000","last_fullsized":"2024-09-10T23:55:48.191309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200461+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:56:17.200461+0000","last_peered":"2024-09-10T23:56:17.200461+0000","last_clean":"2024-09-10T23:56:17.200461+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:56:17.200461+0000","last_undegraded":"2024-09-10T23:56:17.200461+0000","last_fullsized":"2024-09-10T23:56:17.200461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191569+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:55:48.191569+0000","last_peered":"2024-09-10T23:55:48.191569+0000","last_clean":"2024-09-10T23:55:48.191569+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:55:48.191569+0000","last_undegraded":"2024-09-10T23:55:48.191569+0000","last_fullsized":"2024-09-10T23:55:48.191569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192035+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:55:48.192035+0000","last_peered":"2024-09-10T23:55:48.192035+0000","last_clean":"2024-09-10T23:55:48.192035+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:55:48.192035+0000","last_undegraded":"2024-09-10T23:55:48.192035+0000","last_fullsized":"2024-09-10T23:55:48.192035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186205+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:56:17.186205+0000","last_peered":"2024-09-10T23:56:17.186205+0000","last_clean":"2024-09-10T23:56:17.186205+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:56:17.186205+0000","last_undegraded":"2024-09-10T23:56:17.186205+0000","last_fullsized":"2024-09-10T23:56:17.186205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432636+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:55:48.432636+0000","last_peered":"2024-09-10T23:55:48.432636+0000","last_clean":"2024-09-10T23:55:48.432636+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:55:48.432636+0000","last_undegraded":"2024-09-10T23:55:48.432636+0000","last_fullsized":"2024-09-10T23:55:48.432636+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191815+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:55:48.191815+0000","last_peered":"2024-09-10T23:55:48.191815+0000","last_clean":"2024-09-10T23:55:48.191815+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:55:48.191815+0000","last_undegraded":"2024-09-10T23:55:48.191815+0000","last_fullsized":"2024-09-10T23:55:48.191815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178537+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:56:17.178537+0000","last_peered":"2024-09-10T23:56:17.178537+0000","last_clean":"2024-09-10T23:56:17.178537+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:56:17.178537+0000","last_undegraded":"2024-09-10T23:56:17.178537+0000","last_fullsized":"2024-09-10T23:56:17.178537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431602+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:55:48.431602+0000","last_peered":"2024-09-10T23:55:48.431602+0000","last_clean":"2024-09-10T23:55:48.431602+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:55:48.431602+0000","last_undegraded":"2024-09-10T23:55:48.431602+0000","last_fullsized":"2024-09-10T23:55:48.431602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195751+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:55:48.195751+0000","last_peered":"2024-09-10T23:55:48.195751+0000","last_clean":"2024-09-10T23:55:48.195751+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:55:48.195751+0000","last_undegraded":"2024-09-10T23:55:48.195751+0000","last_fullsized":"2024-09-10T23:55:48.195751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.133645+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:56:17.133645+0000","last_peered":"2024-09-10T23:56:17.133645+0000","last_clean":"2024-09-10T23:56:17.133645+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:56:17.133645+0000","last_undegraded":"2024-09-10T23:56:17.133645+0000","last_fullsized":"2024-09-10T23:56:17.133645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389183+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:55:48.389183+0000","last_peered":"2024-09-10T23:55:48.389183+0000","last_clean":"2024-09-10T23:55:48.389183+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:55:48.389183+0000","last_undegraded":"2024-09-10T23:55:48.389183+0000","last_fullsized":"2024-09-10T23:55:48.389183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191804+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:55:48.191804+0000","last_peered":"2024-09-10T23:55:48.191804+0000","last_clean":"2024-09-10T23:55:48.191804+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:55:48.191804+0000","last_undegraded":"2024-09-10T23:55:48.191804+0000","last_fullsized":"2024-09-10T23:55:48.191804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186131+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:56:17.186131+0000","last_peered":"2024-09-10T23:56:17.186131+0000","last_clean":"2024-09-10T23:56:17.186131+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:56:17.186131+0000","last_undegraded":"2024-09-10T23:56:17.186131+0000","last_fullsized":"2024-09-10T23:56:17.186131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192153+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:55:48.192153+0000","last_peered":"2024-09-10T23:55:48.192153+0000","last_clean":"2024-09-10T23:55:48.192153+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:55:48.192153+0000","last_undegraded":"2024-09-10T23:55:48.192153+0000","last_fullsized":"2024-09-10T23:55:48.192153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431867+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:55:48.431867+0000","last_peered":"2024-09-10T23:55:48.431867+0000","last_clean":"2024-09-10T23:55:48.431867+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:55:48.431867+0000","last_undegraded":"2024-09-10T23:55:48.431867+0000","last_fullsized":"2024-09-10T23:55:48.431867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.189859+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:56:17.189859+0000","last_peered":"2024-09-10T23:56:17.189859+0000","last_clean":"2024-09-10T23:56:17.189859+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:56:17.189859+0000","last_undegraded":"2024-09-10T23:56:17.189859+0000","last_fullsized":"2024-09-10T23:56:17.189859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'13","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:04.570195+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:56:04.570195+0000","last_peered":"2024-09-10T23:56:04.570195+0000","last_clean":"2024-09-10T23:56:04.570195+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:56:04.570195+0000","last_undegraded":"2024-09-10T23:56:04.570195+0000","last_fullsized":"2024-09-10T23:56:04.570195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431289+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:55:48.431289+0000","last_peered":"2024-09-10T23:55:48.431289+0000","last_clean":"2024-09-10T23:55:48.431289+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:55:48.431289+0000","last_undegraded":"2024-09-10T23:55:48.431289+0000","last_fullsized":"2024-09-10T23:55:48.431289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.164683+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:56:17.164683+0000","last_peered":"2024-09-10T23:56:17.164683+0000","last_clean":"2024-09-10T23:56:17.164683+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:56:17.164683+0000","last_undegraded":"2024-09-10T23:56:17.164683+0000","last_fullsized":"2024-09-10T23:56:17.164683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191992+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:55:48.191992+0000","last_peered":"2024-09-10T23:55:48.191992+0000","last_clean":"2024-09-10T23:55:48.191992+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:55:48.191992+0000","last_undegraded":"2024-09-10T23:55:48.191992+0000","last_fullsized":"2024-09-10T23:55:48.191992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433181+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:55:48.433181+0000","last_peered":"2024-09-10T23:55:48.433181+0000","last_clean":"2024-09-10T23:55:48.433181+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:55:48.433181+0000","last_undegraded":"2024-09-10T23:55:48.433181+0000","last_fullsized":"2024-09-10T23:55:48.433181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180145+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:56:17.180145+0000","last_peered":"2024-09-10T23:56:17.180145+0000","last_clean":"2024-09-10T23:56:17.180145+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:56:17.180145+0000","last_undegraded":"2024-09-10T23:56:17.180145+0000","last_fullsized":"2024-09-10T23:56:17.180145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195459+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:55:48.195459+0000","last_peered":"2024-09-10T23:55:48.195459+0000","last_clean":"2024-09-10T23:55:48.195459+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:55:48.195459+0000","last_undegraded":"2024-09-10T23:55:48.195459+0000","last_fullsized":"2024-09-10T23:55:48.195459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191584+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:55:48.191584+0000","last_peered":"2024-09-10T23:55:48.191584+0000","last_clean":"2024-09-10T23:55:48.191584+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:55:48.191584+0000","last_undegraded":"2024-09-10T23:55:48.191584+0000","last_fullsized":"2024-09-10T23:55:48.191584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179493+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:56:17.179493+0000","last_peered":"2024-09-10T23:56:17.179493+0000","last_clean":"2024-09-10T23:56:17.179493+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:56:17.179493+0000","last_undegraded":"2024-09-10T23:56:17.179493+0000","last_fullsized":"2024-09-10T23:56:17.179493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196793+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:55:48.196793+0000","last_peered":"2024-09-10T23:55:48.196793+0000","last_clean":"2024-09-10T23:55:48.196793+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:55:48.196793+0000","last_undegraded":"2024-09-10T23:55:48.196793+0000","last_fullsized":"2024-09-10T23:55:48.196793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228467+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:55:48.228467+0000","last_peered":"2024-09-10T23:55:48.228467+0000","last_clean":"2024-09-10T23:55:48.228467+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:55:48.228467+0000","last_undegraded":"2024-09-10T23:55:48.228467+0000","last_fullsized":"2024-09-10T23:55:48.228467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181268+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:56:17.181268+0000","last_peered":"2024-09-10T23:56:17.181268+0000","last_clean":"2024-09-10T23:56:17.181268+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:56:17.181268+0000","last_undegraded":"2024-09-10T23:56:17.181268+0000","last_fullsized":"2024-09-10T23:56:17.181268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:44.206645+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:56:44.206645+0000","last_peered":"2024-09-10T23:56:44.206645+0000","last_clean":"2024-09-10T23:56:44.206645+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:56:44.206645+0000","last_undegraded":"2024-09-10T23:56:44.206645+0000","last_fullsized":"2024-09-10T23:56:44.206645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228796+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:55:48.228796+0000","last_peered":"2024-09-10T23:55:48.228796+0000","last_clean":"2024-09-10T23:55:48.228796+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:55:48.228796+0000","last_undegraded":"2024-09-10T23:55:48.228796+0000","last_fullsized":"2024-09-10T23:55:48.228796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181103+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:56:17.181103+0000","last_peered":"2024-09-10T23:56:17.181103+0000","last_clean":"2024-09-10T23:56:17.181103+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:56:17.181103+0000","last_undegraded":"2024-09-10T23:56:17.181103+0000","last_fullsized":"2024-09-10T23:56:17.181103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196354+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:55:48.196354+0000","last_peered":"2024-09-10T23:55:48.196354+0000","last_clean":"2024-09-10T23:55:48.196354+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:55:48.196354+0000","last_undegraded":"2024-09-10T23:55:48.196354+0000","last_fullsized":"2024-09-10T23:55:48.196354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191644+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:55:48.191644+0000","last_peered":"2024-09-10T23:55:48.191644+0000","last_clean":"2024-09-10T23:55:48.191644+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:55:48.191644+0000","last_undegraded":"2024-09-10T23:55:48.191644+0000","last_fullsized":"2024-09-10T23:55:48.191644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.195563+0000","last_change":"2024-09-10T23:55:48.434804+0000","last_active":"2024-09-10T23:56:17.195563+0000","last_peered":"2024-09-10T23:56:17.195563+0000","last_clean":"2024-09-10T23:56:17.195563+0000","last_became_active":"2024-09-10T23:55:48.434451+0000","last_became_peered":"2024-09-10T23:55:48.434451+0000","last_unstale":"2024-09-10T23:56:17.195563+0000","last_undegraded":"2024-09-10T23:56:17.195563+0000","last_fullsized":"2024-09-10T23:56:17.195563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.587382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191947+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:55:48.191947+0000","last_peered":"2024-09-10T23:55:48.191947+0000","last_clean":"2024-09-10T23:55:48.191947+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:55:48.191947+0000","last_undegraded":"2024-09-10T23:55:48.191947+0000","last_fullsized":"2024-09-10T23:55:48.191947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196441+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:55:48.196441+0000","last_peered":"2024-09-10T23:55:48.196441+0000","last_clean":"2024-09-10T23:55:48.196441+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:55:48.196441+0000","last_undegraded":"2024-09-10T23:55:48.196441+0000","last_fullsized":"2024-09-10T23:55:48.196441+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197191+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:55:48.197191+0000","last_peered":"2024-09-10T23:55:48.197191+0000","last_clean":"2024-09-10T23:55:48.197191+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:55:48.197191+0000","last_undegraded":"2024-09-10T23:55:48.197191+0000","last_fullsized":"2024-09-10T23:55:48.197191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200462+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:56:17.200462+0000","last_peered":"2024-09-10T23:56:17.200462+0000","last_clean":"2024-09-10T23:56:17.200462+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:56:17.200462+0000","last_undegraded":"2024-09-10T23:56:17.200462+0000","last_fullsized":"2024-09-10T23:56:17.200462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432354+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:55:48.432354+0000","last_peered":"2024-09-10T23:55:48.432354+0000","last_clean":"2024-09-10T23:55:48.432354+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:55:48.432354+0000","last_undegraded":"2024-09-10T23:55:48.432354+0000","last_fullsized":"2024-09-10T23:55:48.432354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389219+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:55:48.389219+0000","last_peered":"2024-09-10T23:55:48.389219+0000","last_clean":"2024-09-10T23:55:48.389219+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:55:48.389219+0000","last_undegraded":"2024-09-10T23:55:48.389219+0000","last_fullsized":"2024-09-10T23:55:48.389219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.185951+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:56:17.185951+0000","last_peered":"2024-09-10T23:56:17.185951+0000","last_clean":"2024-09-10T23:56:17.185951+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:56:17.185951+0000","last_undegraded":"2024-09-10T23:56:17.185951+0000","last_fullsized":"2024-09-10T23:56:17.185951+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432850+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:55:48.432850+0000","last_peered":"2024-09-10T23:55:48.432850+0000","last_clean":"2024-09-10T23:55:48.432850+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:55:48.432850+0000","last_undegraded":"2024-09-10T23:55:48.432850+0000","last_fullsized":"2024-09-10T23:55:48.432850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192871+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:55:48.192871+0000","last_peered":"2024-09-10T23:55:48.192871+0000","last_clean":"2024-09-10T23:55:48.192871+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:55:48.192871+0000","last_undegraded":"2024-09-10T23:55:48.192871+0000","last_fullsized":"2024-09-10T23:55:48.192871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.190127+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:56:17.190127+0000","last_peered":"2024-09-10T23:56:17.190127+0000","last_clean":"2024-09-10T23:56:17.190127+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:56:17.190127+0000","last_undegraded":"2024-09-10T23:56:17.190127+0000","last_fullsized":"2024-09-10T23:56:17.190127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228827+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:55:48.228827+0000","last_peered":"2024-09-10T23:55:48.228827+0000","last_clean":"2024-09-10T23:55:48.228827+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:55:48.228827+0000","last_undegraded":"2024-09-10T23:55:48.228827+0000","last_fullsized":"2024-09-10T23:55:48.228827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431768+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:55:48.431768+0000","last_peered":"2024-09-10T23:55:48.431768+0000","last_clean":"2024-09-10T23:55:48.431768+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:55:48.431768+0000","last_undegraded":"2024-09-10T23:55:48.431768+0000","last_fullsized":"2024-09-10T23:55:48.431768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182166+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:56:17.182166+0000","last_peered":"2024-09-10T23:56:17.182166+0000","last_clean":"2024-09-10T23:56:17.182166+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:56:17.182166+0000","last_undegraded":"2024-09-10T23:56:17.182166+0000","last_fullsized":"2024-09-10T23:56:17.182166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433955+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:55:48.433955+0000","last_peered":"2024-09-10T23:55:48.433955+0000","last_clean":"2024-09-10T23:55:48.433955+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:55:48.433955+0000","last_undegraded":"2024-09-10T23:55:48.433955+0000","last_fullsized":"2024-09-10T23:55:48.433955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432671+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:55:48.432671+0000","last_peered":"2024-09-10T23:55:48.432671+0000","last_clean":"2024-09-10T23:55:48.432671+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:55:48.432671+0000","last_undegraded":"2024-09-10T23:55:48.432671+0000","last_fullsized":"2024-09-10T23:55:48.432671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196864+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:56:17.196864+0000","last_peered":"2024-09-10T23:56:17.196864+0000","last_clean":"2024-09-10T23:56:17.196864+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:56:17.196864+0000","last_undegraded":"2024-09-10T23:56:17.196864+0000","last_fullsized":"2024-09-10T23:56:17.196864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191512+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:55:48.191512+0000","last_peered":"2024-09-10T23:55:48.191512+0000","last_clean":"2024-09-10T23:55:48.191512+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:55:48.191512+0000","last_undegraded":"2024-09-10T23:55:48.191512+0000","last_fullsized":"2024-09-10T23:55:48.191512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228828+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:55:48.228828+0000","last_peered":"2024-09-10T23:55:48.228828+0000","last_clean":"2024-09-10T23:55:48.228828+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:55:48.228828+0000","last_undegraded":"2024-09-10T23:55:48.228828+0000","last_fullsized":"2024-09-10T23:55:48.228828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186834+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:56:17.186834+0000","last_peered":"2024-09-10T23:56:17.186834+0000","last_clean":"2024-09-10T23:56:17.186834+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:56:17.186834+0000","last_undegraded":"2024-09-10T23:56:17.186834+0000","last_fullsized":"2024-09-10T23:56:17.186834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.210338+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:56:45.210338+0000","last_peered":"2024-09-10T23:56:45.210338+0000","last_clean":"2024-09-10T23:56:45.210338+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:56:45.210338+0000","last_undegraded":"2024-09-10T23:56:45.210338+0000","last_fullsized":"2024-09-10T23:56:45.210338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195796+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:55:48.195796+0000","last_peered":"2024-09-10T23:55:48.195796+0000","last_clean":"2024-09-10T23:55:48.195796+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:55:48.195796+0000","last_undegraded":"2024-09-10T23:55:48.195796+0000","last_fullsized":"2024-09-10T23:55:48.195796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196400+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:56:17.196400+0000","last_peered":"2024-09-10T23:56:17.196400+0000","last_clean":"2024-09-10T23:56:17.196400+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:56:17.196400+0000","last_undegraded":"2024-09-10T23:56:17.196400+0000","last_fullsized":"2024-09-10T23:56:17.196400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431838+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:55:48.431838+0000","last_peered":"2024-09-10T23:55:48.431838+0000","last_clean":"2024-09-10T23:55:48.431838+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:55:48.431838+0000","last_undegraded":"2024-09-10T23:55:48.431838+0000","last_fullsized":"2024-09-10T23:55:48.431838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433410+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:55:48.433410+0000","last_peered":"2024-09-10T23:55:48.433410+0000","last_clean":"2024-09-10T23:55:48.433410+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:55:48.433410+0000","last_undegraded":"2024-09-10T23:55:48.433410+0000","last_fullsized":"2024-09-10T23:55:48.433410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187705+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:56:17.187705+0000","last_peered":"2024-09-10T23:56:17.187705+0000","last_clean":"2024-09-10T23:56:17.187705+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:56:17.187705+0000","last_undegraded":"2024-09-10T23:56:17.187705+0000","last_fullsized":"2024-09-10T23:56:17.187705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432470+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:55:48.432470+0000","last_peered":"2024-09-10T23:55:48.432470+0000","last_clean":"2024-09-10T23:55:48.432470+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:55:48.432470+0000","last_undegraded":"2024-09-10T23:55:48.432470+0000","last_fullsized":"2024-09-10T23:55:48.432470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432660+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:55:48.432660+0000","last_peered":"2024-09-10T23:55:48.432660+0000","last_clean":"2024-09-10T23:55:48.432660+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:55:48.432660+0000","last_undegraded":"2024-09-10T23:55:48.432660+0000","last_fullsized":"2024-09-10T23:55:48.432660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188737+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:56:17.188737+0000","last_peered":"2024-09-10T23:56:17.188737+0000","last_clean":"2024-09-10T23:56:17.188737+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:56:17.188737+0000","last_undegraded":"2024-09-10T23:56:17.188737+0000","last_fullsized":"2024-09-10T23:56:17.188737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'40","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:46.194526+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:56:46.194526+0000","last_peered":"2024-09-10T23:56:46.194526+0000","last_clean":"2024-09-10T23:56:46.194526+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:56:46.194526+0000","last_undegraded":"2024-09-10T23:56:46.194526+0000","last_fullsized":"2024-09-10T23:56:46.194526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65344,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":185,"num_write":41,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195412+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:55:48.195412+0000","last_peered":"2024-09-10T23:55:48.195412+0000","last_clean":"2024-09-10T23:55:48.195412+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:55:48.195412+0000","last_undegraded":"2024-09-10T23:55:48.195412+0000","last_fullsized":"2024-09-10T23:55:48.195412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198485+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:56:17.198485+0000","last_peered":"2024-09-10T23:56:17.198485+0000","last_clean":"2024-09-10T23:56:17.198485+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:56:17.198485+0000","last_undegraded":"2024-09-10T23:56:17.198485+0000","last_fullsized":"2024-09-10T23:56:17.198485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432787+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:55:48.432787+0000","last_peered":"2024-09-10T23:55:48.432787+0000","last_clean":"2024-09-10T23:55:48.432787+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:55:48.432787+0000","last_undegraded":"2024-09-10T23:55:48.432787+0000","last_fullsized":"2024-09-10T23:55:48.432787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191530+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:55:48.191530+0000","last_peered":"2024-09-10T23:55:48.191530+0000","last_clean":"2024-09-10T23:55:48.191530+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:55:48.191530+0000","last_undegraded":"2024-09-10T23:55:48.191530+0000","last_fullsized":"2024-09-10T23:55:48.191530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184789+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:56:17.184789+0000","last_peered":"2024-09-10T23:56:17.184789+0000","last_clean":"2024-09-10T23:56:17.184789+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:56:17.184789+0000","last_undegraded":"2024-09-10T23:56:17.184789+0000","last_fullsized":"2024-09-10T23:56:17.184789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197287+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:55:48.197287+0000","last_peered":"2024-09-10T23:55:48.197287+0000","last_clean":"2024-09-10T23:55:48.197287+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:55:48.197287+0000","last_undegraded":"2024-09-10T23:55:48.197287+0000","last_fullsized":"2024-09-10T23:55:48.197287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195034+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:55:48.195034+0000","last_peered":"2024-09-10T23:55:48.195034+0000","last_clean":"2024-09-10T23:55:48.195034+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:55:48.195034+0000","last_undegraded":"2024-09-10T23:55:48.195034+0000","last_fullsized":"2024-09-10T23:55:48.195034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197509+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:56:17.197509+0000","last_peered":"2024-09-10T23:56:17.197509+0000","last_clean":"2024-09-10T23:56:17.197509+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:56:17.197509+0000","last_undegraded":"2024-09-10T23:56:17.197509+0000","last_fullsized":"2024-09-10T23:56:17.197509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.192388+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:56:45.192388+0000","last_peered":"2024-09-10T23:56:45.192388+0000","last_clean":"2024-09-10T23:56:45.192388+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:56:45.192388+0000","last_undegraded":"2024-09-10T23:56:45.192388+0000","last_fullsized":"2024-09-10T23:56:45.192388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431433+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:55:48.431433+0000","last_peered":"2024-09-10T23:55:48.431433+0000","last_clean":"2024-09-10T23:55:48.431433+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:55:48.431433+0000","last_undegraded":"2024-09-10T23:55:48.431433+0000","last_fullsized":"2024-09-10T23:55:48.431433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193081+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:55:48.193081+0000","last_peered":"2024-09-10T23:55:48.193081+0000","last_clean":"2024-09-10T23:55:48.193081+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:55:48.193081+0000","last_undegraded":"2024-09-10T23:55:48.193081+0000","last_fullsized":"2024-09-10T23:55:48.193081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180978+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:56:17.180978+0000","last_peered":"2024-09-10T23:56:17.180978+0000","last_clean":"2024-09-10T23:56:17.180978+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:56:17.180978+0000","last_undegraded":"2024-09-10T23:56:17.180978+0000","last_fullsized":"2024-09-10T23:56:17.180978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432271+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:55:48.432271+0000","last_peered":"2024-09-10T23:55:48.432271+0000","last_clean":"2024-09-10T23:55:48.432271+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:55:48.432271+0000","last_undegraded":"2024-09-10T23:55:48.432271+0000","last_fullsized":"2024-09-10T23:55:48.432271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433888+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:55:48.433888+0000","last_peered":"2024-09-10T23:55:48.433888+0000","last_clean":"2024-09-10T23:55:48.433888+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:55:48.433888+0000","last_undegraded":"2024-09-10T23:55:48.433888+0000","last_fullsized":"2024-09-10T23:55:48.433888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179336+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:56:17.179336+0000","last_peered":"2024-09-10T23:56:17.179336+0000","last_clean":"2024-09-10T23:56:17.179336+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:56:17.179336+0000","last_undegraded":"2024-09-10T23:56:17.179336+0000","last_fullsized":"2024-09-10T23:56:17.179336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228461+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:55:48.228461+0000","last_peered":"2024-09-10T23:55:48.228461+0000","last_clean":"2024-09-10T23:55:48.228461+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:55:48.228461+0000","last_undegraded":"2024-09-10T23:55:48.228461+0000","last_fullsized":"2024-09-10T23:55:48.228461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194225+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:55:48.194225+0000","last_peered":"2024-09-10T23:55:48.194225+0000","last_clean":"2024-09-10T23:55:48.194225+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:55:48.194225+0000","last_undegraded":"2024-09-10T23:55:48.194225+0000","last_fullsized":"2024-09-10T23:55:48.194225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184504+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:56:17.184504+0000","last_peered":"2024-09-10T23:56:17.184504+0000","last_clean":"2024-09-10T23:56:17.184504+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:56:17.184504+0000","last_undegraded":"2024-09-10T23:56:17.184504+0000","last_fullsized":"2024-09-10T23:56:17.184504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432027+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:55:48.432027+0000","last_peered":"2024-09-10T23:55:48.432027+0000","last_clean":"2024-09-10T23:55:48.432027+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:55:48.432027+0000","last_undegraded":"2024-09-10T23:55:48.432027+0000","last_fullsized":"2024-09-10T23:55:48.432027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'8","reported_seq":188,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.193798+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:56:45.193798+0000","last_peered":"2024-09-10T23:56:45.193798+0000","last_clean":"2024-09-10T23:56:45.193798+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:56:45.193798+0000","last_undegraded":"2024-09-10T23:56:45.193798+0000","last_fullsized":"2024-09-10T23:56:45.193798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183135+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:56:17.183135+0000","last_peered":"2024-09-10T23:56:17.183135+0000","last_clean":"2024-09-10T23:56:17.183135+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:56:17.183135+0000","last_undegraded":"2024-09-10T23:56:17.183135+0000","last_fullsized":"2024-09-10T23:56:17.183135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433033+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:55:48.433033+0000","last_peered":"2024-09-10T23:55:48.433033+0000","last_clean":"2024-09-10T23:55:48.433033+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:55:48.433033+0000","last_undegraded":"2024-09-10T23:55:48.433033+0000","last_fullsized":"2024-09-10T23:55:48.433033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183513+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:56:17.183513+0000","last_peered":"2024-09-10T23:56:17.183513+0000","last_clean":"2024-09-10T23:56:17.183513+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:56:17.183513+0000","last_undegraded":"2024-09-10T23:56:17.183513+0000","last_fullsized":"2024-09-10T23:56:17.183513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182098+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:56:17.182098+0000","last_peered":"2024-09-10T23:56:17.182098+0000","last_clean":"2024-09-10T23:56:17.182098+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:56:17.182098+0000","last_undegraded":"2024-09-10T23:56:17.182098+0000","last_fullsized":"2024-09-10T23:56:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.156836+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:56:17.156836+0000","last_peered":"2024-09-10T23:56:17.156836+0000","last_clean":"2024-09-10T23:56:17.156836+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:56:17.156836+0000","last_undegraded":"2024-09-10T23:56:17.156836+0000","last_fullsized":"2024-09-10T23:56:17.156836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183555+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:56:17.183555+0000","last_peered":"2024-09-10T23:56:17.183555+0000","last_clean":"2024-09-10T23:56:17.183555+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:56:17.183555+0000","last_undegraded":"2024-09-10T23:56:17.183555+0000","last_fullsized":"2024-09-10T23:56:17.183555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180532+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:56:17.180532+0000","last_peered":"2024-09-10T23:56:17.180532+0000","last_clean":"2024-09-10T23:56:17.180532+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:56:17.180532+0000","last_undegraded":"2024-09-10T23:56:17.180532+0000","last_fullsized":"2024-09-10T23:56:17.180532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182356+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:56:17.182356+0000","last_peered":"2024-09-10T23:56:17.182356+0000","last_clean":"2024-09-10T23:56:17.182356+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:56:17.182356+0000","last_undegraded":"2024-09-10T23:56:17.182356+0000","last_fullsized":"2024-09-10T23:56:17.182356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197300+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:56:17.197300+0000","last_peered":"2024-09-10T23:56:17.197300+0000","last_clean":"2024-09-10T23:56:17.197300+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:56:17.197300+0000","last_undegraded":"2024-09-10T23:56:17.197300+0000","last_fullsized":"2024-09-10T23:56:17.197300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177647+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:56:17.177647+0000","last_peered":"2024-09-10T23:56:17.177647+0000","last_clean":"2024-09-10T23:56:17.177647+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:56:17.177647+0000","last_undegraded":"2024-09-10T23:56:17.177647+0000","last_fullsized":"2024-09-10T23:56:17.177647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184538+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:56:17.184538+0000","last_peered":"2024-09-10T23:56:17.184538+0000","last_clean":"2024-09-10T23:56:17.184538+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:56:17.184538+0000","last_undegraded":"2024-09-10T23:56:17.184538+0000","last_fullsized":"2024-09-10T23:56:17.184538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179051+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:56:17.179051+0000","last_peered":"2024-09-10T23:56:17.179051+0000","last_clean":"2024-09-10T23:56:17.179051+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:56:17.179051+0000","last_undegraded":"2024-09-10T23:56:17.179051+0000","last_fullsized":"2024-09-10T23:56:17.179051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199985+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:56:17.199985+0000","last_peered":"2024-09-10T23:56:17.199985+0000","last_clean":"2024-09-10T23:56:17.199985+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:56:17.199985+0000","last_undegraded":"2024-09-10T23:56:17.199985+0000","last_fullsized":"2024-09-10T23:56:17.199985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188322+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:56:17.188322+0000","last_peered":"2024-09-10T23:56:17.188322+0000","last_clean":"2024-09-10T23:56:17.188322+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:56:17.188322+0000","last_undegraded":"2024-09-10T23:56:17.188322+0000","last_fullsized":"2024-09-10T23:56:17.188322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178350+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:56:17.178350+0000","last_peered":"2024-09-10T23:56:17.178350+0000","last_clean":"2024-09-10T23:56:17.178350+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:56:17.178350+0000","last_undegraded":"2024-09-10T23:56:17.178350+0000","last_fullsized":"2024-09-10T23:56:17.178350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.158699+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:56:17.158699+0000","last_peered":"2024-09-10T23:56:17.158699+0000","last_clean":"2024-09-10T23:56:17.158699+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:56:17.158699+0000","last_undegraded":"2024-09-10T23:56:17.158699+0000","last_fullsized":"2024-09-10T23:56:17.158699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197868+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:56:17.197868+0000","last_peered":"2024-09-10T23:56:17.197868+0000","last_clean":"2024-09-10T23:56:17.197868+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:56:17.197868+0000","last_undegraded":"2024-09-10T23:56:17.197868+0000","last_fullsized":"2024-09-10T23:56:17.197868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199278+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:56:17.199278+0000","last_peered":"2024-09-10T23:56:17.199278+0000","last_clean":"2024-09-10T23:56:17.199278+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:56:17.199278+0000","last_undegraded":"2024-09-10T23:56:17.199278+0000","last_fullsized":"2024-09-10T23:56:17.199278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199460+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:56:17.199460+0000","last_peered":"2024-09-10T23:56:17.199460+0000","last_clean":"2024-09-10T23:56:17.199460+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:56:17.199460+0000","last_undegraded":"2024-09-10T23:56:17.199460+0000","last_fullsized":"2024-09-10T23:56:17.199460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186043+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:56:17.186043+0000","last_peered":"2024-09-10T23:56:17.186043+0000","last_clean":"2024-09-10T23:56:17.186043+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:56:17.186043+0000","last_undegraded":"2024-09-10T23:56:17.186043+0000","last_fullsized":"2024-09-10T23:56:17.186043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184859+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:56:17.184859+0000","last_peered":"2024-09-10T23:56:17.184859+0000","last_clean":"2024-09-10T23:56:17.184859+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:56:17.184859+0000","last_undegraded":"2024-09-10T23:56:17.184859+0000","last_fullsized":"2024-09-10T23:56:17.184859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182408+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:56:17.182408+0000","last_peered":"2024-09-10T23:56:17.182408+0000","last_clean":"2024-09-10T23:56:17.182408+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:56:17.182408+0000","last_undegraded":"2024-09-10T23:56:17.182408+0000","last_fullsized":"2024-09-10T23:56:17.182408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177823+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:56:17.177823+0000","last_peered":"2024-09-10T23:56:17.177823+0000","last_clean":"2024-09-10T23:56:17.177823+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:56:17.177823+0000","last_undegraded":"2024-09-10T23:56:17.177823+0000","last_fullsized":"2024-09-10T23:56:17.177823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200710+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:56:17.200710+0000","last_peered":"2024-09-10T23:56:17.200710+0000","last_clean":"2024-09-10T23:56:17.200710+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:56:17.200710+0000","last_undegraded":"2024-09-10T23:56:17.200710+0000","last_fullsized":"2024-09-10T23:56:17.200710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186703+0000","last_change":"2024-09-10T23:55:48.434274+0000","last_active":"2024-09-10T23:56:17.186703+0000","last_peered":"2024-09-10T23:56:17.186703+0000","last_clean":"2024-09-10T23:56:17.186703+0000","last_became_active":"2024-09-10T23:55:48.433970+0000","last_became_peered":"2024-09-10T23:55:48.433970+0000","last_unstale":"2024-09-10T23:56:17.186703+0000","last_undegraded":"2024-09-10T23:56:17.186703+0000","last_fullsized":"2024-09-10T23:56:17.186703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.612639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198991+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:56:17.198991+0000","last_peered":"2024-09-10T23:56:17.198991+0000","last_clean":"2024-09-10T23:56:17.198991+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:56:17.198991+0000","last_undegraded":"2024-09-10T23:56:17.198991+0000","last_fullsized":"2024-09-10T23:56:17.198991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184374+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:56:17.184374+0000","last_peered":"2024-09-10T23:56:17.184374+0000","last_clean":"2024-09-10T23:56:17.184374+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:56:17.184374+0000","last_undegraded":"2024-09-10T23:56:17.184374+0000","last_fullsized":"2024-09-10T23:56:17.184374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187467+0000","last_change":"2024-09-10T23:55:48.229813+0000","last_active":"2024-09-10T23:56:17.187467+0000","last_peered":"2024-09-10T23:56:17.187467+0000","last_clean":"2024-09-10T23:56:17.187467+0000","last_became_active":"2024-09-10T23:55:48.229420+0000","last_became_peered":"2024-09-10T23:55:48.229420+0000","last_unstale":"2024-09-10T23:56:17.187467+0000","last_undegraded":"2024-09-10T23:56:17.187467+0000","last_fullsized":"2024-09-10T23:56:17.187467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:47.584330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179404+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:56:17.179404+0000","last_peered":"2024-09-10T23:56:17.179404+0000","last_clean":"2024-09-10T23:56:17.179404+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:56:17.179404+0000","last_undegraded":"2024-09-10T23:56:17.179404+0000","last_fullsized":"2024-09-10T23:56:17.179404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181792+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:56:17.181792+0000","last_peered":"2024-09-10T23:56:17.181792+0000","last_clean":"2024-09-10T23:56:17.181792+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:56:17.181792+0000","last_undegraded":"2024-09-10T23:56:17.181792+0000","last_fullsized":"2024-09-10T23:56:17.181792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177183+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:56:17.177183+0000","last_peered":"2024-09-10T23:56:17.177183+0000","last_clean":"2024-09-10T23:56:17.177183+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:56:17.177183+0000","last_undegraded":"2024-09-10T23:56:17.177183+0000","last_fullsized":"2024-09-10T23:56:17.177183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198925+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:56:17.198925+0000","last_peered":"2024-09-10T23:56:17.198925+0000","last_clean":"2024-09-10T23:56:17.198925+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:56:17.198925+0000","last_undegraded":"2024-09-10T23:56:17.198925+0000","last_fullsized":"2024-09-10T23:56:17.198925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182890+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:56:17.182890+0000","last_peered":"2024-09-10T23:56:17.182890+0000","last_clean":"2024-09-10T23:56:17.182890+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:56:17.182890+0000","last_undegraded":"2024-09-10T23:56:17.182890+0000","last_fullsized":"2024-09-10T23:56:17.182890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199096+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:56:17.199096+0000","last_peered":"2024-09-10T23:56:17.199096+0000","last_clean":"2024-09-10T23:56:17.199096+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:56:17.199096+0000","last_undegraded":"2024-09-10T23:56:17.199096+0000","last_fullsized":"2024-09-10T23:56:17.199096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70972,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":752,"num_read_kb":447,"num_write":187,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":212916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710770,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":497970,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":1151569,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070526,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":502280,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266757,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":498082,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462987,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1094686,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626512,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":493360,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822744,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1090219,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986270,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":565994,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182499,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493554,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411434,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493998,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":558614,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738486,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":494748,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:56:49.561 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:56:49.945 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 -- 172.21.15.33:0/2652011214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c10f200 msgr2=0x7f122c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 --2- 172.21.15.33:0/2652011214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c10f200 0x7f122c1115f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1224009900 tx=0x7f122402a410 comp rx=0 tx=0).stop 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 -- 172.21.15.33:0/2652011214 shutdown_connections 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 --2- 172.21.15.33:0/2652011214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c10f200 0x7f122c1115f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 --2- 172.21.15.33:0/2652011214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c075e00 0x7f122c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 --2- 172.21.15.33:0/2652011214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c0754e0 0x7f122c0758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 -- 172.21.15.33:0/2652011214 >> 172.21.15.33:0/2652011214 conn(0x7f122c0fe660 msgr2=0x7f122c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 -- 172.21.15.33:0/2652011214 shutdown_connections 2024-09-10T23:56:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.560+0000 7f122b200640 1 -- 172.21.15.33:0/2652011214 wait complete. 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 Processor -- start 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 -- start start 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c0754e0 0x7f122c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c10f200 0x7f122c1a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f122c114c90 con 0x7f122c075e00 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f122c114b10 con 0x7f122c0754e0 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.562+0000 7f122b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f122c114e10 con 0x7f122c10f200 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40596/0 (socket says 172.21.15.33:40596) 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 -- 172.21.15.33:0/2760975245 learned_addr learned my addr 172.21.15.33:0/2760975245 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1229e00640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c0754e0 0x7f122c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f122a800640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c10f200 0x7f122c1a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 -- 172.21.15.33:0/2760975245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c10f200 msgr2=0x7f122c1a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c10f200 0x7f122c1a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 -- 172.21.15.33:0/2760975245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c0754e0 msgr2=0x7f122c19b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c0754e0 0x7f122c19b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 -- 172.21.15.33:0/2760975245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c1a11f0 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.563+0000 7f1221400640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f121400d950 tx=0x7f121400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.564+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214017030 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.564+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1214004020 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.564+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c1a14e0 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.564+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12140055d0 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.564+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c1a7ba0 con 0x7f122c075e00 2024-09-10T23:56:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.565+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122c0758c0 con 0x7f122c075e00 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.567+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f1214009a30 con 0x7f122c075e00 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.569+0000 7f1223400640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 0x7f12100b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.569+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f12140e5ac0 con 0x7f122c075e00 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.569+0000 7f1229e00640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 0x7f12100b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.570+0000 7f1229e00640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 0x7f12100b78d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f121c005fd0 tx=0x7f121c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.573+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f12140ac420 con 0x7f122c075e00 2024-09-10T23:56:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:50 smithi052 ceph-mon[33526]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:50.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:50 smithi052 ceph-mon[33526]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:56:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.764+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f122c100270 con 0x7f12100b5410 2024-09-10T23:56:50.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:50 smithi033 ceph-mon[30593]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:50.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:50 smithi033 ceph-mon[30593]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:56:50.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.770+0000 7f1223400640 1 -- 172.21.15.33:0/2760975245 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340746 (secure 0 0 0) 0x7f122c100270 con 0x7f12100b5410 2024-09-10T23:56:50.775 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:50.777 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 msgr2=0x7f12100b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 0x7f12100b78d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f121c005fd0 tx=0x7f121c009500 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 msgr2=0x7f122c19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f121400d950 tx=0x7f121400de10 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 shutdown_connections 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12100b5410 0x7f12100b78d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f122c10f200 0x7f122c1a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f122c075e00 0x7f122c19b680 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 --2- 172.21.15.33:0/2760975245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f122c0754e0 0x7f122c19b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:50.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 >> 172.21.15.33:0/2760975245 conn(0x7f122c0fe660 msgr2=0x7f122c1113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:50.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 shutdown_connections 2024-09-10T23:56:50.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:50.775+0000 7f122b200640 1 -- 172.21.15.33:0/2760975245 wait complete. 2024-09-10T23:56:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:50 smithi189 ceph-mon[34000]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:50 smithi189 ceph-mon[34000]: pgmap v438: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T23:56:51.586 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-09-10T23:56:48.827176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661574,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":828,"num_read_kb":511,"num_write":316,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":757,"ondisk_log_size":757,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360932,"kb_used_data":11684,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580892,"statfs":{"total":1151940427776,"available":1151570833408,"internally_reserved":0,"allocated":11964416,"data_stored":7935074,"data_compressed":463005,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1431,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003437"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195931+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:55:48.195931+0000","last_peered":"2024-09-10T23:55:48.195931+0000","last_clean":"2024-09-10T23:55:48.195931+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:55:48.195931+0000","last_undegraded":"2024-09-10T23:55:48.195931+0000","last_fullsized":"2024-09-10T23:55:48.195931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181257+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:56:17.181257+0000","last_peered":"2024-09-10T23:56:17.181257+0000","last_clean":"2024-09-10T23:56:17.181257+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:56:17.181257+0000","last_undegraded":"2024-09-10T23:56:17.181257+0000","last_fullsized":"2024-09-10T23:56:17.181257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431740+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:55:48.431740+0000","last_peered":"2024-09-10T23:55:48.431740+0000","last_clean":"2024-09-10T23:55:48.431740+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:55:48.431740+0000","last_undegraded":"2024-09-10T23:55:48.431740+0000","last_fullsized":"2024-09-10T23:55:48.431740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431965+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:55:48.431965+0000","last_peered":"2024-09-10T23:55:48.431965+0000","last_clean":"2024-09-10T23:55:48.431965+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:55:48.431965+0000","last_undegraded":"2024-09-10T23:55:48.431965+0000","last_fullsized":"2024-09-10T23:55:48.431965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198453+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:56:17.198453+0000","last_peered":"2024-09-10T23:56:17.198453+0000","last_clean":"2024-09-10T23:56:17.198453+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:56:17.198453+0000","last_undegraded":"2024-09-10T23:56:17.198453+0000","last_fullsized":"2024-09-10T23:56:17.198453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191244+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:55:48.191244+0000","last_peered":"2024-09-10T23:55:48.191244+0000","last_clean":"2024-09-10T23:55:48.191244+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:55:48.191244+0000","last_undegraded":"2024-09-10T23:55:48.191244+0000","last_fullsized":"2024-09-10T23:55:48.191244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433246+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:55:48.433246+0000","last_peered":"2024-09-10T23:55:48.433246+0000","last_clean":"2024-09-10T23:55:48.433246+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:55:48.433246+0000","last_undegraded":"2024-09-10T23:55:48.433246+0000","last_fullsized":"2024-09-10T23:55:48.433246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197336+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:56:17.197336+0000","last_peered":"2024-09-10T23:56:17.197336+0000","last_clean":"2024-09-10T23:56:17.197336+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:56:17.197336+0000","last_undegraded":"2024-09-10T23:56:17.197336+0000","last_fullsized":"2024-09-10T23:56:17.197336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191675+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:55:48.191675+0000","last_peered":"2024-09-10T23:55:48.191675+0000","last_clean":"2024-09-10T23:55:48.191675+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:55:48.191675+0000","last_undegraded":"2024-09-10T23:55:48.191675+0000","last_fullsized":"2024-09-10T23:55:48.191675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192047+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:55:48.192047+0000","last_peered":"2024-09-10T23:55:48.192047+0000","last_clean":"2024-09-10T23:55:48.192047+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:55:48.192047+0000","last_undegraded":"2024-09-10T23:55:48.192047+0000","last_fullsized":"2024-09-10T23:55:48.192047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197601+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:56:17.197601+0000","last_peered":"2024-09-10T23:56:17.197601+0000","last_clean":"2024-09-10T23:56:17.197601+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:56:17.197601+0000","last_undegraded":"2024-09-10T23:56:17.197601+0000","last_fullsized":"2024-09-10T23:56:17.197601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191309+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:55:48.191309+0000","last_peered":"2024-09-10T23:55:48.191309+0000","last_clean":"2024-09-10T23:55:48.191309+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:55:48.191309+0000","last_undegraded":"2024-09-10T23:55:48.191309+0000","last_fullsized":"2024-09-10T23:55:48.191309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200461+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:56:17.200461+0000","last_peered":"2024-09-10T23:56:17.200461+0000","last_clean":"2024-09-10T23:56:17.200461+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:56:17.200461+0000","last_undegraded":"2024-09-10T23:56:17.200461+0000","last_fullsized":"2024-09-10T23:56:17.200461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191569+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:55:48.191569+0000","last_peered":"2024-09-10T23:55:48.191569+0000","last_clean":"2024-09-10T23:55:48.191569+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:55:48.191569+0000","last_undegraded":"2024-09-10T23:55:48.191569+0000","last_fullsized":"2024-09-10T23:55:48.191569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192035+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:55:48.192035+0000","last_peered":"2024-09-10T23:55:48.192035+0000","last_clean":"2024-09-10T23:55:48.192035+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:55:48.192035+0000","last_undegraded":"2024-09-10T23:55:48.192035+0000","last_fullsized":"2024-09-10T23:55:48.192035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186205+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:56:17.186205+0000","last_peered":"2024-09-10T23:56:17.186205+0000","last_clean":"2024-09-10T23:56:17.186205+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:56:17.186205+0000","last_undegraded":"2024-09-10T23:56:17.186205+0000","last_fullsized":"2024-09-10T23:56:17.186205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:07.417309+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:56:07.417309+0000","last_peered":"2024-09-10T23:56:07.417309+0000","last_clean":"2024-09-10T23:56:07.417309+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:56:07.417309+0000","last_undegraded":"2024-09-10T23:56:07.417309+0000","last_fullsized":"2024-09-10T23:56:07.417309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191815+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:55:48.191815+0000","last_peered":"2024-09-10T23:55:48.191815+0000","last_clean":"2024-09-10T23:55:48.191815+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:55:48.191815+0000","last_undegraded":"2024-09-10T23:55:48.191815+0000","last_fullsized":"2024-09-10T23:55:48.191815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178537+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:56:17.178537+0000","last_peered":"2024-09-10T23:56:17.178537+0000","last_clean":"2024-09-10T23:56:17.178537+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:56:17.178537+0000","last_undegraded":"2024-09-10T23:56:17.178537+0000","last_fullsized":"2024-09-10T23:56:17.178537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431602+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:55:48.431602+0000","last_peered":"2024-09-10T23:55:48.431602+0000","last_clean":"2024-09-10T23:55:48.431602+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:55:48.431602+0000","last_undegraded":"2024-09-10T23:55:48.431602+0000","last_fullsized":"2024-09-10T23:55:48.431602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195751+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:55:48.195751+0000","last_peered":"2024-09-10T23:55:48.195751+0000","last_clean":"2024-09-10T23:55:48.195751+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:55:48.195751+0000","last_undegraded":"2024-09-10T23:55:48.195751+0000","last_fullsized":"2024-09-10T23:55:48.195751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.133645+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:56:17.133645+0000","last_peered":"2024-09-10T23:56:17.133645+0000","last_clean":"2024-09-10T23:56:17.133645+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:56:17.133645+0000","last_undegraded":"2024-09-10T23:56:17.133645+0000","last_fullsized":"2024-09-10T23:56:17.133645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389183+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:55:48.389183+0000","last_peered":"2024-09-10T23:55:48.389183+0000","last_clean":"2024-09-10T23:55:48.389183+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:55:48.389183+0000","last_undegraded":"2024-09-10T23:55:48.389183+0000","last_fullsized":"2024-09-10T23:55:48.389183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191804+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:55:48.191804+0000","last_peered":"2024-09-10T23:55:48.191804+0000","last_clean":"2024-09-10T23:55:48.191804+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:55:48.191804+0000","last_undegraded":"2024-09-10T23:55:48.191804+0000","last_fullsized":"2024-09-10T23:55:48.191804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186131+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:56:17.186131+0000","last_peered":"2024-09-10T23:56:17.186131+0000","last_clean":"2024-09-10T23:56:17.186131+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:56:17.186131+0000","last_undegraded":"2024-09-10T23:56:17.186131+0000","last_fullsized":"2024-09-10T23:56:17.186131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192153+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:55:48.192153+0000","last_peered":"2024-09-10T23:55:48.192153+0000","last_clean":"2024-09-10T23:55:48.192153+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:55:48.192153+0000","last_undegraded":"2024-09-10T23:55:48.192153+0000","last_fullsized":"2024-09-10T23:55:48.192153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431867+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:55:48.431867+0000","last_peered":"2024-09-10T23:55:48.431867+0000","last_clean":"2024-09-10T23:55:48.431867+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:55:48.431867+0000","last_undegraded":"2024-09-10T23:55:48.431867+0000","last_fullsized":"2024-09-10T23:55:48.431867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.189859+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:56:17.189859+0000","last_peered":"2024-09-10T23:56:17.189859+0000","last_clean":"2024-09-10T23:56:17.189859+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:56:17.189859+0000","last_undegraded":"2024-09-10T23:56:17.189859+0000","last_fullsized":"2024-09-10T23:56:17.189859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'13","reported_seq":55,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:04.570195+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:56:04.570195+0000","last_peered":"2024-09-10T23:56:04.570195+0000","last_clean":"2024-09-10T23:56:04.570195+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:56:04.570195+0000","last_undegraded":"2024-09-10T23:56:04.570195+0000","last_fullsized":"2024-09-10T23:56:04.570195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431289+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:55:48.431289+0000","last_peered":"2024-09-10T23:55:48.431289+0000","last_clean":"2024-09-10T23:55:48.431289+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:55:48.431289+0000","last_undegraded":"2024-09-10T23:55:48.431289+0000","last_fullsized":"2024-09-10T23:55:48.431289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.164683+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:56:17.164683+0000","last_peered":"2024-09-10T23:56:17.164683+0000","last_clean":"2024-09-10T23:56:17.164683+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:56:17.164683+0000","last_undegraded":"2024-09-10T23:56:17.164683+0000","last_fullsized":"2024-09-10T23:56:17.164683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191992+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:55:48.191992+0000","last_peered":"2024-09-10T23:55:48.191992+0000","last_clean":"2024-09-10T23:55:48.191992+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:55:48.191992+0000","last_undegraded":"2024-09-10T23:55:48.191992+0000","last_fullsized":"2024-09-10T23:55:48.191992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433181+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:55:48.433181+0000","last_peered":"2024-09-10T23:55:48.433181+0000","last_clean":"2024-09-10T23:55:48.433181+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:55:48.433181+0000","last_undegraded":"2024-09-10T23:55:48.433181+0000","last_fullsized":"2024-09-10T23:55:48.433181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180145+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:56:17.180145+0000","last_peered":"2024-09-10T23:56:17.180145+0000","last_clean":"2024-09-10T23:56:17.180145+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:56:17.180145+0000","last_undegraded":"2024-09-10T23:56:17.180145+0000","last_fullsized":"2024-09-10T23:56:17.180145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195459+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:55:48.195459+0000","last_peered":"2024-09-10T23:55:48.195459+0000","last_clean":"2024-09-10T23:55:48.195459+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:55:48.195459+0000","last_undegraded":"2024-09-10T23:55:48.195459+0000","last_fullsized":"2024-09-10T23:55:48.195459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191584+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:55:48.191584+0000","last_peered":"2024-09-10T23:55:48.191584+0000","last_clean":"2024-09-10T23:55:48.191584+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:55:48.191584+0000","last_undegraded":"2024-09-10T23:55:48.191584+0000","last_fullsized":"2024-09-10T23:55:48.191584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179493+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:56:17.179493+0000","last_peered":"2024-09-10T23:56:17.179493+0000","last_clean":"2024-09-10T23:56:17.179493+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:56:17.179493+0000","last_undegraded":"2024-09-10T23:56:17.179493+0000","last_fullsized":"2024-09-10T23:56:17.179493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196793+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:55:48.196793+0000","last_peered":"2024-09-10T23:55:48.196793+0000","last_clean":"2024-09-10T23:55:48.196793+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:55:48.196793+0000","last_undegraded":"2024-09-10T23:55:48.196793+0000","last_fullsized":"2024-09-10T23:55:48.196793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228467+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:55:48.228467+0000","last_peered":"2024-09-10T23:55:48.228467+0000","last_clean":"2024-09-10T23:55:48.228467+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:55:48.228467+0000","last_undegraded":"2024-09-10T23:55:48.228467+0000","last_fullsized":"2024-09-10T23:55:48.228467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181268+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:56:17.181268+0000","last_peered":"2024-09-10T23:56:17.181268+0000","last_clean":"2024-09-10T23:56:17.181268+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:56:17.181268+0000","last_undegraded":"2024-09-10T23:56:17.181268+0000","last_fullsized":"2024-09-10T23:56:17.181268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:44.206645+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:56:44.206645+0000","last_peered":"2024-09-10T23:56:44.206645+0000","last_clean":"2024-09-10T23:56:44.206645+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:56:44.206645+0000","last_undegraded":"2024-09-10T23:56:44.206645+0000","last_fullsized":"2024-09-10T23:56:44.206645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228796+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:55:48.228796+0000","last_peered":"2024-09-10T23:55:48.228796+0000","last_clean":"2024-09-10T23:55:48.228796+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:55:48.228796+0000","last_undegraded":"2024-09-10T23:55:48.228796+0000","last_fullsized":"2024-09-10T23:55:48.228796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181103+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:56:17.181103+0000","last_peered":"2024-09-10T23:56:17.181103+0000","last_clean":"2024-09-10T23:56:17.181103+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:56:17.181103+0000","last_undegraded":"2024-09-10T23:56:17.181103+0000","last_fullsized":"2024-09-10T23:56:17.181103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196354+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:55:48.196354+0000","last_peered":"2024-09-10T23:55:48.196354+0000","last_clean":"2024-09-10T23:55:48.196354+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:55:48.196354+0000","last_undegraded":"2024-09-10T23:55:48.196354+0000","last_fullsized":"2024-09-10T23:55:48.196354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191644+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:55:48.191644+0000","last_peered":"2024-09-10T23:55:48.191644+0000","last_clean":"2024-09-10T23:55:48.191644+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:55:48.191644+0000","last_undegraded":"2024-09-10T23:55:48.191644+0000","last_fullsized":"2024-09-10T23:55:48.191644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.195563+0000","last_change":"2024-09-10T23:55:48.434804+0000","last_active":"2024-09-10T23:56:17.195563+0000","last_peered":"2024-09-10T23:56:17.195563+0000","last_clean":"2024-09-10T23:56:17.195563+0000","last_became_active":"2024-09-10T23:55:48.434451+0000","last_became_peered":"2024-09-10T23:55:48.434451+0000","last_unstale":"2024-09-10T23:56:17.195563+0000","last_undegraded":"2024-09-10T23:56:17.195563+0000","last_fullsized":"2024-09-10T23:56:17.195563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.587382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191947+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:55:48.191947+0000","last_peered":"2024-09-10T23:55:48.191947+0000","last_clean":"2024-09-10T23:55:48.191947+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:55:48.191947+0000","last_undegraded":"2024-09-10T23:55:48.191947+0000","last_fullsized":"2024-09-10T23:55:48.191947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196441+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:55:48.196441+0000","last_peered":"2024-09-10T23:55:48.196441+0000","last_clean":"2024-09-10T23:55:48.196441+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:55:48.196441+0000","last_undegraded":"2024-09-10T23:55:48.196441+0000","last_fullsized":"2024-09-10T23:55:48.196441+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197191+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:55:48.197191+0000","last_peered":"2024-09-10T23:55:48.197191+0000","last_clean":"2024-09-10T23:55:48.197191+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:55:48.197191+0000","last_undegraded":"2024-09-10T23:55:48.197191+0000","last_fullsized":"2024-09-10T23:55:48.197191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200462+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:56:17.200462+0000","last_peered":"2024-09-10T23:56:17.200462+0000","last_clean":"2024-09-10T23:56:17.200462+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:56:17.200462+0000","last_undegraded":"2024-09-10T23:56:17.200462+0000","last_fullsized":"2024-09-10T23:56:17.200462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432354+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:55:48.432354+0000","last_peered":"2024-09-10T23:55:48.432354+0000","last_clean":"2024-09-10T23:55:48.432354+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:55:48.432354+0000","last_undegraded":"2024-09-10T23:55:48.432354+0000","last_fullsized":"2024-09-10T23:55:48.432354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389219+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:55:48.389219+0000","last_peered":"2024-09-10T23:55:48.389219+0000","last_clean":"2024-09-10T23:55:48.389219+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:55:48.389219+0000","last_undegraded":"2024-09-10T23:55:48.389219+0000","last_fullsized":"2024-09-10T23:55:48.389219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.185951+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:56:17.185951+0000","last_peered":"2024-09-10T23:56:17.185951+0000","last_clean":"2024-09-10T23:56:17.185951+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:56:17.185951+0000","last_undegraded":"2024-09-10T23:56:17.185951+0000","last_fullsized":"2024-09-10T23:56:17.185951+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432850+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:55:48.432850+0000","last_peered":"2024-09-10T23:55:48.432850+0000","last_clean":"2024-09-10T23:55:48.432850+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:55:48.432850+0000","last_undegraded":"2024-09-10T23:55:48.432850+0000","last_fullsized":"2024-09-10T23:55:48.432850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192871+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:55:48.192871+0000","last_peered":"2024-09-10T23:55:48.192871+0000","last_clean":"2024-09-10T23:55:48.192871+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:55:48.192871+0000","last_undegraded":"2024-09-10T23:55:48.192871+0000","last_fullsized":"2024-09-10T23:55:48.192871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.190127+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:56:17.190127+0000","last_peered":"2024-09-10T23:56:17.190127+0000","last_clean":"2024-09-10T23:56:17.190127+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:56:17.190127+0000","last_undegraded":"2024-09-10T23:56:17.190127+0000","last_fullsized":"2024-09-10T23:56:17.190127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228827+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:55:48.228827+0000","last_peered":"2024-09-10T23:55:48.228827+0000","last_clean":"2024-09-10T23:55:48.228827+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:55:48.228827+0000","last_undegraded":"2024-09-10T23:55:48.228827+0000","last_fullsized":"2024-09-10T23:55:48.228827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431768+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:55:48.431768+0000","last_peered":"2024-09-10T23:55:48.431768+0000","last_clean":"2024-09-10T23:55:48.431768+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:55:48.431768+0000","last_undegraded":"2024-09-10T23:55:48.431768+0000","last_fullsized":"2024-09-10T23:55:48.431768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182166+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:56:17.182166+0000","last_peered":"2024-09-10T23:56:17.182166+0000","last_clean":"2024-09-10T23:56:17.182166+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:56:17.182166+0000","last_undegraded":"2024-09-10T23:56:17.182166+0000","last_fullsized":"2024-09-10T23:56:17.182166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434011+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:55:48.434011+0000","last_peered":"2024-09-10T23:55:48.434011+0000","last_clean":"2024-09-10T23:55:48.434011+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:55:48.434011+0000","last_undegraded":"2024-09-10T23:55:48.434011+0000","last_fullsized":"2024-09-10T23:55:48.434011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432671+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:55:48.432671+0000","last_peered":"2024-09-10T23:55:48.432671+0000","last_clean":"2024-09-10T23:55:48.432671+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:55:48.432671+0000","last_undegraded":"2024-09-10T23:55:48.432671+0000","last_fullsized":"2024-09-10T23:55:48.432671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196864+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:56:17.196864+0000","last_peered":"2024-09-10T23:56:17.196864+0000","last_clean":"2024-09-10T23:56:17.196864+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:56:17.196864+0000","last_undegraded":"2024-09-10T23:56:17.196864+0000","last_fullsized":"2024-09-10T23:56:17.196864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191512+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:55:48.191512+0000","last_peered":"2024-09-10T23:55:48.191512+0000","last_clean":"2024-09-10T23:55:48.191512+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:55:48.191512+0000","last_undegraded":"2024-09-10T23:55:48.191512+0000","last_fullsized":"2024-09-10T23:55:48.191512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228828+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:55:48.228828+0000","last_peered":"2024-09-10T23:55:48.228828+0000","last_clean":"2024-09-10T23:55:48.228828+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:55:48.228828+0000","last_undegraded":"2024-09-10T23:55:48.228828+0000","last_fullsized":"2024-09-10T23:55:48.228828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186834+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:56:17.186834+0000","last_peered":"2024-09-10T23:56:17.186834+0000","last_clean":"2024-09-10T23:56:17.186834+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:56:17.186834+0000","last_undegraded":"2024-09-10T23:56:17.186834+0000","last_fullsized":"2024-09-10T23:56:17.186834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.210338+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:56:45.210338+0000","last_peered":"2024-09-10T23:56:45.210338+0000","last_clean":"2024-09-10T23:56:45.210338+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:56:45.210338+0000","last_undegraded":"2024-09-10T23:56:45.210338+0000","last_fullsized":"2024-09-10T23:56:45.210338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195796+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:55:48.195796+0000","last_peered":"2024-09-10T23:55:48.195796+0000","last_clean":"2024-09-10T23:55:48.195796+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:55:48.195796+0000","last_undegraded":"2024-09-10T23:55:48.195796+0000","last_fullsized":"2024-09-10T23:55:48.195796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196400+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:56:17.196400+0000","last_peered":"2024-09-10T23:56:17.196400+0000","last_clean":"2024-09-10T23:56:17.196400+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:56:17.196400+0000","last_undegraded":"2024-09-10T23:56:17.196400+0000","last_fullsized":"2024-09-10T23:56:17.196400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431838+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:55:48.431838+0000","last_peered":"2024-09-10T23:55:48.431838+0000","last_clean":"2024-09-10T23:55:48.431838+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:55:48.431838+0000","last_undegraded":"2024-09-10T23:55:48.431838+0000","last_fullsized":"2024-09-10T23:55:48.431838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433410+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:55:48.433410+0000","last_peered":"2024-09-10T23:55:48.433410+0000","last_clean":"2024-09-10T23:55:48.433410+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:55:48.433410+0000","last_undegraded":"2024-09-10T23:55:48.433410+0000","last_fullsized":"2024-09-10T23:55:48.433410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187705+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:56:17.187705+0000","last_peered":"2024-09-10T23:56:17.187705+0000","last_clean":"2024-09-10T23:56:17.187705+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:56:17.187705+0000","last_undegraded":"2024-09-10T23:56:17.187705+0000","last_fullsized":"2024-09-10T23:56:17.187705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432470+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:55:48.432470+0000","last_peered":"2024-09-10T23:55:48.432470+0000","last_clean":"2024-09-10T23:55:48.432470+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:55:48.432470+0000","last_undegraded":"2024-09-10T23:55:48.432470+0000","last_fullsized":"2024-09-10T23:55:48.432470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432660+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:55:48.432660+0000","last_peered":"2024-09-10T23:55:48.432660+0000","last_clean":"2024-09-10T23:55:48.432660+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:55:48.432660+0000","last_undegraded":"2024-09-10T23:55:48.432660+0000","last_fullsized":"2024-09-10T23:55:48.432660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188737+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:56:17.188737+0000","last_peered":"2024-09-10T23:56:17.188737+0000","last_clean":"2024-09-10T23:56:17.188737+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:56:17.188737+0000","last_undegraded":"2024-09-10T23:56:17.188737+0000","last_fullsized":"2024-09-10T23:56:17.188737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'40","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:46.194526+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:56:46.194526+0000","last_peered":"2024-09-10T23:56:46.194526+0000","last_clean":"2024-09-10T23:56:46.194526+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:56:46.194526+0000","last_undegraded":"2024-09-10T23:56:46.194526+0000","last_fullsized":"2024-09-10T23:56:46.194526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65344,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":185,"num_write":41,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195412+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:55:48.195412+0000","last_peered":"2024-09-10T23:55:48.195412+0000","last_clean":"2024-09-10T23:55:48.195412+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:55:48.195412+0000","last_undegraded":"2024-09-10T23:55:48.195412+0000","last_fullsized":"2024-09-10T23:55:48.195412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198485+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:56:17.198485+0000","last_peered":"2024-09-10T23:56:17.198485+0000","last_clean":"2024-09-10T23:56:17.198485+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:56:17.198485+0000","last_undegraded":"2024-09-10T23:56:17.198485+0000","last_fullsized":"2024-09-10T23:56:17.198485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432787+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:55:48.432787+0000","last_peered":"2024-09-10T23:55:48.432787+0000","last_clean":"2024-09-10T23:55:48.432787+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:55:48.432787+0000","last_undegraded":"2024-09-10T23:55:48.432787+0000","last_fullsized":"2024-09-10T23:55:48.432787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191530+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:55:48.191530+0000","last_peered":"2024-09-10T23:55:48.191530+0000","last_clean":"2024-09-10T23:55:48.191530+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:55:48.191530+0000","last_undegraded":"2024-09-10T23:55:48.191530+0000","last_fullsized":"2024-09-10T23:55:48.191530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184789+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:56:17.184789+0000","last_peered":"2024-09-10T23:56:17.184789+0000","last_clean":"2024-09-10T23:56:17.184789+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:56:17.184789+0000","last_undegraded":"2024-09-10T23:56:17.184789+0000","last_fullsized":"2024-09-10T23:56:17.184789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197287+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:55:48.197287+0000","last_peered":"2024-09-10T23:55:48.197287+0000","last_clean":"2024-09-10T23:55:48.197287+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:55:48.197287+0000","last_undegraded":"2024-09-10T23:55:48.197287+0000","last_fullsized":"2024-09-10T23:55:48.197287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195034+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:55:48.195034+0000","last_peered":"2024-09-10T23:55:48.195034+0000","last_clean":"2024-09-10T23:55:48.195034+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:55:48.195034+0000","last_undegraded":"2024-09-10T23:55:48.195034+0000","last_fullsized":"2024-09-10T23:55:48.195034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197509+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:56:17.197509+0000","last_peered":"2024-09-10T23:56:17.197509+0000","last_clean":"2024-09-10T23:56:17.197509+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:56:17.197509+0000","last_undegraded":"2024-09-10T23:56:17.197509+0000","last_fullsized":"2024-09-10T23:56:17.197509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.192388+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:56:45.192388+0000","last_peered":"2024-09-10T23:56:45.192388+0000","last_clean":"2024-09-10T23:56:45.192388+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:56:45.192388+0000","last_undegraded":"2024-09-10T23:56:45.192388+0000","last_fullsized":"2024-09-10T23:56:45.192388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431433+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:55:48.431433+0000","last_peered":"2024-09-10T23:55:48.431433+0000","last_clean":"2024-09-10T23:55:48.431433+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:55:48.431433+0000","last_undegraded":"2024-09-10T23:55:48.431433+0000","last_fullsized":"2024-09-10T23:55:48.431433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193081+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:55:48.193081+0000","last_peered":"2024-09-10T23:55:48.193081+0000","last_clean":"2024-09-10T23:55:48.193081+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:55:48.193081+0000","last_undegraded":"2024-09-10T23:55:48.193081+0000","last_fullsized":"2024-09-10T23:55:48.193081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180978+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:56:17.180978+0000","last_peered":"2024-09-10T23:56:17.180978+0000","last_clean":"2024-09-10T23:56:17.180978+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:56:17.180978+0000","last_undegraded":"2024-09-10T23:56:17.180978+0000","last_fullsized":"2024-09-10T23:56:17.180978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432271+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:55:48.432271+0000","last_peered":"2024-09-10T23:55:48.432271+0000","last_clean":"2024-09-10T23:55:48.432271+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:55:48.432271+0000","last_undegraded":"2024-09-10T23:55:48.432271+0000","last_fullsized":"2024-09-10T23:55:48.432271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433888+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:55:48.433888+0000","last_peered":"2024-09-10T23:55:48.433888+0000","last_clean":"2024-09-10T23:55:48.433888+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:55:48.433888+0000","last_undegraded":"2024-09-10T23:55:48.433888+0000","last_fullsized":"2024-09-10T23:55:48.433888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179336+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:56:17.179336+0000","last_peered":"2024-09-10T23:56:17.179336+0000","last_clean":"2024-09-10T23:56:17.179336+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:56:17.179336+0000","last_undegraded":"2024-09-10T23:56:17.179336+0000","last_fullsized":"2024-09-10T23:56:17.179336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228461+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:55:48.228461+0000","last_peered":"2024-09-10T23:55:48.228461+0000","last_clean":"2024-09-10T23:55:48.228461+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:55:48.228461+0000","last_undegraded":"2024-09-10T23:55:48.228461+0000","last_fullsized":"2024-09-10T23:55:48.228461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194225+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:55:48.194225+0000","last_peered":"2024-09-10T23:55:48.194225+0000","last_clean":"2024-09-10T23:55:48.194225+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:55:48.194225+0000","last_undegraded":"2024-09-10T23:55:48.194225+0000","last_fullsized":"2024-09-10T23:55:48.194225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184504+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:56:17.184504+0000","last_peered":"2024-09-10T23:56:17.184504+0000","last_clean":"2024-09-10T23:56:17.184504+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:56:17.184504+0000","last_undegraded":"2024-09-10T23:56:17.184504+0000","last_fullsized":"2024-09-10T23:56:17.184504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432027+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:55:48.432027+0000","last_peered":"2024-09-10T23:55:48.432027+0000","last_clean":"2024-09-10T23:55:48.432027+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:55:48.432027+0000","last_undegraded":"2024-09-10T23:55:48.432027+0000","last_fullsized":"2024-09-10T23:55:48.432027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'8","reported_seq":188,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.193798+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:56:45.193798+0000","last_peered":"2024-09-10T23:56:45.193798+0000","last_clean":"2024-09-10T23:56:45.193798+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:56:45.193798+0000","last_undegraded":"2024-09-10T23:56:45.193798+0000","last_fullsized":"2024-09-10T23:56:45.193798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183135+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:56:17.183135+0000","last_peered":"2024-09-10T23:56:17.183135+0000","last_clean":"2024-09-10T23:56:17.183135+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:56:17.183135+0000","last_undegraded":"2024-09-10T23:56:17.183135+0000","last_fullsized":"2024-09-10T23:56:17.183135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433033+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:55:48.433033+0000","last_peered":"2024-09-10T23:55:48.433033+0000","last_clean":"2024-09-10T23:55:48.433033+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:55:48.433033+0000","last_undegraded":"2024-09-10T23:55:48.433033+0000","last_fullsized":"2024-09-10T23:55:48.433033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183513+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:56:17.183513+0000","last_peered":"2024-09-10T23:56:17.183513+0000","last_clean":"2024-09-10T23:56:17.183513+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:56:17.183513+0000","last_undegraded":"2024-09-10T23:56:17.183513+0000","last_fullsized":"2024-09-10T23:56:17.183513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182098+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:56:17.182098+0000","last_peered":"2024-09-10T23:56:17.182098+0000","last_clean":"2024-09-10T23:56:17.182098+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:56:17.182098+0000","last_undegraded":"2024-09-10T23:56:17.182098+0000","last_fullsized":"2024-09-10T23:56:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.156836+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:56:17.156836+0000","last_peered":"2024-09-10T23:56:17.156836+0000","last_clean":"2024-09-10T23:56:17.156836+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:56:17.156836+0000","last_undegraded":"2024-09-10T23:56:17.156836+0000","last_fullsized":"2024-09-10T23:56:17.156836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183555+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:56:17.183555+0000","last_peered":"2024-09-10T23:56:17.183555+0000","last_clean":"2024-09-10T23:56:17.183555+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:56:17.183555+0000","last_undegraded":"2024-09-10T23:56:17.183555+0000","last_fullsized":"2024-09-10T23:56:17.183555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180532+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:56:17.180532+0000","last_peered":"2024-09-10T23:56:17.180532+0000","last_clean":"2024-09-10T23:56:17.180532+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:56:17.180532+0000","last_undegraded":"2024-09-10T23:56:17.180532+0000","last_fullsized":"2024-09-10T23:56:17.180532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182356+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:56:17.182356+0000","last_peered":"2024-09-10T23:56:17.182356+0000","last_clean":"2024-09-10T23:56:17.182356+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:56:17.182356+0000","last_undegraded":"2024-09-10T23:56:17.182356+0000","last_fullsized":"2024-09-10T23:56:17.182356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197300+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:56:17.197300+0000","last_peered":"2024-09-10T23:56:17.197300+0000","last_clean":"2024-09-10T23:56:17.197300+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:56:17.197300+0000","last_undegraded":"2024-09-10T23:56:17.197300+0000","last_fullsized":"2024-09-10T23:56:17.197300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177647+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:56:17.177647+0000","last_peered":"2024-09-10T23:56:17.177647+0000","last_clean":"2024-09-10T23:56:17.177647+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:56:17.177647+0000","last_undegraded":"2024-09-10T23:56:17.177647+0000","last_fullsized":"2024-09-10T23:56:17.177647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184538+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:56:17.184538+0000","last_peered":"2024-09-10T23:56:17.184538+0000","last_clean":"2024-09-10T23:56:17.184538+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:56:17.184538+0000","last_undegraded":"2024-09-10T23:56:17.184538+0000","last_fullsized":"2024-09-10T23:56:17.184538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179051+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:56:17.179051+0000","last_peered":"2024-09-10T23:56:17.179051+0000","last_clean":"2024-09-10T23:56:17.179051+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:56:17.179051+0000","last_undegraded":"2024-09-10T23:56:17.179051+0000","last_fullsized":"2024-09-10T23:56:17.179051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199985+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:56:17.199985+0000","last_peered":"2024-09-10T23:56:17.199985+0000","last_clean":"2024-09-10T23:56:17.199985+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:56:17.199985+0000","last_undegraded":"2024-09-10T23:56:17.199985+0000","last_fullsized":"2024-09-10T23:56:17.199985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188322+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:56:17.188322+0000","last_peered":"2024-09-10T23:56:17.188322+0000","last_clean":"2024-09-10T23:56:17.188322+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:56:17.188322+0000","last_undegraded":"2024-09-10T23:56:17.188322+0000","last_fullsized":"2024-09-10T23:56:17.188322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178350+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:56:17.178350+0000","last_peered":"2024-09-10T23:56:17.178350+0000","last_clean":"2024-09-10T23:56:17.178350+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:56:17.178350+0000","last_undegraded":"2024-09-10T23:56:17.178350+0000","last_fullsized":"2024-09-10T23:56:17.178350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.158699+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:56:17.158699+0000","last_peered":"2024-09-10T23:56:17.158699+0000","last_clean":"2024-09-10T23:56:17.158699+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:56:17.158699+0000","last_undegraded":"2024-09-10T23:56:17.158699+0000","last_fullsized":"2024-09-10T23:56:17.158699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197868+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:56:17.197868+0000","last_peered":"2024-09-10T23:56:17.197868+0000","last_clean":"2024-09-10T23:56:17.197868+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:56:17.197868+0000","last_undegraded":"2024-09-10T23:56:17.197868+0000","last_fullsized":"2024-09-10T23:56:17.197868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199278+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:56:17.199278+0000","last_peered":"2024-09-10T23:56:17.199278+0000","last_clean":"2024-09-10T23:56:17.199278+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:56:17.199278+0000","last_undegraded":"2024-09-10T23:56:17.199278+0000","last_fullsized":"2024-09-10T23:56:17.199278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199460+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:56:17.199460+0000","last_peered":"2024-09-10T23:56:17.199460+0000","last_clean":"2024-09-10T23:56:17.199460+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:56:17.199460+0000","last_undegraded":"2024-09-10T23:56:17.199460+0000","last_fullsized":"2024-09-10T23:56:17.199460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186043+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:56:17.186043+0000","last_peered":"2024-09-10T23:56:17.186043+0000","last_clean":"2024-09-10T23:56:17.186043+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:56:17.186043+0000","last_undegraded":"2024-09-10T23:56:17.186043+0000","last_fullsized":"2024-09-10T23:56:17.186043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184859+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:56:17.184859+0000","last_peered":"2024-09-10T23:56:17.184859+0000","last_clean":"2024-09-10T23:56:17.184859+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:56:17.184859+0000","last_undegraded":"2024-09-10T23:56:17.184859+0000","last_fullsized":"2024-09-10T23:56:17.184859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182408+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:56:17.182408+0000","last_peered":"2024-09-10T23:56:17.182408+0000","last_clean":"2024-09-10T23:56:17.182408+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:56:17.182408+0000","last_undegraded":"2024-09-10T23:56:17.182408+0000","last_fullsized":"2024-09-10T23:56:17.182408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177823+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:56:17.177823+0000","last_peered":"2024-09-10T23:56:17.177823+0000","last_clean":"2024-09-10T23:56:17.177823+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:56:17.177823+0000","last_undegraded":"2024-09-10T23:56:17.177823+0000","last_fullsized":"2024-09-10T23:56:17.177823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200710+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:56:17.200710+0000","last_peered":"2024-09-10T23:56:17.200710+0000","last_clean":"2024-09-10T23:56:17.200710+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:56:17.200710+0000","last_undegraded":"2024-09-10T23:56:17.200710+0000","last_fullsized":"2024-09-10T23:56:17.200710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186703+0000","last_change":"2024-09-10T23:55:48.434274+0000","last_active":"2024-09-10T23:56:17.186703+0000","last_peered":"2024-09-10T23:56:17.186703+0000","last_clean":"2024-09-10T23:56:17.186703+0000","last_became_active":"2024-09-10T23:55:48.433970+0000","last_became_peered":"2024-09-10T23:55:48.433970+0000","last_unstale":"2024-09-10T23:56:17.186703+0000","last_undegraded":"2024-09-10T23:56:17.186703+0000","last_fullsized":"2024-09-10T23:56:17.186703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.612639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198991+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:56:17.198991+0000","last_peered":"2024-09-10T23:56:17.198991+0000","last_clean":"2024-09-10T23:56:17.198991+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:56:17.198991+0000","last_undegraded":"2024-09-10T23:56:17.198991+0000","last_fullsized":"2024-09-10T23:56:17.198991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184374+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:56:17.184374+0000","last_peered":"2024-09-10T23:56:17.184374+0000","last_clean":"2024-09-10T23:56:17.184374+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:56:17.184374+0000","last_undegraded":"2024-09-10T23:56:17.184374+0000","last_fullsized":"2024-09-10T23:56:17.184374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187467+0000","last_change":"2024-09-10T23:55:48.229813+0000","last_active":"2024-09-10T23:56:17.187467+0000","last_peered":"2024-09-10T23:56:17.187467+0000","last_clean":"2024-09-10T23:56:17.187467+0000","last_became_active":"2024-09-10T23:55:48.229420+0000","last_became_peered":"2024-09-10T23:55:48.229420+0000","last_unstale":"2024-09-10T23:56:17.187467+0000","last_undegraded":"2024-09-10T23:56:17.187467+0000","last_fullsized":"2024-09-10T23:56:17.187467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:47.584330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179404+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:56:17.179404+0000","last_peered":"2024-09-10T23:56:17.179404+0000","last_clean":"2024-09-10T23:56:17.179404+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:56:17.179404+0000","last_undegraded":"2024-09-10T23:56:17.179404+0000","last_fullsized":"2024-09-10T23:56:17.179404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181792+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:56:17.181792+0000","last_peered":"2024-09-10T23:56:17.181792+0000","last_clean":"2024-09-10T23:56:17.181792+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:56:17.181792+0000","last_undegraded":"2024-09-10T23:56:17.181792+0000","last_fullsized":"2024-09-10T23:56:17.181792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177183+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:56:17.177183+0000","last_peered":"2024-09-10T23:56:17.177183+0000","last_clean":"2024-09-10T23:56:17.177183+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:56:17.177183+0000","last_undegraded":"2024-09-10T23:56:17.177183+0000","last_fullsized":"2024-09-10T23:56:17.177183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198925+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:56:17.198925+0000","last_peered":"2024-09-10T23:56:17.198925+0000","last_clean":"2024-09-10T23:56:17.198925+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:56:17.198925+0000","last_undegraded":"2024-09-10T23:56:17.198925+0000","last_fullsized":"2024-09-10T23:56:17.198925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182890+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:56:17.182890+0000","last_peered":"2024-09-10T23:56:17.182890+0000","last_clean":"2024-09-10T23:56:17.182890+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:56:17.182890+0000","last_undegraded":"2024-09-10T23:56:17.182890+0000","last_fullsized":"2024-09-10T23:56:17.182890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199096+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:56:17.199096+0000","last_peered":"2024-09-10T23:56:17.199096+0000","last_clean":"2024-09-10T23:56:17.199096+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:56:17.199096+0000","last_undegraded":"2024-09-10T23:56:17.199096+0000","last_fullsized":"2024-09-10T23:56:17.199096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70972,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":752,"num_read_kb":447,"num_write":191,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":212916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710771,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":497970,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":1151569,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070526,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":502280,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266757,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":498082,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462987,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1094686,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626512,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":493360,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822744,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1090219,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986270,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":565994,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182500,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493554,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493998,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":558614,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738486,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":494748,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:56:51.591 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T23:56:51.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T23:56:51.975 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 -- 172.21.15.33:0/2558791721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 msgr2=0x7f3084108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 --2- 172.21.15.33:0/2558791721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f3084108c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3070009900 tx=0x7f307002a410 comp rx=0 tx=0).stop 2024-09-10T23:56:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 -- 172.21.15.33:0/2558791721 shutdown_connections 2024-09-10T23:56:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 --2- 172.21.15.33:0/2558791721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084109150 0x7f308410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 --2- 172.21.15.33:0/2558791721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f3084108c10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 --2- 172.21.15.33:0/2558791721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084102dc0 0x7f30841031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 -- 172.21.15.33:0/2558791721 >> 172.21.15.33:0/2558791721 conn(0x7f30840fe830 msgr2=0x7f3084100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 -- 172.21.15.33:0/2558791721 shutdown_connections 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.615+0000 7f308c200640 1 -- 172.21.15.33:0/2558791721 wait complete. 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 Processor -- start 2024-09-10T23:56:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 -- start start 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 0x7f308419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084109150 0x7f30841a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3084112d10 con 0x7f30841087d0 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3084112b90 con 0x7f3084102dc0 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.616+0000 7f308c200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3084112e90 con 0x7f3084109150 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3088e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3088e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55346/0 (socket says 172.21.15.33:55346) 2024-09-10T23:56:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3088e00640 1 -- 172.21.15.33:0/424587722 learned_addr learned my addr 172.21.15.33:0/424587722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 0x7f308419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f308a200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084109150 0x7f30841a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 -- 172.21.15.33:0/424587722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084109150 msgr2=0x7f30841a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084109150 0x7f30841a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 -- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 msgr2=0x7f308419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3089800640 1 -- 172.21.15.33:0/424587722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30841a1450 con 0x7f3084102dc0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.617+0000 7f3088e00640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f3089800640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 0x7f308419b3a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f307800d6d0 tx=0x7f307800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078017070 con 0x7f3084102dc0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3078009820 con 0x7f3084102dc0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30841a1740 con 0x7f3084102dc0 2024-09-10T23:56:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078004bc0 con 0x7f3084102dc0 2024-09-10T23:56:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.618+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30841a7e00 con 0x7f3084102dc0 2024-09-10T23:56:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.619+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30841031a0 con 0x7f3084102dc0 2024-09-10T23:56:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.622+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f3078005220 con 0x7f3084102dc0 2024-09-10T23:56:52.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.623+0000 7f3082000640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 0x7f306c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:52.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.623+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f30780e5fb0 con 0x7f3084102dc0 2024-09-10T23:56:52.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.623+0000 7f3088e00640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 0x7f306c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.624+0000 7f3088e00640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 0x7f306c0b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30700096c0 tx=0x7f3070005e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.625+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3078005540 con 0x7f3084102dc0 2024-09-10T23:56:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:52 smithi052 ceph-mon[33526]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:52 smithi052 ceph-mon[33526]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T23:56:52.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:52 smithi033 ceph-mon[30593]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:52.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:52 smithi033 ceph-mon[30593]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T23:56:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.823+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 --> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3084063590 con 0x7f306c0b5370 2024-09-10T23:56:52.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.829+0000 7f3082000640 1 -- 172.21.15.33:0/424587722 <== mgr.14150 v2:172.21.15.33:6800/604054582 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340747 (secure 0 0 0) 0x7f3084063590 con 0x7f306c0b5370 2024-09-10T23:56:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:52 smithi189 ceph-mon[34000]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:52 smithi189 ceph-mon[34000]: pgmap v439: 129 pgs: 129 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T23:56:52.836 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:52.837 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-09-10T23:56:52.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 msgr2=0x7f306c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 0x7f306c0b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30700096c0 tx=0x7f3070005e60 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 msgr2=0x7f308419b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 0x7f308419b3a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f307800d6d0 tx=0x7f307800db90 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 shutdown_connections 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.833+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f306c0b5370 0x7f306c0b7830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3084109150 0x7f30841a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30841087d0 0x7f308419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 --2- 172.21.15.33:0/424587722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3084102dc0 0x7f308419b3a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 >> 172.21.15.33:0/424587722 conn(0x7f30840fe830 msgr2=0x7f3084104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 shutdown_connections 2024-09-10T23:56:52.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:52.834+0000 7f308c200640 1 -- 172.21.15.33:0/424587722 wait complete. 2024-09-10T23:56:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-09-10T23:56:50.827814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661574,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":833,"num_read_kb":516,"num_write":320,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2956326,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360932,"kb_used_data":11684,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580892,"statfs":{"total":1151940427776,"available":1151570833408,"internally_reserved":0,"allocated":11964416,"data_stored":7936419,"data_compressed":463005,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1431,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":14,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003513"},"pg_stats":[{"pgid":"2.1f","version":"83'9","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195931+0000","last_change":"2024-09-10T23:53:53.715746+0000","last_active":"2024-09-10T23:55:48.195931+0000","last_peered":"2024-09-10T23:55:48.195931+0000","last_clean":"2024-09-10T23:55:48.195931+0000","last_became_active":"2024-09-10T23:53:53.715422+0000","last_became_peered":"2024-09-10T23:53:53.715422+0000","last_unstale":"2024-09-10T23:55:48.195931+0000","last_undegraded":"2024-09-10T23:55:48.195931+0000","last_fullsized":"2024-09-10T23:55:48.195931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:44.417257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181257+0000","last_change":"2024-09-10T23:53:55.749562+0000","last_active":"2024-09-10T23:56:17.181257+0000","last_peered":"2024-09-10T23:56:17.181257+0000","last_clean":"2024-09-10T23:56:17.181257+0000","last_became_active":"2024-09-10T23:53:55.749223+0000","last_became_peered":"2024-09-10T23:53:55.749223+0000","last_unstale":"2024-09-10T23:56:17.181257+0000","last_undegraded":"2024-09-10T23:56:17.181257+0000","last_fullsized":"2024-09-10T23:56:17.181257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:43.738432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431740+0000","last_change":"2024-09-10T23:54:04.805212+0000","last_active":"2024-09-10T23:55:48.431740+0000","last_peered":"2024-09-10T23:55:48.431740+0000","last_clean":"2024-09-10T23:55:48.431740+0000","last_became_active":"2024-09-10T23:54:04.804819+0000","last_became_peered":"2024-09-10T23:54:04.804819+0000","last_unstale":"2024-09-10T23:55:48.431740+0000","last_undegraded":"2024-09-10T23:55:48.431740+0000","last_fullsized":"2024-09-10T23:55:48.431740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.248116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431965+0000","last_change":"2024-09-10T23:53:53.749095+0000","last_active":"2024-09-10T23:55:48.431965+0000","last_peered":"2024-09-10T23:55:48.431965+0000","last_clean":"2024-09-10T23:55:48.431965+0000","last_became_active":"2024-09-10T23:53:53.748733+0000","last_became_peered":"2024-09-10T23:53:53.748733+0000","last_unstale":"2024-09-10T23:55:48.431965+0000","last_undegraded":"2024-09-10T23:55:48.431965+0000","last_fullsized":"2024-09-10T23:55:48.431965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:07.225780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198453+0000","last_change":"2024-09-10T23:53:55.734605+0000","last_active":"2024-09-10T23:56:17.198453+0000","last_peered":"2024-09-10T23:56:17.198453+0000","last_clean":"2024-09-10T23:56:17.198453+0000","last_became_active":"2024-09-10T23:53:55.734291+0000","last_became_peered":"2024-09-10T23:53:55.734291+0000","last_unstale":"2024-09-10T23:56:17.198453+0000","last_undegraded":"2024-09-10T23:56:17.198453+0000","last_fullsized":"2024-09-10T23:56:17.198453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:32.562228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191244+0000","last_change":"2024-09-10T23:54:48.497886+0000","last_active":"2024-09-10T23:55:48.191244+0000","last_peered":"2024-09-10T23:55:48.191244+0000","last_clean":"2024-09-10T23:55:48.191244+0000","last_became_active":"2024-09-10T23:54:48.497401+0000","last_became_peered":"2024-09-10T23:54:48.497401+0000","last_unstale":"2024-09-10T23:55:48.191244+0000","last_undegraded":"2024-09-10T23:55:48.191244+0000","last_fullsized":"2024-09-10T23:55:48.191244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.515058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433246+0000","last_change":"2024-09-10T23:54:47.997526+0000","last_active":"2024-09-10T23:55:48.433246+0000","last_peered":"2024-09-10T23:55:48.433246+0000","last_clean":"2024-09-10T23:55:48.433246+0000","last_became_active":"2024-09-10T23:54:47.982185+0000","last_became_peered":"2024-09-10T23:54:47.982185+0000","last_unstale":"2024-09-10T23:55:48.433246+0000","last_undegraded":"2024-09-10T23:55:48.433246+0000","last_fullsized":"2024-09-10T23:55:48.433246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:13.178063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197336+0000","last_change":"2024-09-10T23:53:55.741370+0000","last_active":"2024-09-10T23:56:17.197336+0000","last_peered":"2024-09-10T23:56:17.197336+0000","last_clean":"2024-09-10T23:56:17.197336+0000","last_became_active":"2024-09-10T23:53:55.736497+0000","last_became_peered":"2024-09-10T23:53:55.736497+0000","last_unstale":"2024-09-10T23:56:17.197336+0000","last_undegraded":"2024-09-10T23:56:17.197336+0000","last_fullsized":"2024-09-10T23:56:17.197336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:37.852964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191675+0000","last_change":"2024-09-10T23:54:04.807536+0000","last_active":"2024-09-10T23:55:48.191675+0000","last_peered":"2024-09-10T23:55:48.191675+0000","last_clean":"2024-09-10T23:55:48.191675+0000","last_became_active":"2024-09-10T23:54:04.807139+0000","last_became_peered":"2024-09-10T23:54:04.807139+0000","last_unstale":"2024-09-10T23:55:48.191675+0000","last_undegraded":"2024-09-10T23:55:48.191675+0000","last_fullsized":"2024-09-10T23:55:48.191675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:20.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192047+0000","last_change":"2024-09-10T23:53:53.714063+0000","last_active":"2024-09-10T23:55:48.192047+0000","last_peered":"2024-09-10T23:55:48.192047+0000","last_clean":"2024-09-10T23:55:48.192047+0000","last_became_active":"2024-09-10T23:53:53.713689+0000","last_became_peered":"2024-09-10T23:53:53.713689+0000","last_unstale":"2024-09-10T23:55:48.192047+0000","last_undegraded":"2024-09-10T23:55:48.192047+0000","last_fullsized":"2024-09-10T23:55:48.192047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:54.543446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197601+0000","last_change":"2024-09-10T23:53:55.749633+0000","last_active":"2024-09-10T23:56:17.197601+0000","last_peered":"2024-09-10T23:56:17.197601+0000","last_clean":"2024-09-10T23:56:17.197601+0000","last_became_active":"2024-09-10T23:53:55.746836+0000","last_became_peered":"2024-09-10T23:53:55.746836+0000","last_unstale":"2024-09-10T23:56:17.197601+0000","last_undegraded":"2024-09-10T23:56:17.197601+0000","last_fullsized":"2024-09-10T23:56:17.197601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:54.203483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191309+0000","last_change":"2024-09-10T23:54:04.804411+0000","last_active":"2024-09-10T23:55:48.191309+0000","last_peered":"2024-09-10T23:55:48.191309+0000","last_clean":"2024-09-10T23:55:48.191309+0000","last_became_active":"2024-09-10T23:54:04.803922+0000","last_became_peered":"2024-09-10T23:54:04.803922+0000","last_unstale":"2024-09-10T23:55:48.191309+0000","last_undegraded":"2024-09-10T23:55:48.191309+0000","last_fullsized":"2024-09-10T23:55:48.191309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:13.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200461+0000","last_change":"2024-09-10T23:53:55.751548+0000","last_active":"2024-09-10T23:56:17.200461+0000","last_peered":"2024-09-10T23:56:17.200461+0000","last_clean":"2024-09-10T23:56:17.200461+0000","last_became_active":"2024-09-10T23:53:55.749170+0000","last_became_peered":"2024-09-10T23:53:55.749170+0000","last_unstale":"2024-09-10T23:56:17.200461+0000","last_undegraded":"2024-09-10T23:56:17.200461+0000","last_fullsized":"2024-09-10T23:56:17.200461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:45.660500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191569+0000","last_change":"2024-09-10T23:53:53.715682+0000","last_active":"2024-09-10T23:55:48.191569+0000","last_peered":"2024-09-10T23:55:48.191569+0000","last_clean":"2024-09-10T23:55:48.191569+0000","last_became_active":"2024-09-10T23:53:53.715215+0000","last_became_peered":"2024-09-10T23:53:53.715215+0000","last_unstale":"2024-09-10T23:55:48.191569+0000","last_undegraded":"2024-09-10T23:55:48.191569+0000","last_fullsized":"2024-09-10T23:55:48.191569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:48.007658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192035+0000","last_change":"2024-09-10T23:54:04.803560+0000","last_active":"2024-09-10T23:55:48.192035+0000","last_peered":"2024-09-10T23:55:48.192035+0000","last_clean":"2024-09-10T23:55:48.192035+0000","last_became_active":"2024-09-10T23:54:04.803130+0000","last_became_peered":"2024-09-10T23:54:04.803130+0000","last_unstale":"2024-09-10T23:55:48.192035+0000","last_undegraded":"2024-09-10T23:55:48.192035+0000","last_fullsized":"2024-09-10T23:55:48.192035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:11.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186205+0000","last_change":"2024-09-10T23:53:55.752306+0000","last_active":"2024-09-10T23:56:17.186205+0000","last_peered":"2024-09-10T23:56:17.186205+0000","last_clean":"2024-09-10T23:56:17.186205+0000","last_became_active":"2024-09-10T23:53:55.751909+0000","last_became_peered":"2024-09-10T23:53:55.751909+0000","last_unstale":"2024-09-10T23:56:17.186205+0000","last_undegraded":"2024-09-10T23:56:17.186205+0000","last_fullsized":"2024-09-10T23:56:17.186205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:31.986552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:07.417309+0000","last_change":"2024-09-10T23:53:53.712828+0000","last_active":"2024-09-10T23:56:07.417309+0000","last_peered":"2024-09-10T23:56:07.417309+0000","last_clean":"2024-09-10T23:56:07.417309+0000","last_became_active":"2024-09-10T23:53:53.712235+0000","last_became_peered":"2024-09-10T23:53:53.712235+0000","last_unstale":"2024-09-10T23:56:07.417309+0000","last_undegraded":"2024-09-10T23:56:07.417309+0000","last_fullsized":"2024-09-10T23:56:07.417309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:14.066007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191815+0000","last_change":"2024-09-10T23:54:04.811960+0000","last_active":"2024-09-10T23:55:48.191815+0000","last_peered":"2024-09-10T23:55:48.191815+0000","last_clean":"2024-09-10T23:55:48.191815+0000","last_became_active":"2024-09-10T23:54:04.811509+0000","last_became_peered":"2024-09-10T23:54:04.811509+0000","last_unstale":"2024-09-10T23:55:48.191815+0000","last_undegraded":"2024-09-10T23:55:48.191815+0000","last_fullsized":"2024-09-10T23:55:48.191815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:36.170672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178537+0000","last_change":"2024-09-10T23:53:55.734251+0000","last_active":"2024-09-10T23:56:17.178537+0000","last_peered":"2024-09-10T23:56:17.178537+0000","last_clean":"2024-09-10T23:56:17.178537+0000","last_became_active":"2024-09-10T23:53:55.732205+0000","last_became_peered":"2024-09-10T23:53:55.732205+0000","last_unstale":"2024-09-10T23:56:17.178537+0000","last_undegraded":"2024-09-10T23:56:17.178537+0000","last_fullsized":"2024-09-10T23:56:17.178537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:30.761709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431602+0000","last_change":"2024-09-10T23:53:53.711982+0000","last_active":"2024-09-10T23:55:48.431602+0000","last_peered":"2024-09-10T23:55:48.431602+0000","last_clean":"2024-09-10T23:55:48.431602+0000","last_became_active":"2024-09-10T23:53:53.711484+0000","last_became_peered":"2024-09-10T23:53:53.711484+0000","last_unstale":"2024-09-10T23:55:48.431602+0000","last_undegraded":"2024-09-10T23:55:48.431602+0000","last_fullsized":"2024-09-10T23:55:48.431602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:38.597258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195751+0000","last_change":"2024-09-10T23:54:04.810427+0000","last_active":"2024-09-10T23:55:48.195751+0000","last_peered":"2024-09-10T23:55:48.195751+0000","last_clean":"2024-09-10T23:55:48.195751+0000","last_became_active":"2024-09-10T23:54:04.809562+0000","last_became_peered":"2024-09-10T23:54:04.809562+0000","last_unstale":"2024-09-10T23:55:48.195751+0000","last_undegraded":"2024-09-10T23:55:48.195751+0000","last_fullsized":"2024-09-10T23:55:48.195751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:03.506905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.133645+0000","last_change":"2024-09-10T23:53:55.737325+0000","last_active":"2024-09-10T23:56:17.133645+0000","last_peered":"2024-09-10T23:56:17.133645+0000","last_clean":"2024-09-10T23:56:17.133645+0000","last_became_active":"2024-09-10T23:53:55.736301+0000","last_became_peered":"2024-09-10T23:53:55.736301+0000","last_unstale":"2024-09-10T23:56:17.133645+0000","last_undegraded":"2024-09-10T23:56:17.133645+0000","last_fullsized":"2024-09-10T23:56:17.133645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:20.198077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389183+0000","last_change":"2024-09-10T23:53:53.749158+0000","last_active":"2024-09-10T23:55:48.389183+0000","last_peered":"2024-09-10T23:55:48.389183+0000","last_clean":"2024-09-10T23:55:48.389183+0000","last_became_active":"2024-09-10T23:53:53.748741+0000","last_became_peered":"2024-09-10T23:53:53.748741+0000","last_unstale":"2024-09-10T23:55:48.389183+0000","last_undegraded":"2024-09-10T23:55:48.389183+0000","last_fullsized":"2024-09-10T23:55:48.389183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:28.026121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191804+0000","last_change":"2024-09-10T23:54:04.811934+0000","last_active":"2024-09-10T23:55:48.191804+0000","last_peered":"2024-09-10T23:55:48.191804+0000","last_clean":"2024-09-10T23:55:48.191804+0000","last_became_active":"2024-09-10T23:54:04.811270+0000","last_became_peered":"2024-09-10T23:54:04.811270+0000","last_unstale":"2024-09-10T23:55:48.191804+0000","last_undegraded":"2024-09-10T23:55:48.191804+0000","last_fullsized":"2024-09-10T23:55:48.191804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:53.159788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186131+0000","last_change":"2024-09-10T23:53:55.739210+0000","last_active":"2024-09-10T23:56:17.186131+0000","last_peered":"2024-09-10T23:56:17.186131+0000","last_clean":"2024-09-10T23:56:17.186131+0000","last_became_active":"2024-09-10T23:53:55.738815+0000","last_became_peered":"2024-09-10T23:53:55.738815+0000","last_unstale":"2024-09-10T23:56:17.186131+0000","last_undegraded":"2024-09-10T23:56:17.186131+0000","last_fullsized":"2024-09-10T23:56:17.186131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:42.086428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192153+0000","last_change":"2024-09-10T23:53:54.179287+0000","last_active":"2024-09-10T23:55:48.192153+0000","last_peered":"2024-09-10T23:55:48.192153+0000","last_clean":"2024-09-10T23:55:48.192153+0000","last_became_active":"2024-09-10T23:53:54.178910+0000","last_became_peered":"2024-09-10T23:53:54.178910+0000","last_unstale":"2024-09-10T23:55:48.192153+0000","last_undegraded":"2024-09-10T23:55:48.192153+0000","last_fullsized":"2024-09-10T23:55:48.192153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:20.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431867+0000","last_change":"2024-09-10T23:54:04.805523+0000","last_active":"2024-09-10T23:55:48.431867+0000","last_peered":"2024-09-10T23:55:48.431867+0000","last_clean":"2024-09-10T23:55:48.431867+0000","last_became_active":"2024-09-10T23:54:04.805139+0000","last_became_peered":"2024-09-10T23:54:04.805139+0000","last_unstale":"2024-09-10T23:55:48.431867+0000","last_undegraded":"2024-09-10T23:55:48.431867+0000","last_fullsized":"2024-09-10T23:55:48.431867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:54.692802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.189859+0000","last_change":"2024-09-10T23:53:55.745402+0000","last_active":"2024-09-10T23:56:17.189859+0000","last_peered":"2024-09-10T23:56:17.189859+0000","last_clean":"2024-09-10T23:56:17.189859+0000","last_became_active":"2024-09-10T23:53:55.744490+0000","last_became_peered":"2024-09-10T23:53:55.744490+0000","last_unstale":"2024-09-10T23:56:17.189859+0000","last_undegraded":"2024-09-10T23:56:17.189859+0000","last_fullsized":"2024-09-10T23:56:17.189859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:56.235228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'15","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.775751+0000","last_change":"2024-09-10T23:53:53.714056+0000","last_active":"2024-09-10T23:56:45.775751+0000","last_peered":"2024-09-10T23:56:45.775751+0000","last_clean":"2024-09-10T23:56:45.775751+0000","last_became_active":"2024-09-10T23:53:53.713595+0000","last_became_peered":"2024-09-10T23:53:53.713595+0000","last_unstale":"2024-09-10T23:56:45.775751+0000","last_undegraded":"2024-09-10T23:56:45.775751+0000","last_fullsized":"2024-09-10T23:56:45.775751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:25.707103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431289+0000","last_change":"2024-09-10T23:54:04.792383+0000","last_active":"2024-09-10T23:55:48.431289+0000","last_peered":"2024-09-10T23:55:48.431289+0000","last_clean":"2024-09-10T23:55:48.431289+0000","last_became_active":"2024-09-10T23:54:04.792031+0000","last_became_peered":"2024-09-10T23:54:04.792031+0000","last_unstale":"2024-09-10T23:55:48.431289+0000","last_undegraded":"2024-09-10T23:55:48.431289+0000","last_fullsized":"2024-09-10T23:55:48.431289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:37.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.164683+0000","last_change":"2024-09-10T23:53:55.743856+0000","last_active":"2024-09-10T23:56:17.164683+0000","last_peered":"2024-09-10T23:56:17.164683+0000","last_clean":"2024-09-10T23:56:17.164683+0000","last_became_active":"2024-09-10T23:53:55.743285+0000","last_became_peered":"2024-09-10T23:53:55.743285+0000","last_unstale":"2024-09-10T23:56:17.164683+0000","last_undegraded":"2024-09-10T23:56:17.164683+0000","last_fullsized":"2024-09-10T23:56:17.164683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:02.541633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'1","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191992+0000","last_change":"2024-09-10T23:53:53.750772+0000","last_active":"2024-09-10T23:55:48.191992+0000","last_peered":"2024-09-10T23:55:48.191992+0000","last_clean":"2024-09-10T23:55:48.191992+0000","last_became_active":"2024-09-10T23:53:53.750191+0000","last_became_peered":"2024-09-10T23:53:53.750191+0000","last_unstale":"2024-09-10T23:55:48.191992+0000","last_undegraded":"2024-09-10T23:55:48.191992+0000","last_fullsized":"2024-09-10T23:55:48.191992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:45.351862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433181+0000","last_change":"2024-09-10T23:54:04.791426+0000","last_active":"2024-09-10T23:55:48.433181+0000","last_peered":"2024-09-10T23:55:48.433181+0000","last_clean":"2024-09-10T23:55:48.433181+0000","last_became_active":"2024-09-10T23:54:04.790997+0000","last_became_peered":"2024-09-10T23:54:04.790997+0000","last_unstale":"2024-09-10T23:55:48.433181+0000","last_undegraded":"2024-09-10T23:55:48.433181+0000","last_fullsized":"2024-09-10T23:55:48.433181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:29.814992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180145+0000","last_change":"2024-09-10T23:53:55.740281+0000","last_active":"2024-09-10T23:56:17.180145+0000","last_peered":"2024-09-10T23:56:17.180145+0000","last_clean":"2024-09-10T23:56:17.180145+0000","last_became_active":"2024-09-10T23:53:55.739945+0000","last_became_peered":"2024-09-10T23:53:55.739945+0000","last_unstale":"2024-09-10T23:56:17.180145+0000","last_undegraded":"2024-09-10T23:56:17.180145+0000","last_fullsized":"2024-09-10T23:56:17.180145+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:40:04.258344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195459+0000","last_change":"2024-09-10T23:53:53.751036+0000","last_active":"2024-09-10T23:55:48.195459+0000","last_peered":"2024-09-10T23:55:48.195459+0000","last_clean":"2024-09-10T23:55:48.195459+0000","last_became_active":"2024-09-10T23:53:53.750239+0000","last_became_peered":"2024-09-10T23:53:53.750239+0000","last_unstale":"2024-09-10T23:55:48.195459+0000","last_undegraded":"2024-09-10T23:55:48.195459+0000","last_fullsized":"2024-09-10T23:55:48.195459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:13.397600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191584+0000","last_change":"2024-09-10T23:54:47.979095+0000","last_active":"2024-09-10T23:55:48.191584+0000","last_peered":"2024-09-10T23:55:48.191584+0000","last_clean":"2024-09-10T23:55:48.191584+0000","last_became_active":"2024-09-10T23:54:47.978691+0000","last_became_peered":"2024-09-10T23:54:47.978691+0000","last_unstale":"2024-09-10T23:55:48.191584+0000","last_undegraded":"2024-09-10T23:55:48.191584+0000","last_fullsized":"2024-09-10T23:55:48.191584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:59.819462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179493+0000","last_change":"2024-09-10T23:53:55.741317+0000","last_active":"2024-09-10T23:56:17.179493+0000","last_peered":"2024-09-10T23:56:17.179493+0000","last_clean":"2024-09-10T23:56:17.179493+0000","last_became_active":"2024-09-10T23:53:55.741011+0000","last_became_peered":"2024-09-10T23:53:55.741011+0000","last_unstale":"2024-09-10T23:56:17.179493+0000","last_undegraded":"2024-09-10T23:56:17.179493+0000","last_fullsized":"2024-09-10T23:56:17.179493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:45.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196793+0000","last_change":"2024-09-10T23:53:53.711075+0000","last_active":"2024-09-10T23:55:48.196793+0000","last_peered":"2024-09-10T23:55:48.196793+0000","last_clean":"2024-09-10T23:55:48.196793+0000","last_became_active":"2024-09-10T23:53:53.710730+0000","last_became_peered":"2024-09-10T23:53:53.710730+0000","last_unstale":"2024-09-10T23:55:48.196793+0000","last_undegraded":"2024-09-10T23:55:48.196793+0000","last_fullsized":"2024-09-10T23:55:48.196793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:16.016930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228467+0000","last_change":"2024-09-10T23:54:04.798549+0000","last_active":"2024-09-10T23:55:48.228467+0000","last_peered":"2024-09-10T23:55:48.228467+0000","last_clean":"2024-09-10T23:55:48.228467+0000","last_became_active":"2024-09-10T23:54:04.796037+0000","last_became_peered":"2024-09-10T23:54:04.796037+0000","last_unstale":"2024-09-10T23:55:48.228467+0000","last_undegraded":"2024-09-10T23:55:48.228467+0000","last_fullsized":"2024-09-10T23:55:48.228467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:08.582683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181268+0000","last_change":"2024-09-10T23:53:55.739979+0000","last_active":"2024-09-10T23:56:17.181268+0000","last_peered":"2024-09-10T23:56:17.181268+0000","last_clean":"2024-09-10T23:56:17.181268+0000","last_became_active":"2024-09-10T23:53:55.739183+0000","last_became_peered":"2024-09-10T23:53:55.739183+0000","last_unstale":"2024-09-10T23:56:17.181268+0000","last_undegraded":"2024-09-10T23:56:17.181268+0000","last_fullsized":"2024-09-10T23:56:17.181268+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:49.583557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:48.216015+0000","last_change":"2024-09-10T23:53:53.749691+0000","last_active":"2024-09-10T23:56:48.216015+0000","last_peered":"2024-09-10T23:56:48.216015+0000","last_clean":"2024-09-10T23:56:48.216015+0000","last_became_active":"2024-09-10T23:53:53.748548+0000","last_became_peered":"2024-09-10T23:53:53.748548+0000","last_unstale":"2024-09-10T23:56:48.216015+0000","last_undegraded":"2024-09-10T23:56:48.216015+0000","last_fullsized":"2024-09-10T23:56:48.216015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:09.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228796+0000","last_change":"2024-09-10T23:54:04.811753+0000","last_active":"2024-09-10T23:55:48.228796+0000","last_peered":"2024-09-10T23:55:48.228796+0000","last_clean":"2024-09-10T23:55:48.228796+0000","last_became_active":"2024-09-10T23:54:04.807645+0000","last_became_peered":"2024-09-10T23:54:04.807645+0000","last_unstale":"2024-09-10T23:55:48.228796+0000","last_undegraded":"2024-09-10T23:55:48.228796+0000","last_fullsized":"2024-09-10T23:55:48.228796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:28.497606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181103+0000","last_change":"2024-09-10T23:53:55.739595+0000","last_active":"2024-09-10T23:56:17.181103+0000","last_peered":"2024-09-10T23:56:17.181103+0000","last_clean":"2024-09-10T23:56:17.181103+0000","last_became_active":"2024-09-10T23:53:55.739255+0000","last_became_peered":"2024-09-10T23:53:55.739255+0000","last_unstale":"2024-09-10T23:56:17.181103+0000","last_undegraded":"2024-09-10T23:56:17.181103+0000","last_fullsized":"2024-09-10T23:56:17.181103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:05.308379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196354+0000","last_change":"2024-09-10T23:53:53.714653+0000","last_active":"2024-09-10T23:55:48.196354+0000","last_peered":"2024-09-10T23:55:48.196354+0000","last_clean":"2024-09-10T23:55:48.196354+0000","last_became_active":"2024-09-10T23:53:53.713186+0000","last_became_peered":"2024-09-10T23:53:53.713186+0000","last_unstale":"2024-09-10T23:55:48.196354+0000","last_undegraded":"2024-09-10T23:55:48.196354+0000","last_fullsized":"2024-09-10T23:55:48.196354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:26.073001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191644+0000","last_change":"2024-09-10T23:54:47.979504+0000","last_active":"2024-09-10T23:55:48.191644+0000","last_peered":"2024-09-10T23:55:48.191644+0000","last_clean":"2024-09-10T23:55:48.191644+0000","last_became_active":"2024-09-10T23:54:47.978938+0000","last_became_peered":"2024-09-10T23:54:47.978938+0000","last_unstale":"2024-09-10T23:55:48.191644+0000","last_undegraded":"2024-09-10T23:55:48.191644+0000","last_fullsized":"2024-09-10T23:55:48.191644+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:51.433454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.195563+0000","last_change":"2024-09-10T23:55:48.434804+0000","last_active":"2024-09-10T23:56:17.195563+0000","last_peered":"2024-09-10T23:56:17.195563+0000","last_clean":"2024-09-10T23:56:17.195563+0000","last_became_active":"2024-09-10T23:55:48.434451+0000","last_became_peered":"2024-09-10T23:55:48.434451+0000","last_unstale":"2024-09-10T23:56:17.195563+0000","last_undegraded":"2024-09-10T23:56:17.195563+0000","last_fullsized":"2024-09-10T23:56:17.195563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.587382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"83'3","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191947+0000","last_change":"2024-09-10T23:53:53.709907+0000","last_active":"2024-09-10T23:55:48.191947+0000","last_peered":"2024-09-10T23:55:48.191947+0000","last_clean":"2024-09-10T23:55:48.191947+0000","last_became_active":"2024-09-10T23:53:53.709585+0000","last_became_peered":"2024-09-10T23:53:53.709585+0000","last_unstale":"2024-09-10T23:55:48.191947+0000","last_undegraded":"2024-09-10T23:55:48.191947+0000","last_fullsized":"2024-09-10T23:55:48.191947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:18.699236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":117,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.196487+0000","last_change":"2024-09-10T23:52:23.002382+0000","last_active":"2024-09-10T23:55:48.196487+0000","last_peered":"2024-09-10T23:55:48.196487+0000","last_clean":"2024-09-10T23:55:48.196487+0000","last_became_active":"2024-09-10T23:52:22.996032+0000","last_became_peered":"2024-09-10T23:52:22.996032+0000","last_unstale":"2024-09-10T23:55:48.196487+0000","last_undegraded":"2024-09-10T23:55:48.196487+0000","last_fullsized":"2024-09-10T23:55:48.196487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:48:07.891908+0000","last_clean_scrub_stamp":"2024-09-10T23:48:07.891908+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:44.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197191+0000","last_change":"2024-09-10T23:54:04.799567+0000","last_active":"2024-09-10T23:55:48.197191+0000","last_peered":"2024-09-10T23:55:48.197191+0000","last_clean":"2024-09-10T23:55:48.197191+0000","last_became_active":"2024-09-10T23:54:04.798399+0000","last_became_peered":"2024-09-10T23:54:04.798399+0000","last_unstale":"2024-09-10T23:55:48.197191+0000","last_undegraded":"2024-09-10T23:55:48.197191+0000","last_fullsized":"2024-09-10T23:55:48.197191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:41.263278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200462+0000","last_change":"2024-09-10T23:53:55.743925+0000","last_active":"2024-09-10T23:56:17.200462+0000","last_peered":"2024-09-10T23:56:17.200462+0000","last_clean":"2024-09-10T23:56:17.200462+0000","last_became_active":"2024-09-10T23:53:55.739821+0000","last_became_peered":"2024-09-10T23:53:55.739821+0000","last_unstale":"2024-09-10T23:56:17.200462+0000","last_undegraded":"2024-09-10T23:56:17.200462+0000","last_fullsized":"2024-09-10T23:56:17.200462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:11.904469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'3","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432354+0000","last_change":"2024-09-10T23:53:54.179257+0000","last_active":"2024-09-10T23:55:48.432354+0000","last_peered":"2024-09-10T23:55:48.432354+0000","last_clean":"2024-09-10T23:55:48.432354+0000","last_became_active":"2024-09-10T23:53:54.178797+0000","last_became_peered":"2024-09-10T23:53:54.178797+0000","last_unstale":"2024-09-10T23:55:48.432354+0000","last_undegraded":"2024-09-10T23:55:48.432354+0000","last_fullsized":"2024-09-10T23:55:48.432354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.422861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.389219+0000","last_change":"2024-09-10T23:54:04.796380+0000","last_active":"2024-09-10T23:55:48.389219+0000","last_peered":"2024-09-10T23:55:48.389219+0000","last_clean":"2024-09-10T23:55:48.389219+0000","last_became_active":"2024-09-10T23:54:04.795724+0000","last_became_peered":"2024-09-10T23:54:04.795724+0000","last_unstale":"2024-09-10T23:55:48.389219+0000","last_undegraded":"2024-09-10T23:55:48.389219+0000","last_fullsized":"2024-09-10T23:55:48.389219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:01.410213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.185951+0000","last_change":"2024-09-10T23:53:55.737322+0000","last_active":"2024-09-10T23:56:17.185951+0000","last_peered":"2024-09-10T23:56:17.185951+0000","last_clean":"2024-09-10T23:56:17.185951+0000","last_became_active":"2024-09-10T23:53:55.736893+0000","last_became_peered":"2024-09-10T23:53:55.736893+0000","last_unstale":"2024-09-10T23:56:17.185951+0000","last_undegraded":"2024-09-10T23:56:17.185951+0000","last_fullsized":"2024-09-10T23:56:17.185951+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:48.979740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432850+0000","last_change":"2024-09-10T23:53:53.712431+0000","last_active":"2024-09-10T23:55:48.432850+0000","last_peered":"2024-09-10T23:55:48.432850+0000","last_clean":"2024-09-10T23:55:48.432850+0000","last_became_active":"2024-09-10T23:53:53.712052+0000","last_became_peered":"2024-09-10T23:53:53.712052+0000","last_unstale":"2024-09-10T23:55:48.432850+0000","last_undegraded":"2024-09-10T23:55:48.432850+0000","last_fullsized":"2024-09-10T23:55:48.432850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:14.767633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.192871+0000","last_change":"2024-09-10T23:54:04.804797+0000","last_active":"2024-09-10T23:55:48.192871+0000","last_peered":"2024-09-10T23:55:48.192871+0000","last_clean":"2024-09-10T23:55:48.192871+0000","last_became_active":"2024-09-10T23:54:04.803939+0000","last_became_peered":"2024-09-10T23:54:04.803939+0000","last_unstale":"2024-09-10T23:55:48.192871+0000","last_undegraded":"2024-09-10T23:55:48.192871+0000","last_fullsized":"2024-09-10T23:55:48.192871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:41:32.069900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.190127+0000","last_change":"2024-09-10T23:53:55.744547+0000","last_active":"2024-09-10T23:56:17.190127+0000","last_peered":"2024-09-10T23:56:17.190127+0000","last_clean":"2024-09-10T23:56:17.190127+0000","last_became_active":"2024-09-10T23:53:55.744212+0000","last_became_peered":"2024-09-10T23:53:55.744212+0000","last_unstale":"2024-09-10T23:56:17.190127+0000","last_undegraded":"2024-09-10T23:56:17.190127+0000","last_fullsized":"2024-09-10T23:56:17.190127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:28.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228827+0000","last_change":"2024-09-10T23:53:53.710413+0000","last_active":"2024-09-10T23:55:48.228827+0000","last_peered":"2024-09-10T23:55:48.228827+0000","last_clean":"2024-09-10T23:55:48.228827+0000","last_became_active":"2024-09-10T23:53:53.710050+0000","last_became_peered":"2024-09-10T23:53:53.710050+0000","last_unstale":"2024-09-10T23:55:48.228827+0000","last_undegraded":"2024-09-10T23:55:48.228827+0000","last_fullsized":"2024-09-10T23:55:48.228827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:10.427996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431768+0000","last_change":"2024-09-10T23:54:04.800635+0000","last_active":"2024-09-10T23:55:48.431768+0000","last_peered":"2024-09-10T23:55:48.431768+0000","last_clean":"2024-09-10T23:55:48.431768+0000","last_became_active":"2024-09-10T23:54:04.799250+0000","last_became_peered":"2024-09-10T23:54:04.799250+0000","last_unstale":"2024-09-10T23:55:48.431768+0000","last_undegraded":"2024-09-10T23:55:48.431768+0000","last_fullsized":"2024-09-10T23:55:48.431768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:53.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182166+0000","last_change":"2024-09-10T23:53:55.741901+0000","last_active":"2024-09-10T23:56:17.182166+0000","last_peered":"2024-09-10T23:56:17.182166+0000","last_clean":"2024-09-10T23:56:17.182166+0000","last_became_active":"2024-09-10T23:53:55.741513+0000","last_became_peered":"2024-09-10T23:53:55.741513+0000","last_unstale":"2024-09-10T23:56:17.182166+0000","last_undegraded":"2024-09-10T23:56:17.182166+0000","last_fullsized":"2024-09-10T23:56:17.182166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:04.226784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.434011+0000","last_change":"2024-09-10T23:54:47.991496+0000","last_active":"2024-09-10T23:55:48.434011+0000","last_peered":"2024-09-10T23:55:48.434011+0000","last_clean":"2024-09-10T23:55:48.434011+0000","last_became_active":"2024-09-10T23:54:47.979640+0000","last_became_peered":"2024-09-10T23:54:47.979640+0000","last_unstale":"2024-09-10T23:55:48.434011+0000","last_undegraded":"2024-09-10T23:55:48.434011+0000","last_fullsized":"2024-09-10T23:55:48.434011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:11.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432671+0000","last_change":"2024-09-10T23:54:04.806385+0000","last_active":"2024-09-10T23:55:48.432671+0000","last_peered":"2024-09-10T23:55:48.432671+0000","last_clean":"2024-09-10T23:55:48.432671+0000","last_became_active":"2024-09-10T23:54:04.805178+0000","last_became_peered":"2024-09-10T23:54:04.805178+0000","last_unstale":"2024-09-10T23:55:48.432671+0000","last_undegraded":"2024-09-10T23:55:48.432671+0000","last_fullsized":"2024-09-10T23:55:48.432671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:23:13.936616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196864+0000","last_change":"2024-09-10T23:53:55.742370+0000","last_active":"2024-09-10T23:56:17.196864+0000","last_peered":"2024-09-10T23:56:17.196864+0000","last_clean":"2024-09-10T23:56:17.196864+0000","last_became_active":"2024-09-10T23:53:55.742057+0000","last_became_peered":"2024-09-10T23:53:55.742057+0000","last_unstale":"2024-09-10T23:56:17.196864+0000","last_undegraded":"2024-09-10T23:56:17.196864+0000","last_fullsized":"2024-09-10T23:56:17.196864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:11.966267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'15","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191512+0000","last_change":"2024-09-10T23:53:53.749288+0000","last_active":"2024-09-10T23:55:48.191512+0000","last_peered":"2024-09-10T23:55:48.191512+0000","last_clean":"2024-09-10T23:55:48.191512+0000","last_became_active":"2024-09-10T23:53:53.748710+0000","last_became_peered":"2024-09-10T23:53:53.748710+0000","last_unstale":"2024-09-10T23:55:48.191512+0000","last_undegraded":"2024-09-10T23:55:48.191512+0000","last_fullsized":"2024-09-10T23:55:48.191512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:15.333949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228828+0000","last_change":"2024-09-10T23:54:04.803839+0000","last_active":"2024-09-10T23:55:48.228828+0000","last_peered":"2024-09-10T23:55:48.228828+0000","last_clean":"2024-09-10T23:55:48.228828+0000","last_became_active":"2024-09-10T23:54:04.800321+0000","last_became_peered":"2024-09-10T23:54:04.800321+0000","last_unstale":"2024-09-10T23:55:48.228828+0000","last_undegraded":"2024-09-10T23:55:48.228828+0000","last_fullsized":"2024-09-10T23:55:48.228828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:59.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186834+0000","last_change":"2024-09-10T23:53:55.738871+0000","last_active":"2024-09-10T23:56:17.186834+0000","last_peered":"2024-09-10T23:56:17.186834+0000","last_clean":"2024-09-10T23:56:17.186834+0000","last_became_active":"2024-09-10T23:53:55.738288+0000","last_became_peered":"2024-09-10T23:53:55.738288+0000","last_unstale":"2024-09-10T23:56:17.186834+0000","last_undegraded":"2024-09-10T23:56:17.186834+0000","last_fullsized":"2024-09-10T23:56:17.186834+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:09.479175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.210338+0000","last_change":"2024-09-10T23:53:53.714709+0000","last_active":"2024-09-10T23:56:45.210338+0000","last_peered":"2024-09-10T23:56:45.210338+0000","last_clean":"2024-09-10T23:56:45.210338+0000","last_became_active":"2024-09-10T23:53:53.713597+0000","last_became_peered":"2024-09-10T23:53:53.713597+0000","last_unstale":"2024-09-10T23:56:45.210338+0000","last_undegraded":"2024-09-10T23:56:45.210338+0000","last_fullsized":"2024-09-10T23:56:45.210338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:19.768901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195796+0000","last_change":"2024-09-10T23:54:04.807817+0000","last_active":"2024-09-10T23:55:48.195796+0000","last_peered":"2024-09-10T23:55:48.195796+0000","last_clean":"2024-09-10T23:55:48.195796+0000","last_became_active":"2024-09-10T23:54:04.807334+0000","last_became_peered":"2024-09-10T23:54:04.807334+0000","last_unstale":"2024-09-10T23:55:48.195796+0000","last_undegraded":"2024-09-10T23:55:48.195796+0000","last_fullsized":"2024-09-10T23:55:48.195796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.196400+0000","last_change":"2024-09-10T23:53:55.741844+0000","last_active":"2024-09-10T23:56:17.196400+0000","last_peered":"2024-09-10T23:56:17.196400+0000","last_clean":"2024-09-10T23:56:17.196400+0000","last_became_active":"2024-09-10T23:53:55.741401+0000","last_became_peered":"2024-09-10T23:53:55.741401+0000","last_unstale":"2024-09-10T23:56:17.196400+0000","last_undegraded":"2024-09-10T23:56:17.196400+0000","last_fullsized":"2024-09-10T23:56:17.196400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:57.684471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431838+0000","last_change":"2024-09-10T23:53:53.713356+0000","last_active":"2024-09-10T23:55:48.431838+0000","last_peered":"2024-09-10T23:55:48.431838+0000","last_clean":"2024-09-10T23:55:48.431838+0000","last_became_active":"2024-09-10T23:53:53.713022+0000","last_became_peered":"2024-09-10T23:53:53.713022+0000","last_unstale":"2024-09-10T23:55:48.431838+0000","last_undegraded":"2024-09-10T23:55:48.431838+0000","last_fullsized":"2024-09-10T23:55:48.431838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:15.773129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433410+0000","last_change":"2024-09-10T23:54:04.795767+0000","last_active":"2024-09-10T23:55:48.433410+0000","last_peered":"2024-09-10T23:55:48.433410+0000","last_clean":"2024-09-10T23:55:48.433410+0000","last_became_active":"2024-09-10T23:54:04.795278+0000","last_became_peered":"2024-09-10T23:54:04.795278+0000","last_unstale":"2024-09-10T23:55:48.433410+0000","last_undegraded":"2024-09-10T23:55:48.433410+0000","last_fullsized":"2024-09-10T23:55:48.433410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:11.050927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187705+0000","last_change":"2024-09-10T23:53:55.736261+0000","last_active":"2024-09-10T23:56:17.187705+0000","last_peered":"2024-09-10T23:56:17.187705+0000","last_clean":"2024-09-10T23:56:17.187705+0000","last_became_active":"2024-09-10T23:53:55.735932+0000","last_became_peered":"2024-09-10T23:53:55.735932+0000","last_unstale":"2024-09-10T23:56:17.187705+0000","last_undegraded":"2024-09-10T23:56:17.187705+0000","last_fullsized":"2024-09-10T23:56:17.187705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:14.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432470+0000","last_change":"2024-09-10T23:53:53.711966+0000","last_active":"2024-09-10T23:55:48.432470+0000","last_peered":"2024-09-10T23:55:48.432470+0000","last_clean":"2024-09-10T23:55:48.432470+0000","last_became_active":"2024-09-10T23:53:53.711610+0000","last_became_peered":"2024-09-10T23:53:53.711610+0000","last_unstale":"2024-09-10T23:55:48.432470+0000","last_undegraded":"2024-09-10T23:55:48.432470+0000","last_fullsized":"2024-09-10T23:55:48.432470+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:03.961208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432660+0000","last_change":"2024-09-10T23:54:04.802147+0000","last_active":"2024-09-10T23:55:48.432660+0000","last_peered":"2024-09-10T23:55:48.432660+0000","last_clean":"2024-09-10T23:55:48.432660+0000","last_became_active":"2024-09-10T23:54:04.801040+0000","last_became_peered":"2024-09-10T23:54:04.801040+0000","last_unstale":"2024-09-10T23:55:48.432660+0000","last_undegraded":"2024-09-10T23:55:48.432660+0000","last_fullsized":"2024-09-10T23:55:48.432660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:13.688798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188737+0000","last_change":"2024-09-10T23:53:55.743890+0000","last_active":"2024-09-10T23:56:17.188737+0000","last_peered":"2024-09-10T23:56:17.188737+0000","last_clean":"2024-09-10T23:56:17.188737+0000","last_became_active":"2024-09-10T23:53:55.743442+0000","last_became_peered":"2024-09-10T23:53:55.743442+0000","last_unstale":"2024-09-10T23:56:17.188737+0000","last_undegraded":"2024-09-10T23:56:17.188737+0000","last_fullsized":"2024-09-10T23:56:17.188737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:05.199427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'40","reported_seq":355,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:46.194526+0000","last_change":"2024-09-10T23:54:47.987451+0000","last_active":"2024-09-10T23:56:46.194526+0000","last_peered":"2024-09-10T23:56:46.194526+0000","last_clean":"2024-09-10T23:56:46.194526+0000","last_became_active":"2024-09-10T23:54:47.976082+0000","last_became_peered":"2024-09-10T23:54:47.976082+0000","last_unstale":"2024-09-10T23:56:46.194526+0000","last_undegraded":"2024-09-10T23:56:46.194526+0000","last_fullsized":"2024-09-10T23:56:46.194526+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:34:20.500346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65344,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":185,"num_write":41,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":3842,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195412+0000","last_change":"2024-09-10T23:54:04.809712+0000","last_active":"2024-09-10T23:55:48.195412+0000","last_peered":"2024-09-10T23:55:48.195412+0000","last_clean":"2024-09-10T23:55:48.195412+0000","last_became_active":"2024-09-10T23:54:04.809335+0000","last_became_peered":"2024-09-10T23:54:04.809335+0000","last_unstale":"2024-09-10T23:55:48.195412+0000","last_undegraded":"2024-09-10T23:55:48.195412+0000","last_fullsized":"2024-09-10T23:55:48.195412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:15.544194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198485+0000","last_change":"2024-09-10T23:53:55.749016+0000","last_active":"2024-09-10T23:56:17.198485+0000","last_peered":"2024-09-10T23:56:17.198485+0000","last_clean":"2024-09-10T23:56:17.198485+0000","last_became_active":"2024-09-10T23:53:55.745889+0000","last_became_peered":"2024-09-10T23:53:55.745889+0000","last_unstale":"2024-09-10T23:56:17.198485+0000","last_undegraded":"2024-09-10T23:56:17.198485+0000","last_fullsized":"2024-09-10T23:56:17.198485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:06.605162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432787+0000","last_change":"2024-09-10T23:53:53.749347+0000","last_active":"2024-09-10T23:55:48.432787+0000","last_peered":"2024-09-10T23:55:48.432787+0000","last_clean":"2024-09-10T23:55:48.432787+0000","last_became_active":"2024-09-10T23:53:53.748777+0000","last_became_peered":"2024-09-10T23:53:53.748777+0000","last_unstale":"2024-09-10T23:55:48.432787+0000","last_undegraded":"2024-09-10T23:55:48.432787+0000","last_fullsized":"2024-09-10T23:55:48.432787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:53.154356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.191530+0000","last_change":"2024-09-10T23:54:04.807616+0000","last_active":"2024-09-10T23:55:48.191530+0000","last_peered":"2024-09-10T23:55:48.191530+0000","last_clean":"2024-09-10T23:55:48.191530+0000","last_became_active":"2024-09-10T23:54:04.807214+0000","last_became_peered":"2024-09-10T23:54:04.807214+0000","last_unstale":"2024-09-10T23:55:48.191530+0000","last_undegraded":"2024-09-10T23:55:48.191530+0000","last_fullsized":"2024-09-10T23:55:48.191530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:29.235133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184789+0000","last_change":"2024-09-10T23:53:55.741359+0000","last_active":"2024-09-10T23:56:17.184789+0000","last_peered":"2024-09-10T23:56:17.184789+0000","last_clean":"2024-09-10T23:56:17.184789+0000","last_became_active":"2024-09-10T23:53:55.741040+0000","last_became_peered":"2024-09-10T23:53:55.741040+0000","last_unstale":"2024-09-10T23:56:17.184789+0000","last_undegraded":"2024-09-10T23:56:17.184789+0000","last_fullsized":"2024-09-10T23:56:17.184789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:17.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.197287+0000","last_change":"2024-09-10T23:53:53.715079+0000","last_active":"2024-09-10T23:55:48.197287+0000","last_peered":"2024-09-10T23:55:48.197287+0000","last_clean":"2024-09-10T23:55:48.197287+0000","last_became_active":"2024-09-10T23:53:53.714214+0000","last_became_peered":"2024-09-10T23:53:53.714214+0000","last_unstale":"2024-09-10T23:55:48.197287+0000","last_undegraded":"2024-09-10T23:55:48.197287+0000","last_fullsized":"2024-09-10T23:55:48.197287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:54.829825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.195034+0000","last_change":"2024-09-10T23:54:04.806902+0000","last_active":"2024-09-10T23:55:48.195034+0000","last_peered":"2024-09-10T23:55:48.195034+0000","last_clean":"2024-09-10T23:55:48.195034+0000","last_became_active":"2024-09-10T23:54:04.805676+0000","last_became_peered":"2024-09-10T23:54:04.805676+0000","last_unstale":"2024-09-10T23:55:48.195034+0000","last_undegraded":"2024-09-10T23:55:48.195034+0000","last_fullsized":"2024-09-10T23:55:48.195034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:10.454149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197509+0000","last_change":"2024-09-10T23:53:55.750230+0000","last_active":"2024-09-10T23:56:17.197509+0000","last_peered":"2024-09-10T23:56:17.197509+0000","last_clean":"2024-09-10T23:56:17.197509+0000","last_became_active":"2024-09-10T23:53:55.749830+0000","last_became_peered":"2024-09-10T23:53:55.749830+0000","last_unstale":"2024-09-10T23:56:17.197509+0000","last_undegraded":"2024-09-10T23:56:17.197509+0000","last_fullsized":"2024-09-10T23:56:17.197509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:56.394035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.192388+0000","last_change":"2024-09-10T23:53:53.716271+0000","last_active":"2024-09-10T23:56:45.192388+0000","last_peered":"2024-09-10T23:56:45.192388+0000","last_clean":"2024-09-10T23:56:45.192388+0000","last_became_active":"2024-09-10T23:53:53.715938+0000","last_became_peered":"2024-09-10T23:53:53.715938+0000","last_unstale":"2024-09-10T23:56:45.192388+0000","last_undegraded":"2024-09-10T23:56:45.192388+0000","last_fullsized":"2024-09-10T23:56:45.192388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.472436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.431433+0000","last_change":"2024-09-10T23:54:04.806939+0000","last_active":"2024-09-10T23:55:48.431433+0000","last_peered":"2024-09-10T23:55:48.431433+0000","last_clean":"2024-09-10T23:55:48.431433+0000","last_became_active":"2024-09-10T23:54:04.806286+0000","last_became_peered":"2024-09-10T23:54:04.806286+0000","last_unstale":"2024-09-10T23:55:48.431433+0000","last_undegraded":"2024-09-10T23:55:48.431433+0000","last_fullsized":"2024-09-10T23:55:48.431433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:56.346239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.193081+0000","last_change":"2024-09-10T23:54:04.795432+0000","last_active":"2024-09-10T23:55:48.193081+0000","last_peered":"2024-09-10T23:55:48.193081+0000","last_clean":"2024-09-10T23:55:48.193081+0000","last_became_active":"2024-09-10T23:54:04.795040+0000","last_became_peered":"2024-09-10T23:54:04.795040+0000","last_unstale":"2024-09-10T23:55:48.193081+0000","last_undegraded":"2024-09-10T23:55:48.193081+0000","last_fullsized":"2024-09-10T23:55:48.193081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:13.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180978+0000","last_change":"2024-09-10T23:53:55.737155+0000","last_active":"2024-09-10T23:56:17.180978+0000","last_peered":"2024-09-10T23:56:17.180978+0000","last_clean":"2024-09-10T23:56:17.180978+0000","last_became_active":"2024-09-10T23:53:55.736460+0000","last_became_peered":"2024-09-10T23:53:55.736460+0000","last_unstale":"2024-09-10T23:56:17.180978+0000","last_undegraded":"2024-09-10T23:56:17.180978+0000","last_fullsized":"2024-09-10T23:56:17.180978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:32.024671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432271+0000","last_change":"2024-09-10T23:53:53.711304+0000","last_active":"2024-09-10T23:55:48.432271+0000","last_peered":"2024-09-10T23:55:48.432271+0000","last_clean":"2024-09-10T23:55:48.432271+0000","last_became_active":"2024-09-10T23:53:53.710914+0000","last_became_peered":"2024-09-10T23:53:53.710914+0000","last_unstale":"2024-09-10T23:55:48.432271+0000","last_undegraded":"2024-09-10T23:55:48.432271+0000","last_fullsized":"2024-09-10T23:55:48.432271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:06.285966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433888+0000","last_change":"2024-09-10T23:54:04.804468+0000","last_active":"2024-09-10T23:55:48.433888+0000","last_peered":"2024-09-10T23:55:48.433888+0000","last_clean":"2024-09-10T23:55:48.433888+0000","last_became_active":"2024-09-10T23:54:04.802228+0000","last_became_peered":"2024-09-10T23:54:04.802228+0000","last_unstale":"2024-09-10T23:55:48.433888+0000","last_undegraded":"2024-09-10T23:55:48.433888+0000","last_fullsized":"2024-09-10T23:55:48.433888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179336+0000","last_change":"2024-09-10T23:53:55.742712+0000","last_active":"2024-09-10T23:56:17.179336+0000","last_peered":"2024-09-10T23:56:17.179336+0000","last_clean":"2024-09-10T23:56:17.179336+0000","last_became_active":"2024-09-10T23:53:55.742305+0000","last_became_peered":"2024-09-10T23:53:55.742305+0000","last_unstale":"2024-09-10T23:56:17.179336+0000","last_undegraded":"2024-09-10T23:56:17.179336+0000","last_fullsized":"2024-09-10T23:56:17.179336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:50.763934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.228461+0000","last_change":"2024-09-10T23:53:53.708076+0000","last_active":"2024-09-10T23:55:48.228461+0000","last_peered":"2024-09-10T23:55:48.228461+0000","last_clean":"2024-09-10T23:55:48.228461+0000","last_became_active":"2024-09-10T23:53:53.707614+0000","last_became_peered":"2024-09-10T23:53:53.707614+0000","last_unstale":"2024-09-10T23:55:48.228461+0000","last_undegraded":"2024-09-10T23:55:48.228461+0000","last_fullsized":"2024-09-10T23:55:48.228461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:56.838705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.194225+0000","last_change":"2024-09-10T23:53:53.719167+0000","last_active":"2024-09-10T23:55:48.194225+0000","last_peered":"2024-09-10T23:55:48.194225+0000","last_clean":"2024-09-10T23:55:48.194225+0000","last_became_active":"2024-09-10T23:53:53.718616+0000","last_became_peered":"2024-09-10T23:53:53.718616+0000","last_unstale":"2024-09-10T23:55:48.194225+0000","last_undegraded":"2024-09-10T23:55:48.194225+0000","last_fullsized":"2024-09-10T23:55:48.194225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:45.347970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184504+0000","last_change":"2024-09-10T23:53:55.741989+0000","last_active":"2024-09-10T23:56:17.184504+0000","last_peered":"2024-09-10T23:56:17.184504+0000","last_clean":"2024-09-10T23:56:17.184504+0000","last_became_active":"2024-09-10T23:53:55.741635+0000","last_became_peered":"2024-09-10T23:53:55.741635+0000","last_unstale":"2024-09-10T23:56:17.184504+0000","last_undegraded":"2024-09-10T23:56:17.184504+0000","last_fullsized":"2024-09-10T23:56:17.184504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:24.389838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.432027+0000","last_change":"2024-09-10T23:54:04.808479+0000","last_active":"2024-09-10T23:55:48.432027+0000","last_peered":"2024-09-10T23:55:48.432027+0000","last_clean":"2024-09-10T23:55:48.432027+0000","last_became_active":"2024-09-10T23:54:04.807909+0000","last_became_peered":"2024-09-10T23:54:04.807909+0000","last_unstale":"2024-09-10T23:55:48.432027+0000","last_undegraded":"2024-09-10T23:55:48.432027+0000","last_fullsized":"2024-09-10T23:55:48.432027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:04.526633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'8","reported_seq":188,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:45.193798+0000","last_change":"2024-09-10T23:54:47.994113+0000","last_active":"2024-09-10T23:56:45.193798+0000","last_peered":"2024-09-10T23:56:45.193798+0000","last_clean":"2024-09-10T23:56:45.193798+0000","last_became_active":"2024-09-10T23:54:47.983459+0000","last_became_peered":"2024-09-10T23:54:47.983459+0000","last_unstale":"2024-09-10T23:56:45.193798+0000","last_undegraded":"2024-09-10T23:56:45.193798+0000","last_fullsized":"2024-09-10T23:56:45.193798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:52.680973+0000","last_clean_scrub_stamp":"2024-09-10T23:53:52.680973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:09.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183135+0000","last_change":"2024-09-10T23:53:55.747932+0000","last_active":"2024-09-10T23:56:17.183135+0000","last_peered":"2024-09-10T23:56:17.183135+0000","last_clean":"2024-09-10T23:56:17.183135+0000","last_became_active":"2024-09-10T23:53:55.746889+0000","last_became_peered":"2024-09-10T23:53:55.746889+0000","last_unstale":"2024-09-10T23:56:17.183135+0000","last_undegraded":"2024-09-10T23:56:17.183135+0000","last_fullsized":"2024-09-10T23:56:17.183135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:13:22.302746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:55:48.433033+0000","last_change":"2024-09-10T23:54:04.800439+0000","last_active":"2024-09-10T23:55:48.433033+0000","last_peered":"2024-09-10T23:55:48.433033+0000","last_clean":"2024-09-10T23:55:48.433033+0000","last_became_active":"2024-09-10T23:54:04.798839+0000","last_became_peered":"2024-09-10T23:54:04.798839+0000","last_unstale":"2024-09-10T23:55:48.433033+0000","last_undegraded":"2024-09-10T23:55:48.433033+0000","last_fullsized":"2024-09-10T23:55:48.433033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:54:03.764128+0000","last_clean_scrub_stamp":"2024-09-10T23:54:03.764128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:41.709152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183513+0000","last_change":"2024-09-10T23:53:55.734624+0000","last_active":"2024-09-10T23:56:17.183513+0000","last_peered":"2024-09-10T23:56:17.183513+0000","last_clean":"2024-09-10T23:56:17.183513+0000","last_became_active":"2024-09-10T23:53:55.733864+0000","last_became_peered":"2024-09-10T23:53:55.733864+0000","last_unstale":"2024-09-10T23:56:17.183513+0000","last_undegraded":"2024-09-10T23:56:17.183513+0000","last_fullsized":"2024-09-10T23:56:17.183513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:57.957294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182098+0000","last_change":"2024-09-10T23:53:55.745235+0000","last_active":"2024-09-10T23:56:17.182098+0000","last_peered":"2024-09-10T23:56:17.182098+0000","last_clean":"2024-09-10T23:56:17.182098+0000","last_became_active":"2024-09-10T23:53:55.744770+0000","last_became_peered":"2024-09-10T23:53:55.744770+0000","last_unstale":"2024-09-10T23:56:17.182098+0000","last_undegraded":"2024-09-10T23:56:17.182098+0000","last_fullsized":"2024-09-10T23:56:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:13.984465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.156836+0000","last_change":"2024-09-10T23:53:55.742635+0000","last_active":"2024-09-10T23:56:17.156836+0000","last_peered":"2024-09-10T23:56:17.156836+0000","last_clean":"2024-09-10T23:56:17.156836+0000","last_became_active":"2024-09-10T23:53:55.742201+0000","last_became_peered":"2024-09-10T23:53:55.742201+0000","last_unstale":"2024-09-10T23:56:17.156836+0000","last_undegraded":"2024-09-10T23:56:17.156836+0000","last_fullsized":"2024-09-10T23:56:17.156836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.724806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.183555+0000","last_change":"2024-09-10T23:53:55.742314+0000","last_active":"2024-09-10T23:56:17.183555+0000","last_peered":"2024-09-10T23:56:17.183555+0000","last_clean":"2024-09-10T23:56:17.183555+0000","last_became_active":"2024-09-10T23:53:55.741973+0000","last_became_peered":"2024-09-10T23:53:55.741973+0000","last_unstale":"2024-09-10T23:56:17.183555+0000","last_undegraded":"2024-09-10T23:56:17.183555+0000","last_fullsized":"2024-09-10T23:56:17.183555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:29:11.716412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.180532+0000","last_change":"2024-09-10T23:53:55.738387+0000","last_active":"2024-09-10T23:56:17.180532+0000","last_peered":"2024-09-10T23:56:17.180532+0000","last_clean":"2024-09-10T23:56:17.180532+0000","last_became_active":"2024-09-10T23:53:55.738014+0000","last_became_peered":"2024-09-10T23:53:55.738014+0000","last_unstale":"2024-09-10T23:56:17.180532+0000","last_undegraded":"2024-09-10T23:56:17.180532+0000","last_fullsized":"2024-09-10T23:56:17.180532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:04.691765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182356+0000","last_change":"2024-09-10T23:53:55.745314+0000","last_active":"2024-09-10T23:56:17.182356+0000","last_peered":"2024-09-10T23:56:17.182356+0000","last_clean":"2024-09-10T23:56:17.182356+0000","last_became_active":"2024-09-10T23:53:55.744906+0000","last_became_peered":"2024-09-10T23:53:55.744906+0000","last_unstale":"2024-09-10T23:56:17.182356+0000","last_undegraded":"2024-09-10T23:56:17.182356+0000","last_fullsized":"2024-09-10T23:56:17.182356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:16.853189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197300+0000","last_change":"2024-09-10T23:53:55.751649+0000","last_active":"2024-09-10T23:56:17.197300+0000","last_peered":"2024-09-10T23:56:17.197300+0000","last_clean":"2024-09-10T23:56:17.197300+0000","last_became_active":"2024-09-10T23:53:55.751247+0000","last_became_peered":"2024-09-10T23:53:55.751247+0000","last_unstale":"2024-09-10T23:56:17.197300+0000","last_undegraded":"2024-09-10T23:56:17.197300+0000","last_fullsized":"2024-09-10T23:56:17.197300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:33.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177647+0000","last_change":"2024-09-10T23:53:55.745773+0000","last_active":"2024-09-10T23:56:17.177647+0000","last_peered":"2024-09-10T23:56:17.177647+0000","last_clean":"2024-09-10T23:56:17.177647+0000","last_became_active":"2024-09-10T23:53:55.745016+0000","last_became_peered":"2024-09-10T23:53:55.745016+0000","last_unstale":"2024-09-10T23:56:17.177647+0000","last_undegraded":"2024-09-10T23:56:17.177647+0000","last_fullsized":"2024-09-10T23:56:17.177647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:35.912443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184538+0000","last_change":"2024-09-10T23:53:55.745290+0000","last_active":"2024-09-10T23:56:17.184538+0000","last_peered":"2024-09-10T23:56:17.184538+0000","last_clean":"2024-09-10T23:56:17.184538+0000","last_became_active":"2024-09-10T23:53:55.744968+0000","last_became_peered":"2024-09-10T23:53:55.744968+0000","last_unstale":"2024-09-10T23:56:17.184538+0000","last_undegraded":"2024-09-10T23:56:17.184538+0000","last_fullsized":"2024-09-10T23:56:17.184538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:49.580327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179051+0000","last_change":"2024-09-10T23:53:55.751244+0000","last_active":"2024-09-10T23:56:17.179051+0000","last_peered":"2024-09-10T23:56:17.179051+0000","last_clean":"2024-09-10T23:56:17.179051+0000","last_became_active":"2024-09-10T23:53:55.750390+0000","last_became_peered":"2024-09-10T23:53:55.750390+0000","last_unstale":"2024-09-10T23:56:17.179051+0000","last_undegraded":"2024-09-10T23:56:17.179051+0000","last_fullsized":"2024-09-10T23:56:17.179051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:58.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199985+0000","last_change":"2024-09-10T23:53:55.746223+0000","last_active":"2024-09-10T23:56:17.199985+0000","last_peered":"2024-09-10T23:56:17.199985+0000","last_clean":"2024-09-10T23:56:17.199985+0000","last_became_active":"2024-09-10T23:53:55.745845+0000","last_became_peered":"2024-09-10T23:53:55.745845+0000","last_unstale":"2024-09-10T23:56:17.199985+0000","last_undegraded":"2024-09-10T23:56:17.199985+0000","last_fullsized":"2024-09-10T23:56:17.199985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:55.606341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.188322+0000","last_change":"2024-09-10T23:53:55.749022+0000","last_active":"2024-09-10T23:56:17.188322+0000","last_peered":"2024-09-10T23:56:17.188322+0000","last_clean":"2024-09-10T23:56:17.188322+0000","last_became_active":"2024-09-10T23:53:55.748722+0000","last_became_peered":"2024-09-10T23:53:55.748722+0000","last_unstale":"2024-09-10T23:56:17.188322+0000","last_undegraded":"2024-09-10T23:56:17.188322+0000","last_fullsized":"2024-09-10T23:56:17.188322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:24.342340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.178350+0000","last_change":"2024-09-10T23:54:48.499364+0000","last_active":"2024-09-10T23:56:17.178350+0000","last_peered":"2024-09-10T23:56:17.178350+0000","last_clean":"2024-09-10T23:56:17.178350+0000","last_became_active":"2024-09-10T23:54:48.498891+0000","last_became_peered":"2024-09-10T23:54:48.498891+0000","last_unstale":"2024-09-10T23:56:17.178350+0000","last_undegraded":"2024-09-10T23:56:17.178350+0000","last_fullsized":"2024-09-10T23:56:17.178350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.361081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.158699+0000","last_change":"2024-09-10T23:53:55.740178+0000","last_active":"2024-09-10T23:56:17.158699+0000","last_peered":"2024-09-10T23:56:17.158699+0000","last_clean":"2024-09-10T23:56:17.158699+0000","last_became_active":"2024-09-10T23:53:55.739713+0000","last_became_peered":"2024-09-10T23:53:55.739713+0000","last_unstale":"2024-09-10T23:56:17.158699+0000","last_undegraded":"2024-09-10T23:56:17.158699+0000","last_fullsized":"2024-09-10T23:56:17.158699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:40.584883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.197868+0000","last_change":"2024-09-10T23:53:55.732915+0000","last_active":"2024-09-10T23:56:17.197868+0000","last_peered":"2024-09-10T23:56:17.197868+0000","last_clean":"2024-09-10T23:56:17.197868+0000","last_became_active":"2024-09-10T23:53:55.732096+0000","last_became_peered":"2024-09-10T23:53:55.732096+0000","last_unstale":"2024-09-10T23:56:17.197868+0000","last_undegraded":"2024-09-10T23:56:17.197868+0000","last_fullsized":"2024-09-10T23:56:17.197868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:43.264415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199278+0000","last_change":"2024-09-10T23:53:55.733008+0000","last_active":"2024-09-10T23:56:17.199278+0000","last_peered":"2024-09-10T23:56:17.199278+0000","last_clean":"2024-09-10T23:56:17.199278+0000","last_became_active":"2024-09-10T23:53:55.732667+0000","last_became_peered":"2024-09-10T23:53:55.732667+0000","last_unstale":"2024-09-10T23:56:17.199278+0000","last_undegraded":"2024-09-10T23:56:17.199278+0000","last_fullsized":"2024-09-10T23:56:17.199278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:43.961395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199460+0000","last_change":"2024-09-10T23:53:55.748224+0000","last_active":"2024-09-10T23:56:17.199460+0000","last_peered":"2024-09-10T23:56:17.199460+0000","last_clean":"2024-09-10T23:56:17.199460+0000","last_became_active":"2024-09-10T23:53:55.746590+0000","last_became_peered":"2024-09-10T23:53:55.746590+0000","last_unstale":"2024-09-10T23:56:17.199460+0000","last_undegraded":"2024-09-10T23:56:17.199460+0000","last_fullsized":"2024-09-10T23:56:17.199460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:52.005607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186043+0000","last_change":"2024-09-10T23:53:55.745113+0000","last_active":"2024-09-10T23:56:17.186043+0000","last_peered":"2024-09-10T23:56:17.186043+0000","last_clean":"2024-09-10T23:56:17.186043+0000","last_became_active":"2024-09-10T23:53:55.744799+0000","last_became_peered":"2024-09-10T23:53:55.744799+0000","last_unstale":"2024-09-10T23:56:17.186043+0000","last_undegraded":"2024-09-10T23:56:17.186043+0000","last_fullsized":"2024-09-10T23:56:17.186043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:32:11.074301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184859+0000","last_change":"2024-09-10T23:53:55.740375+0000","last_active":"2024-09-10T23:56:17.184859+0000","last_peered":"2024-09-10T23:56:17.184859+0000","last_clean":"2024-09-10T23:56:17.184859+0000","last_became_active":"2024-09-10T23:53:55.739512+0000","last_became_peered":"2024-09-10T23:53:55.739512+0000","last_unstale":"2024-09-10T23:56:17.184859+0000","last_undegraded":"2024-09-10T23:56:17.184859+0000","last_fullsized":"2024-09-10T23:56:17.184859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:40.617514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182408+0000","last_change":"2024-09-10T23:53:55.740989+0000","last_active":"2024-09-10T23:56:17.182408+0000","last_peered":"2024-09-10T23:56:17.182408+0000","last_clean":"2024-09-10T23:56:17.182408+0000","last_became_active":"2024-09-10T23:53:55.740609+0000","last_became_peered":"2024-09-10T23:53:55.740609+0000","last_unstale":"2024-09-10T23:56:17.182408+0000","last_undegraded":"2024-09-10T23:56:17.182408+0000","last_fullsized":"2024-09-10T23:56:17.182408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.448187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177823+0000","last_change":"2024-09-10T23:53:55.741516+0000","last_active":"2024-09-10T23:56:17.177823+0000","last_peered":"2024-09-10T23:56:17.177823+0000","last_clean":"2024-09-10T23:56:17.177823+0000","last_became_active":"2024-09-10T23:53:55.741169+0000","last_became_peered":"2024-09-10T23:53:55.741169+0000","last_unstale":"2024-09-10T23:56:17.177823+0000","last_undegraded":"2024-09-10T23:56:17.177823+0000","last_fullsized":"2024-09-10T23:56:17.177823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:39.899123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.200710+0000","last_change":"2024-09-10T23:53:55.746752+0000","last_active":"2024-09-10T23:56:17.200710+0000","last_peered":"2024-09-10T23:56:17.200710+0000","last_clean":"2024-09-10T23:56:17.200710+0000","last_became_active":"2024-09-10T23:53:55.746395+0000","last_became_peered":"2024-09-10T23:53:55.746395+0000","last_unstale":"2024-09-10T23:56:17.200710+0000","last_undegraded":"2024-09-10T23:56:17.200710+0000","last_fullsized":"2024-09-10T23:56:17.200710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:15.691757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.186703+0000","last_change":"2024-09-10T23:55:48.434274+0000","last_active":"2024-09-10T23:56:17.186703+0000","last_peered":"2024-09-10T23:56:17.186703+0000","last_clean":"2024-09-10T23:56:17.186703+0000","last_became_active":"2024-09-10T23:55:48.433970+0000","last_became_peered":"2024-09-10T23:55:48.433970+0000","last_unstale":"2024-09-10T23:56:17.186703+0000","last_undegraded":"2024-09-10T23:56:17.186703+0000","last_fullsized":"2024-09-10T23:56:17.186703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:53.612639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198991+0000","last_change":"2024-09-10T23:53:55.745463+0000","last_active":"2024-09-10T23:56:17.198991+0000","last_peered":"2024-09-10T23:56:17.198991+0000","last_clean":"2024-09-10T23:56:17.198991+0000","last_became_active":"2024-09-10T23:53:55.744873+0000","last_became_peered":"2024-09-10T23:53:55.744873+0000","last_unstale":"2024-09-10T23:56:17.198991+0000","last_undegraded":"2024-09-10T23:56:17.198991+0000","last_fullsized":"2024-09-10T23:56:17.198991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:45.357849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.184374+0000","last_change":"2024-09-10T23:53:55.753043+0000","last_active":"2024-09-10T23:56:17.184374+0000","last_peered":"2024-09-10T23:56:17.184374+0000","last_clean":"2024-09-10T23:56:17.184374+0000","last_became_active":"2024-09-10T23:53:55.750520+0000","last_became_peered":"2024-09-10T23:53:55.750520+0000","last_unstale":"2024-09-10T23:56:17.184374+0000","last_undegraded":"2024-09-10T23:56:17.184374+0000","last_fullsized":"2024-09-10T23:56:17.184374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:18.631863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.187467+0000","last_change":"2024-09-10T23:55:48.229813+0000","last_active":"2024-09-10T23:56:17.187467+0000","last_peered":"2024-09-10T23:56:17.187467+0000","last_clean":"2024-09-10T23:56:17.187467+0000","last_became_active":"2024-09-10T23:55:48.229420+0000","last_became_peered":"2024-09-10T23:55:48.229420+0000","last_unstale":"2024-09-10T23:56:17.187467+0000","last_undegraded":"2024-09-10T23:56:17.187467+0000","last_fullsized":"2024-09-10T23:56:17.187467+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:47.584330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.179404+0000","last_change":"2024-09-10T23:54:48.499043+0000","last_active":"2024-09-10T23:56:17.179404+0000","last_peered":"2024-09-10T23:56:17.179404+0000","last_clean":"2024-09-10T23:56:17.179404+0000","last_became_active":"2024-09-10T23:54:48.498604+0000","last_became_peered":"2024-09-10T23:54:48.498604+0000","last_unstale":"2024-09-10T23:56:17.179404+0000","last_undegraded":"2024-09-10T23:56:17.179404+0000","last_fullsized":"2024-09-10T23:56:17.179404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:10.712778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.181792+0000","last_change":"2024-09-10T23:53:55.740014+0000","last_active":"2024-09-10T23:56:17.181792+0000","last_peered":"2024-09-10T23:56:17.181792+0000","last_clean":"2024-09-10T23:56:17.181792+0000","last_became_active":"2024-09-10T23:53:55.739648+0000","last_became_peered":"2024-09-10T23:53:55.739648+0000","last_unstale":"2024-09-10T23:56:17.181792+0000","last_undegraded":"2024-09-10T23:56:17.181792+0000","last_fullsized":"2024-09-10T23:56:17.181792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:54.594704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.177183+0000","last_change":"2024-09-10T23:53:55.745090+0000","last_active":"2024-09-10T23:56:17.177183+0000","last_peered":"2024-09-10T23:56:17.177183+0000","last_clean":"2024-09-10T23:56:17.177183+0000","last_became_active":"2024-09-10T23:53:55.743263+0000","last_became_peered":"2024-09-10T23:53:55.743263+0000","last_unstale":"2024-09-10T23:56:17.177183+0000","last_undegraded":"2024-09-10T23:56:17.177183+0000","last_fullsized":"2024-09-10T23:56:17.177183+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:16.240083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.198925+0000","last_change":"2024-09-10T23:53:55.746895+0000","last_active":"2024-09-10T23:56:17.198925+0000","last_peered":"2024-09-10T23:56:17.198925+0000","last_clean":"2024-09-10T23:56:17.198925+0000","last_became_active":"2024-09-10T23:53:55.746367+0000","last_became_peered":"2024-09-10T23:53:55.746367+0000","last_unstale":"2024-09-10T23:56:17.198925+0000","last_undegraded":"2024-09-10T23:56:17.198925+0000","last_fullsized":"2024-09-10T23:56:17.198925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:09.192505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.182890+0000","last_change":"2024-09-10T23:53:55.733901+0000","last_active":"2024-09-10T23:56:17.182890+0000","last_peered":"2024-09-10T23:56:17.182890+0000","last_clean":"2024-09-10T23:56:17.182890+0000","last_became_active":"2024-09-10T23:53:55.732771+0000","last_became_peered":"2024-09-10T23:53:55.732771+0000","last_unstale":"2024-09-10T23:56:17.182890+0000","last_undegraded":"2024-09-10T23:56:17.182890+0000","last_fullsized":"2024-09-10T23:56:17.182890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:34.333805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:56:17.199096+0000","last_change":"2024-09-10T23:53:55.736893+0000","last_active":"2024-09-10T23:56:17.199096+0000","last_peered":"2024-09-10T23:56:17.199096+0000","last_clean":"2024-09-10T23:56:17.199096+0000","last_became_active":"2024-09-10T23:53:55.736554+0000","last_became_peered":"2024-09-10T23:53:55.736554+0000","last_unstale":"2024-09-10T23:56:17.199096+0000","last_undegraded":"2024-09-10T23:56:17.199096+0000","last_fullsized":"2024-09-10T23:56:17.199096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:53:54.698713+0000","last_clean_scrub_stamp":"2024-09-10T23:53:54.698713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:59.593265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70972,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":757,"num_read_kb":452,"num_write":195,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":4486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286491,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710771,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":497970,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907000,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":1151569,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070527,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":502280,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266757,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":498082,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462988,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1096031,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626513,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":493360,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822744,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1090219,"data_compressed":65901,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986270,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":565994,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182500,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493554,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":493998,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":558614,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":494748,"data_compressed":29478,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34792,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36423,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:56:53.679 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:54.061 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:54 smithi033 ceph-mon[30593]: from='client.35258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:54 smithi033 ceph-mon[30593]: pgmap v440: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T23:56:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 -- 172.21.15.33:0/339122465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8102c10 msgr2=0x7fb7d8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 --2- 172.21.15.33:0/339122465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8102c10 0x7fb7d8102ff0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009900 tx=0x7fb7cc02a410 comp rx=0 tx=0).stop 2024-09-10T23:56:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 -- 172.21.15.33:0/339122465 shutdown_connections 2024-09-10T23:56:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 --2- 172.21.15.33:0/339122465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8108fa0 0x7fb7d810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 --2- 172.21.15.33:0/339122465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108620 0x7fb7d8108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 --2- 172.21.15.33:0/339122465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8102c10 0x7fb7d8102ff0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.674+0000 7fb7dea00640 1 -- 172.21.15.33:0/339122465 >> 172.21.15.33:0/339122465 conn(0x7fb7d80fe660 msgr2=0x7fb7d8100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.675+0000 7fb7dea00640 1 -- 172.21.15.33:0/339122465 shutdown_connections 2024-09-10T23:56:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.675+0000 7fb7dea00640 1 -- 172.21.15.33:0/339122465 wait complete. 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.675+0000 7fb7dea00640 1 Processor -- start 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 -- start start 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8102c10 0x7fb7d80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108fa0 0x7fb7d8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d8112b60 con 0x7fb7d8108620 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d81129e0 con 0x7fb7d8102c10 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d8112ce0 con 0x7fb7d8108fa0 2024-09-10T23:56:54.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dcc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dcc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55364/0 (socket says 172.21.15.33:55364) 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.676+0000 7fb7dcc00640 1 -- 172.21.15.33:0/4072202259 learned_addr learned my addr 172.21.15.33:0/4072202259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7de000640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108fa0 0x7fb7d8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dd600640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8102c10 0x7fb7d80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 -- 172.21.15.33:0/4072202259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108fa0 msgr2=0x7fb7d8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108fa0 0x7fb7d8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 -- 172.21.15.33:0/4072202259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8102c10 msgr2=0x7fb7d80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8102c10 0x7fb7d80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 -- 172.21.15.33:0/4072202259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d81a72f0 con 0x7fb7d8108620 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.677+0000 7fb7dcc00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400d950 tx=0x7fb7c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.678+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4017070 con 0x7fb7d8108620 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.678+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7c4009c30 con 0x7fb7d8108620 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.678+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400f620 con 0x7fb7d8108620 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.678+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d81a75e0 con 0x7fb7d8108620 2024-09-10T23:56:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.678+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d81a7b70 con 0x7fb7d8108620 2024-09-10T23:56:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.679+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d8102ff0 con 0x7fb7d8108620 2024-09-10T23:56:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.681+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fb7c4010460 con 0x7fb7d8108620 2024-09-10T23:56:54.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.684+0000 7fb7d6000640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 0x7fb7c00b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:54.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.684+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb7c40e5c70 con 0x7fb7d8108620 2024-09-10T23:56:54.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.684+0000 7fb7dd600640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 0x7fb7c00b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:54.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.685+0000 7fb7dd600640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 0x7fb7c00b7950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc006010 tx=0x7fb7cc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.689+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7c4009de0 con 0x7fb7d8108620 2024-09-10T23:56:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:54 smithi052 ceph-mon[33526]: from='client.35258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:54 smithi052 ceph-mon[33526]: pgmap v440: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T23:56:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:54 smithi189 ceph-mon[34000]: from='client.35258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:54 smithi189 ceph-mon[34000]: pgmap v440: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T23:56:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.922+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7d80767a0 con 0x7fb7d8108620 2024-09-10T23:56:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.923+0000 7fb7d6000640 1 -- 172.21.15.33:0/4072202259 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7fb7c40ac000 con 0x7fb7d8108620 2024-09-10T23:56:54.925 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:54.925 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:56:54.925 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:56:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 msgr2=0x7fb7c00b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 0x7fb7c00b7950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc006010 tx=0x7fb7cc005e80 comp rx=0 tx=0).stop 2024-09-10T23:56:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 msgr2=0x7fb7d80759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400d950 tx=0x7fb7c400de10 comp rx=0 tx=0).stop 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 shutdown_connections 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7c00b5490 0x7fb7c00b7950 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7d8108fa0 0x7fb7d8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d8108620 0x7fb7d80759e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 --2- 172.21.15.33:0/4072202259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7d8102c10 0x7fb7d80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 >> 172.21.15.33:0/4072202259 conn(0x7fb7d80fe660 msgr2=0x7fb7d80ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 shutdown_connections 2024-09-10T23:56:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:54.927+0000 7fb7dea00640 1 -- 172.21.15.33:0/4072202259 wait complete. 2024-09-10T23:56:55.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:55 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/4072202259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:55.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:55 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/4072202259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:55.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:56:55.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:55 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/4072202259' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:56.172 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:56.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:56 smithi033 ceph-mon[30593]: pgmap v441: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T23:56:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:56 smithi052 ceph-mon[33526]: pgmap v441: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T23:56:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:56 smithi189 ceph-mon[34000]: pgmap v441: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T23:56:56.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 -- 172.21.15.33:0/268382328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 msgr2=0x7fe44810ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:56.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 --2- 172.21.15.33:0/268382328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44810ee70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe434009900 tx=0x7fe43402a410 comp rx=0 tx=0).stop 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 -- 172.21.15.33:0/268382328 shutdown_connections 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 --2- 172.21.15.33:0/268382328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 0x7fe4481117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 --2- 172.21.15.33:0/268382328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44810ee70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 --2- 172.21.15.33:0/268382328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe4480758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 -- 172.21.15.33:0/268382328 >> 172.21.15.33:0/268382328 conn(0x7fe4480fe810 msgr2=0x7fe448100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 -- 172.21.15.33:0/268382328 shutdown_connections 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.810+0000 7fe44fc00640 1 -- 172.21.15.33:0/268382328 wait complete. 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.811+0000 7fe44fc00640 1 Processor -- start 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.811+0000 7fe44fc00640 1 -- start start 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe44819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:56.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 0x7fe4481a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe448114ea0 con 0x7fe448075de0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe448114d20 con 0x7fe4480754c0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe448115020 con 0x7fe44810f3b0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe447e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe447e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55388/0 (socket says 172.21.15.33:55388) 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe447e00640 1 -- 172.21.15.33:0/1378397764 learned_addr learned my addr 172.21.15.33:0/1378397764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44d200640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe44819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.812+0000 7fe44dc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 0x7fe4481a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 -- 172.21.15.33:0/1378397764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 msgr2=0x7fe4481a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 0x7fe4481a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 -- 172.21.15.33:0/1378397764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 msgr2=0x7fe44819b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe44819b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:56.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 -- 172.21.15.33:0/1378397764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4481a14b0 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe44d200640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe44819b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe447e00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe43402a930 tx=0x7fe434003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43403f070 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe434003e40 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434035030 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.813+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4481a1740 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.814+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4481a7e60 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.815+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4480769d0 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.817+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fe434031400 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.818+0000 7fe445600640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 0x7fe42c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.818+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe434106b00 con 0x7fe448075de0 2024-09-10T23:56:56.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.819+0000 7fe44d200640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 0x7fe42c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:56.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.819+0000 7fe44d200640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 0x7fe42c0b78b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe438005d00 tx=0x7fe43800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:56.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:56.822+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe4340cce10 con 0x7fe448075de0 2024-09-10T23:56:57.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.058+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe44802e5c0 con 0x7fe448075de0 2024-09-10T23:56:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.059+0000 7fe445600640 1 -- 172.21.15.33:0/1378397764 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7fe4340d1840 con 0x7fe448075de0 2024-09-10T23:56:57.060 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:57.061 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:56:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:56:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 msgr2=0x7fe42c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 0x7fe42c0b78b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe438005d00 tx=0x7fe43800b410 comp rx=0 tx=0).stop 2024-09-10T23:56:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 msgr2=0x7fe44819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:57.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe43402a930 tx=0x7fe434003c20 comp rx=0 tx=0).stop 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 shutdown_connections 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe42c0b53f0 0x7fe42c0b78b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe44810f3b0 0x7fe4481a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe448075de0 0x7fe44819b940 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 --2- 172.21.15.33:0/1378397764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4480754c0 0x7fe44819b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 >> 172.21.15.33:0/1378397764 conn(0x7fe4480fe810 msgr2=0x7fe4480ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 shutdown_connections 2024-09-10T23:56:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:57.062+0000 7fe44fc00640 1 -- 172.21.15.33:0/1378397764 wait complete. 2024-09-10T23:56:57.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:57 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1378397764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:57.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:57 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1378397764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:57.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:57 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1378397764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:56:58.060 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T23:56:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:56:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:58 smithi052 ceph-mon[33526]: pgmap v442: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-10T23:56:58.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:58 smithi033 ceph-mon[30593]: pgmap v442: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-10T23:56:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:58 smithi189 ceph-mon[34000]: pgmap v442: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 -- 172.21.15.33:0/932631597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a00103cc0 msgr2=0x7f7a001040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 --2- 172.21.15.33:0/932631597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a00103cc0 0x7f7a001040a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009900 tx=0x7f79f002a3f0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 -- 172.21.15.33:0/932631597 shutdown_connections 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 --2- 172.21.15.33:0/932631597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 0x7f7a0010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 --2- 172.21.15.33:0/932631597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a001045e0 0x7f7a0010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 --2- 172.21.15.33:0/932631597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a00103cc0 0x7f7a001040a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.045+0000 7f7a05000640 1 -- 172.21.15.33:0/932631597 >> 172.21.15.33:0/932631597 conn(0x7f7a000fd700 msgr2=0x7f7a000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:59.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.046+0000 7f7a05000640 1 -- 172.21.15.33:0/932631597 shutdown_connections 2024-09-10T23:56:59.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.046+0000 7f7a05000640 1 -- 172.21.15.33:0/932631597 wait complete. 2024-09-10T23:56:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.046+0000 7f7a05000640 1 Processor -- start 2024-09-10T23:56:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 -- start start 2024-09-10T23:56:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 0x7f7a0019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 0x7f7a001a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00112c40 con 0x7f7a001045e0 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00112ac0 con 0x7f7a0010d120 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f7a05000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00112dc0 con 0x7f7a00103cc0 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f79f5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f79f5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55410/0 (socket says 172.21.15.33:55410) 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.047+0000 7f79f5400640 1 -- 172.21.15.33:0/559174904 learned_addr learned my addr 172.21.15.33:0/559174904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79fde00640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 0x7f7a0019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79fe800640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 0x7f7a001a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 -- 172.21.15.33:0/559174904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 msgr2=0x7f7a0019b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 0x7f7a0019b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 -- 172.21.15.33:0/559174904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 msgr2=0x7f7a001a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:59.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 0x7f7a001a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 -- 172.21.15.33:0/559174904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a001a1410 con 0x7f7a001045e0 2024-09-10T23:56:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79fde00640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 0x7f7a0019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:56:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.048+0000 7f79f5400640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f79e800ccb0 tx=0x7f79e800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.049+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003970 con 0x7f7a001045e0 2024-09-10T23:56:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.049+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a001a1700 con 0x7f7a001045e0 2024-09-10T23:56:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.049+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79e8004030 con 0x7f7a001045e0 2024-09-10T23:56:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.049+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e800f6b0 con 0x7f7a001045e0 2024-09-10T23:56:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.049+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a001a7f90 con 0x7f7a001045e0 2024-09-10T23:56:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.050+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a001040a0 con 0x7f7a001045e0 2024-09-10T23:56:59.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.052+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f79e8003b10 con 0x7f7a001045e0 2024-09-10T23:56:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.053+0000 7f79f7400640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 0x7f79e40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:56:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.054+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f79e80e65d0 con 0x7f7a001045e0 2024-09-10T23:56:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.054+0000 7f79fde00640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 0x7f79e40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:56:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.054+0000 7f79fde00640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 0x7f79e40b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79f0000c00 tx=0x7f79f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:56:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.057+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f79e8014070 con 0x7f7a001045e0 2024-09-10T23:56:59.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.254+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a001a81c0 con 0x7f7a001045e0 2024-09-10T23:56:59.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.255+0000 7f79f7400640 1 -- 172.21.15.33:0/559174904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24816 (secure 0 0 0) 0x7f79e80acf30 con 0x7f7a001045e0 2024-09-10T23:56:59.257 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:56:59.257 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:55:48.186249+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 msgr2=0x7f79e40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 0x7f79e40b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f79f0000c00 tx=0x7f79f0005a20 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 msgr2=0x7f7a0019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f79e800ccb0 tx=0x7f79e800a620 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 shutdown_connections 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f79e40b5370 0x7f79e40b7830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a0010d120 0x7f7a001a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a001045e0 0x7f7a0019b8a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 --2- 172.21.15.33:0/559174904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a00103cc0 0x7f7a0019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:56:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 >> 172.21.15.33:0/559174904 conn(0x7f7a000fd700 msgr2=0x7f7a0010f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:56:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 shutdown_connections 2024-09-10T23:56:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:56:59.258+0000 7f7a05000640 1 -- 172.21.15.33:0/559174904 wait complete. 2024-09-10T23:56:59.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:56:59 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/559174904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:59.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:56:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/559174904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:56:59.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:56:59 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/559174904' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T23:57:00.043 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-10T23:57:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 -- 172.21.15.33:0/1968669085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564104b90 msgr2=0x7f2564104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 --2- 172.21.15.33:0/1968669085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564104b90 0x7f2564104f90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2554009930 tx=0x7f255402a420 comp rx=0 tx=0).stop 2024-09-10T23:57:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 -- 172.21.15.33:0/1968669085 shutdown_connections 2024-09-10T23:57:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 --2- 172.21.15.33:0/1968669085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 0x7f256410d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 --2- 172.21.15.33:0/1968669085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564105ce0 0x7f2564106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 --2- 172.21.15.33:0/1968669085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564104b90 0x7f2564104f90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 -- 172.21.15.33:0/1968669085 >> 172.21.15.33:0/1968669085 conn(0x7f2564100470 msgr2=0x7f2564102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 -- 172.21.15.33:0/1968669085 shutdown_connections 2024-09-10T23:57:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.552+0000 7f2569e00640 1 -- 172.21.15.33:0/1968669085 wait complete. 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 Processor -- start 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 -- start start 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 0x7f256419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2564110700 con 0x7f2564105ce0 2024-09-10T23:57:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2564110580 con 0x7f25641066a0 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f2569e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2564110880 con 0x7f2564104b90 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.553+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f2562a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55438/0 (socket says 172.21.15.33:55438) 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f2562a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38274/0 (socket says 172.21.15.33:38274) 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 -- 172.21.15.33:0/2003057702 learned_addr learned my addr 172.21.15.33:0/2003057702 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f2563400640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 0x7f256419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 -- 172.21.15.33:0/2003057702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 msgr2=0x7f256419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 -- 172.21.15.33:0/2003057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 msgr2=0x7f256419c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 0x7f256419c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 -- 172.21.15.33:0/2003057702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256419ca30 con 0x7f2564105ce0 2024-09-10T23:57:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f2562a00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.554+0000 7f255be00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d770 tx=0x7f254c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.555+0000 7f2568a00640 1 -- 172.21.15.33:0/2003057702 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c017070 con 0x7f2564105ce0 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.555+0000 7f2568a00640 1 -- 172.21.15.33:0/2003057702 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f254c0054b0 con 0x7f2564105ce0 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.555+0000 7f2568a00640 1 -- 172.21.15.33:0/2003057702 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c004c60 con 0x7f2564105ce0 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.555+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256419cd20 con 0x7f2564105ce0 2024-09-10T23:57:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.555+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25641a33f0 con 0x7f2564105ce0 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.558+0000 7f256cc39740 1 Processor -- start 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.558+0000 7f256cc39740 1 -- start start 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.558+0000 7f2568a00640 1 -- 172.21.15.33:0/2003057702 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f254c004e00 con 0x7f2564105ce0 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.558+0000 7f256cc39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cc3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.558+0000 7f256cc39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cc64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f256cc39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f256cc39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0c346b0 con 0x55fdb0cc6b00 2024-09-10T23:57:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f256cc39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0c23ae0 con 0x55fdb0cc40c0 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f256cc39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0c278f0 con 0x55fdb0cc1790 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2562a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cc64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cc3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55452/0 (socket says 172.21.15.33:55452) 2024-09-10T23:57:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f255be00640 1 -- 172.21.15.33:0/433009531 learned_addr learned my addr 172.21.15.33:0/433009531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 -- 172.21.15.33:0/433009531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc40c0 msgr2=0x55fdb0cc64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cc64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 -- 172.21.15.33:0/433009531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 msgr2=0x55fdb0cc8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f2563400640 1 -- 172.21.15.33:0/433009531 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb0bf0780 con 0x55fdb0cc1790 2024-09-10T23:57:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.559+0000 7f255be00640 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2563400640 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cc3b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f255c005fd0 tx=0x7f255c010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5026bd8901eec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2568a00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 0x7f25480b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2553e00640 1 -- 172.21.15.33:0/433009531 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c016070 con 0x55fdb0cc1790 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2553e00640 1 -- 172.21.15.33:0/433009531 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f255c004d20 con 0x55fdb0cc1790 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2553e00640 1 -- 172.21.15.33:0/433009531 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0126b0 con 0x55fdb0cc1790 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2568a00640 1 -- 172.21.15.33:0/2003057702 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f254c0e5ac0 con 0x7f2564105ce0 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.560+0000 7f2562a00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 0x7f25480b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 -- 172.21.15.33:0/433009531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 msgr2=0x55fdb0cc3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cc3b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f255c005fd0 tx=0x7f255c010740 comp rx=0 tx=0).stop 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 -- 172.21.15.33:0/433009531 shutdown_connections 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cc8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cc64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f2562a00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 0x7f25480b78b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25540057c0 tx=0x7f2554031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 --2- 172.21.15.33:0/433009531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cc3b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 -- 172.21.15.33:0/433009531 >> 172.21.15.33:0/433009531 conn(0x55fdb0cbc8e0 msgr2=0x55fdb0cbd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 -- 172.21.15.33:0/433009531 shutdown_connections 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.561+0000 7f256cc39740 1 -- 172.21.15.33:0/433009531 wait complete. 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 -- start start 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 Processor -- start 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0ccb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0ccc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0b5bab0 con 0x55fdb0cc1790 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0bca570 con 0x55fdb0cc6b00 2024-09-10T23:57:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fdb0cc9ae0 con 0x55fdb0cc40c0 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f256cc39740 10 client.0 _ll_register_callbacks cb 0x55fdb0bd9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f2562a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f2562a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55458/0 (socket says 172.21.15.33:55458) 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.562+0000 7f2562a00640 1 -- 172.21.15.33:0/3020969658 learned_addr learned my addr 172.21.15.33:0/3020969658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f255be00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0ccb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2563400640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0ccc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 -- 172.21.15.33:0/3020969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 msgr2=0x55fdb0ccb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0ccb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 -- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 msgr2=0x55fdb0ccc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0ccc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 -- 172.21.15.33:0/3020969658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb0985790 con 0x55fdb0cc1790 2024-09-10T23:57:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2563400640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0ccc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2562a00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2554004540 tx=0x7f255402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a48b532adbf917c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.563+0000 7f2550c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554035050 con 0x55fdb0cc1790 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c004d20 con 0x55fdb0cc1790 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f25540317d0 con 0x55fdb0cc1790 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f25540319d0 con 0x55fdb0cc1790 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 10 client.15495 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdb09fe620 con 0x55fdb0cc1790 2024-09-10T23:57:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f255c004d20 con 0x55fdb0cc1790 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2554053c30 con 0x55fdb0cc1790 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 10 client.15495 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 20 client.15495 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.564+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0cd6760 0x55fdb0cd8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.565+0000 7f256cc39740 4 client.15495 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.565+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb0c36600 con 0x55fdb0cd6760 2024-09-10T23:57:00.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.565+0000 7f255be00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0cd6760 0x55fdb0cd8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.566+0000 7f255be00640 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0cd6760 0x55fdb0cd8b50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9287d393dcc70d5 server_cookie=2f3d670a137a9aa5 in_seq=0 out_seq=0 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.566+0000 7f2550c00640 10 client.15495 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.566+0000 7f2550c00640 1 -- 172.21.15.33:0/3020969658 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdb0c36600 con 0x55fdb0cd6760 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.566+0000 7f2550c00640 10 client.15495 handle_command_reply: tid=0 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 client.15495 shutdown 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 msgr2=0x55fdb0ccaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2554004540 tx=0x7f255402a420 comp rx=0 tx=0).stop 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 shutdown_connections 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0ccc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0cd6760 0x55fdb0cd8b50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0ccb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 --2- 172.21.15.33:0/3020969658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0ccaed0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.573 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 >> 172.21.15.33:0/3020969658 conn(0x55fdb0cbc8e0 msgr2=0x55fdb0cbba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.573 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f2550c00640 0 client.15495 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:00.573 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 shutdown_connections 2024-09-10T23:57:00.573 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 1 -- 172.21.15.33:0/3020969658 wait complete. 2024-09-10T23:57:00.573 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.567+0000 7f256cc39740 20 client.15495 trim_cache size 0 max 16384 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 Processor -- start 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 -- start start 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cbf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cdd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25641b00a0 con 0x55fdb0cc40c0 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f25641ad970 con 0x55fdb0cc6b00 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.582+0000 7f256cc39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25641ab7c0 con 0x55fdb0cc1790 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55464/0 (socket says 172.21.15.33:55464) 2024-09-10T23:57:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 -- 172.21.15.33:0/1775765180 learned_addr learned my addr 172.21.15.33:0/1775765180 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f2563400640 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cdd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f2562a00640 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cbf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 -- 172.21.15.33:0/1775765180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 msgr2=0x55fdb0cbf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cbf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 -- 172.21.15.33:0/1775765180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 msgr2=0x55fdb0cdd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cdd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.583+0000 7f255be00640 1 -- 172.21.15.33:0/1775765180 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb0cc6820 con 0x55fdb0cc40c0 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f255be00640 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f254c093010 tx=0x7f254c093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff13858538fbc0df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f2553400640 1 -- 172.21.15.33:0/1775765180 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0ec070 con 0x55fdb0cc40c0 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f2553400640 1 -- 172.21.15.33:0/1775765180 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f254c0ab8e0 con 0x55fdb0cc40c0 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f2553400640 1 -- 172.21.15.33:0/1775765180 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c020040 con 0x55fdb0cc40c0 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 -- 172.21.15.33:0/1775765180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 msgr2=0x55fdb0cbfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f254c093010 tx=0x7f254c093040 comp rx=0 tx=0).stop 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 -- 172.21.15.33:0/1775765180 shutdown_connections 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cdd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cbfe70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 --2- 172.21.15.33:0/1775765180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc1790 0x55fdb0cbf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 -- 172.21.15.33:0/1775765180 >> 172.21.15.33:0/1775765180 conn(0x55fdb0cbc8e0 msgr2=0x55fdb0cbd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.584+0000 7f256cc39740 1 -- 172.21.15.33:0/1775765180 shutdown_connections 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 -- 172.21.15.33:0/1775765180 wait complete. 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 -- start start 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 Processor -- start 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cd19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cd20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25641abe30 con 0x55fdb0cc1790 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f25641ad2a0 con 0x55fdb0cc6b00 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25641ac500 con 0x55fdb0cc40c0 2024-09-10T23:57:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.585+0000 7f256cc39740 10 client.0 _ll_register_callbacks cb 0x7f2554004490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55470/0 (socket says 172.21.15.33:55470) 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 -- 172.21.15.33:0/3527330672 learned_addr learned my addr 172.21.15.33:0/3527330672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f255be00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cd19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2563400640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cd20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 -- 172.21.15.33:0/3527330672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 msgr2=0x55fdb0cd19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cd19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 -- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 msgr2=0x55fdb0cd20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cd20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 -- 172.21.15.33:0/3527330672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb0cd0440 con 0x55fdb0cc1790 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2562a00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f25540495f0 tx=0x7f2554049920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7de9f59f209f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.586+0000 7f2550c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554035040 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254c0ab8e0 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f25540317d0 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f255406d050 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 10 client.15501 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdb0d43970 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f254c0ab8e0 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2554053bc0 con 0x55fdb0cc1790 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 20 client.15501 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0d443a0 0x55fdb0d467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 4 client.15501 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:57:00.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.587+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdb0c320b0 con 0x55fdb0d443a0 2024-09-10T23:57:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.588+0000 7f255be00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0d443a0 0x55fdb0d467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.588+0000 7f255be00640 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0d443a0 0x55fdb0d467c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e998f26cca4a6e7 server_cookie=601d288c342f074d in_seq=0 out_seq=0 2024-09-10T23:57:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.588+0000 7f2550c00640 10 client.15501 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f2550c00640 1 -- 172.21.15.33:0/3527330672 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdb0c320b0 con 0x55fdb0d443a0 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f2550c00640 10 client.15501 handle_command_reply: tid=0 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 client.15501 shutdown 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 msgr2=0x55fdb0cd2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f25540495f0 tx=0x7f2554049920 comp rx=0 tx=0).stop 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 shutdown_connections 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fdb0cc6b00 0x55fdb0cd20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fdb0d443a0 0x55fdb0d467c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fdb0cc40c0 0x55fdb0cd19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 --2- 172.21.15.33:0/3527330672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fdb0cc1790 0x55fdb0cd2c20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f2550c00640 0 client.15501 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 >> 172.21.15.33:0/3527330672 conn(0x55fdb0cbc8e0 msgr2=0x55fdb0cc0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 shutdown_connections 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.604+0000 7f256cc39740 1 -- 172.21.15.33:0/3527330672 wait complete. 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f256cc39740 20 client.15501 trim_cache size 0 max 16384 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:57:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 msgr2=0x7f25480b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 0x7f25480b78b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25540057c0 tx=0x7f2554031420 comp rx=0 tx=0).stop 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 msgr2=0x7f256419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d770 tx=0x7f254c00dc30 comp rx=0 tx=0).stop 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 shutdown_connections 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f25480b53f0 0x7f25480b78b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25641066a0 0x7f256419c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2564105ce0 0x7f256419b540 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 --2- 172.21.15.33:0/2003057702 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2564104b90 0x7f256419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.605+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 >> 172.21.15.33:0/2003057702 conn(0x7f2564100470 msgr2=0x7f2564109150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.606+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 shutdown_connections 2024-09-10T23:57:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:00.606+0000 7f2569e00640 1 -- 172.21.15.33:0/2003057702 wait complete. 2024-09-10T23:57:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:00 smithi052 ceph-mon[33526]: pgmap v443: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:57:00.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:00 smithi033 ceph-mon[30593]: pgmap v443: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:57:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:00 smithi189 ceph-mon[34000]: pgmap v443: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-10T23:57:01.963 INFO:teuthology.orchestra.run.smithi033.stdout:{"run_dir":"/var/run/ceph"} 2024-09-10T23:57:01.963 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-10T23:57:01.964 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 6190 2024-09-10T23:57:01.964 DEBUG:tasks.quiescer:Yielding 2024-09-10T23:57:01.964 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T23:57:01.974 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T23:57:01.974 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi033.front.sepia.ceph.com 2024-09-10T23:57:01.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-10T23:57:01.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:57:02.058 INFO:teuthology.orchestra.run.smithi033.stdout:total 0 2024-09-10T23:57:02.082 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-10T23:57:02.083 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-fuse 1.1T 356M 1.1T 1% /tmp/cephfs 2024-09-10T23:57:02.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-10T23:57:02.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-10T23:57:02.370 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-10T23:57:02.370 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:02 smithi052 ceph-mon[33526]: pgmap v444: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T23:57:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:02 smithi033 ceph-mon[30593]: pgmap v444: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T23:57:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:02 smithi189 ceph-mon[34000]: pgmap v444: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 -- 172.21.15.33:0/2464370367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65800754e0 msgr2=0x7f65800758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 --2- 172.21.15.33:0/2464370367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65800754e0 0x7f65800758c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6574009900 tx=0x7f657402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 -- 172.21.15.33:0/2464370367 shutdown_connections 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 --2- 172.21.15.33:0/2464370367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f658010f200 0x7f65801115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 --2- 172.21.15.33:0/2464370367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6580075e00 0x7f658010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 --2- 172.21.15.33:0/2464370367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65800754e0 0x7f65800758c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 -- 172.21.15.33:0/2464370367 >> 172.21.15.33:0/2464370367 conn(0x7f65800fe660 msgr2=0x7f6580100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 -- 172.21.15.33:0/2464370367 shutdown_connections 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.070+0000 7f6586200640 1 -- 172.21.15.33:0/2464370367 wait complete. 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.071+0000 7f6586200640 1 Processor -- start 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 -- start start 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65800754e0 0x7f658019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6580075e00 0x7f658019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6580114c90 con 0x7f658010f200 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6580114b10 con 0x7f65800754e0 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6586200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6580114e10 con 0x7f6580075e00 2024-09-10T23:57:03.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6585800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6585800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48326/0 (socket says 172.21.15.33:48326) 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.072+0000 7f6585800640 1 -- 172.21.15.33:0/1355696439 learned_addr learned my addr 172.21.15.33:0/1355696439 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6584e00640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65800754e0 0x7f658019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f657fe00640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6580075e00 0x7f658019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 -- 172.21.15.33:0/1355696439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6580075e00 msgr2=0x7f658019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6580075e00 0x7f658019b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 -- 172.21.15.33:0/1355696439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65800754e0 msgr2=0x7f658019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65800754e0 0x7f658019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 -- 172.21.15.33:0/1355696439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65801a1210 con 0x7f658010f200 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.073+0000 7f6585800640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f657800e9d0 tx=0x7f657800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.074+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657800cd80 con 0x7f658010f200 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.074+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6578005020 con 0x7f658010f200 2024-09-10T23:57:03.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.074+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65801a1500 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.074+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780116d0 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.074+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801a7bc0 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.075+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65800758c0 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.077+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f657800f040 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.078+0000 7f657d600640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 0x7f65680b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.079+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f65780e6280 con 0x7f658010f200 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.079+0000 7f6584e00640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 0x7f65680b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.079+0000 7f6584e00640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 0x7f65680b78d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f65740057c0 tx=0x7f65740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:03.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.082+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6578016030 con 0x7f658010f200 2024-09-10T23:57:03.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.320+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65801a7f50 con 0x7f658010f200 2024-09-10T23:57:03.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.321+0000 7f657d600640 1 -- 172.21.15.33:0/1355696439 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f65780ac590 con 0x7f658010f200 2024-09-10T23:57:03.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:03.323 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:57:03.323 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:57:03.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 msgr2=0x7f65680b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 0x7f65680b78d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f65740057c0 tx=0x7f65740058d0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 msgr2=0x7f65801a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f657800e9d0 tx=0x7f657800ee90 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 shutdown_connections 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f65680b5410 0x7f65680b78d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f658010f200 0x7f65801a0a40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6580075e00 0x7f658019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 --2- 172.21.15.33:0/1355696439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65800754e0 0x7f658019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.324+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 >> 172.21.15.33:0/1355696439 conn(0x7f65800fe660 msgr2=0x7f65801113b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.325+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 shutdown_connections 2024-09-10T23:57:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:03.325+0000 7f6586200640 1 -- 172.21.15.33:0/1355696439 wait complete. 2024-09-10T23:57:03.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:03 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1355696439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:03.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:03 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1355696439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:03.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:03 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1355696439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:04 smithi052 ceph-mon[33526]: pgmap v445: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-10T23:57:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:04 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:04.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:04 smithi189 ceph-mon[34000]: pgmap v445: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-10T23:57:04.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:04 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:04 smithi033 ceph-mon[30593]: pgmap v445: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-10T23:57:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:04 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:57:04.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:53:56.754883+0000', 'modified': '2024-09-10T23:56:45.854905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34688, 'mds_1': 34649, 'mds_2': 34622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24622': {'gid': 24622, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3755759093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3755759093}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3755759093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/3553481852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 3553481852}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 3553481852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34595': {'gid': 34595, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/1634418949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 1634418949}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 1634418949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34622': {'gid': 34622, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 23, 'addr': '172.21.15.52:6835/3258065233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3258065233}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3258065233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34649': {'gid': 34649, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.52:6837/106203237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 106203237}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 106203237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34688': {'gid': 34688, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.52:6839/2315099444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 2315099444}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 2315099444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34688, 'qdb_cluster': [34622, 34649, 34688]} 2024-09-10T23:57:04.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T23:57:04.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T23:57:05.123 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-10T23:57:05.208 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-10T23:57:05.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-10T23:57:05.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T23:57:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/: 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:total 2 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 .. 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 data 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data: 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:05.413 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:05.414 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 .. 2024-09-10T23:57:05.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-10T23:57:05.561 INFO:teuthology.orchestra.run.smithi033.stdout:[Service] 2024-09-10T23:57:05.562 INFO:teuthology.orchestra.run.smithi033.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-10T23:57:05.562 INFO:teuthology.orchestra.run.smithi033.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-10T23:57:05.566 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-10T23:57:05.635 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:05.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:05.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:57:05.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:05.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:05.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:57:05.732 INFO:teuthology.orchestra.run.smithi033.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-10T23:57:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:57:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:57:05.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 -- 172.21.15.33:0/4155038188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7301087f0 msgr2=0x7fb730108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 --2- 172.21.15.33:0/4155038188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7301087f0 0x7fb730108c30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb718009900 tx=0x7fb71802a410 comp rx=0 tx=0).stop 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 -- 172.21.15.33:0/4155038188 shutdown_connections 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 --2- 172.21.15.33:0/4155038188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730109170 0x7fb73010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 --2- 172.21.15.33:0/4155038188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7301087f0 0x7fb730108c30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 --2- 172.21.15.33:0/4155038188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb730102de0 0x7fb7301031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 -- 172.21.15.33:0/4155038188 >> 172.21.15.33:0/4155038188 conn(0x7fb7300fe830 msgr2=0x7fb730100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 -- 172.21.15.33:0/4155038188 shutdown_connections 2024-09-10T23:57:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.108+0000 7fb734a00640 1 -- 172.21.15.33:0/4155038188 wait complete. 2024-09-10T23:57:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.109+0000 7fb734a00640 1 Processor -- start 2024-09-10T23:57:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.109+0000 7fb734a00640 1 -- start start 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730102de0 0x7fb73019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 0x7fb7301a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb730112d30 con 0x7fb730109170 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb730112bb0 con 0x7fb730102de0 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb734a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb730112eb0 con 0x7fb7301087f0 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb727e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb727e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51082/0 (socket says 172.21.15.33:51082) 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb727e00640 1 -- 172.21.15.33:0/1571022732 learned_addr learned my addr 172.21.15.33:0/1571022732 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.110+0000 7fb72de00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730102de0 0x7fb73019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb72e800640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 0x7fb7301a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 -- 172.21.15.33:0/1571022732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730102de0 msgr2=0x7fb73019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730102de0 0x7fb73019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 -- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 msgr2=0x7fb7301a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 0x7fb7301a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 -- 172.21.15.33:0/1571022732 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7301a14b0 con 0x7fb7301087f0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb72e800640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 0x7fb7301a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.111+0000 7fb727e00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb71802a930 tx=0x7fb718003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.112+0000 7fb726a00640 1 -- 172.21.15.33:0/1571022732 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71803f070 con 0x7fb7301087f0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.112+0000 7fb726a00640 1 -- 172.21.15.33:0/1571022732 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb71803baf0 con 0x7fb7301087f0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.112+0000 7fb726a00640 1 -- 172.21.15.33:0/1571022732 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718035030 con 0x7fb7301087f0 2024-09-10T23:57:06.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.112+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301a1740 con 0x7fb7301087f0 2024-09-10T23:57:06.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.112+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7301a7e60 con 0x7fb7301087f0 2024-09-10T23:57:06.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.115+0000 7fb7374c9740 1 Processor -- start 2024-09-10T23:57:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.115+0000 7fb7374c9740 1 -- start start 2024-09-10T23:57:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e62b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e63fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e6426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69e5a2d50 con 0x55b69e62b240 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b69e592180 con 0x55b69e62bb60 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb7374c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b69e595f90 con 0x55b69e640300 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb726a00640 1 -- 172.21.15.33:0/1571022732 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fb71803b660 con 0x7fb7301087f0 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb72e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e62b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb72de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e63fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb72de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e63fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53888/0 (socket says 172.21.15.33:53888) 2024-09-10T23:57:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.116+0000 7fb72de00640 1 -- 172.21.15.33:0/4144852195 learned_addr learned my addr 172.21.15.33:0/4144852195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:06.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 -- 172.21.15.33:0/4144852195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 msgr2=0x55b69e6426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e6426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 -- 172.21.15.33:0/4144852195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 msgr2=0x55b69e63fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e63fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 -- 172.21.15.33:0/4144852195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69e55ca70 con 0x55b69e62b240 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb72e800640 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e62b620 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb728009ec0 tx=0x7fb72800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4388ef06980d703 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.117+0000 7fb71f000640 1 -- 172.21.15.33:0/4144852195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728003b70 con 0x55b69e62b240 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.118+0000 7fb71f000640 1 -- 172.21.15.33:0/4144852195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb728003d10 con 0x55b69e62b240 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.118+0000 7fb71f000640 1 -- 172.21.15.33:0/4144852195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728011840 con 0x55b69e62b240 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.118+0000 7fb7374c9740 1 -- 172.21.15.33:0/4144852195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 msgr2=0x55b69e62b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.118+0000 7fb7374c9740 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e62b620 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb728009ec0 tx=0x7fb72800f730 comp rx=0 tx=0).stop 2024-09-10T23:57:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.118+0000 7fb726a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 0x7fb7140b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 -- 172.21.15.33:0/4144852195 shutdown_connections 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb726a00640 1 -- 172.21.15.33:0/1571022732 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb7181069c0 con 0x7fb7301087f0 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e6426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e63fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 --2- 172.21.15.33:0/4144852195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e62b620 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 -- 172.21.15.33:0/4144852195 >> 172.21.15.33:0/4144852195 conn(0x55b69e629020 msgr2=0x55b69e62a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb72de00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 0x7fb7140b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 -- 172.21.15.33:0/4144852195 shutdown_connections 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.119+0000 7fb7374c9740 1 -- 172.21.15.33:0/4144852195 wait complete. 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb72de00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 0x7fb7140b78b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b69e629f50 tx=0x7fb720005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 -- start start 2024-09-10T23:57:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 Processor -- start 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 0x55b69e635450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62bb60 0x55b69e63fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 0x55b69e635b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69e3f35f0 con 0x55b69e640300 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b69e52d460 con 0x55b69e62b240 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b69e631960 con 0x55b69e62bb60 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.120+0000 7fb7374c9740 10 client.0 _ll_register_callbacks cb 0x55b69e53d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.121+0000 7fb72e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 0x55b69e635b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.121+0000 7fb72de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 0x55b69e635450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.121+0000 7fb72e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 0x55b69e635b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48368/0 (socket says 172.21.15.33:48368) 2024-09-10T23:57:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.121+0000 7fb72e800640 1 -- 172.21.15.33:0/352360270 learned_addr learned my addr 172.21.15.33:0/352360270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.121+0000 7fb727e00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62bb60 0x55b69e63fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 -- 172.21.15.33:0/352360270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62bb60 msgr2=0x55b69e63fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62bb60 0x55b69e63fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 -- 172.21.15.33:0/352360270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 msgr2=0x55b69e635b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 0x55b69e635b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 -- 172.21.15.33:0/352360270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69e2f0540 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb72de00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 0x55b69e635450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb720012cb0 tx=0x7fb720004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1f111786ba55ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.122+0000 7fb713400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720009e40 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b69e52fa70 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb720018030 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb720004020 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb7374c9740 10 client.35306 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.123+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b69e54a6f0 con 0x55b69e62b240 2024-09-10T23:57:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b69e52fa70 con 0x55b69e62b240 2024-09-10T23:57:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb720004830 con 0x55b69e62b240 2024-09-10T23:57:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 10 client.35306 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 10 client.35306 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:57:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 20 client.35306 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6599c0 0x55b69e65ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 4 client.35306 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.124+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69e5a4ca0 con 0x55b69e6599c0 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.125+0000 7fb727e00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6599c0 0x55b69e65ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.125+0000 7fb727e00640 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6599c0 0x55b69e65ae30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17171e2f812161a server_cookie=b547f0adb6f76370 in_seq=0 out_seq=0 2024-09-10T23:57:06.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.125+0000 7fb713400640 10 client.35306 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.126+0000 7fb713400640 1 -- 172.21.15.33:0/352360270 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b69e5a4ca0 con 0x55b69e6599c0 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.126+0000 7fb713400640 10 client.35306 handle_command_reply: tid=0 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.126+0000 7fb7374c9740 1 client.35306 shutdown 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.126+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 msgr2=0x55b69e635450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.126+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 0x55b69e635450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb720012cb0 tx=0x7fb720004730 comp rx=0 tx=0).stop 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 shutdown_connections 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6599c0 0x55b69e65ae30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e640300 0x55b69e635b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62bb60 0x55b69e63fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 --2- 172.21.15.33:0/352360270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62b240 0x55b69e635450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 >> 172.21.15.33:0/352360270 conn(0x55b69e629020 msgr2=0x55b69e628140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb713400640 0 client.35306 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:57:06.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 shutdown_connections 2024-09-10T23:57:06.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.127+0000 7fb7374c9740 1 -- 172.21.15.33:0/352360270 wait complete. 2024-09-10T23:57:06.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.128+0000 7fb7374c9740 20 client.35306 trim_cache size 0 max 16384 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.162+0000 7fb7374c9740 1 Processor -- start 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.162+0000 7fb7374c9740 1 -- start start 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e632bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e658830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69e659170 con 0x55b69e62b240 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b69e659840 con 0x55b69e62bb60 2024-09-10T23:57:06.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb7374c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b69e659f10 con 0x55b69e640300 2024-09-10T23:57:06.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb72de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb72de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48384/0 (socket says 172.21.15.33:48384) 2024-09-10T23:57:06.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb72de00640 1 -- 172.21.15.33:0/1211293069 learned_addr learned my addr 172.21.15.33:0/1211293069 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb727e00640 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e632bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.163+0000 7fb72e800640 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e658830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 -- 172.21.15.33:0/1211293069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 msgr2=0x55b69e658830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e658830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 -- 172.21.15.33:0/1211293069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 msgr2=0x55b69e632bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e632bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 -- 172.21.15.33:0/1211293069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69e629d50 con 0x55b69e62b240 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb72de00640 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb720004cc0 tx=0x7fb720009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98c17fb52c8734f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.164+0000 7fb71e600640 1 -- 172.21.15.33:0/1211293069 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72003c020 con 0x55b69e62b240 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb71e600640 1 -- 172.21.15.33:0/1211293069 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb720009e40 con 0x55b69e62b240 2024-09-10T23:57:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb71e600640 1 -- 172.21.15.33:0/1211293069 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720003af0 con 0x55b69e62b240 2024-09-10T23:57:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 -- 172.21.15.33:0/1211293069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 msgr2=0x55b69e65a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb720004cc0 tx=0x7fb720009c50 comp rx=0 tx=0).stop 2024-09-10T23:57:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 -- 172.21.15.33:0/1211293069 shutdown_connections 2024-09-10T23:57:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e640300 0x55b69e658830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e62bb60 0x55b69e632bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1211293069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62b240 0x55b69e65a760 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.165+0000 7fb7374c9740 1 -- 172.21.15.33:0/1211293069 >> 172.21.15.33:0/1211293069 conn(0x55b69e629020 msgr2=0x55b69e640920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.166+0000 7fb7374c9740 1 -- 172.21.15.33:0/1211293069 shutdown_connections 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.166+0000 7fb7374c9740 1 -- 172.21.15.33:0/1211293069 wait complete. 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.166+0000 7fb7374c9740 1 -- start start 2024-09-10T23:57:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.166+0000 7fb7374c9740 1 Processor -- start 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62b240 0x55b69e663760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e640300 0x55b69e6608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69e65acb0 con 0x55b69e62bb60 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b69e65a5e0 con 0x55b69e640300 2024-09-10T23:57:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b69e65b380 con 0x55b69e62b240 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb7374c9740 10 client.0 _ll_register_callbacks cb 0x7fb72001e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb727e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb727e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48400/0 (socket says 172.21.15.33:48400) 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb727e00640 1 -- 172.21.15.33:0/1973001242 learned_addr learned my addr 172.21.15.33:0/1973001242 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb72de00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62b240 0x55b69e663760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.167+0000 7fb72e800640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e640300 0x55b69e6608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 -- 172.21.15.33:0/1973001242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62b240 msgr2=0x55b69e663760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62b240 0x55b69e663760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 -- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e640300 msgr2=0x55b69e6608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e640300 0x55b69e6608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 -- 172.21.15.33:0/1973001242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69e660fb0 con 0x55b69e62bb60 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb727e00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb718005820 tx=0x7fb71802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40a159133f77d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb713400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:06.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718049040 con 0x55b69e62bb60 2024-09-10T23:57:06.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb71803bca0 con 0x55b69e62bb60 2024-09-10T23:57:06.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.168+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb720009e40 con 0x55b69e62bb60 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb7180cc790 con 0x55b69e62bb60 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 10 client.15522 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b69e6c7230 con 0x55b69e62bb60 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb720009e40 con 0x55b69e62bb60 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb7180c8ef0 con 0x55b69e62bb60 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 10 client.15522 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 10 client.15522 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 20 client.15522 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6cbe30 0x55b69e6cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 4 client.15522 mds_command: new command op to 34622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.169+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 --> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] -- command(tid 0: {"prefix": "status"}) -- 0x55b69e5a0750 con 0x55b69e6cbe30 2024-09-10T23:57:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.170+0000 7fb72de00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6cbe30 0x55b69e6cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.170+0000 7fb72de00640 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6cbe30 0x55b69e6cab40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e25823a287d5e0d server_cookie=97eab50a047eda43 in_seq=0 out_seq=0 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.170+0000 7fb713400640 10 client.15522 ms_handle_connect on v2:172.21.15.52:6834/3258065233 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb713400640 1 -- 172.21.15.33:0/1973001242 <== mds.2 v2:172.21.15.52:6834/3258065233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b69e5a0750 con 0x55b69e6cbe30 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb713400640 10 client.15522 handle_command_reply: tid=0 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 client.15522 shutdown 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 msgr2=0x55b69e660380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb718005820 tx=0x7fb71802a410 comp rx=0 tx=0).stop 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 shutdown_connections 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:6834/3258065233,v1:172.21.15.52:6835/3258065233] conn(0x55b69e6cbe30 0x55b69e6cab40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b69e640300 0x55b69e6608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69e62bb60 0x55b69e660380 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 --2- 172.21.15.33:0/1973001242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b69e62b240 0x55b69e663760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 >> 172.21.15.33:0/1973001242 conn(0x55b69e629020 msgr2=0x55b69e658830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb713400640 0 client.15522 ms_handle_reset on v2:172.21.15.52:6834/3258065233 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 shutdown_connections 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 1 -- 172.21.15.33:0/1973001242 wait complete. 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.171+0000 7fb7374c9740 20 client.15522 trim_cache size 0 max 16384 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34622, 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:57:06.175 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 143.22593091300001, 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 26, 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 87, 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 228.34208460599999 2024-09-10T23:57:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 msgr2=0x7fb7140b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 0x7fb7140b78b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b69e629f50 tx=0x7fb720005f90 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 msgr2=0x7fb73019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb71802a930 tx=0x7fb718003b90 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 shutdown_connections 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7140b53f0 0x7fb7140b78b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb730109170 0x7fb7301a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7301087f0 0x7fb73019b940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 --2- 172.21.15.33:0/1571022732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb730102de0 0x7fb73019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.172+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 >> 172.21.15.33:0/1571022732 conn(0x7fb7300fe830 msgr2=0x7fb730104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.173+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 shutdown_connections 2024-09-10T23:57:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:06.173+0000 7fb734a00640 1 -- 172.21.15.33:0/1571022732 wait complete. 2024-09-10T23:57:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:06 smithi052 ceph-mon[33526]: pgmap v446: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T23:57:06.769 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:06 smithi033 ceph-mon[30593]: pgmap v446: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T23:57:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:06 smithi189 ceph-mon[34000]: pgmap v446: 129 pgs: 129 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T23:57:07.196 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T23:57:07.626 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.246+0000 7ff849200640 1 -- 172.21.15.33:0/528014067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 msgr2=0x7ff844111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.246+0000 7ff849200640 1 --2- 172.21.15.33:0/528014067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff844111610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009ca0 tx=0x7ff83c02a8b0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 -- 172.21.15.33:0/528014067 shutdown_connections 2024-09-10T23:57:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 --2- 172.21.15.33:0/528014067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff844111610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 --2- 172.21.15.33:0/528014067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff844075de0 0x7ff84410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 --2- 172.21.15.33:0/528014067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8440754c0 0x7ff8440758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 -- 172.21.15.33:0/528014067 >> 172.21.15.33:0/528014067 conn(0x7ff8440fe660 msgr2=0x7ff844100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 -- 172.21.15.33:0/528014067 shutdown_connections 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.247+0000 7ff849200640 1 -- 172.21.15.33:0/528014067 wait complete. 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 Processor -- start 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 -- start start 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff844075de0 0x7ff84419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff8441a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff844114d00 con 0x7ff84410f220 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff844114b80 con 0x7ff8440754c0 2024-09-10T23:57:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.248+0000 7ff849200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff844114e80 con 0x7ff844075de0 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53936/0 (socket says 172.21.15.33:53936) 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 -- 172.21.15.33:0/1375614359 learned_addr learned my addr 172.21.15.33:0/1375614359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843e00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff8441a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff83be00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff844075de0 0x7ff84419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 -- 172.21.15.33:0/1375614359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff844075de0 msgr2=0x7ff84419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff844075de0 0x7ff84419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 -- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 msgr2=0x7ff8441a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff8441a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843400640 1 -- 172.21.15.33:0/1375614359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441a1160 con 0x7ff8440754c0 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.249+0000 7ff843e00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff8441a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff843400640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c920 tx=0x7ff83400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff840c00640 1 -- 172.21.15.33:0/1375614359 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834007c70 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff840c00640 1 -- 172.21.15.33:0/1375614359 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff834007e10 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff840c00640 1 -- 172.21.15.33:0/1375614359 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834018710 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441a1450 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.250+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441a7b10 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.254+0000 7ff840c00640 1 -- 172.21.15.33:0/1375614359 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7ff83400f450 con 0x7ff8440754c0 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.254+0000 7ff84d283740 1 Processor -- start 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.254+0000 7ff84d283740 1 -- start start 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.254+0000 7ff84d283740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 0x55f374e057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.254+0000 7ff84d283740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05d20 0x55f374e11770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff84d283740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff84d283740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f374d7cd50 con 0x55f374e05400 2024-09-10T23:57:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff84d283740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f374d6c180 con 0x55f374e05d20 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff84d283740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f374d6ff90 con 0x55f374e11cb0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff843e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 0x55f374e057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff843e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 0x55f374e057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48434/0 (socket says 172.21.15.33:48434) 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff843e00640 1 -- 172.21.15.33:0/2989525715 learned_addr learned my addr 172.21.15.33:0/2989525715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff83be00640 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff843400640 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05d20 0x55f374e11770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff83be00640 1 -- 172.21.15.33:0/2989525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05d20 msgr2=0x55f374e11770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.255+0000 7ff83be00640 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05d20 0x55f374e11770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff83be00640 1 -- 172.21.15.33:0/2989525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 msgr2=0x55f374e057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff83be00640 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 0x55f374e057e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff83be00640 1 -- 172.21.15.33:0/2989525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f374d36a70 con 0x55f374e11cb0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff83be00640 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e140a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009c20 tx=0x7ff82c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d3d42fd4d04e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff840c00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 0x7ff8280b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff838c00640 1 -- 172.21.15.33:0/2989525715 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004050 con 0x55f374e11cb0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff840c00640 1 -- 172.21.15.33:0/1375614359 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff8340e6360 con 0x7ff8440754c0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff838c00640 1 -- 172.21.15.33:0/2989525715 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff82c005020 con 0x55f374e11cb0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff838c00640 1 -- 172.21.15.33:0/2989525715 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004ba0 con 0x55f374e11cb0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.256+0000 7ff843e00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 0x7ff8280b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.257+0000 7ff84d283740 1 -- 172.21.15.33:0/2989525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 msgr2=0x55f374e140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.257+0000 7ff84d283740 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e140a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009c20 tx=0x7ff82c011810 comp rx=0 tx=0).stop 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.257+0000 7ff843e00640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 0x7ff8280b78d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009a60 tx=0x7ff83c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 -- 172.21.15.33:0/2989525715 shutdown_connections 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e140a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05d20 0x55f374e11770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 --2- 172.21.15.33:0/2989525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05400 0x55f374e057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 -- 172.21.15.33:0/2989525715 >> 172.21.15.33:0/2989525715 conn(0x55f374e03230 msgr2=0x55f374e043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 -- 172.21.15.33:0/2989525715 shutdown_connections 2024-09-10T23:57:08.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 -- 172.21.15.33:0/2989525715 wait complete. 2024-09-10T23:57:08.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 -- start start 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.258+0000 7ff84d283740 1 Processor -- start 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e05400 0x55f374e0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e11cb0 0x55f374e0f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f374bcd5f0 con 0x55f374e05d20 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f374d07460 con 0x55f374e11cb0 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f374e14a00 con 0x55f374e05400 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff84d283740 10 client.0 _ll_register_callbacks cb 0x55f374d17210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.259+0000 7ff843e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e11cb0 0x55f374e0f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48448/0 (socket says 172.21.15.33:48448) 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 -- 172.21.15.33:0/336266980 learned_addr learned my addr 172.21.15.33:0/336266980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff843400640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e05400 0x55f374e0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 -- 172.21.15.33:0/336266980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e05400 msgr2=0x55f374e0ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e05400 0x55f374e0ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 -- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e11cb0 msgr2=0x55f374e0f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e11cb0 0x55f374e0f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.260+0000 7ff83be00640 1 -- 172.21.15.33:0/336266980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f374aca540 con 0x55f374e05d20 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff83be00640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff82c01b040 tx=0x7ff82c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df4fc86660b28f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff831600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c027020 con 0x55f374e05d20 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff82c003c20 con 0x55f374e05d20 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f374d09a70 con 0x55f374e05d20 2024-09-10T23:57:08.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff82c032050 con 0x55f374e05d20 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff84d283740 10 client.15534 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.261+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f374d246f0 con 0x55f374e05d20 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f374d09a70 con 0x55f374e05d20 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff82c023c20 con 0x55f374e05d20 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 10 client.15534 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 10 client.15534 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 20 client.15534 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e22860 0x55f374e23cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 4 client.15534 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.262+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f374d7eca0 con 0x55f374e22860 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.263+0000 7ff843400640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e22860 0x55f374e23cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.263+0000 7ff843400640 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e22860 0x55f374e23cd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a452a237c91044 server_cookie=97176701267bf176 in_seq=0 out_seq=0 2024-09-10T23:57:08.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.263+0000 7ff831600640 10 client.15534 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff831600640 1 -- 172.21.15.33:0/336266980 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f374d7eca0 con 0x55f374e22860 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff831600640 10 client.15534 handle_command_reply: tid=0 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff84d283740 1 client.15534 shutdown 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 msgr2=0x55f374e0f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff82c01b040 tx=0x7ff82c003820 comp rx=0 tx=0).stop 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 shutdown_connections 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.264+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e22860 0x55f374e23cd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e11cb0 0x55f374e0f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e0f1f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 --2- 172.21.15.33:0/336266980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e05400 0x55f374e0ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 >> 172.21.15.33:0/336266980 conn(0x55f374e03230 msgr2=0x55f374e08dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff831600640 0 client.15534 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 shutdown_connections 2024-09-10T23:57:08.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 1 -- 172.21.15.33:0/336266980 wait complete. 2024-09-10T23:57:08.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.265+0000 7ff84d283740 20 client.15534 trim_cache size 0 max 16384 2024-09-10T23:57:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 Processor -- start 2024-09-10T23:57:08.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 -- start start 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e21860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e0bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f374e22010 con 0x55f374e05d20 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f374e226e0 con 0x55f374e05400 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff84d283740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f374e22db0 con 0x55f374e11cb0 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48460/0 (socket says 172.21.15.33:48460) 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.288+0000 7ff83be00640 1 -- 172.21.15.33:0/4236254384 learned_addr learned my addr 172.21.15.33:0/4236254384 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:08.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff843400640 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e21860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 -- 172.21.15.33:0/4236254384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 msgr2=0x55f374e0bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e0bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 -- 172.21.15.33:0/4236254384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 msgr2=0x55f374e21860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e21860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 -- 172.21.15.33:0/4236254384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f374dfe8c0 con 0x55f374e05d20 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff83be00640 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82c019430 tx=0x7ff82c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf9f3f99e1ae99f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.289+0000 7ff833e00640 1 -- 172.21.15.33:0/4236254384 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c027070 con 0x55f374e05d20 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff833e00640 1 -- 172.21.15.33:0/4236254384 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff82c015020 con 0x55f374e05d20 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff833e00640 1 -- 172.21.15.33:0/4236254384 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0052a0 con 0x55f374e05d20 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 -- 172.21.15.33:0/4236254384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 msgr2=0x55f374e095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82c019430 tx=0x7ff82c011810 comp rx=0 tx=0).stop 2024-09-10T23:57:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 -- 172.21.15.33:0/4236254384 shutdown_connections 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e0bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e095c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 --2- 172.21.15.33:0/4236254384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e21860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.290+0000 7ff84d283740 1 -- 172.21.15.33:0/4236254384 >> 172.21.15.33:0/4236254384 conn(0x55f374e03230 msgr2=0x55f374e0d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.291+0000 7ff84d283740 1 -- 172.21.15.33:0/4236254384 shutdown_connections 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.291+0000 7ff84d283740 1 -- 172.21.15.33:0/4236254384 wait complete. 2024-09-10T23:57:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.291+0000 7ff84d283740 1 -- start start 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.291+0000 7ff84d283740 1 Processor -- start 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e2c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e25ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f374e23b50 con 0x55f374e05d20 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f374e23480 con 0x55f374e05400 2024-09-10T23:57:08.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f374e24220 con 0x55f374e11cb0 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff84d283740 10 client.0 _ll_register_callbacks cb 0x7ff82c009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff843400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e2c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48466/0 (socket says 172.21.15.33:48466) 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff83be00640 1 -- 172.21.15.33:0/882150793 learned_addr learned my addr 172.21.15.33:0/882150793 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.292+0000 7ff843e00640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e25ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 -- 172.21.15.33:0/882150793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 msgr2=0x55f374e25ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e25ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 -- 172.21.15.33:0/882150793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 msgr2=0x55f374e25ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 -- 172.21.15.33:0/882150793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f374e266e0 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff83be00640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff843400640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e2c5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8340e3910 tx=0x7ff8340ac450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04215914426728c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff831600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.293+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8340e6150 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff8340a8830 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82c015020 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff8340ac0d0 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 10 client.35330 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f374e8f1a0 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff82c015020 con 0x55f374e05400 2024-09-10T23:57:08.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff8340e3b60 con 0x55f374e05400 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 10 client.35330 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 10 client.35330 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 20 client.35330 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e93c20 0x55f374e92930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 4 client.35330 mds_command: new command op to 34649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.294+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 --> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] -- command(tid 0: {"prefix": "status"}) -- 0x55f374d7a750 con 0x55f374e93c20 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.295+0000 7ff83be00640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e93c20 0x55f374e92930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.295+0000 7ff83be00640 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e93c20 0x55f374e92930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9497aa8090196e9b server_cookie=2cb0bfe35d4b5f0 in_seq=0 out_seq=0 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.295+0000 7ff831600640 10 client.35330 ms_handle_connect on v2:172.21.15.52:6836/106203237 2024-09-10T23:57:08.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff831600640 1 -- 172.21.15.33:0/882150793 <== mds.1 v2:172.21.15.52:6836/106203237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f374d7a750 con 0x55f374e93c20 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff831600640 10 client.35330 handle_command_reply: tid=0 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 client.35330 shutdown 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 msgr2=0x55f374e2c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e2c5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8340e3910 tx=0x7ff8340ac450 comp rx=0 tx=0).stop 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 shutdown_connections 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:6836/106203237,v1:172.21.15.52:6837/106203237] conn(0x55f374e93c20 0x55f374e92930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f374e11cb0 0x55f374e25ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f374e05d20 0x55f374e25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 --2- 172.21.15.33:0/882150793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f374e05400 0x55f374e2c5e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 >> 172.21.15.33:0/882150793 conn(0x55f374e03230 msgr2=0x55f374e102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff831600640 0 client.35330 ms_handle_reset on v2:172.21.15.52:6836/106203237 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 shutdown_connections 2024-09-10T23:57:08.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 1 -- 172.21.15.33:0/882150793 wait complete. 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.296+0000 7ff84d283740 20 client.35330 trim_cache size 0 max 16384 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34649, 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:57:08.301 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 146.35751738900001, 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 26, 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 87, 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 219.80038485599999 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:57:08.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 msgr2=0x7ff8280b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 0x7ff8280b78d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009a60 tx=0x7ff83c005ef0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 msgr2=0x7ff84419b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c920 tx=0x7ff83400cde0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 shutdown_connections 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff8280b5410 0x7ff8280b78d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84410f220 0x7ff8441a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff844075de0 0x7ff84419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 --2- 172.21.15.33:0/1375614359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8440754c0 0x7ff84419b0b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.297+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 >> 172.21.15.33:0/1375614359 conn(0x7ff8440fe660 msgr2=0x7ff844111340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.298+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 shutdown_connections 2024-09-10T23:57:08.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:08.298+0000 7ff849200640 1 -- 172.21.15.33:0/1375614359 wait complete. 2024-09-10T23:57:08.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:08 smithi033 ceph-mon[30593]: pgmap v447: 129 pgs: 129 active+clean; 800 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T23:57:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:08 smithi189 ceph-mon[34000]: pgmap v447: 129 pgs: 129 active+clean; 800 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T23:57:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:08 smithi052 ceph-mon[33526]: pgmap v447: 129 pgs: 129 active+clean; 800 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-10T23:57:09.247 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T23:57:09.714 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 -- 172.21.15.33:0/2534050597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c102c10 msgr2=0x7fe43c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 --2- 172.21.15.33:0/2534050597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c102c10 0x7fe43c102ff0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009900 tx=0x7fe42c02a400 comp rx=0 tx=0).stop 2024-09-10T23:57:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 -- 172.21.15.33:0/2534050597 shutdown_connections 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 --2- 172.21.15.33:0/2534050597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe43c108fa0 0x7fe43c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 --2- 172.21.15.33:0/2534050597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c108620 0x7fe43c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 --2- 172.21.15.33:0/2534050597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c102c10 0x7fe43c102ff0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 -- 172.21.15.33:0/2534050597 >> 172.21.15.33:0/2534050597 conn(0x7fe43c0fe660 msgr2=0x7fe43c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 -- 172.21.15.33:0/2534050597 shutdown_connections 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.404+0000 7fe440a00640 1 -- 172.21.15.33:0/2534050597 wait complete. 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.405+0000 7fe440a00640 1 Processor -- start 2024-09-10T23:57:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.405+0000 7fe440a00640 1 -- start start 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c108620 0x7fe43c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe43c108fa0 0x7fe43c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c112b20 con 0x7fe43c108620 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1129a0 con 0x7fe43c102c10 2024-09-10T23:57:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe440a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c112ca0 con 0x7fe43c108fa0 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe43a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe439e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c108620 0x7fe43c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe43a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53966/0 (socket says 172.21.15.33:53966) 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.406+0000 7fe43a800640 1 -- 172.21.15.33:0/3158135562 learned_addr learned my addr 172.21.15.33:0/3158135562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 -- 172.21.15.33:0/3158135562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe43c108fa0 msgr2=0x7fe43c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe43c108fa0 0x7fe43c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 -- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c108620 msgr2=0x7fe43c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c108620 0x7fe43c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 -- 172.21.15.33:0/3158135562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c1a7370 con 0x7fe43c102c10 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.407+0000 7fe43a800640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02a920 tx=0x7fe42c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.408+0000 7fe433400640 1 -- 172.21.15.33:0/3158135562 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c03f070 con 0x7fe43c102c10 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.408+0000 7fe433400640 1 -- 172.21.15.33:0/3158135562 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe42c03baf0 con 0x7fe43c102c10 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.408+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c1a7600 con 0x7fe43c102c10 2024-09-10T23:57:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.408+0000 7fe433400640 1 -- 172.21.15.33:0/3158135562 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c035030 con 0x7fe43c102c10 2024-09-10T23:57:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.408+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c1a7b30 con 0x7fe43c102c10 2024-09-10T23:57:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.411+0000 7fe443fea740 1 Processor -- start 2024-09-10T23:57:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 -- start start 2024-09-10T23:57:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe433400640 1 -- 172.21.15.33:0/3158135562 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fe42c03b660 con 0x7fe43c102c10 2024-09-10T23:57:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 0x5631fa6b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 0x5631fa6c0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5631fa62bd50 con 0x5631fa6b4400 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5631fa61b180 con 0x5631fa6b4d20 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe443fea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631fa61ef90 con 0x5631fa6c0cb0 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe43b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 0x5631fa6b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe43a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 0x5631fa6c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.412+0000 7fe43b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 0x5631fa6b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48484/0 (socket says 172.21.15.33:48484) 2024-09-10T23:57:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe439e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe439e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51236/0 (socket says 172.21.15.33:51236) 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43b200640 1 -- 172.21.15.33:0/3485136807 learned_addr learned my addr 172.21.15.33:0/3485136807 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43a800640 1 -- 172.21.15.33:0/3485136807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 msgr2=0x5631fa6c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43a800640 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43a800640 1 -- 172.21.15.33:0/3485136807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 msgr2=0x5631fa6b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43a800640 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 0x5631fa6b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe43a800640 1 -- 172.21.15.33:0/3485136807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa5e5a70 con 0x5631fa6b4d20 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.413+0000 7fe439e00640 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.414+0000 7fe43a800640 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 0x5631fa6c0770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe42c103fe0 tx=0x7fe42c10aa90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f358a16ab257a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.414+0000 7fe427400640 1 -- 172.21.15.33:0/3485136807 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c11a070 con 0x5631fa6b4d20 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.414+0000 7fe427400640 1 -- 172.21.15.33:0/3485136807 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe42c10faa0 con 0x5631fa6b4d20 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.414+0000 7fe427400640 1 -- 172.21.15.33:0/3485136807 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c115ae0 con 0x5631fa6b4d20 2024-09-10T23:57:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.414+0000 7fe433400640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 0x7fe4200b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe433400640 1 -- 172.21.15.33:0/3158135562 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe42c1069d0 con 0x7fe43c102c10 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe43b200640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 0x7fe4200b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 -- 172.21.15.33:0/3485136807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 msgr2=0x5631fa6c0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 0x5631fa6c0770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe42c103fe0 tx=0x7fe42c10aa90 comp rx=0 tx=0).stop 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 -- 172.21.15.33:0/3485136807 shutdown_connections 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4d20 0x5631fa6c0770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 --2- 172.21.15.33:0/3485136807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4400 0x5631fa6b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 -- 172.21.15.33:0/3485136807 >> 172.21.15.33:0/3485136807 conn(0x5631fa6b2230 msgr2=0x5631fa6b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 -- 172.21.15.33:0/3485136807 shutdown_connections 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.415+0000 7fe443fea740 1 -- 172.21.15.33:0/3485136807 wait complete. 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.416+0000 7fe43b200640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 0x7fe4200b7950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe434011490 tx=0x7fe434009990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.416+0000 7fe443fea740 1 -- start start 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.416+0000 7fe443fea740 1 Processor -- start 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6be710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5631fa47c5f0 con 0x5631fa6b4d20 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5631fa5b6460 con 0x5631fa6b4400 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6c3720 con 0x5631fa6c0cb0 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe443fea740 10 client.0 _ll_register_callbacks cb 0x5631fa5c6210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe439e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe439e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6be1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48488/0 (socket says 172.21.15.33:48488) 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe439e00640 1 -- 172.21.15.33:0/2987044771 learned_addr learned my addr 172.21.15.33:0/2987044771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.417+0000 7fe43a800640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43b200640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 -- 172.21.15.33:0/2987044771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 msgr2=0x5631fa6be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6be710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 -- 172.21.15.33:0/2987044771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 msgr2=0x5631fa6be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6be1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 -- 172.21.15.33:0/2987044771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa379540 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe43a800640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6bdc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0c9f00 tx=0x7fe42c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4925034b9563e7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe41be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.418+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c049030 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631fa5b8a70 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe42c03bca0 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe42c0c92e0 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 10 client.35342 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5631fa5d36f0 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5631fa5b8a70 con 0x5631fa6b4400 2024-09-10T23:57:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe42c0d13f0 con 0x5631fa6b4400 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 10 client.35342 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 10 client.35342 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 20 client.35342 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa6d1420 0x5631fa6d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 4 client.35342 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.419+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631fa62dca0 con 0x5631fa6d1420 2024-09-10T23:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.420+0000 7fe439e00640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa6d1420 0x5631fa6d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.421+0000 7fe439e00640 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa6d1420 0x5631fa6d2890 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d32c1c329d3cf16 server_cookie=c67468a96f38598d in_seq=0 out_seq=0 2024-09-10T23:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.421+0000 7fe41be00640 10 client.35342 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe41be00640 1 -- 172.21.15.33:0/2987044771 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631fa62dca0 con 0x5631fa6d1420 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe41be00640 10 client.35342 handle_command_reply: tid=0 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 client.35342 shutdown 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 msgr2=0x5631fa6bdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6bdc90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0c9f00 tx=0x7fe42c0057c0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 shutdown_connections 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa6d1420 0x5631fa6d2890 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 --2- 172.21.15.33:0/2987044771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6bdc90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 >> 172.21.15.33:0/2987044771 conn(0x5631fa6b2230 msgr2=0x5631fa6b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe41be00640 0 client.35342 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 shutdown_connections 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.422+0000 7fe443fea740 1 -- 172.21.15.33:0/2987044771 wait complete. 2024-09-10T23:57:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.423+0000 7fe443fea740 20 client.35342 trim_cache size 0 max 16384 2024-09-10T23:57:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 Processor -- start 2024-09-10T23:57:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 -- start start 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 0x5631fa6baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 0x5631fa6bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d0bd0 con 0x5631fa6c0cb0 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d12a0 con 0x5631fa6b4400 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.447+0000 7fe443fea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d1970 con 0x5631fa6b4d20 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54008/0 (socket says 172.21.15.33:54008) 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 -- 172.21.15.33:0/2820090539 learned_addr learned my addr 172.21.15.33:0/2820090539 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe439e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 0x5631fa6baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43b200640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 0x5631fa6bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 -- 172.21.15.33:0/2820090539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 msgr2=0x5631fa6baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 0x5631fa6baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 -- 172.21.15.33:0/2820090539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 msgr2=0x5631fa6bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 0x5631fa6bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 -- 172.21.15.33:0/2820090539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa6ad8c0 con 0x5631fa6b4400 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe439e00640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 0x5631fa6baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43b200640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 0x5631fa6bb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.448+0000 7fe43a800640 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe42c10a920 tx=0x7fe42c02a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed240865fcdd86c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.449+0000 7fe426a00640 1 -- 172.21.15.33:0/2820090539 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c049020 con 0x5631fa6b4400 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.449+0000 7fe426a00640 1 -- 172.21.15.33:0/2820090539 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe42c0cbcf0 con 0x5631fa6b4400 2024-09-10T23:57:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.449+0000 7fe426a00640 1 -- 172.21.15.33:0/2820090539 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0c8400 con 0x5631fa6b4400 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- 172.21.15.33:0/2820090539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 msgr2=0x5631fa6d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe42c10a920 tx=0x7fe42c02a400 comp rx=0 tx=0).stop 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- 172.21.15.33:0/2820090539 shutdown_connections 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6c0cb0 0x5631fa6bb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6b4d20 0x5631fa6baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 --2- 172.21.15.33:0/2820090539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6d1420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- 172.21.15.33:0/2820090539 >> 172.21.15.33:0/2820090539 conn(0x5631fa6b2230 msgr2=0x5631fa6bc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- 172.21.15.33:0/2820090539 shutdown_connections 2024-09-10T23:57:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- 172.21.15.33:0/2820090539 wait complete. 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.450+0000 7fe443fea740 1 -- start start 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 Processor -- start 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6db350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d2710 con 0x5631fa6b4d20 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d2040 con 0x5631fa6b4400 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631fa6d2de0 con 0x5631fa6c0cb0 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe443fea740 10 client.0 _ll_register_callbacks cb 0x7fe42c10a850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe439e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe439e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48508/0 (socket says 172.21.15.33:48508) 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe439e00640 1 -- 172.21.15.33:0/109570332 learned_addr learned my addr 172.21.15.33:0/109570332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe43b200640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.451+0000 7fe43a800640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 -- 172.21.15.33:0/109570332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 msgr2=0x5631fa6d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6d4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 -- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 msgr2=0x5631fa6db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6db350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 -- 172.21.15.33:0/109570332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa6d5610 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe43a800640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe439e00640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5631fa6d30c0 tx=0x7fe4280204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff3a9110bf34666 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.452+0000 7fe41be00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428028020 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe428010630 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631fa629750 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe428033050 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe443fea740 10 client.15558 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5631fa73dee0 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.453+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5631fa629750 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe428024880 con 0x5631fa6b4d20 2024-09-10T23:57:10.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 10 client.15558 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 10 client.15558 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:57:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 20 client.15558 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa742b60 0x5631fa741870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 4 client.15558 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:57:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "status"}) -- 0x5631fa626b80 con 0x5631fa742b60 2024-09-10T23:57:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.454+0000 7fe43a800640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa742b60 0x5631fa741870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.455+0000 7fe43a800640 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa742b60 0x5631fa741870 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d147b590b0a6d46d server_cookie=cb1352c816f5a69b in_seq=0 out_seq=0 2024-09-10T23:57:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.455+0000 7fe41be00640 10 client.15558 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe41be00640 1 -- 172.21.15.33:0/109570332 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5631fa626b80 con 0x5631fa742b60 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe41be00640 10 client.15558 handle_command_reply: tid=0 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 client.15558 shutdown 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 msgr2=0x5631fa6d4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5631fa6d30c0 tx=0x7fe4280204d0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 shutdown_connections 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5631fa742b60 0x5631fa741870 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631fa6c0cb0 0x5631fa6d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5631fa6b4d20 0x5631fa6d4820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 --2- 172.21.15.33:0/109570332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631fa6b4400 0x5631fa6db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 >> 172.21.15.33:0/109570332 conn(0x5631fa6b2230 msgr2=0x5631fa6cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe41be00640 0 client.15558 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.456+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 shutdown_connections 2024-09-10T23:57:10.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.457+0000 7fe443fea740 1 -- 172.21.15.33:0/109570332 wait complete. 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.457+0000 7fe443fea740 20 client.15558 trim_cache size 0 max 16384 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "63242646-6fce-11ef-bcea-c7b262605968", 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 34688, 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-09-10T23:57:10.461 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 192.71699523800001, 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 26, 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 87, 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 87, 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 206.24697739999999 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.458+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 msgr2=0x7fe4200b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.458+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 0x7fe4200b7950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe434011490 tx=0x7fe434009990 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.458+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 msgr2=0x7fe43c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.458+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02a920 tx=0x7fe42c003b90 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 shutdown_connections 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4200b5490 0x7fe4200b7950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe43c108fa0 0x7fe43c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe43c108620 0x7fe43c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 --2- 172.21.15.33:0/3158135562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe43c102c10 0x7fe43c0754a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 >> 172.21.15.33:0/3158135562 conn(0x7fe43c0fe660 msgr2=0x7fe43c100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 shutdown_connections 2024-09-10T23:57:10.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:10.459+0000 7fe440a00640 1 -- 172.21.15.33:0/3158135562 wait complete. 2024-09-10T23:57:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:10 smithi033 ceph-mon[30593]: pgmap v448: 129 pgs: 129 active+clean; 840 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-10T23:57:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:10 smithi189 ceph-mon[34000]: pgmap v448: 129 pgs: 129 active+clean; 840 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-10T23:57:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:10 smithi052 ceph-mon[33526]: pgmap v448: 129 pgs: 129 active+clean; 840 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-10T23:57:11.445 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-10T23:57:12.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:12 smithi033 ceph-mon[30593]: pgmap v449: 129 pgs: 129 active+clean; 18 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-09-10T23:57:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:12 smithi189 ceph-mon[34000]: pgmap v449: 129 pgs: 129 active+clean; 18 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-09-10T23:57:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:12 smithi052 ceph-mon[33526]: pgmap v449: 129 pgs: 129 active+clean; 18 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.6 MiB/s wr, 20 op/s 2024-09-10T23:57:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.746+0000 7f4058600640 1 -- 172.21.15.33:0/4215975229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050104b80 msgr2=0x7f4050104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.746+0000 7f4058600640 1 --2- 172.21.15.33:0/4215975229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050104b80 0x7f4050104f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4044009890 tx=0x7f404402a360 comp rx=0 tx=0).stop 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 -- 172.21.15.33:0/4215975229 shutdown_connections 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 --2- 172.21.15.33:0/4215975229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 0x7f405010d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 --2- 172.21.15.33:0/4215975229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050105cd0 0x7f4050106150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 --2- 172.21.15.33:0/4215975229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050104b80 0x7f4050104f80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 -- 172.21.15.33:0/4215975229 >> 172.21.15.33:0/4215975229 conn(0x7f4050100440 msgr2=0x7f4050102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 -- 172.21.15.33:0/4215975229 shutdown_connections 2024-09-10T23:57:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.747+0000 7f4058600640 1 -- 172.21.15.33:0/4215975229 wait complete. 2024-09-10T23:57:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.748+0000 7f4058600640 1 Processor -- start 2024-09-10T23:57:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.748+0000 7f4058600640 1 -- start start 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 0x7f405019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 0x7f405019c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4050110680 con 0x7f4050104b80 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4050110500 con 0x7f4050106690 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4058600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4050110800 con 0x7f4050105cd0 2024-09-10T23:57:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4055200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4055c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 0x7f405019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4055200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38002/0 (socket says 172.21.15.33:38002) 2024-09-10T23:57:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4056600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 0x7f405019c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.749+0000 7f4055200640 1 -- 172.21.15.33:0/2116531407 learned_addr learned my addr 172.21.15.33:0/2116531407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 -- 172.21.15.33:0/2116531407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 msgr2=0x7f405019c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 0x7f405019c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 -- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 msgr2=0x7f405019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 0x7f405019aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 -- 172.21.15.33:0/2116531407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405019ca00 con 0x7f4050105cd0 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055c00640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 0x7f405019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4055200640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9f0 tx=0x7f403c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f404e000640 1 -- 172.21.15.33:0/2116531407 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c00cd80 con 0x7f4050105cd0 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.750+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405019ccf0 con 0x7f4050105cd0 2024-09-10T23:57:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.751+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40501a33c0 con 0x7f4050105cd0 2024-09-10T23:57:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.751+0000 7f404e000640 1 -- 172.21.15.33:0/2116531407 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f403c0108c0 con 0x7f4050105cd0 2024-09-10T23:57:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.751+0000 7f404e000640 1 -- 172.21.15.33:0/2116531407 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c018840 con 0x7f4050105cd0 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.754+0000 7f405b410740 1 Processor -- start 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.754+0000 7f405b410740 1 -- start start 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fb64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fb8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562cd9f136b0 con 0x562cd9fb17a0 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562cd9f02ae0 con 0x562cd9fb6b10 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f405b410740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562cd9f068f0 con 0x562cd9fb40d0 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f4056600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f404e000640 1 -- 172.21.15.33:0/2116531407 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f403c0189e0 con 0x7f4050105cd0 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f4056600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54190/0 (socket says 172.21.15.33:54190) 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f4056600640 1 -- 172.21.15.33:0/811750439 learned_addr learned my addr 172.21.15.33:0/811750439 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.755+0000 7f4055c00640 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fb64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 -- 172.21.15.33:0/811750439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 msgr2=0x562cd9fb64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fb64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 -- 172.21.15.33:0/811750439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 msgr2=0x562cd9fb8fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fb8fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 -- 172.21.15.33:0/811750439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd9ecf780 con 0x562cd9fb17a0 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4056600640 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4048009a40 tx=0x7f40480095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7891b1dce82344cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4042a00640 1 -- 172.21.15.33:0/811750439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404800d8b0 con 0x562cd9fb17a0 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4042a00640 1 -- 172.21.15.33:0/811750439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f404801c070 con 0x562cd9fb17a0 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.756+0000 7f4042a00640 1 -- 172.21.15.33:0/811750439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048016380 con 0x562cd9fb17a0 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f404e000640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 0x7f40380b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 -- 172.21.15.33:0/811750439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 msgr2=0x562cd9fb3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4048009a40 tx=0x7f40480095c0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 -- 172.21.15.33:0/811750439 shutdown_connections 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fb8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fb64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 --2- 172.21.15.33:0/811750439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fb3b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 -- 172.21.15.33:0/811750439 >> 172.21.15.33:0/811750439 conn(0x562cd9f9b8e0 msgr2=0x562cd9f9c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f404e000640 1 -- 172.21.15.33:0/2116531407 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f403c0e63c0 con 0x7f4050105cd0 2024-09-10T23:57:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f405b410740 1 -- 172.21.15.33:0/811750439 shutdown_connections 2024-09-10T23:57:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.757+0000 7f4055c00640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 0x7f40380b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.758+0000 7f405b410740 1 -- 172.21.15.33:0/811750439 wait complete. 2024-09-10T23:57:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.758+0000 7f405b410740 1 -- start start 2024-09-10T23:57:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.758+0000 7f405b410740 1 Processor -- start 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.758+0000 7f4055c00640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 0x7f40380b78b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4044009860 tx=0x7f4044005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fbb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fbc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562cd9e3aab0 con 0x562cd9fb17a0 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562cd9ea9570 con 0x562cd9fb6b10 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562cd9fb9af0 con 0x562cd9fb40d0 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f405b410740 10 client.0 _ll_register_callbacks cb 0x562cd9eb8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f4055c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f4055c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54200/0 (socket says 172.21.15.33:54200) 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f4055c00640 1 -- 172.21.15.33:0/3106338206 learned_addr learned my addr 172.21.15.33:0/3106338206 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f4056600640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fbc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.759+0000 7f4055200640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fbb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 -- 172.21.15.33:0/3106338206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 msgr2=0x562cd9fbb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fbb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 -- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 msgr2=0x562cd9fbc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fbc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 -- 172.21.15.33:0/3106338206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd9c64790 con 0x562cd9fb17a0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055200640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fbb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4056600640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fbc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4055c00640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4044009250 tx=0x7f404402a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9ddceb81b0bc68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4037400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404404e030 con 0x562cd9fb17a0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4044004250 con 0x562cd9fb17a0 2024-09-10T23:57:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f404801c070 con 0x562cd9fb17a0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f404405b050 con 0x562cd9fb17a0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f405b410740 10 client.15570 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.760+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cd9cdd620 con 0x562cd9fb17a0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f404801c070 con 0x562cd9fb17a0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4044003780 con 0x562cd9fb17a0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 10 client.15570 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 20 client.15570 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cd9fc6930 0x562cd9fc8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 4 client.15570 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cd9f15600 con 0x562cd9fc6930 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.761+0000 7f4055200640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cd9fc6930 0x562cd9fc8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.762+0000 7f4055200640 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cd9fc6930 0x562cd9fc8d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8676c125a35d141 server_cookie=c8ffd1b4024518b2 in_seq=0 out_seq=0 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.762+0000 7f4037400640 10 client.15570 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f4037400640 1 -- 172.21.15.33:0/3106338206 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cd9f15600 con 0x562cd9fc6930 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f4037400640 10 client.15570 handle_command_reply: tid=0 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 client.15570 shutdown 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 msgr2=0x562cd9fbafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4044009250 tx=0x7f404402a360 comp rx=0 tx=0).stop 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 shutdown_connections 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb6b10 0x562cd9fbc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cd9fc6930 0x562cd9fc8d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb40d0 0x562cd9fbb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 --2- 172.21.15.33:0/3106338206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb17a0 0x562cd9fbafb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.763+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 >> 172.21.15.33:0/3106338206 conn(0x562cd9f9b8e0 msgr2=0x562cd9fb44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.764+0000 7f4037400640 0 client.15570 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.764+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 shutdown_connections 2024-09-10T23:57:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.764+0000 7f405b410740 1 -- 172.21.15.33:0/3106338206 wait complete. 2024-09-10T23:57:13.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.764+0000 7f405b410740 20 client.15570 trim_cache size 0 max 16384 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.785+0000 7f405b410740 1 Processor -- start 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.785+0000 7f405b410740 1 -- start start 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fbad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9f9c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4030012490 con 0x562cd9fb6b10 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f403000fd60 con 0x562cd9fb40d0 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f405b410740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f403000dbb0 con 0x562cd9fb17a0 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4056600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9f9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36540/0 (socket says 172.21.15.33:36540) 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fbad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 -- 172.21.15.33:0/934838887 learned_addr learned my addr 172.21.15.33:0/934838887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 -- 172.21.15.33:0/934838887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 msgr2=0x562cd9fbad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fbad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 -- 172.21.15.33:0/934838887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 msgr2=0x562cd9f9c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9f9c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.786+0000 7f4055200640 1 -- 172.21.15.33:0/934838887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd9fb3f00 con 0x562cd9fb40d0 2024-09-10T23:57:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.787+0000 7f4055200640 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f403c0ac3d0 tx=0x7f403c0a8da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8d0a7877258d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.787+0000 7f4042000640 1 -- 172.21.15.33:0/934838887 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c0e6180 con 0x562cd9fb40d0 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.787+0000 7f4042000640 1 -- 172.21.15.33:0/934838887 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f403c0b5bb0 con 0x562cd9fb40d0 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.787+0000 7f4042000640 1 -- 172.21.15.33:0/934838887 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c0b5720 con 0x562cd9fb40d0 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- 172.21.15.33:0/934838887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 msgr2=0x562cd9f9c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f403c0ac3d0 tx=0x7f403c0a8da0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- 172.21.15.33:0/934838887 shutdown_connections 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9f9c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9f9c140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 --2- 172.21.15.33:0/934838887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fbad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- 172.21.15.33:0/934838887 >> 172.21.15.33:0/934838887 conn(0x562cd9f9b8e0 msgr2=0x562cd9f9fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- 172.21.15.33:0/934838887 shutdown_connections 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- 172.21.15.33:0/934838887 wait complete. 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.788+0000 7f405b410740 1 -- start start 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 Processor -- start 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fc1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9fc2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f403000e220 con 0x562cd9fb6b10 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f403000f690 con 0x562cd9fb40d0 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f403000e8f0 con 0x562cd9fb17a0 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f405b410740 10 client.0 _ll_register_callbacks cb 0x7f4044042050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f4056600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.789+0000 7f4055c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fc1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4055200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9fc2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4055c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fc1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38026/0 (socket says 172.21.15.33:38026) 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54208/0 (socket says 172.21.15.33:54208) 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4055c00640 1 -- 172.21.15.33:0/3985789861 learned_addr learned my addr 172.21.15.33:0/3985789861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 -- 172.21.15.33:0/3985789861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 msgr2=0x562cd9fc1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fc1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 -- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 msgr2=0x562cd9fc2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9fc2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 -- 172.21.15.33:0/3985789861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd9fc08d0 con 0x562cd9fb6b10 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4056600640 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4048010010 tx=0x7f4048003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5316aaeaa0794c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4037400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048017420 con 0x562cd9fb6b10 2024-09-10T23:57:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.790+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f403c0b5bb0 con 0x562cd9fb6b10 2024-09-10T23:57:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f40480175c0 con 0x562cd9fb6b10 2024-09-10T23:57:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4048035050 con 0x562cd9fb6b10 2024-09-10T23:57:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f405b410740 10 client.15576 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:13.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cda033e10 con 0x562cd9fb6b10 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f403c0b5bb0 con 0x562cd9fb6b10 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.791+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f404800b040 con 0x562cd9fb6b10 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 10 client.15576 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 20 client.15576 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cda0345b0 0x562cda0369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 4 client.15576 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562cd9f110b0 con 0x562cda0345b0 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.792+0000 7f4055c00640 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cda0345b0 0x562cda0369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.793+0000 7f4055c00640 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cda0345b0 0x562cda0369d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b24b1a19f819c53 server_cookie=e4e05c3ff8132768 in_seq=0 out_seq=0 2024-09-10T23:57:13.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:13.793+0000 7f4037400640 10 client.15576 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.141+0000 7f4037400640 1 -- 172.21.15.33:0/3985789861 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562cd9f110b0 con 0x562cda0345b0 2024-09-10T23:57:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.141+0000 7f4037400640 10 client.15576 handle_command_reply: tid=0 2024-09-10T23:57:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 client.15576 shutdown 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 msgr2=0x562cd9fc2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4048010010 tx=0x7f4048003ba0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 shutdown_connections 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562cd9fb6b10 0x562cd9fc2680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562cd9fb40d0 0x562cd9fc2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562cda0345b0 0x562cda0369d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 --2- 172.21.15.33:0/3985789861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cd9fb17a0 0x562cd9fc1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f4037400640 0 client.15576 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.142+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 >> 172.21.15.33:0/3985789861 conn(0x562cd9f9b8e0 msgr2=0x562cd9f9fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.143+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 shutdown_connections 2024-09-10T23:57:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.143+0000 7f405b410740 1 -- 172.21.15.33:0/3985789861 wait complete. 2024-09-10T23:57:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.143+0000 7f405b410740 20 client.15576 trim_cache size 0 max 16384 2024-09-10T23:57:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:57:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:57:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:57:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 msgr2=0x7f40380b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 0x7f40380b78b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4044009860 tx=0x7f4044005c90 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 msgr2=0x7f405019b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f403c00e9f0 tx=0x7f403c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 shutdown_connections 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40380b53f0 0x7f40380b78b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4050106690 0x7f405019c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4050105cd0 0x7f405019b510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 --2- 172.21.15.33:0/2116531407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4050104b80 0x7f405019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 >> 172.21.15.33:0/2116531407 conn(0x7f4050100440 msgr2=0x7f4050109140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:14.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 shutdown_connections 2024-09-10T23:57:14.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:14.144+0000 7f4058600640 1 -- 172.21.15.33:0/2116531407 wait complete. 2024-09-10T23:57:14.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:14 smithi052 ceph-mon[33526]: pgmap v450: 129 pgs: 129 active+clean; 23 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 40 op/s 2024-09-10T23:57:14.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:14 smithi033 ceph-mon[30593]: pgmap v450: 129 pgs: 129 active+clean; 23 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 40 op/s 2024-09-10T23:57:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:14 smithi189 ceph-mon[34000]: pgmap v450: 129 pgs: 129 active+clean; 23 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.0 MiB/s wr, 40 op/s 2024-09-10T23:57:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:16 smithi033 ceph-mon[30593]: pgmap v451: 129 pgs: 129 active+clean; 24 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.2 MiB/s wr, 61 op/s 2024-09-10T23:57:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:16 smithi189 ceph-mon[34000]: pgmap v451: 129 pgs: 129 active+clean; 24 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.2 MiB/s wr, 61 op/s 2024-09-10T23:57:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:16 smithi052 ceph-mon[33526]: pgmap v451: 129 pgs: 129 active+clean; 24 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.2 MiB/s wr, 61 op/s 2024-09-10T23:57:18.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:18 smithi033 ceph-mon[30593]: pgmap v452: 129 pgs: 129 active+clean; 35 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.6 MiB/s wr, 186 op/s 2024-09-10T23:57:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:18 smithi189 ceph-mon[34000]: pgmap v452: 129 pgs: 129 active+clean; 35 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.6 MiB/s wr, 186 op/s 2024-09-10T23:57:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:18 smithi052 ceph-mon[33526]: pgmap v452: 129 pgs: 129 active+clean; 35 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.6 MiB/s wr, 186 op/s 2024-09-10T23:57:20.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:20 smithi033 ceph-mon[30593]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2024-09-10T23:57:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:20 smithi189 ceph-mon[34000]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2024-09-10T23:57:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:20 smithi052 ceph-mon[33526]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2024-09-10T23:57:22.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:22 smithi033 ceph-mon[30593]: pgmap v454: 129 pgs: 129 active+clean; 40 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 4.5 MiB/s wr, 235 op/s 2024-09-10T23:57:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:22 smithi189 ceph-mon[34000]: pgmap v454: 129 pgs: 129 active+clean; 40 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 4.5 MiB/s wr, 235 op/s 2024-09-10T23:57:22.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:22 smithi052 ceph-mon[33526]: pgmap v454: 129 pgs: 129 active+clean; 40 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 4.5 MiB/s wr, 235 op/s 2024-09-10T23:57:24.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:24 smithi033 ceph-mon[30593]: pgmap v455: 129 pgs: 129 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-10T23:57:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:24 smithi189 ceph-mon[34000]: pgmap v455: 129 pgs: 129 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-10T23:57:24.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:24 smithi052 ceph-mon[33526]: pgmap v455: 129 pgs: 129 active+clean; 44 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2024-09-10T23:57:25.757 INFO:teuthology.orchestra.run.smithi033.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-10T23:57:25.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T23:57:26.428 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/: 2024-09-10T23:57:26.428 INFO:teuthology.orchestra.run.smithi033.stdout:total 2 2024-09-10T23:57:26.428 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 . 2024-09-10T23:57:26.428 INFO:teuthology.orchestra.run.smithi033.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:26.428 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 data 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data: 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:total 45 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 . 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 10 23:57 base 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 10 23:57 global 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 log 2024-09-10T23:57:26.429 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_commit_ts 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_dynshmem 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 23:57 pg_hba.conf 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 23:57 pg_ident.conf 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 23:57 pg_logical 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 pg_multixact 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_notify 2024-09-10T23:57:26.430 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_replslot 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_serial 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_snapshots 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_stat 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_stat_tmp 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 pg_subtrans 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_tblspc 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_twophase 2024-09-10T23:57:26.431 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 23:57 pg_wal 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 pg_xact 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 23:57 postgresql.auto.conf 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 23:57 postgresql.conf 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base: 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:total 3 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 10 23:57 . 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 1 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 13493 2024-09-10T23:57:26.432 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 13494 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:total 7778 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 . 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 10 23:57 .. 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 1247 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1247_vm 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 23:57 1249 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1249_fsm 2024-09-10T23:57:26.433 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1249_vm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 1259 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1259_vm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-10T23:57:26.434 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-10T23:57:26.435 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-10T23:57:26.436 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2579 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-10T23:57:26.437 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606_vm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 23:57 2608 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2608_vm 2024-09-10T23:57:26.438 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2610 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2610_vm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-10T23:57:26.439 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 23:57 2619 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2619_fsm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2619_vm 2024-09-10T23:57:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 23:57 2658 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 2659 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2662 2024-09-10T23:57:26.441 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2663 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2664 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2665 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2666 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2667 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 23:57 2673 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 23:57 2674 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2678 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2679 2024-09-10T23:57:26.442 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-10T23:57:26.443 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2696 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2703 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2704 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-10T23:57:26.444 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-10T23:57:26.445 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-10T23:57:26.446 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-10T23:57:26.447 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3455 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-10T23:57:26.448 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-10T23:57:26.449 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-10T23:57:26.450 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-10T23:57:26.451 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-10T23:57:26.452 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-10T23:57:26.453 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-10T23:57:26.454 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-09-10T23:57:26.454 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:57:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:26 smithi033 ceph-mon[30593]: pgmap v456: 129 pgs: 129 active+clean; 44 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-10T23:57:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:26 smithi189 ceph-mon[34000]: pgmap v456: 129 pgs: 129 active+clean; 44 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-10T23:57:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:26.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:26 smithi052 ceph-mon[33526]: pgmap v456: 129 pgs: 129 active+clean; 44 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-10T23:57:27.051 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-10T23:57:27.052 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:total 7778 2024-09-10T23:57:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 . 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 10 23:57 .. 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 1247 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1247_vm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 23:57 1249 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1249_fsm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1249_vm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-10T23:57:27.054 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 1259 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1259_vm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-10T23:57:27.055 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-10T23:57:27.056 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2579 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-10T23:57:27.057 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606_vm 2024-09-10T23:57:27.058 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 23:57 2608 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2608_vm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2610 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2610_vm 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-10T23:57:27.059 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-10T23:57:27.060 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 23:57 2619 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2619_fsm 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2619_vm 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-10T23:57:27.061 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 23:57 2658 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 2659 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2662 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2663 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2664 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2665 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2666 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2667 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-10T23:57:27.062 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 23:57 2673 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 23:57 2674 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2678 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2679 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-10T23:57:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2696 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-10T23:57:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2703 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2704 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-10T23:57:27.065 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-10T23:57:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-10T23:57:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-10T23:57:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3455 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-10T23:57:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-10T23:57:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-10T23:57:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-10T23:57:27.072 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-10T23:57:27.072 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-10T23:57:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-10T23:57:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-10T23:57:27.075 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 -- 172.21.15.33:0/2718440854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 msgr2=0x7f9450105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 --2- 172.21.15.33:0/2718440854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f9450105f80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f943c009930 tx=0x7f943c02a420 comp rx=0 tx=0).stop 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 -- 172.21.15.33:0/2718440854 shutdown_connections 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 --2- 172.21.15.33:0/2718440854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94501064c0 0x7f945010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 --2- 172.21.15.33:0/2718440854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f9450105f80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 --2- 172.21.15.33:0/2718440854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 0x7f9450104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 -- 172.21.15.33:0/2718440854 >> 172.21.15.33:0/2718440854 conn(0x7f9450100250 msgr2=0x7f9450102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.293+0000 7f944f200640 1 -- 172.21.15.33:0/2718440854 shutdown_connections 2024-09-10T23:57:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.294+0000 7f944f200640 1 -- 172.21.15.33:0/2718440854 wait complete. 2024-09-10T23:57:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 Processor -- start 2024-09-10T23:57:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 -- start start 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 0x7f945019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94501064c0 0x7f945019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9450110500 con 0x7f9450105b00 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9450110380 con 0x7f94501049b0 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9450110680 con 0x7f94501064c0 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48014/0 (socket says 172.21.15.33:48014) 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.295+0000 7f944d400640 1 -- 172.21.15.33:0/44520451 learned_addr learned my addr 172.21.15.33:0/44520451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944de00640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 0x7f945019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 -- 172.21.15.33:0/44520451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94501064c0 msgr2=0x7f945019bf40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:57:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94501064c0 0x7f945019bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 -- 172.21.15.33:0/44520451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 msgr2=0x7f945019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 0x7f945019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 -- 172.21.15.33:0/44520451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945019c800 con 0x7f9450105b00 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.296+0000 7f944d400640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f943c031460 tx=0x7f943c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.297+0000 7f9446a00640 1 -- 172.21.15.33:0/44520451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c03f070 con 0x7f9450105b00 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.297+0000 7f9446a00640 1 -- 172.21.15.33:0/44520451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f943c031ba0 con 0x7f9450105b00 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.297+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945019ca90 con 0x7f9450105b00 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.297+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94501a31c0 con 0x7f9450105b00 2024-09-10T23:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.297+0000 7f9446a00640 1 -- 172.21.15.33:0/44520451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c035030 con 0x7f9450105b00 2024-09-10T23:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.300+0000 7f945820e740 1 Processor -- start 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 -- start start 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c5eb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55638c5566b0 con 0x55638c5e8ce0 2024-09-10T23:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55638c545ae0 con 0x55638c5e3970 2024-09-10T23:57:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f945820e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55638c5498f0 con 0x55638c5e62a0 2024-09-10T23:57:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.301+0000 7f9446a00640 1 -- 172.21.15.33:0/44520451 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f943c03bc90 con 0x7f9450105b00 2024-09-10T23:57:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42596/0 (socket says 172.21.15.33:42596) 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 -- 172.21.15.33:0/107905160 learned_addr learned my addr 172.21.15.33:0/107905160 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944d400640 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c5eb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 -- 172.21.15.33:0/107905160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 msgr2=0x55638c5e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 -- 172.21.15.33:0/107905160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 msgr2=0x55638c5eb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c5eb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 -- 172.21.15.33:0/107905160 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638c512780 con 0x55638c5e62a0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.302+0000 7f944de00640 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9440009cf0 tx=0x7f9440011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ae3c596b42ff2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.303+0000 7f943b400640 1 -- 172.21.15.33:0/107905160 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440004230 con 0x55638c5e62a0 2024-09-10T23:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.303+0000 7f943b400640 1 -- 172.21.15.33:0/107905160 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94400043d0 con 0x55638c5e62a0 2024-09-10T23:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.303+0000 7f943b400640 1 -- 172.21.15.33:0/107905160 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440019750 con 0x55638c5e62a0 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.303+0000 7f9446a00640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 0x7f94340b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f9446a00640 1 -- 172.21.15.33:0/44520451 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f943c106ed0 con 0x7f9450105b00 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 -- 172.21.15.33:0/107905160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 msgr2=0x55638c5e8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9440009cf0 tx=0x7f9440011810 comp rx=0 tx=0).stop 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f944e800640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 0x7f94340b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 -- 172.21.15.33:0/107905160 shutdown_connections 2024-09-10T23:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c5eb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e62a0 0x55638c5e8690 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 --2- 172.21.15.33:0/107905160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 -- 172.21.15.33:0/107905160 >> 172.21.15.33:0/107905160 conn(0x55638c5deac0 msgr2=0x55638c5df850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 -- 172.21.15.33:0/107905160 shutdown_connections 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.304+0000 7f945820e740 1 -- 172.21.15.33:0/107905160 wait complete. 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.305+0000 7f945820e740 1 -- start start 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.305+0000 7f944e800640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 0x7f94340b78b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f945019ba40 tx=0x7f9448009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.305+0000 7f945820e740 1 Processor -- start 2024-09-10T23:57:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.306+0000 7f945820e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.306+0000 7f945820e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c5fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f945820e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e8ce0 0x55638c5ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f945820e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55638c47dab0 con 0x55638c5e62a0 2024-09-10T23:57:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f945820e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55638c4ec570 con 0x55638c5e3970 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f945820e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55638c5fccd0 con 0x55638c5e8ce0 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f945820e740 10 client.0 _ll_register_callbacks cb 0x55638c4fb100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c5fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43200/0 (socket says 172.21.15.33:43200) 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 -- 172.21.15.33:0/1454052523 learned_addr learned my addr 172.21.15.33:0/1454052523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944e800640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e8ce0 0x55638c5ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 -- 172.21.15.33:0/1454052523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e8ce0 msgr2=0x55638c5ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e8ce0 0x55638c5ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 -- 172.21.15.33:0/1454052523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 msgr2=0x55638c5fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c5fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.307+0000 7f944de00640 1 -- 172.21.15.33:0/1454052523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638c2a7790 con 0x55638c5e3970 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.308+0000 7f944de00640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5efa7aeda181f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.308+0000 7f942fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.308+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440027070 con 0x55638c5e3970 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.308+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94400043d0 con 0x55638c5e3970 2024-09-10T23:57:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.308+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9440005240 con 0x55638c5e3970 2024-09-10T23:57:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.309+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9440033050 con 0x55638c5e3970 2024-09-10T23:57:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.309+0000 7f945820e740 10 client.35375 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.309+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55638c320620 con 0x55638c5e3970 2024-09-10T23:57:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.309+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94400043d0 con 0x55638c5e3970 2024-09-10T23:57:27.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9440004b50 con 0x55638c5e3970 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 10 client.35375 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 10 client.35375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 20 client.35375 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c6097c0 0x55638c60bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 4 client.35375 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55638c558600 con 0x55638c6097c0 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.310+0000 7f944d400640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c6097c0 0x55638c60bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.311+0000 7f944d400640 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c6097c0 0x55638c60bbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51064315a0563ca server_cookie=b2cc1bef214e24ad in_seq=0 out_seq=0 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.311+0000 7f942fe00640 10 client.35375 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.312+0000 7f942fe00640 1 -- 172.21.15.33:0/1454052523 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55638c558600 con 0x55638c6097c0 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.312+0000 7f942fe00640 10 client.35375 handle_command_reply: tid=0 2024-09-10T23:57:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.312+0000 7f945820e740 1 client.35375 shutdown 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.312+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 msgr2=0x55638c5fe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.312+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440003820 comp rx=0 tx=0).stop 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 shutdown_connections 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c6097c0 0x55638c60bbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f942fe00640 0 client.35375 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e8ce0 0x55638c5ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c5fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 --2- 172.21.15.33:0/1454052523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e3970 0x55638c5fe0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 >> 172.21.15.33:0/1454052523 conn(0x55638c5deac0 msgr2=0x55638c5ddbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 shutdown_connections 2024-09-10T23:57:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 1 -- 172.21.15.33:0/1454052523 wait complete. 2024-09-10T23:57:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.313+0000 7f945820e740 20 client.35375 trim_cache size 0 max 16384 2024-09-10T23:57:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 Processor -- start 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 -- start start 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c5e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 0x55638c5e2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9430012440 con 0x55638c5e8ce0 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f943000fd10 con 0x55638c5e62a0 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f945820e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f943000db60 con 0x55638c5e3970 2024-09-10T23:57:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f944e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.333+0000 7f944e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48046/0 (socket says 172.21.15.33:48046) 2024-09-10T23:57:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944e800640 1 -- 172.21.15.33:0/3294886790 learned_addr learned my addr 172.21.15.33:0/3294886790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944d400640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 0x55638c5e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c5e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 -- 172.21.15.33:0/3294886790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 msgr2=0x55638c5e2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 0x55638c5e2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 -- 172.21.15.33:0/3294886790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 msgr2=0x55638c6104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 -- 172.21.15.33:0/3294886790 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638c5da460 con 0x55638c5e3970 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944e800640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944d400640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 0x55638c5e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.334+0000 7f944de00640 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c5e1b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3395e5779dc13341 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.335+0000 7f943aa00640 1 -- 172.21.15.33:0/3294886790 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440030020 con 0x55638c5e3970 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.335+0000 7f943aa00640 1 -- 172.21.15.33:0/3294886790 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9440005b90 con 0x55638c5e3970 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.335+0000 7f943aa00640 1 -- 172.21.15.33:0/3294886790 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440027070 con 0x55638c5e3970 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- 172.21.15.33:0/3294886790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 msgr2=0x55638c5e1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c5e1b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c00 tx=0x7f9440011810 comp rx=0 tx=0).stop 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- 172.21.15.33:0/3294886790 shutdown_connections 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e8ce0 0x55638c6104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e62a0 0x55638c5e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 --2- 172.21.15.33:0/3294886790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c5e1b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- 172.21.15.33:0/3294886790 >> 172.21.15.33:0/3294886790 conn(0x55638c5deac0 msgr2=0x55638c5e2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- 172.21.15.33:0/3294886790 shutdown_connections 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- 172.21.15.33:0/3294886790 wait complete. 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 -- start start 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.336+0000 7f945820e740 1 Processor -- start 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c605ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e8ce0 0x55638c604d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f943000e1d0 con 0x55638c5e62a0 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f943000f640 con 0x55638c5e8ce0 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f943000e8a0 con 0x55638c5e3970 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f945820e740 10 client.0 _ll_register_callbacks cb 0x7f94480094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f944d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f944d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48052/0 (socket says 172.21.15.33:48052) 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f944d400640 1 -- 172.21.15.33:0/2716290937 learned_addr learned my addr 172.21.15.33:0/2716290937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.337+0000 7f944de00640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c605ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944e800640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e8ce0 0x55638c604d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 -- 172.21.15.33:0/2716290937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 msgr2=0x55638c605ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c605ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 -- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e8ce0 msgr2=0x55638c604d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e8ce0 0x55638c604d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 -- 172.21.15.33:0/2716290937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638c605450 con 0x55638c5e62a0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f944d400640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f943c1044b0 tx=0x7f943c0d4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b72a02a5718cc10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f942fe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c049040 con 0x55638c5e62a0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.338+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f943c1046d0 con 0x55638c5e62a0 2024-09-10T23:57:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9440005b90 con 0x55638c5e62a0 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f943c0b6e60 con 0x55638c5e62a0 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 10 client.15594 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55638c6766c0 con 0x55638c5e62a0 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9440005b90 con 0x55638c5e62a0 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f943c03b460 con 0x55638c5e62a0 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 10 client.15594 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 20 client.15594 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:27.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c677020 0x55638c679440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 4 client.15594 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:57:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.339+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55638c5540b0 con 0x55638c677020 2024-09-10T23:57:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.340+0000 7f944de00640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c677020 0x55638c679440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.341+0000 7f942fe00640 10 client.15594 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.341+0000 7f944de00640 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c677020 0x55638c679440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ca27084c68aaf99 server_cookie=3865c7b6629edb67 in_seq=0 out_seq=0 2024-09-10T23:57:27.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.614+0000 7f498d600640 1 -- 172.21.15.33:0/1633029564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 msgr2=0x7f4988108c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.614+0000 7f498d600640 1 --2- 172.21.15.33:0/1633029564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f4988108c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4978009860 tx=0x7f497802a340 comp rx=0 tx=0).stop 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 -- 172.21.15.33:0/1633029564 shutdown_connections 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 --2- 172.21.15.33:0/1633029564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f498810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 --2- 172.21.15.33:0/1633029564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f4988108c00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 --2- 172.21.15.33:0/1633029564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 0x7f4988103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 -- 172.21.15.33:0/1633029564 >> 172.21.15.33:0/1633029564 conn(0x7f49880fe800 msgr2=0x7f4988100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 -- 172.21.15.33:0/1633029564 shutdown_connections 2024-09-10T23:57:27.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.615+0000 7f498d600640 1 -- 172.21.15.33:0/1633029564 wait complete. 2024-09-10T23:57:27.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.616+0000 7f498d600640 1 Processor -- start 2024-09-10T23:57:27.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.616+0000 7f498d600640 1 -- start start 2024-09-10T23:57:27.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 0x7f498819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f49881a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4988114ea0 con 0x7f4988109140 2024-09-10T23:57:27.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4988114d20 con 0x7f4988102db0 2024-09-10T23:57:27.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f942fe00640 1 -- 172.21.15.33:0/2716290937 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55638c5540b0 con 0x55638c677020 2024-09-10T23:57:27.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f942fe00640 10 client.15594 handle_command_reply: tid=0 2024-09-10T23:57:27.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f945820e740 1 client.15594 shutdown 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f498d600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4988115020 con 0x7f49881087c0 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f4986000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f4987400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f49881a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f4986000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42654/0 (socket says 172.21.15.33:42654) 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.617+0000 7f4986000640 1 -- 172.21.15.33:0/3277392480 learned_addr learned my addr 172.21.15.33:0/3277392480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 -- 172.21.15.33:0/3277392480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 msgr2=0x7f498819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986a00640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 0x7f498819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 0x7f498819b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 -- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 msgr2=0x7f49881a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f49881a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 -- 172.21.15.33:0/3277392480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49881a14e0 con 0x7f49881087c0 2024-09-10T23:57:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4987400640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f49881a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.618+0000 7f4986000640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f49780057c0 tx=0x7f497802ae60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 msgr2=0x55638c6047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f943c1044b0 tx=0x7f943c0d4f90 comp rx=0 tx=0).stop 2024-09-10T23:57:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978037040 con 0x7f49881087c0 2024-09-10T23:57:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4978030c70 con 0x7f49881087c0 2024-09-10T23:57:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49780035f0 con 0x7f49881087c0 2024-09-10T23:57:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49881a1770 con 0x7f49881087c0 2024-09-10T23:57:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 shutdown_connections 2024-09-10T23:57:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55638c5e8ce0 0x55638c604d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55638c5e62a0 0x55638c6047d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55638c677020 0x55638c679440 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 --2- 172.21.15.33:0/2716290937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55638c5e3970 0x55638c605ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.623 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 >> 172.21.15.33:0/2716290937 conn(0x55638c5deac0 msgr2=0x55638c5e29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.619+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49881a7e90 con 0x7f49881087c0 2024-09-10T23:57:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.620+0000 7f942fe00640 0 client.15594 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.620+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 shutdown_connections 2024-09-10T23:57:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.620+0000 7f945820e740 1 -- 172.21.15.33:0/2716290937 wait complete. 2024-09-10T23:57:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.620+0000 7f945820e740 20 client.15594 trim_cache size 0 max 16384 2024-09-10T23:57:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:57:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:57:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:57:27.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:57:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4988103190 con 0x7f49881087c0 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 msgr2=0x7f94340b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 0x7f94340b78b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f945019ba40 tx=0x7f9448009580 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 msgr2=0x7f945019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f943c031460 tx=0x7f943c003c10 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 shutdown_connections 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94340b53f0 0x7f94340b78b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f94501064c0 0x7f945019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9450105b00 0x7f945019b310 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 --2- 172.21.15.33:0/44520451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94501049b0 0x7f945019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 >> 172.21.15.33:0/44520451 conn(0x7f9450100250 msgr2=0x7f9450108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 shutdown_connections 2024-09-10T23:57:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:27.621+0000 7f944f200640 1 -- 172.21.15.33:0/44520451 wait complete. 2024-09-10T23:57:27.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.624+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f4978004050 con 0x7f49881087c0 2024-09-10T23:57:27.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.625+0000 7f497f400640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 0x7f496c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:27.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.625+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4978105540 con 0x7f49881087c0 2024-09-10T23:57:27.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.626+0000 7f4986a00640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 0x7f496c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:27.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.627+0000 7f4986a00640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 0x7f496c0b78b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4980005fd0 tx=0x7f4980009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.630+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f497804a060 con 0x7f49881087c0 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-10T23:57:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-10T23:57:27.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:total 7778 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 . 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 10 23:57 .. 2024-09-10T23:57:27.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 1247 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1247_vm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 23:57 1249 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1249_fsm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1249_vm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 1259 2024-09-10T23:57:27.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1259_vm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-10T23:57:27.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-10T23:57:27.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2579 2024-09-10T23:57:27.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-10T23:57:27.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606_vm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-10T23:57:27.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 23:57 2608 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2608_vm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2610 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2610_vm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-10T23:57:27.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-10T23:57:27.798 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 23:57 2619 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2619_fsm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2619_vm 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-10T23:57:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 23:57 2658 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 2659 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-10T23:57:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2662 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2663 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2664 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2665 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2666 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2667 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-10T23:57:27.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 23:57 2673 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 23:57 2674 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2678 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2679 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-10T23:57:27.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-10T23:57:27.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2696 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2703 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2704 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-10T23:57:27.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-10T23:57:27.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-10T23:57:27.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-10T23:57:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-10T23:57:27.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3455 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-10T23:57:27.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-10T23:57:27.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-10T23:57:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-10T23:57:27.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-10T23:57:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-10T23:57:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-10T23:57:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-10T23:57:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-10T23:57:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-10T23:57:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-10T23:57:27.904 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-10T23:57:27.905 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/global: 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:total 538 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 10 23:57 . 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1213 2024-09-10T23:57:27.906 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1213_fsm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1213_vm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1214 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1214_fsm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1214_vm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 1232 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 1233 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1260 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1260_fsm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1260_vm 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1261 2024-09-10T23:57:27.907 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1261_fsm 2024-09-10T23:57:27.908 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1261_vm 2024-09-10T23:57:27.908 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1262 2024-09-10T23:57:27.908 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1262_fsm 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1262_vm 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2396 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2396_fsm 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2396_vm 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2397 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2671 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2672 2024-09-10T23:57:27.910 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2676 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2677 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2694 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2695 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2697 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2698 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2846 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2847 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2964 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2965 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2966 2024-09-10T23:57:27.911 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2967 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3592 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3593 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4060 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4061 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4175 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4176 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4177 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4178 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4181 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4182 2024-09-10T23:57:27.912 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4183 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4184 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4185 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4186 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6000 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6001 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6002 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6100 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6114 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6115 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 pg_control 2024-09-10T23:57:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-10T23:57:27.914 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:27.914 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/log: 2024-09-10T23:57:27.914 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:27.914 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:27.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.945+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f498810af50 con 0x7f49881087c0 2024-09-10T23:57:27.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.946+0000 7f497f400640 1 -- 172.21.15.33:0/3277392480 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f4978004370 con 0x7f49881087c0 2024-09-10T23:57:27.948 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:27.948 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:57:27.948 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 msgr2=0x7f496c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 0x7f496c0b78b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4980005fd0 tx=0x7f4980009500 comp rx=0 tx=0).stop 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 msgr2=0x7f498819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f49780057c0 tx=0x7f497802ae60 comp rx=0 tx=0).stop 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 shutdown_connections 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f496c0b53f0 0x7f496c0b78b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4988109140 0x7f49881a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49881087c0 0x7f498819b970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 --2- 172.21.15.33:0/3277392480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4988102db0 0x7f498819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 >> 172.21.15.33:0/3277392480 conn(0x7f49880fe800 msgr2=0x7f4988100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 shutdown_connections 2024-09-10T23:57:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:27.949+0000 7f498d600640 1 -- 172.21.15.33:0/3277392480 wait complete. 2024-09-10T23:57:28.015 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.015 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-10T23:57:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:total 3 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 23:57 . 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 mappings 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 23:57 replorigin_checkpoint 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 snapshots 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 23:57 .. 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.017 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 23:57 .. 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:total 2 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 . 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 members 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 offsets 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.018 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 .. 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 0000 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 .. 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 0000 2024-09-10T23:57:28.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.020 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.022 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 0000 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:total 16386 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 23:57 . 2024-09-10T23:57:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 23:57 000000010000000000000001 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 archive_status 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 23:57 .. 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 10 23:57 .. 2024-09-10T23:57:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 0000 2024-09-10T23:57:28.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-10T23:57:28.362 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-10T23:57:28.502 INFO:teuthology.orchestra.run.smithi033.stderr:dropping old tables... 2024-09-10T23:57:28.510 INFO:teuthology.orchestra.run.smithi033.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-10T23:57:28.510 INFO:teuthology.orchestra.run.smithi033.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-10T23:57:28.510 INFO:teuthology.orchestra.run.smithi033.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-10T23:57:28.510 INFO:teuthology.orchestra.run.smithi033.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-10T23:57:28.510 INFO:teuthology.orchestra.run.smithi033.stderr:creating tables... 2024-09-10T23:57:28.576 INFO:teuthology.orchestra.run.smithi033.stderr:generating data (client-side)... 2024-09-10T23:57:28.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:28 smithi033 ceph-mon[30593]: pgmap v457: 129 pgs: 129 active+clean; 48 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 3.1 MiB/s wr, 264 op/s 2024-09-10T23:57:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:28 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3277392480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:28 smithi189 ceph-mon[34000]: pgmap v457: 129 pgs: 129 active+clean; 48 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 3.1 MiB/s wr, 264 op/s 2024-09-10T23:57:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:28 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3277392480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:28 smithi052 ceph-mon[33526]: pgmap v457: 129 pgs: 129 active+clean; 48 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 3.1 MiB/s wr, 264 op/s 2024-09-10T23:57:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:28 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3277392480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:28.969 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0' 2024-09-10T23:57:28.970 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0 2024-09-10T23:57:29.401 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:29.459 INFO:teuthology.orchestra.run.smithi033.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.84 s, remaining 26.15 s) 2024-09-10T23:57:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 -- 172.21.15.33:0/3410390904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10b350 msgr2=0x7ff03c111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 --2- 172.21.15.33:0/3410390904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10b350 0x7ff03c111b50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff034009ca0 tx=0x7ff03402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 -- 172.21.15.33:0/3410390904 shutdown_connections 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 --2- 172.21.15.33:0/3410390904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10b350 0x7ff03c111b50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 --2- 172.21.15.33:0/3410390904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c10a9d0 0x7ff03c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 --2- 172.21.15.33:0/3410390904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c104fc0 0x7ff03c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 -- 172.21.15.33:0/3410390904 >> 172.21.15.33:0/3410390904 conn(0x7ff03c1009f0 msgr2=0x7ff03c102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 -- 172.21.15.33:0/3410390904 shutdown_connections 2024-09-10T23:57:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.248+0000 7ff043800640 1 -- 172.21.15.33:0/3410390904 wait complete. 2024-09-10T23:57:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.249+0000 7ff043800640 1 Processor -- start 2024-09-10T23:57:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.249+0000 7ff043800640 1 -- start start 2024-09-10T23:57:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 0x7ff03c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 0x7ff03c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 0x7ff03c1a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c114e80 con 0x7ff03c10a9d0 2024-09-10T23:57:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c114d00 con 0x7ff03c104fc0 2024-09-10T23:57:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff043800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c115000 con 0x7ff03c10b350 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.250+0000 7ff040e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 0x7ff03c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff041800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 0x7ff03c1a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 0x7ff03c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff040e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 0x7ff03c19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43258/0 (socket says 172.21.15.33:43258) 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff040e00640 1 -- 172.21.15.33:0/1204984579 learned_addr learned my addr 172.21.15.33:0/1204984579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 -- 172.21.15.33:0/1204984579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 msgr2=0x7ff03c1a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 0x7ff03c1a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 -- 172.21.15.33:0/1204984579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 msgr2=0x7ff03c19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 0x7ff03c19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 -- 172.21.15.33:0/1204984579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c1a13e0 con 0x7ff03c10a9d0 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff041800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 0x7ff03c1a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.251+0000 7ff03be00640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 0x7ff03c19b870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d6d0 tx=0x7ff02800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.252+0000 7ff039600640 1 -- 172.21.15.33:0/1204984579 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028017070 con 0x7ff03c10a9d0 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.252+0000 7ff039600640 1 -- 172.21.15.33:0/1204984579 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff028009820 con 0x7ff03c10a9d0 2024-09-10T23:57:30.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.252+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c1a16d0 con 0x7ff03c10a9d0 2024-09-10T23:57:30.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.252+0000 7ff039600640 1 -- 172.21.15.33:0/1204984579 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028004bc0 con 0x7ff03c10a9d0 2024-09-10T23:57:30.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.252+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c1a7f60 con 0x7ff03c10a9d0 2024-09-10T23:57:30.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.255+0000 7ff046426740 1 Processor -- start 2024-09-10T23:57:30.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.255+0000 7ff046426740 1 -- start start 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb40560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb4ca30 0x55f55fb4ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f55fab5ca0 con 0x55f55fb40aa0 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f55faa50d0 con 0x55f55fb4ca30 2024-09-10T23:57:30.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff046426740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f55faa8ee0 con 0x55f55fb40180 2024-09-10T23:57:30.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff040e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff040e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48100/0 (socket says 172.21.15.33:48100) 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff040e00640 1 -- 172.21.15.33:0/753144556 learned_addr learned my addr 172.21.15.33:0/753144556 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.256+0000 7ff041800640 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb40560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 -- 172.21.15.33:0/753144556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 msgr2=0x55f55fb40560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb40560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 -- 172.21.15.33:0/753144556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb4ca30 msgr2=0x55f55fb4ee20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb4ca30 0x55f55fb4ee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 -- 172.21.15.33:0/753144556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55fa57400 con 0x55f55fb40aa0 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff041800640 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb40560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff040e00640 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b890 tx=0x7ff03000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7fe12a4d3358dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff039600640 1 -- 172.21.15.33:0/1204984579 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7ff028005220 con 0x7ff03c10a9d0 2024-09-10T23:57:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff02e000640 1 -- 172.21.15.33:0/753144556 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030003dd0 con 0x55f55fb40aa0 2024-09-10T23:57:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff02e000640 1 -- 172.21.15.33:0/753144556 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff030015070 con 0x55f55fb40aa0 2024-09-10T23:57:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.257+0000 7ff02e000640 1 -- 172.21.15.33:0/753144556 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0300106a0 con 0x55f55fb40aa0 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 -- 172.21.15.33:0/753144556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 msgr2=0x55f55fb4c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b890 tx=0x7ff03000bd50 comp rx=0 tx=0).stop 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 -- 172.21.15.33:0/753144556 shutdown_connections 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb4ca30 0x55f55fb4ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4c4f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 --2- 172.21.15.33:0/753144556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb40560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.258+0000 7ff046426740 1 -- 172.21.15.33:0/753144556 >> 172.21.15.33:0/753144556 conn(0x55f55fb3dfb0 msgr2=0x55f55fb3f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.259+0000 7ff046426740 1 -- 172.21.15.33:0/753144556 shutdown_connections 2024-09-10T23:57:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.259+0000 7ff046426740 1 -- 172.21.15.33:0/753144556 wait complete. 2024-09-10T23:57:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.259+0000 7ff046426740 1 -- start start 2024-09-10T23:57:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 Processor -- start 2024-09-10T23:57:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff039600640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 0x7ff0240b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff039600640 1 -- 172.21.15.33:0/1204984579 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0280e5ad0 con 0x7ff03c10a9d0 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff041800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 0x7ff0240b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40aa0 0x55f55fb49720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 0x55f55fb49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f55f9067a0 con 0x55f55fb4ca30 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f55fa4aa10 con 0x55f55fb40aa0 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f55fb4f700 con 0x55f55fb40180 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.260+0000 7ff046426740 10 client.0 _ll_register_callbacks cb 0x55f55fa5abe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42700/0 (socket says 172.21.15.33:42700) 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 -- 172.21.15.33:0/2400432816 learned_addr learned my addr 172.21.15.33:0/2400432816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff041800640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 0x55f55fb49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff041800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 0x7ff0240b77c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 -- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40aa0 msgr2=0x55f55fb49720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40aa0 0x55f55fb49720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 -- 172.21.15.33:0/2400432816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 msgr2=0x55f55fb49ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 0x55f55fb49ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff040e00640 1 -- 172.21.15.33:0/2400432816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55f812b90 con 0x55f55fb40180 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.261+0000 7ff041800640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 0x55f55fb49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff040e00640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff030003f40 tx=0x7ff030003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad6b32c3fbffdf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff022a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T23:57:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030005240 con 0x55f55fb40180 2024-09-10T23:57:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff030015070 con 0x55f55fb40180 2024-09-10T23:57:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0300053e0 con 0x55f55fb40180 2024-09-10T23:57:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.262+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff0300046c0 con 0x55f55fb40180 2024-09-10T23:57:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 10 client.25378 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f55fb6bf80 con 0x55f55fb40180 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff030015070 con 0x55f55fb40180 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff0300119d0 con 0x55f55fb40180 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 10 client.25378 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 10 client.25378 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 20 client.25378 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb6d330 0x55f55fb6f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 4 client.25378 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.263+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f55fab7bf0 con 0x55f55fb6d330 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.264+0000 7ff03be00640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb6d330 0x55f55fb6f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.264+0000 7ff03be00640 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb6d330 0x55f55fb6f720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d611f3fb110d63a0 server_cookie=af3f57fc125823cb in_seq=0 out_seq=0 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.264+0000 7ff022a00640 10 client.25378 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.265+0000 7ff022a00640 1 -- 172.21.15.33:0/2400432816 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f55fab7bf0 con 0x55f55fb6d330 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.265+0000 7ff022a00640 10 client.25378 handle_command_reply: tid=0 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 client.25378 shutdown 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 msgr2=0x55f55fb4c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff030003f40 tx=0x7ff030003f70 comp rx=0 tx=0).stop 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 shutdown_connections 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb4ca30 0x55f55fb49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40aa0 0x55f55fb49720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb6d330 0x55f55fb6f720 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 --2- 172.21.15.33:0/2400432816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4c2d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 >> 172.21.15.33:0/2400432816 conn(0x55f55fb3dfb0 msgr2=0x55f55fb43b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff022a00640 0 client.25378 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 shutdown_connections 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.266+0000 7ff046426740 1 -- 172.21.15.33:0/2400432816 wait complete. 2024-09-10T23:57:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.267+0000 7ff046426740 20 client.25378 trim_cache size 0 max 16384 2024-09-10T23:57:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 Processor -- start 2024-09-10T23:57:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 -- start start 2024-09-10T23:57:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40180 0x55f55fb4de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 0x55f55fb4e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c1abd70 con 0x55f55fb3dfb0 2024-09-10T23:57:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c1a9640 con 0x55f55fb40180 2024-09-10T23:57:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff046426740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c0746d0 con 0x55f55fb40aa0 2024-09-10T23:57:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff040e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff040e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48122/0 (socket says 172.21.15.33:48122) 2024-09-10T23:57:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.290+0000 7ff040e00640 1 -- 172.21.15.33:0/159761936 learned_addr learned my addr 172.21.15.33:0/159761936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff03be00640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40180 0x55f55fb4de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff041800640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 0x55f55fb4e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 -- 172.21.15.33:0/159761936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 msgr2=0x55f55fb4e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 0x55f55fb4e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 -- 172.21.15.33:0/159761936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40180 msgr2=0x55f55fb4de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40180 0x55f55fb4de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 -- 172.21.15.33:0/159761936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f55fb44280 con 0x55f55fb3dfb0 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff041800640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 0x55f55fb4e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.291+0000 7ff040e00640 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff030000c00 tx=0x7ff030004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bf8f9f45dfe29b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.292+0000 7ff02d600640 1 -- 172.21.15.33:0/159761936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030003b70 con 0x55f55fb3dfb0 2024-09-10T23:57:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.292+0000 7ff02d600640 1 -- 172.21.15.33:0/159761936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff030015070 con 0x55f55fb3dfb0 2024-09-10T23:57:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.292+0000 7ff02d600640 1 -- 172.21.15.33:0/159761936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030004860 con 0x55f55fb3dfb0 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 -- 172.21.15.33:0/159761936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 msgr2=0x55f55fb3f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff030000c00 tx=0x7ff030004270 comp rx=0 tx=0).stop 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 -- 172.21.15.33:0/159761936 shutdown_connections 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40aa0 0x55f55fb4e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb40180 0x55f55fb4de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 --2- 172.21.15.33:0/159761936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb3dfb0 0x55f55fb3f3a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 -- 172.21.15.33:0/159761936 >> 172.21.15.33:0/159761936 conn(0x55f55fb492f0 msgr2=0x55f55fb3ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 -- 172.21.15.33:0/159761936 shutdown_connections 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.293+0000 7ff046426740 1 -- 172.21.15.33:0/159761936 wait complete. 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 -- start start 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 Processor -- start 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 0x55f55fb55250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c074d40 con 0x55f55fb40aa0 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c1a8f70 con 0x55f55fb3dfb0 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.294+0000 7ff046426740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c1a81d0 con 0x55f55fb40180 2024-09-10T23:57:30.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff046426740 10 client.0 _ll_register_callbacks cb 0x7ff030004530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48130/0 (socket says 172.21.15.33:48130) 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 -- 172.21.15.33:0/4206206242 learned_addr learned my addr 172.21.15.33:0/4206206242 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff040e00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 0x55f55fb55250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff03be00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 -- 172.21.15.33:0/4206206242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 msgr2=0x55f55fb4f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.295+0000 7ff041800640 1 -- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 msgr2=0x55f55fb55250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff041800640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 0x55f55fb55250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff041800640 1 -- 172.21.15.33:0/4206206242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55fbda0f0 con 0x55f55fb40aa0 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff03be00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:30.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff040e00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 0x55f55fb55250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff041800640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff034031920 tx=0x7ff0340095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff29ccfda5ff134b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff022a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034003e20 con 0x55f55fb40aa0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0340047a0 con 0x55f55fb40aa0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.296+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff030015070 con 0x55f55fb40aa0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff0340305c0 con 0x55f55fb40aa0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 10 client.15618 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f55fbdb190 con 0x55f55fb40aa0 2024-09-10T23:57:30.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff030015070 con 0x55f55fb40aa0 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff034044040 con 0x55f55fb40aa0 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 10 client.15618 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 10 client.15618 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 20 client.15618 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb4ca30 0x55f55fbdda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 4 client.15618 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}] 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.297+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}) -- 0x55f55fab36a0 con 0x55f55fb4ca30 2024-09-10T23:57:30.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.298+0000 7ff040e00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb4ca30 0x55f55fbdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:30.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.299+0000 7ff040e00640 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb4ca30 0x55f55fbdda10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8948d10cf2086d1f server_cookie=3b70683d33d65a8c in_seq=0 out_seq=0 2024-09-10T23:57:30.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.299+0000 7ff022a00640 10 client.15618 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:30 smithi033 ceph-mon[30593]: pgmap v458: 129 pgs: 129 active+clean; 48 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-10T23:57:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff022a00640 1 -- 172.21.15.33:0/4206206242 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f55fab36a0 con 0x55f55fb4ca30 2024-09-10T23:57:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff022a00640 10 client.15618 handle_command_reply: tid=0 2024-09-10T23:57:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 client.15618 shutdown 2024-09-10T23:57:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 msgr2=0x55f55fb4ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff034031920 tx=0x7ff0340095c0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 shutdown_connections 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f55fb40aa0 0x55f55fb4ffb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f55fb4ca30 0x55f55fbdda10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f55fb40180 0x55f55fb4f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 --2- 172.21.15.33:0/4206206242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f55fb3dfb0 0x55f55fb55250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff022a00640 0 client.15618 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 >> 172.21.15.33:0/4206206242 conn(0x55f55fb492f0 msgr2=0x55f55fb4b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 shutdown_connections 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 1 -- 172.21.15.33:0/4206206242 wait complete. 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.801+0000 7ff046426740 20 client.15618 trim_cache size 0 max 16384 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 2, 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "7f2f5515": { 2024-09-10T23:57:30.804 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 2, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.2, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:57:30.805 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:30.806 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 msgr2=0x7ff0240b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 0x7ff0240b77c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034004a80 comp rx=0 tx=0).stop 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 msgr2=0x7ff03c19b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 0x7ff03c19b870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d6d0 tx=0x7ff02800db90 comp rx=0 tx=0).stop 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 shutdown_connections 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0240b5300 0x7ff0240b77c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff03c10b350 0x7ff03c1a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03c10a9d0 0x7ff03c19b870 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 --2- 172.21.15.33:0/1204984579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff03c104fc0 0x7ff03c19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 >> 172.21.15.33:0/1204984579 conn(0x7ff03c1009f0 msgr2=0x7ff03c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 shutdown_connections 2024-09-10T23:57:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:30.802+0000 7ff043800640 1 -- 172.21.15.33:0/1204984579 wait complete. 2024-09-10T23:57:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:30 smithi189 ceph-mon[34000]: pgmap v458: 129 pgs: 129 active+clean; 48 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-10T23:57:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:30 smithi052 ceph-mon[33526]: pgmap v458: 129 pgs: 129 active+clean; 48 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-09-10T23:57:31.546 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7f2f5515', quiesce took 5.1 seconds. Will release after: 20.1 2024-09-10T23:57:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:32 smithi033 ceph-mon[30593]: pgmap v459: 129 pgs: 129 active+clean; 48 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-10T23:57:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:32 smithi189 ceph-mon[34000]: pgmap v459: 129 pgs: 129 active+clean; 48 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-10T23:57:32.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:32 smithi052 ceph-mon[33526]: pgmap v459: 129 pgs: 129 active+clean; 48 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-10T23:57:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:34 smithi033 ceph-mon[30593]: pgmap v460: 129 pgs: 129 active+clean; 59 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-09-10T23:57:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:34 smithi189 ceph-mon[34000]: pgmap v460: 129 pgs: 129 active+clean; 59 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-09-10T23:57:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:34 smithi052 ceph-mon[33526]: pgmap v460: 129 pgs: 129 active+clean; 59 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-09-10T23:57:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:36 smithi033 ceph-mon[30593]: pgmap v461: 129 pgs: 129 active+clean; 63 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-10T23:57:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:36 smithi189 ceph-mon[34000]: pgmap v461: 129 pgs: 129 active+clean; 63 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-10T23:57:36.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:36 smithi052 ceph-mon[33526]: pgmap v461: 129 pgs: 129 active+clean; 63 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-10T23:57:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:38 smithi033 ceph-mon[30593]: pgmap v462: 129 pgs: 129 active+clean; 63 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-09-10T23:57:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:38 smithi189 ceph-mon[34000]: pgmap v462: 129 pgs: 129 active+clean; 63 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-09-10T23:57:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:38 smithi052 ceph-mon[33526]: pgmap v462: 129 pgs: 129 active+clean; 63 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 -- 172.21.15.33:0/3644705361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 msgr2=0x7f147c10ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 --2- 172.21.15.33:0/3644705361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c10ac20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1474009cd0 tx=0x7f147402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 -- 172.21.15.33:0/3644705361 shutdown_connections 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 --2- 172.21.15.33:0/3644705361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c10ac20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 --2- 172.21.15.33:0/3644705361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c1038e0 0x7f147c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 --2- 172.21.15.33:0/3644705361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c102790 0x7f147c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 -- 172.21.15.33:0/3644705361 >> 172.21.15.33:0/3644705361 conn(0x7f147c0fe030 msgr2=0x7f147c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 -- 172.21.15.33:0/3644705361 shutdown_connections 2024-09-10T23:57:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.749+0000 7f1481400640 1 -- 172.21.15.33:0/3644705361 wait complete. 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.750+0000 7f1481400640 1 Processor -- start 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.750+0000 7f1481400640 1 -- start start 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c102790 0x7f147c076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 0x7f147c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f147c10e300 con 0x7f147c1042a0 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f147c10e180 con 0x7f147c102790 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1481400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f147c10e480 con 0x7f147c1038e0 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34502/0 (socket says 172.21.15.33:34502) 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f1480a00640 1 -- 172.21.15.33:0/2776076492 learned_addr learned my addr 172.21.15.33:0/2776076492 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f147be00640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c102790 0x7f147c076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.751+0000 7f147b400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 0x7f147c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 -- 172.21.15.33:0/2776076492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 msgr2=0x7f147c075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 0x7f147c075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 -- 172.21.15.33:0/2776076492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c102790 msgr2=0x7f147c076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c102790 0x7f147c076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 -- 172.21.15.33:0/2776076492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c0762f0 con 0x7f147c1042a0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f147b400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 0x7f147c075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1480a00640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1474003ba0 tx=0x7f1474003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1478c00640 1 -- 172.21.15.33:0/2776076492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474004240 con 0x7f147c1042a0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1478c00640 1 -- 172.21.15.33:0/2776076492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14740305a0 con 0x7f147c1042a0 2024-09-10T23:57:40.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1478c00640 1 -- 172.21.15.33:0/2776076492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740466e0 con 0x7f147c1042a0 2024-09-10T23:57:40.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c1a2b00 con 0x7f147c1042a0 2024-09-10T23:57:40.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.752+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c1a3020 con 0x7f147c1042a0 2024-09-10T23:57:40.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.756+0000 7f1485800740 1 Processor -- start 2024-09-10T23:57:40.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.756+0000 7f1478c00640 1 -- 172.21.15.33:0/2776076492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f1474030070 con 0x7f147c1042a0 2024-09-10T23:57:40.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.756+0000 7f1485800740 1 -- start start 2024-09-10T23:57:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a3970 0x5580532a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5580532166b0 con 0x5580532a8ce0 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558053205ae0 con 0x5580532a62a0 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f1485800740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5580532098f0 con 0x5580532a3970 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34506/0 (socket says 172.21.15.33:34506) 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38864/0 (socket says 172.21.15.33:38864) 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147b400640 1 -- 172.21.15.33:0/2884050618 learned_addr learned my addr 172.21.15.33:0/2884050618 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.757+0000 7f147b400640 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a3970 0x5580532a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 -- 172.21.15.33:0/2884050618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a3970 msgr2=0x5580532a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a3970 0x5580532a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 -- 172.21.15.33:0/2884050618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 msgr2=0x5580532ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 -- 172.21.15.33:0/2884050618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580531d2780 con 0x5580532a62a0 2024-09-10T23:57:40.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147b400640 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f1478c00640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 0x7f14600b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f1478c00640 1 -- 172.21.15.33:0/2776076492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f147402e030 con 0x7f147c1042a0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147be00640 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bbe0 tx=0x7f146c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7a1226b093a6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.758+0000 7f147b400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 0x7f14600b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1471200640 1 -- 172.21.15.33:0/2884050618 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c015070 con 0x5580532a62a0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1471200640 1 -- 172.21.15.33:0/2884050618 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f146c0054b0 con 0x5580532a62a0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1471200640 1 -- 172.21.15.33:0/2884050618 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c011440 con 0x5580532a62a0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 -- 172.21.15.33:0/2884050618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 msgr2=0x5580532a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f147b400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 0x7f14600b7830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14680058c0 tx=0x7f146800b460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bbe0 tx=0x7f146c00f730 comp rx=0 tx=0).stop 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 -- 172.21.15.33:0/2884050618 shutdown_connections 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a62a0 0x5580532a8690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 --2- 172.21.15.33:0/2884050618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a3970 0x5580532a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.759+0000 7f1485800740 1 -- 172.21.15.33:0/2884050618 >> 172.21.15.33:0/2884050618 conn(0x55805329eac0 msgr2=0x55805329f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.760+0000 7f1485800740 1 -- 172.21.15.33:0/2884050618 shutdown_connections 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.760+0000 7f1485800740 1 -- 172.21.15.33:0/2884050618 wait complete. 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.760+0000 7f1485800740 1 -- start start 2024-09-10T23:57:40.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.760+0000 7f1485800740 1 Processor -- start 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x5580532ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55805313dab0 con 0x5580532a8ce0 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580531ac570 con 0x5580532a3970 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5580532abcc0 con 0x5580532a62a0 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1485800740 10 client.0 _ll_register_callbacks cb 0x5580531bb100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f147be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x5580532ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34514/0 (socket says 172.21.15.33:34514) 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 -- 172.21.15.33:0/2472693079 learned_addr learned my addr 172.21.15.33:0/2472693079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f147b400640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 -- 172.21.15.33:0/2472693079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 msgr2=0x5580532ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 -- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 msgr2=0x5580532ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x5580532ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.761+0000 7f1480a00640 1 -- 172.21.15.33:0/2472693079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558052f67790 con 0x5580532a8ce0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1480a00640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f14740c9a80 tx=0x7f1474104c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6c3dd5c6f12e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1465600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740cd4b0 con 0x5580532a8ce0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f14740c7bb0 con 0x5580532a8ce0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f146c0054b0 con 0x5580532a8ce0 2024-09-10T23:57:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f14740d1f90 con 0x5580532a8ce0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1485800740 10 client.15630 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558052fe0620 con 0x5580532a8ce0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.762+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f146c0054b0 con 0x5580532a8ce0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f14740cc710 con 0x5580532a8ce0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 10 client.15630 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 20 client.15630 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5580532b88e0 0x5580532bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 4 client.15630 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558053218600 con 0x5580532b88e0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.763+0000 7f147be00640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5580532b88e0 0x5580532bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.764+0000 7f147be00640 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5580532b88e0 0x5580532bad80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42610accd8cc31c server_cookie=9e9742253e943a5 in_seq=0 out_seq=0 2024-09-10T23:57:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.764+0000 7f1465600640 10 client.15630 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1465600640 1 -- 172.21.15.33:0/2472693079 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558053218600 con 0x5580532b88e0 2024-09-10T23:57:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1465600640 10 client.15630 handle_command_reply: tid=0 2024-09-10T23:57:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 client.15630 shutdown 2024-09-10T23:57:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 msgr2=0x5580532ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f14740c9a80 tx=0x7f1474104c80 comp rx=0 tx=0).stop 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 shutdown_connections 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532ae320 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5580532b88e0 0x5580532bad80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 --2- 172.21.15.33:0/2472693079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x5580532ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 >> 172.21.15.33:0/2472693079 conn(0x55805329eac0 msgr2=0x55805329dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1465600640 0 client.15630 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 shutdown_connections 2024-09-10T23:57:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.765+0000 7f1485800740 1 -- 172.21.15.33:0/2472693079 wait complete. 2024-09-10T23:57:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.766+0000 7f1485800740 20 client.15630 trim_cache size 0 max 16384 2024-09-10T23:57:40.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:40 smithi033 ceph-mon[30593]: pgmap v463: 129 pgs: 129 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 152 op/s 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 Processor -- start 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 -- start start 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x55805329f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x55805329fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1afd00 con 0x5580532a8ce0 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ad5d0 con 0x5580532a3970 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1485800740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ab420 con 0x5580532a62a0 2024-09-10T23:57:40.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34522/0 (socket says 172.21.15.33:34522) 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 -- 172.21.15.33:0/2391420228 learned_addr learned my addr 172.21.15.33:0/2391420228 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f147be00640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x55805329f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f147b400640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x55805329fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 -- 172.21.15.33:0/2391420228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 msgr2=0x55805329fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x55805329fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.782+0000 7f1480a00640 1 -- 172.21.15.33:0/2391420228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 msgr2=0x55805329f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1480a00640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x55805329f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1480a00640 1 -- 172.21.15.33:0/2391420228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580532acbb0 con 0x5580532a8ce0 2024-09-10T23:57:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f147be00640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x55805329f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1480a00640 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f14740ccb10 tx=0x7f14740cd100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5299f884aae100a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1467e00640 1 -- 172.21.15.33:0/2391420228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740e82c0 con 0x5580532a8ce0 2024-09-10T23:57:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1467e00640 1 -- 172.21.15.33:0/2391420228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1474036070 con 0x5580532a8ce0 2024-09-10T23:57:40.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.783+0000 7f1467e00640 1 -- 172.21.15.33:0/2391420228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14740cd4b0 con 0x5580532a8ce0 2024-09-10T23:57:40.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- 172.21.15.33:0/2391420228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 msgr2=0x5580532a1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f14740ccb10 tx=0x7f14740cd100 comp rx=0 tx=0).stop 2024-09-10T23:57:40.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- 172.21.15.33:0/2391420228 shutdown_connections 2024-09-10T23:57:40.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a8ce0 0x5580532a1b10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x55805329fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 --2- 172.21.15.33:0/2391420228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a3970 0x55805329f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- 172.21.15.33:0/2391420228 >> 172.21.15.33:0/2391420228 conn(0x55805329eac0 msgr2=0x5580532a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- 172.21.15.33:0/2391420228 shutdown_connections 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- 172.21.15.33:0/2391420228 wait complete. 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 -- start start 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.784+0000 7f1485800740 1 Processor -- start 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a8ce0 0x5580532b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1aba90 con 0x5580532a3970 2024-09-10T23:57:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1acf00 con 0x5580532a8ce0 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f147c1ac160 con 0x5580532a62a0 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f1485800740 10 client.0 _ll_register_callbacks cb 0x7f1474009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34528/0 (socket says 172.21.15.33:34528) 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 -- 172.21.15.33:0/651085509 learned_addr learned my addr 172.21.15.33:0/651085509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 -- 172.21.15.33:0/651085509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 msgr2=0x5580532b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 -- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a8ce0 msgr2=0x5580532b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a8ce0 0x5580532b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.785+0000 7f147be00640 1 -- 172.21.15.33:0/651085509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580532b4360 con 0x5580532a3970 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f147be00640 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bbb0 tx=0x7f146c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2944f17035a6604 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1465600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c031060 con 0x5580532a3970 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f146c02c650 con 0x5580532a3970 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1474036070 con 0x5580532a3970 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f146c038050 con 0x5580532a3970 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1485800740 10 client.15636 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:40.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558053325890 con 0x5580532a3970 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.786+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1474036070 con 0x5580532a3970 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f146c019410 con 0x5580532a3970 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 10 client.15636 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 20 client.15636 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558053326030 0x558053328450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 4 client.15636 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580532140b0 con 0x558053326030 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.787+0000 7f147b400640 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558053326030 0x558053328450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.788+0000 7f147b400640 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558053326030 0x558053328450 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=183091bf589f7a52 server_cookie=1474024ac6b56150 in_seq=0 out_seq=0 2024-09-10T23:57:40.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.788+0000 7f1465600640 10 client.15636 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.825+0000 7f1465600640 1 -- 172.21.15.33:0/651085509 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580532140b0 con 0x558053326030 2024-09-10T23:57:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.825+0000 7f1465600640 10 client.15636 handle_command_reply: tid=0 2024-09-10T23:57:40.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.825+0000 7f1485800740 1 client.15636 shutdown 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 msgr2=0x5580532b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f146c00bbb0 tx=0x7f146c005e50 comp rx=0 tx=0).stop 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 shutdown_connections 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580532a8ce0 0x5580532b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558053326030 0x558053328450 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580532a62a0 0x5580532b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 --2- 172.21.15.33:0/651085509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580532a3970 0x5580532b4a30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1465600640 0 client.15636 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 >> 172.21.15.33:0/651085509 conn(0x55805329eac0 msgr2=0x55805329f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 shutdown_connections 2024-09-10T23:57:40.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 1 -- 172.21.15.33:0/651085509 wait complete. 2024-09-10T23:57:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.826+0000 7f1485800740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T23:57:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:57:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:57:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:57:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 msgr2=0x7f14600b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 0x7f14600b7830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14680058c0 tx=0x7f146800b460 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 msgr2=0x7f147c075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1474003ba0 tx=0x7f1474003bd0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 shutdown_connections 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f14600b5370 0x7f14600b7830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f147c1042a0 0x7f147c075a80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f147c1038e0 0x7f147c075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 --2- 172.21.15.33:0/2776076492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c102790 0x7f147c076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 >> 172.21.15.33:0/2776076492 conn(0x7f147c0fe030 msgr2=0x7f147c106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 shutdown_connections 2024-09-10T23:57:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:40.827+0000 7f1481400640 1 -- 172.21.15.33:0/2776076492 wait complete. 2024-09-10T23:57:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:40 smithi189 ceph-mon[34000]: pgmap v463: 129 pgs: 129 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 152 op/s 2024-09-10T23:57:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:40 smithi052 ceph-mon[33526]: pgmap v463: 129 pgs: 129 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.2 MiB/s wr, 152 op/s 2024-09-10T23:57:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:42 smithi033 ceph-mon[30593]: pgmap v464: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.5 MiB/s wr, 137 op/s 2024-09-10T23:57:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:42 smithi189 ceph-mon[34000]: pgmap v464: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.5 MiB/s wr, 137 op/s 2024-09-10T23:57:42.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:42 smithi052 ceph-mon[33526]: pgmap v464: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.5 MiB/s wr, 137 op/s 2024-09-10T23:57:44.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:44 smithi033 ceph-mon[30593]: pgmap v465: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 104 op/s 2024-09-10T23:57:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:44 smithi189 ceph-mon[34000]: pgmap v465: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 104 op/s 2024-09-10T23:57:44.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:44 smithi052 ceph-mon[33526]: pgmap v465: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 104 op/s 2024-09-10T23:57:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:46 smithi189 ceph-mon[34000]: pgmap v466: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1022 KiB/s wr, 16 op/s 2024-09-10T23:57:46.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:46 smithi052 ceph-mon[33526]: pgmap v466: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1022 KiB/s wr, 16 op/s 2024-09-10T23:57:47.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:46 smithi033 ceph-mon[30593]: pgmap v466: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1022 KiB/s wr, 16 op/s 2024-09-10T23:57:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:48 smithi189 ceph-mon[34000]: pgmap v467: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 684 KiB/s wr, 20 op/s 2024-09-10T23:57:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:48 smithi052 ceph-mon[33526]: pgmap v467: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 684 KiB/s wr, 20 op/s 2024-09-10T23:57:49.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:48 smithi033 ceph-mon[30593]: pgmap v467: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 684 KiB/s wr, 20 op/s 2024-09-10T23:57:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:50 smithi189 ceph-mon[34000]: pgmap v468: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 683 KiB/s wr, 17 op/s 2024-09-10T23:57:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:50 smithi189 ceph-mon[34000]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-09-10T23:57:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:50 smithi052 ceph-mon[33526]: pgmap v468: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 683 KiB/s wr, 17 op/s 2024-09-10T23:57:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:50 smithi052 ceph-mon[33526]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-09-10T23:57:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:50 smithi033 ceph-mon[30593]: pgmap v468: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 683 KiB/s wr, 17 op/s 2024-09-10T23:57:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:50 smithi033 ceph-mon[30593]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-09-10T23:57:51.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:57:52.037 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:52 smithi033 ceph-mon[30593]: pgmap v469: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 355 KiB/s wr, 18 op/s 2024-09-10T23:57:52.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 -- 172.21.15.33:0/686403311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f045010a820 msgr2=0x7f045010ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 --2- 172.21.15.33:0/686403311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f045010a820 0x7f045010ac60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f043c009900 tx=0x7f043c02a410 comp rx=0 tx=0).stop 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 -- 172.21.15.33:0/686403311 shutdown_connections 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 --2- 172.21.15.33:0/686403311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010b1a0 0x7f04501119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 --2- 172.21.15.33:0/686403311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f045010a820 0x7f045010ac60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 --2- 172.21.15.33:0/686403311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0450104e10 0x7f04501051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 -- 172.21.15.33:0/686403311 >> 172.21.15.33:0/686403311 conn(0x7f0450100840 msgr2=0x7f0450102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 -- 172.21.15.33:0/686403311 shutdown_connections 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.705+0000 7f0455e00640 1 -- 172.21.15.33:0/686403311 wait complete. 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 Processor -- start 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 -- start start 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 0x7f045019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 0x7f04501a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114d20 con 0x7f0450104e10 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114ba0 con 0x7f045010b1a0 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.707+0000 7f0455e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114ea0 con 0x7f045010a820 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44768/0 (socket says 172.21.15.33:44768) 2024-09-10T23:57:52.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 -- 172.21.15.33:0/2498478459 learned_addr learned my addr 172.21.15.33:0/2498478459 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f044fe00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 0x7f045019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 -- 172.21.15.33:0/2498478459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 msgr2=0x7f045019b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0455400640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 0x7f04501a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 0x7f045019b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 -- 172.21.15.33:0/2498478459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 msgr2=0x7f04501a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 0x7f04501a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 -- 172.21.15.33:0/2498478459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04501a1200 con 0x7f0450104e10 2024-09-10T23:57:52.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f044fe00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 0x7f045019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0455400640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 0x7f04501a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.708+0000 7f0454a00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f044400e9f0 tx=0x7f044400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.709+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044400cd80 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.709+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04440108c0 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.709+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04440187c0 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.709+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04501a14f0 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.709+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04501a7bb0 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.710+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04501051f0 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.712+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0444010430 con 0x7f0450104e10 2024-09-10T23:57:52.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.715+0000 7f044d600640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 0x7f04380b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.715+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f04440e6960 con 0x7f0450104e10 2024-09-10T23:57:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.715+0000 7f044fe00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 0x7f04380b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.716+0000 7f044fe00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 0x7f04380b7850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f043c006010 tx=0x7f043c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:52.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.717+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04440ad420 con 0x7f0450104e10 2024-09-10T23:57:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:52 smithi189 ceph-mon[34000]: pgmap v469: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 355 KiB/s wr, 18 op/s 2024-09-10T23:57:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:52 smithi052 ceph-mon[33526]: pgmap v469: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 355 KiB/s wr, 18 op/s 2024-09-10T23:57:52.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.954+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f045019c280 con 0x7f0450104e10 2024-09-10T23:57:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.955+0000 7f044d600640 1 -- 172.21.15.33:0/2498478459 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f04440acd20 con 0x7f0450104e10 2024-09-10T23:57:52.957 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:57:52.957 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:57:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:57:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 msgr2=0x7f04380b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 0x7f04380b7850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f043c006010 tx=0x7f043c005a20 comp rx=0 tx=0).stop 2024-09-10T23:57:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 msgr2=0x7f045019b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f044400e9f0 tx=0x7f044400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 shutdown_connections 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f04380b5390 0x7f04380b7850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f045010b1a0 0x7f04501a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f045010a820 0x7f045019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 --2- 172.21.15.33:0/2498478459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0450104e10 0x7f045019b150 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 >> 172.21.15.33:0/2498478459 conn(0x7f0450100840 msgr2=0x7f0450102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.957+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 shutdown_connections 2024-09-10T23:57:52.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:52.958+0000 7f0455e00640 1 -- 172.21.15.33:0/2498478459 wait complete. 2024-09-10T23:57:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:53 smithi033 ceph-mon[30593]: pgmap v470: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 20 op/s 2024-09-10T23:57:53.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2498478459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:53.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:53 smithi189 ceph-mon[34000]: pgmap v470: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 20 op/s 2024-09-10T23:57:53.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2498478459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:53.926 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id 7f2f5515 --release --await' 2024-09-10T23:57:53.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id 7f2f5515 --release --await 2024-09-10T23:57:53.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:53 smithi052 ceph-mon[33526]: pgmap v470: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 14 KiB/s wr, 20 op/s 2024-09-10T23:57:53.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2498478459' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:57:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 -- 172.21.15.33:0/3455627584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be810a6f0 msgr2=0x7f1be810cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 --2- 172.21.15.33:0/3455627584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be810a6f0 0x7f1be810cbb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009ca0 tx=0x7f1be002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 -- 172.21.15.33:0/3455627584 shutdown_connections 2024-09-10T23:57:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 --2- 172.21.15.33:0/3455627584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be810a6f0 0x7f1be810cbb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 --2- 172.21.15.33:0/3455627584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1be8107d30 0x7f1be810a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 --2- 172.21.15.33:0/3455627584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be806bc20 0x7f1be81077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 -- 172.21.15.33:0/3455627584 >> 172.21.15.33:0/3455627584 conn(0x7f1be80fcf60 msgr2=0x7f1be80ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 -- 172.21.15.33:0/3455627584 shutdown_connections 2024-09-10T23:57:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.960+0000 7f1bed600640 1 -- 172.21.15.33:0/3455627584 wait complete. 2024-09-10T23:57:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.961+0000 7f1bed600640 1 Processor -- start 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.961+0000 7f1bed600640 1 -- start start 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be8107d30 0x7f1be819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1be810a6f0 0x7f1be819bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8110570 con 0x7f1be806bc20 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81103f0 con 0x7f1be8107d30 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1bed600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81106f0 con 0x7f1be810a6f0 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44778/0 (socket says 172.21.15.33:44778) 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 -- 172.21.15.33:0/1417949989 learned_addr learned my addr 172.21.15.33:0/1417949989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7400640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be8107d30 0x7f1be819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 -- 172.21.15.33:0/1417949989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1be810a6f0 msgr2=0x7f1be819bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1be810a6f0 0x7f1be819bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 -- 172.21.15.33:0/1417949989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be8107d30 msgr2=0x7f1be819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be8107d30 0x7f1be819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.962+0000 7f1be7e00640 1 -- 172.21.15.33:0/1417949989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be819c8a0 con 0x7f1be806bc20 2024-09-10T23:57:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9f0 tx=0x7f1bd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1be4c00640 1 -- 172.21.15.33:0/1417949989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800cd80 con 0x7f1be806bc20 2024-09-10T23:57:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1be4c00640 1 -- 172.21.15.33:0/1417949989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80108c0 con 0x7f1be806bc20 2024-09-10T23:57:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be819cb90 con 0x7f1be806bc20 2024-09-10T23:57:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1be4c00640 1 -- 172.21.15.33:0/1417949989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80187c0 con 0x7f1be806bc20 2024-09-10T23:57:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.963+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be81a3260 con 0x7f1be806bc20 2024-09-10T23:57:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.967+0000 7f1be4c00640 1 -- 172.21.15.33:0/1417949989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1bd8010430 con 0x7f1be806bc20 2024-09-10T23:57:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.967+0000 7f1bf1a91740 1 Processor -- start 2024-09-10T23:57:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 -- start start 2024-09-10T23:57:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c97cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c97f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c9821a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1be4c00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 0x7f1bcc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56452c8ed6b0 con 0x56452c97fce0 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56452c8dcae0 con 0x56452c97a970 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56452c8e08f0 con 0x56452c97d2a0 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1be4c00640 1 -- 172.21.15.33:0/1417949989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1bd80e6400 con 0x7f1be806bc20 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1becc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c97cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1be7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c9821a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.968+0000 7f1becc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c97cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54570/0 (socket says 172.21.15.33:54570) 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c97f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1becc00640 1 -- 172.21.15.33:0/431683167 learned_addr learned my addr 172.21.15.33:0/431683167 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1becc00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 0x7f1bcc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 -- 172.21.15.33:0/431683167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 msgr2=0x56452c97cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c97cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 -- 172.21.15.33:0/431683167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 msgr2=0x56452c9821a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c9821a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 -- 172.21.15.33:0/431683167 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452c8a9780 con 0x56452c97d2a0 2024-09-10T23:57:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.969+0000 7f1be7e00640 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c97f690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ac4c0 tx=0x7f1bd80abf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e11d120a72a60def server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1bdd200640 1 -- 172.21.15.33:0/431683167 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80acec0 con 0x56452c97d2a0 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1becc00640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 0x7f1bcc0b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1be0004af0 tx=0x7f1be0009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1bdd200640 1 -- 172.21.15.33:0/431683167 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80ac7c0 con 0x56452c97d2a0 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1bdd200640 1 -- 172.21.15.33:0/431683167 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80a8a30 con 0x56452c97d2a0 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1bf1a91740 1 -- 172.21.15.33:0/431683167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 msgr2=0x56452c97f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.970+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c97f690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ac4c0 tx=0x7f1bd80abf30 comp rx=0 tx=0).stop 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 -- 172.21.15.33:0/431683167 shutdown_connections 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c9821a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c97f690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/431683167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c97cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 -- 172.21.15.33:0/431683167 >> 172.21.15.33:0/431683167 conn(0x56452c975ac0 msgr2=0x56452c976850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 -- 172.21.15.33:0/431683167 shutdown_connections 2024-09-10T23:57:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 -- 172.21.15.33:0/431683167 wait complete. 2024-09-10T23:57:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 -- start start 2024-09-10T23:57:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.971+0000 7f1bf1a91740 1 Processor -- start 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c9846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c985290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56452c814ab0 con 0x56452c97fce0 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56452c883570 con 0x56452c97a970 2024-09-10T23:57:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56452c982c00 con 0x56452c97d2a0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1bf1a91740 10 client.0 _ll_register_callbacks cb 0x56452c892100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54578/0 (socket says 172.21.15.33:54578) 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1becc00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c985290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 -- 172.21.15.33:0/1690410778 learned_addr learned my addr 172.21.15.33:0/1690410778 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7400640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c9846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 -- 172.21.15.33:0/1690410778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 msgr2=0x56452c9846c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c9846c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 -- 172.21.15.33:0/1690410778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 msgr2=0x56452c985290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c985290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.972+0000 7f1be7e00640 1 -- 172.21.15.33:0/1690410778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452c63e790 con 0x56452c97a970 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1be7e00640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbeb92c65e60dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bd1600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80acec0 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1bd80abc30 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd80ac7c0 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bd80adaf0 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bf1a91740 10 client.35426 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.973+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56452c6b7620 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80ac7c0 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f1bd80ab620 con 0x56452c97a970 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 10 client.35426 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 10 client.35426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 20 client.35426 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c98f4c0 0x56452c9918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 4 client.35426 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56452c8ef600 con 0x56452c98f4c0 2024-09-10T23:57:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.974+0000 7f1be7400640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c98f4c0 0x56452c9918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.975+0000 7f1be7400640 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c98f4c0 0x56452c9918b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71845d8b8c5b943 server_cookie=b3fa0818f86de807 in_seq=0 out_seq=0 2024-09-10T23:57:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.975+0000 7f1bd1600640 10 client.35426 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bd1600640 1 -- 172.21.15.33:0/1690410778 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56452c8ef600 con 0x56452c98f4c0 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bd1600640 10 client.35426 handle_command_reply: tid=0 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 client.35426 shutdown 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 msgr2=0x56452c984020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8009310 comp rx=0 tx=0).stop 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 shutdown_connections 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97fce0 0x56452c985290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c98f4c0 0x56452c9918b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c9846c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/1690410778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97a970 0x56452c984020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bd1600640 0 client.35426 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 >> 172.21.15.33:0/1690410778 conn(0x56452c975ac0 msgr2=0x56452c974bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.976+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 shutdown_connections 2024-09-10T23:57:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.977+0000 7f1bf1a91740 1 -- 172.21.15.33:0/1690410778 wait complete. 2024-09-10T23:57:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.977+0000 7f1bf1a91740 20 client.35426 trim_cache size 0 max 16384 2024-09-10T23:57:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.993+0000 7f1bf1a91740 1 Processor -- start 2024-09-10T23:57:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.993+0000 7f1bf1a91740 1 -- start start 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c970c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97fce0 0x56452c976320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81aff30 con 0x56452c97a970 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ad800 con 0x56452c97fce0 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ab650 con 0x56452c97d2a0 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44812/0 (socket says 172.21.15.33:44812) 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1be7e00640 1 -- 172.21.15.33:0/2713151312 learned_addr learned my addr 172.21.15.33:0/2713151312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1be7400640 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c970c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.994+0000 7f1becc00640 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97fce0 0x56452c976320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 -- 172.21.15.33:0/2713151312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 msgr2=0x56452c970c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c970c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 -- 172.21.15.33:0/2713151312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97fce0 msgr2=0x56452c976320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97fce0 0x56452c976320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:53.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 -- 172.21.15.33:0/2713151312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452c97d0d0 con 0x56452c97a970 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1be7e00640 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ac4c0 tx=0x7f1bd80a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2521cbab0700171 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1bd3e00640 1 -- 172.21.15.33:0/2713151312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80acec0 con 0x56452c97a970 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1bd3e00640 1 -- 172.21.15.33:0/2713151312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80e6120 con 0x56452c97a970 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.995+0000 7f1bd3e00640 1 -- 172.21.15.33:0/2713151312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80adc90 con 0x56452c97a970 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- 172.21.15.33:0/2713151312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 msgr2=0x56452c9807d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ac4c0 tx=0x7f1bd80a8040 comp rx=0 tx=0).stop 2024-09-10T23:57:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- 172.21.15.33:0/2713151312 shutdown_connections 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97fce0 0x56452c976320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97d2a0 0x56452c970c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/2713151312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c9807d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- 172.21.15.33:0/2713151312 >> 172.21.15.33:0/2713151312 conn(0x56452c975ac0 msgr2=0x56452c9800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- 172.21.15.33:0/2713151312 shutdown_connections 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- 172.21.15.33:0/2713151312 wait complete. 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.996+0000 7f1bf1a91740 1 -- start start 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 Processor -- start 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97d2a0 0x56452c98aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97fce0 0x56452c98b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81abcc0 con 0x56452c97a970 2024-09-10T23:57:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ad130 con 0x56452c97d2a0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1be81ac390 con 0x56452c97fce0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1bf1a91740 10 client.0 _ll_register_callbacks cb 0x7f1bd4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44818/0 (socket says 172.21.15.33:44818) 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1be7e00640 1 -- 172.21.15.33:0/4248581364 learned_addr learned my addr 172.21.15.33:0/4248581364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1be7400640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97d2a0 0x56452c98aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.997+0000 7f1becc00640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97fce0 0x56452c98b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 -- 172.21.15.33:0/4248581364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97fce0 msgr2=0x56452c98b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97fce0 0x56452c98b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 -- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97d2a0 msgr2=0x56452c98aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97d2a0 0x56452c98aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 -- 172.21.15.33:0/4248581364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452c989610 con 0x56452c97a970 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1be7e00640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9c0 tx=0x7f1bd8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75566e5b25b4053 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bd1600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80b2690 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1bd80a8110 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd80e6120 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bd80acec0 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bf1a91740 10 client.15660 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.998+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56452c989610 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80e6120 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f1bd8018b80 con 0x56452c97a970 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 20 client.15660 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c9fcc20 0x56452c9ff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 4 client.15660 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:57:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56452c8eb0b0 con 0x56452c9fcc20 2024-09-10T23:57:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:53.999+0000 7f1be7400640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c9fcc20 0x56452c9ff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.000+0000 7f1be7400640 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c9fcc20 0x56452c9ff040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f79962338f9a8d7f server_cookie=11d252c3c728583 in_seq=0 out_seq=0 2024-09-10T23:57:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.000+0000 7f1bd1600640 10 client.15660 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bd1600640 1 -- 172.21.15.33:0/4248581364 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56452c8eb0b0 con 0x56452c9fcc20 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bd1600640 10 client.15660 handle_command_reply: tid=0 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 client.15660 shutdown 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 msgr2=0x56452c98bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9c0 tx=0x7f1bd8009310 comp rx=0 tx=0).stop 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 shutdown_connections 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56452c9fcc20 0x56452c9ff040 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56452c97fce0 0x56452c98b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56452c97d2a0 0x56452c98aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 --2- 172.21.15.33:0/4248581364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56452c97a970 0x56452c98bd10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bd1600640 0 client.15660 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.012+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 >> 172.21.15.33:0/4248581364 conn(0x56452c975ac0 msgr2=0x56452c9800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 shutdown_connections 2024-09-10T23:57:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bf1a91740 1 -- 172.21.15.33:0/4248581364 wait complete. 2024-09-10T23:57:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bf1a91740 20 client.15660 trim_cache size 0 max 16384 2024-09-10T23:57:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:57:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:57:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:57:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 msgr2=0x7f1bcc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 0x7f1bcc0b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1be0004af0 tx=0x7f1be0009380 comp rx=0 tx=0).stop 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 msgr2=0x7f1be819ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e9f0 tx=0x7f1bd800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 shutdown_connections 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1bcc0b52e0 0x7f1bcc0b77a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1be810a6f0 0x7f1be819bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be8107d30 0x7f1be819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 --2- 172.21.15.33:0/1417949989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1be806bc20 0x7f1be819ad60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.013+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 >> 172.21.15.33:0/1417949989 conn(0x7f1be80fcf60 msgr2=0x7f1be8108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.014+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 shutdown_connections 2024-09-10T23:57:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:57:54.014+0000 7f1bed600640 1 -- 172.21.15.33:0/1417949989 wait complete. 2024-09-10T23:57:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 -- 172.21.15.33:0/2300486133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac109130 msgr2=0x7f4aac10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/2300486133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac109130 0x7f4aac10f930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009ca0 tx=0x7f4aa402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 -- 172.21.15.33:0/2300486133 shutdown_connections 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/2300486133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac109130 0x7f4aac10f930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/2300486133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 0x7f4aac108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/2300486133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac102da0 0x7f4aac103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.890+0000 7f4ab2a00640 1 -- 172.21.15.33:0/2300486133 >> 172.21.15.33:0/2300486133 conn(0x7f4aac0fe810 msgr2=0x7f4aac100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.891+0000 7f4ab2a00640 1 -- 172.21.15.33:0/2300486133 shutdown_connections 2024-09-10T23:57:54.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.891+0000 7f4ab2a00640 1 -- 172.21.15.33:0/2300486133 wait complete. 2024-09-10T23:57:54.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.891+0000 7f4ab2a00640 1 Processor -- start 2024-09-10T23:57:54.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 -- start start 2024-09-10T23:57:54.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 0x7f4aac0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac109130 0x7f4aac075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112cf0 con 0x7f4aac102da0 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112b70 con 0x7f4aac1087b0 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4ab2a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112e70 con 0x7f4aac109130 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4aabe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4aabe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44836/0 (socket says 172.21.15.33:44836) 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.892+0000 7f4aabe00640 1 -- 172.21.15.33:0/851673186 learned_addr learned my addr 172.21.15.33:0/851673186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aa3400640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 0x7f4aac0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac109130 0x7f4aac075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 -- 172.21.15.33:0/851673186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac109130 msgr2=0x7f4aac075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac109130 0x7f4aac075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 -- 172.21.15.33:0/851673186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 msgr2=0x7f4aac0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 0x7f4aac0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 -- 172.21.15.33:0/851673186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac1a7540 con 0x7f4aac102da0 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.893+0000 7f4aabe00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00d950 tx=0x7f4a9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.894+0000 7f4aa9600640 1 -- 172.21.15.33:0/851673186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c017030 con 0x7f4aac102da0 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.894+0000 7f4aa9600640 1 -- 172.21.15.33:0/851673186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a9c004020 con 0x7f4aac102da0 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.894+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac1a7830 con 0x7f4aac102da0 2024-09-10T23:57:54.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.894+0000 7f4aa9600640 1 -- 172.21.15.33:0/851673186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0055d0 con 0x7f4aac102da0 2024-09-10T23:57:54.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.894+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac1a7dc0 con 0x7f4aac102da0 2024-09-10T23:57:54.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 Processor -- start 2024-09-10T23:57:54.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 -- start start 2024-09-10T23:57:54.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4aa9600640 1 -- 172.21.15.33:0/851673186 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4a9c009a30 con 0x7f4aac102da0 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199d3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555c1993e290 con 0x555c199c6ff0 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555c1992d6c0 con 0x555c199d38a0 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.897+0000 7f4ab560e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555c199314d0 con 0x555c199c7910 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44852/0 (socket says 172.21.15.33:44852) 2024-09-10T23:57:54.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4240389987 learned_addr learned my addr 172.21.15.33:0/4240389987 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4aabe00640 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4240389987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 msgr2=0x555c199d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4240389987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 msgr2=0x555c199d5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4240389987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c198ba460 con 0x555c199c6ff0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.898+0000 7f4aabe00640 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4004af0 tx=0x7f4aa4031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af946568b0cc8aff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aa1200640 1 -- 172.21.15.33:0/4240389987 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4031980 con 0x555c199c6ff0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aa1200640 1 -- 172.21.15.33:0/4240389987 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa4036070 con 0x555c199c6ff0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aa1200640 1 -- 172.21.15.33:0/4240389987 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4004420 con 0x555c199c6ff0 2024-09-10T23:57:54.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aa9600640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 0x7f4a900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aa9600640 1 -- 172.21.15.33:0/851673186 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4a9c0e58f0 con 0x7f4aac102da0 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 -- 172.21.15.33:0/4240389987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 msgr2=0x555c199c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4004af0 tx=0x7f4aa4031500 comp rx=0 tx=0).stop 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4aabe00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 0x7f4a900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 -- 172.21.15.33:0/4240389987 shutdown_connections 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199d5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4240389987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199c73d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 -- 172.21.15.33:0/4240389987 >> 172.21.15.33:0/4240389987 conn(0x555c199c4e20 msgr2=0x555c199c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 -- 172.21.15.33:0/4240389987 shutdown_connections 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.900+0000 7f4ab560e740 1 -- 172.21.15.33:0/4240389987 wait complete. 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.901+0000 7f4aabe00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 0x7f4a900b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0e33c0 tx=0x7f4a9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.901+0000 7f4ab560e740 1 -- start start 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.901+0000 7f4ab560e740 1 Processor -- start 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 0x555c199d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199d38a0 0x555c199d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555c1978ebb0 con 0x555c199c6ff0 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555c198c86c0 con 0x555c199c7910 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555c199d6370 con 0x555c199d38a0 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab560e740 10 client.0 _ll_register_callbacks cb 0x555c198e3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:54.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44860/0 (socket says 172.21.15.33:44860) 2024-09-10T23:57:54.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4ab0a00640 1 -- 172.21.15.33:0/2727395727 learned_addr learned my addr 172.21.15.33:0/2727395727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 0x555c199d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4aa3400640 1 -- 172.21.15.33:0/2727395727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199d38a0 msgr2=0x555c199d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.902+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199d38a0 0x555c199d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4aa3400640 1 -- 172.21.15.33:0/2727395727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 msgr2=0x555c199d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4aa3400640 1 -- 172.21.15.33:0/2727395727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1968bb00 con 0x555c199c7910 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 0x555c199d0dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4aac076f90 tx=0x7f4a940107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d8ad55c955d34a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4a99600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9401c680 con 0x555c199c7910 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa4036070 con 0x555c199c7910 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.903+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4a9401c820 con 0x555c199c7910 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a9401ca20 con 0x555c199c7910 2024-09-10T23:57:54.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 10 client.35441 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c19702960 con 0x555c199c7910 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa4036070 con 0x555c199c7910 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4a940037a0 con 0x555c199c7910 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 10 client.35441 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 10 client.35441 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 20 client.35441 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c199e3230 0x555c199e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 4 client.35441 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.904+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c199401e0 con 0x555c199e3230 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.905+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c199e3230 0x555c199e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.905+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c199e3230 0x555c199e5660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4a7f004a87b20c server_cookie=a555dc5aba977d7 in_seq=0 out_seq=0 2024-09-10T23:57:54.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.905+0000 7f4a99600640 10 client.35441 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:54.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4a99600640 1 -- 172.21.15.33:0/2727395727 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c199401e0 con 0x555c199e3230 2024-09-10T23:57:54.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4a99600640 10 client.35441 handle_command_reply: tid=0 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 client.35441 shutdown 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 msgr2=0x555c199d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 0x555c199d0dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4aac076f90 tx=0x7f4a940107a0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 shutdown_connections 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c199e3230 0x555c199e5660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199d38a0 0x555c199d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.906+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199c7910 0x555c199d0dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2727395727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 >> 172.21.15.33:0/2727395727 conn(0x555c199c4e20 msgr2=0x555c199ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4a99600640 0 client.35441 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 shutdown_connections 2024-09-10T23:57:54.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4ab560e740 1 -- 172.21.15.33:0/2727395727 wait complete. 2024-09-10T23:57:54.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.907+0000 7f4ab560e740 20 client.35441 trim_cache size 0 max 16384 2024-09-10T23:57:54.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 Processor -- start 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 -- start start 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1b4410 con 0x555c199c6ff0 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1b1ce0 con 0x555c199d38a0 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab560e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1afb30 con 0x555c199c7910 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44870/0 (socket says 172.21.15.33:44870) 2024-09-10T23:57:54.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.925+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4106916595 learned_addr learned my addr 172.21.15.33:0/4106916595 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4aa3400640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4106916595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 msgr2=0x555c199eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4106916595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 msgr2=0x555c199eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 -- 172.21.15.33:0/4106916595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c199c58a0 con 0x555c199c6ff0 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4aa3400640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4aa402aeb0 tx=0x7f4aa4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cc09d2f40427db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4a9be00640 1 -- 172.21.15.33:0/4106916595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa405f070 con 0x555c199c6ff0 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4a9be00640 1 -- 172.21.15.33:0/4106916595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa4036040 con 0x555c199c6ff0 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.926+0000 7f4a9be00640 1 -- 172.21.15.33:0/4106916595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40305c0 con 0x555c199c6ff0 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 -- 172.21.15.33:0/4106916595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 msgr2=0x555c199ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:54.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4aa402aeb0 tx=0x7f4aa4009360 comp rx=0 tx=0).stop 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 -- 172.21.15.33:0/4106916595 shutdown_connections 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 --2- 172.21.15.33:0/4106916595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199ce3b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 -- 172.21.15.33:0/4106916595 >> 172.21.15.33:0/4106916595 conn(0x555c199c4e20 msgr2=0x555c199cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 -- 172.21.15.33:0/4106916595 shutdown_connections 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.927+0000 7f4ab560e740 1 -- 172.21.15.33:0/4106916595 wait complete. 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 -- start start 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 Processor -- start 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1b01a0 con 0x555c199c6ff0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1b1610 con 0x555c199d38a0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1b0870 con 0x555c199c7910 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.928+0000 7f4ab560e740 10 client.0 _ll_register_callbacks cb 0x7f4a9400b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44872/0 (socket says 172.21.15.33:44872) 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 -- 172.21.15.33:0/2757294473 learned_addr learned my addr 172.21.15.33:0/2757294473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 -- 172.21.15.33:0/2757294473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 msgr2=0x555c199ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 -- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 msgr2=0x555c199ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:54.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.929+0000 7f4ab0a00640 1 -- 172.21.15.33:0/2757294473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c199df5d0 con 0x555c199c6ff0 2024-09-10T23:57:54.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4ab0a00640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4003b70 tx=0x7f4aa4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f88aba40d5833a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:57:54.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4a99600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa405f070 con 0x555c199c6ff0 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4aa4003ed0 con 0x555c199c6ff0 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa4036040 con 0x555c199c6ff0 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4aa4071050 con 0x555c199c6ff0 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4ab560e740 10 client.15678 fetch_fsmap learned FSMap version 26 2024-09-10T23:57:54.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c19a50dd0 con 0x555c199c6ff0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.930+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa4036040 con 0x555c199c6ff0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4aa4043020 con 0x555c199c6ff0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 10 client.15678 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 10 client.15678 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 20 client.15678 populate_metadata read hostname 'smithi033' 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c19a511c0 0x555c19a535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 4 client.15678 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7f2f5515", "release": true, "await": true}] 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7f2f5515", "release": true, "await": true}) -- 0x555c1993bc90 con 0x555c19a511c0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.931+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c19a511c0 0x555c19a535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.932+0000 7f4aa3400640 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c19a511c0 0x555c19a535b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d7933b8ca95e4c server_cookie=6db65f27896a70b3 in_seq=0 out_seq=0 2024-09-10T23:57:54.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.932+0000 7f4a99600640 10 client.15678 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:55.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4a99600640 1 -- 172.21.15.33:0/2757294473 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555c1993bc90 con 0x555c19a511c0 2024-09-10T23:57:55.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4a99600640 10 client.15678 handle_command_reply: tid=0 2024-09-10T23:57:55.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 client.15678 shutdown 2024-09-10T23:57:55.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 msgr2=0x555c199dbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:55.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4003b70 tx=0x7f4aa4003970 comp rx=0 tx=0).stop 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 shutdown_connections 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c199d38a0 0x555c199ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555c19a511c0 0x555c19a535b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555c199c7910 0x555c199ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 --2- 172.21.15.33:0/2757294473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c199c6ff0 0x555c199dbb70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 >> 172.21.15.33:0/2757294473 conn(0x555c199c4e20 msgr2=0x555c199d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4a99600640 0 client.15678 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 shutdown_connections 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 1 -- 172.21.15.33:0/2757294473 wait complete. 2024-09-10T23:57:55.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.998+0000 7f4ab560e740 20 client.15678 trim_cache size 0 max 16384 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 4, 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "7f2f5515": { 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 4, 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:57:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.2, 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 msgr2=0x7f4a900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 0x7f4a900b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0e33c0 tx=0x7f4a9c000bc0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 msgr2=0x7f4aac0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00d950 tx=0x7f4a9c00de10 comp rx=0 tx=0).stop 2024-09-10T23:57:55.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 shutdown_connections 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4a900b5360 0x7f4a900b7820 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4aac109130 0x7f4aac075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aac1087b0 0x7f4aac0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 --2- 172.21.15.33:0/851673186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4aac102da0 0x7f4aac0754a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 >> 172.21.15.33:0/851673186 conn(0x7f4aac0fe810 msgr2=0x7f4aac100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 shutdown_connections 2024-09-10T23:57:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:57:54.999+0000 7f4ab2a00640 1 -- 172.21.15.33:0/851673186 wait complete. 2024-09-10T23:57:55.925 INFO:teuthology.orchestra.run.smithi033.stderr:200000 of 3200000 tuples (6%) done (elapsed 27.31 s, remaining 409.63 s) 2024-09-10T23:57:56.051 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7f2f5515', total seconds elapsed: 29.6 2024-09-10T23:57:56.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:55 smithi052 ceph-mon[33526]: pgmap v471: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 10 op/s 2024-09-10T23:57:56.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:55 smithi033 ceph-mon[30593]: pgmap v471: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 10 op/s 2024-09-10T23:57:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:55 smithi189 ceph-mon[34000]: pgmap v471: 129 pgs: 129 active+clean; 70 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.8 KiB/s wr, 10 op/s 2024-09-10T23:57:57.678 INFO:teuthology.orchestra.run.smithi033.stderr:300000 of 3200000 tuples (9%) done (elapsed 29.06 s, remaining 280.93 s) 2024-09-10T23:57:58.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:57 smithi033 ceph-mon[30593]: pgmap v472: 129 pgs: 129 active+clean; 77 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T23:57:58.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:57 smithi052 ceph-mon[33526]: pgmap v472: 129 pgs: 129 active+clean; 77 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T23:57:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:57 smithi189 ceph-mon[34000]: pgmap v472: 129 pgs: 129 active+clean; 77 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2024-09-10T23:57:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:400000 of 3200000 tuples (12%) done (elapsed 30.26 s, remaining 211.82 s) 2024-09-10T23:58:00.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:57:59 smithi052 ceph-mon[33526]: pgmap v473: 129 pgs: 129 active+clean; 85 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-10T23:58:00.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:57:59 smithi033 ceph-mon[30593]: pgmap v473: 129 pgs: 129 active+clean; 85 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-10T23:58:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:57:59 smithi189 ceph-mon[34000]: pgmap v473: 129 pgs: 129 active+clean; 85 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 MiB/s wr, 9 op/s 2024-09-10T23:58:00.704 INFO:teuthology.orchestra.run.smithi033.stderr:500000 of 3200000 tuples (15%) done (elapsed 32.09 s, remaining 173.28 s) 2024-09-10T23:58:02.007 INFO:teuthology.orchestra.run.smithi033.stderr:600000 of 3200000 tuples (18%) done (elapsed 33.39 s, remaining 144.70 s) 2024-09-10T23:58:02.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:01 smithi052 ceph-mon[33526]: pgmap v474: 129 pgs: 129 active+clean; 117 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 12 op/s 2024-09-10T23:58:02.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:01 smithi033 ceph-mon[30593]: pgmap v474: 129 pgs: 129 active+clean; 117 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 12 op/s 2024-09-10T23:58:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:01 smithi189 ceph-mon[34000]: pgmap v474: 129 pgs: 129 active+clean; 117 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 12 op/s 2024-09-10T23:58:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:700000 of 3200000 tuples (21%) done (elapsed 35.00 s, remaining 124.99 s) 2024-09-10T23:58:04.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:03 smithi052 ceph-mon[33526]: pgmap v475: 129 pgs: 129 active+clean; 145 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 18 op/s 2024-09-10T23:58:04.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:03 smithi033 ceph-mon[30593]: pgmap v475: 129 pgs: 129 active+clean; 145 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 18 op/s 2024-09-10T23:58:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:03 smithi189 ceph-mon[34000]: pgmap v475: 129 pgs: 129 active+clean; 145 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 18 op/s 2024-09-10T23:58:05.337 INFO:teuthology.orchestra.run.smithi033.stderr:800000 of 3200000 tuples (25%) done (elapsed 36.72 s, remaining 110.16 s) 2024-09-10T23:58:06.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:05 smithi052 ceph-mon[33526]: pgmap v476: 129 pgs: 129 active+clean; 165 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 17 op/s 2024-09-10T23:58:06.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:05 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:06.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:05 smithi033 ceph-mon[30593]: pgmap v476: 129 pgs: 129 active+clean; 165 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 17 op/s 2024-09-10T23:58:06.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:05 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:06.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:05 smithi189 ceph-mon[34000]: pgmap v476: 129 pgs: 129 active+clean; 165 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 17 op/s 2024-09-10T23:58:06.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:05 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:58:06.647 INFO:teuthology.orchestra.run.smithi033.stderr:900000 of 3200000 tuples (28%) done (elapsed 38.03 s, remaining 97.19 s) 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 -- 172.21.15.33:0/2790964638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 msgr2=0x7f88ec105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 --2- 172.21.15.33:0/2790964638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec105360 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009ca0 tx=0x7f88e402a8c0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 -- 172.21.15.33:0/2790964638 shutdown_connections 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 --2- 172.21.15.33:0/2790964638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 0x7f88ec10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 --2- 172.21.15.33:0/2790964638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 0x7f88ec107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 --2- 172.21.15.33:0/2790964638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec105360 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 -- 172.21.15.33:0/2790964638 >> 172.21.15.33:0/2790964638 conn(0x7f88ec0fcf30 msgr2=0x7f88ec0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 -- 172.21.15.33:0/2790964638 shutdown_connections 2024-09-10T23:58:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.142+0000 7f88f2e00640 1 -- 172.21.15.33:0/2790964638 wait complete. 2024-09-10T23:58:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.143+0000 7f88f2e00640 1 Processor -- start 2024-09-10T23:58:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 -- start start 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 0x7f88ec19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 0x7f88ec19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec10e2d0 con 0x7f88ec06b470 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec10e150 con 0x7f88ec1058f0 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f2e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec10e450 con 0x7f88ec1084a0 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36178/0 (socket says 172.21.15.33:36178) 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f1a00640 1 -- 172.21.15.33:0/3095058926 learned_addr learned my addr 172.21.15.33:0/3095058926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.144+0000 7f88f1000640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 0x7f88ec19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f2400640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 0x7f88ec19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 -- 172.21.15.33:0/3095058926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 msgr2=0x7f88ec19bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 0x7f88ec19bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 -- 172.21.15.33:0/3095058926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 msgr2=0x7f88ec19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 0x7f88ec19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 -- 172.21.15.33:0/3095058926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec19c7b0 con 0x7f88ec06b470 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f88e4005e30 tx=0x7f88e4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88ea000640 1 -- 172.21.15.33:0/3095058926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4032e90 con 0x7f88ec06b470 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88ea000640 1 -- 172.21.15.33:0/3095058926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88e40044d0 con 0x7f88ec06b470 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.145+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec19ca40 con 0x7f88ec06b470 2024-09-10T23:58:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.146+0000 7f88ea000640 1 -- 172.21.15.33:0/3095058926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4030ce0 con 0x7f88ec06b470 2024-09-10T23:58:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.146+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec1a3170 con 0x7f88ec06b470 2024-09-10T23:58:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.149+0000 7f88f7232740 1 Processor -- start 2024-09-10T23:58:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.149+0000 7f88f7232740 1 -- start start 2024-09-10T23:58:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.149+0000 7f88f7232740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f7232740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f42a0 0x560a732f6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f7232740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f6ce0 0x560a732f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f7232740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560a732646b0 con 0x560a732f1970 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f7232740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a73253ae0 con 0x560a732f42a0 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f7232740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a732578f0 con 0x560a732f6ce0 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88ea000640 1 -- 172.21.15.33:0/3095058926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f88e4004040 con 0x7f88ec06b470 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36190/0 (socket says 172.21.15.33:36190) 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f2400640 1 -- 172.21.15.33:0/3767089593 learned_addr learned my addr 172.21.15.33:0/3767089593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f42a0 0x560a732f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.150+0000 7f88f1000640 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f6ce0 0x560a732f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 -- 172.21.15.33:0/3767089593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f6ce0 msgr2=0x560a732f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f6ce0 0x560a732f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 -- 172.21.15.33:0/3767089593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f42a0 msgr2=0x560a732f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f42a0 0x560a732f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 -- 172.21.15.33:0/3767089593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a73220780 con 0x560a732f1970 2024-09-10T23:58:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88f2400640 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f88d800bc10 tx=0x7f88d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e0cb93272a6ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88dea00640 1 -- 172.21.15.33:0/3767089593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8015070 con 0x560a732f1970 2024-09-10T23:58:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88dea00640 1 -- 172.21.15.33:0/3767089593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d801a8f0 con 0x560a732f1970 2024-09-10T23:58:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.151+0000 7f88dea00640 1 -- 172.21.15.33:0/3767089593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8011710 con 0x560a732f1970 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88ea000640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 0x7f88d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88ea000640 1 -- 172.21.15.33:0/3095058926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f88e4107250 con 0x7f88ec06b470 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 0x7f88d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 -- 172.21.15.33:0/3767089593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 msgr2=0x560a732f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f88d800bc10 tx=0x7f88d800f730 comp rx=0 tx=0).stop 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 -- 172.21.15.33:0/3767089593 shutdown_connections 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f6ce0 0x560a732f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f42a0 0x560a732f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 --2- 172.21.15.33:0/3767089593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732f3d60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.152+0000 7f88f7232740 1 -- 172.21.15.33:0/3767089593 >> 172.21.15.33:0/3767089593 conn(0x560a732ecac0 msgr2=0x560a732ed850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.153+0000 7f88f7232740 1 -- 172.21.15.33:0/3767089593 shutdown_connections 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.153+0000 7f88f7232740 1 -- 172.21.15.33:0/3767089593 wait complete. 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.153+0000 7f88f1a00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 0x7f88d40b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88e4104950 tx=0x7f88e410ac90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.153+0000 7f88f7232740 1 -- start start 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.153+0000 7f88f7232740 1 Processor -- start 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732fb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a732fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560a7318bab0 con 0x560a732f1970 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a731fa570 con 0x560a732f6ce0 2024-09-10T23:58:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560a732f9cc0 con 0x560a732f42a0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f7232740 10 client.0 _ll_register_callbacks cb 0x560a73209100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36194/0 (socket says 172.21.15.33:36194) 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f2400640 1 -- 172.21.15.33:0/2839492550 learned_addr learned my addr 172.21.15.33:0/2839492550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.154+0000 7f88f1000640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f2400640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a732fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 -- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 msgr2=0x560a732fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a732fc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 -- 172.21.15.33:0/2839492550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 msgr2=0x560a732fb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 -- 172.21.15.33:0/2839492550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a72fb5790 con 0x560a732f42a0 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f2400640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f1000640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732fb860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f88e0012700 tx=0x7f88e0012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188d2cb1d6ae5c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88d3400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T23:58:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e000f920 con 0x560a732f42a0 2024-09-10T23:58:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d801a8f0 con 0x560a732f42a0 2024-09-10T23:58:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.155+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f88e000fac0 con 0x560a732f42a0 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.156+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88e000fcc0 con 0x560a732f42a0 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.156+0000 7f88f7232740 10 client.25438 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.156+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a7302e620 con 0x560a732f42a0 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.156+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d801a8f0 con 0x560a732f42a0 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.156+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f88e001c420 con 0x560a732f42a0 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 10 client.25438 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 10 client.25438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 20 client.25438 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73306bc0 0x560a73309000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 4 client.25438 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a73266600 con 0x560a73306bc0 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.157+0000 7f88f2400640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73306bc0 0x560a73309000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.158+0000 7f88d3400640 10 client.25438 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.158+0000 7f88f2400640 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73306bc0 0x560a73309000 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c57228997dc9a3e4 server_cookie=617318da10fe6938 in_seq=0 out_seq=0 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88d3400640 1 -- 172.21.15.33:0/2839492550 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a73266600 con 0x560a73306bc0 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88d3400640 10 client.25438 handle_command_reply: tid=0 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 client.25438 shutdown 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 msgr2=0x560a732fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732fb860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f88e0012700 tx=0x7f88e0012bc0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 shutdown_connections 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a732fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73306bc0 0x560a73309000 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732fb860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 --2- 172.21.15.33:0/2839492550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f1970 0x560a732fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 >> 172.21.15.33:0/2839492550 conn(0x560a732ecac0 msgr2=0x560a732ebbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88d3400640 0 client.25438 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 shutdown_connections 2024-09-10T23:58:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 1 -- 172.21.15.33:0/2839492550 wait complete. 2024-09-10T23:58:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.159+0000 7f88f7232740 20 client.25438 trim_cache size 0 max 16384 2024-09-10T23:58:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 Processor -- start 2024-09-10T23:58:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 -- start start 2024-09-10T23:58:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f6ce0 0x560a732f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1afd60 con 0x560a732f6ce0 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1ad630 con 0x560a732f1970 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f7232740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1ab480 con 0x560a732f42a0 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f6ce0 0x560a732f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f2400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f2400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54450/0 (socket says 172.21.15.33:54450) 2024-09-10T23:58:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.180+0000 7f88f2400640 1 -- 172.21.15.33:0/3916815283 learned_addr learned my addr 172.21.15.33:0/3916815283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f1000640 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 -- 172.21.15.33:0/3916815283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 msgr2=0x560a732f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 -- 172.21.15.33:0/3916815283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f6ce0 msgr2=0x560a732f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f6ce0 0x560a732f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 -- 172.21.15.33:0/3916815283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a732f40d0 con 0x560a732f1970 2024-09-10T23:58:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88f2400640 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88d800fc30 tx=0x7f88d800b2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b721708f0c467f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.181+0000 7f88de000640 1 -- 172.21.15.33:0/3916815283 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8015040 con 0x560a732f1970 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88de000640 1 -- 172.21.15.33:0/3916815283 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d80054d0 con 0x560a732f1970 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88de000640 1 -- 172.21.15.33:0/3916815283 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d801a520 con 0x560a732f1970 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 -- 172.21.15.33:0/3916815283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 msgr2=0x560a732f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88d800fc30 tx=0x7f88d800b2c0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 -- 172.21.15.33:0/3916815283 shutdown_connections 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f6ce0 0x560a732f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f42a0 0x560a732f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 --2- 172.21.15.33:0/3916815283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f1970 0x560a732f0f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.182+0000 7f88f7232740 1 -- 172.21.15.33:0/3916815283 >> 172.21.15.33:0/3916815283 conn(0x560a732ecac0 msgr2=0x560a732e7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 -- 172.21.15.33:0/3916815283 shutdown_connections 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 -- 172.21.15.33:0/3916815283 wait complete. 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 -- start start 2024-09-10T23:58:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 Processor -- start 2024-09-10T23:58:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 0x560a73302d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.183+0000 7f88f7232740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f7232740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a733020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f7232740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1abaf0 con 0x560a732f42a0 2024-09-10T23:58:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f7232740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1acf60 con 0x560a732f6ce0 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f7232740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec1ac1c0 con 0x560a732f1970 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f7232740 10 client.0 _ll_register_callbacks cb 0x7f88e0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36212/0 (socket says 172.21.15.33:36212) 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 -- 172.21.15.33:0/1717901226 learned_addr learned my addr 172.21.15.33:0/1717901226 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f2400640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a733020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f2400640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 0x560a73302d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 -- 172.21.15.33:0/1717901226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 msgr2=0x560a73302d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 0x560a73302d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 -- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 msgr2=0x560a733020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a733020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f1000640 1 -- 172.21.15.33:0/1717901226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a733028b0 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.184+0000 7f88f2400640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 0x560a73302d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88f1000640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f88e0000c00 tx=0x7f88e000ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdea1ec83371560c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88d3400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e001cad0 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d80054d0 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f88e001cc70 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88e0035050 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88f7232740 10 client.15696 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a73373cc0 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.185+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d80054d0 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f88e0003990 con 0x560a732f42a0 2024-09-10T23:58:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 10 client.15696 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 20 client.15696 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73374690 0x560a73376ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 4 client.15696 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a732620b0 con 0x560a73374690 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.186+0000 7f88f2400640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73374690 0x560a73376ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.187+0000 7f88f2400640 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73374690 0x560a73376ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96700e1fd3a0db1b server_cookie=ee85e1ac7532482a in_seq=0 out_seq=0 2024-09-10T23:58:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.187+0000 7f88d3400640 10 client.15696 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:07.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:07.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:07.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:58:07.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.206+0000 7f88d3400640 1 -- 172.21.15.33:0/1717901226 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a732620b0 con 0x560a73374690 2024-09-10T23:58:07.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.206+0000 7f88d3400640 10 client.15696 handle_command_reply: tid=0 2024-09-10T23:58:07.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.206+0000 7f88f7232740 1 client.15696 shutdown 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.206+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 msgr2=0x560a73301a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.206+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f88e0000c00 tx=0x7f88e000ffb0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 shutdown_connections 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a732f6ce0 0x560a733020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560a732f42a0 0x560a73301a80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560a73374690 0x560a73376ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 --2- 172.21.15.33:0/1717901226 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560a732f1970 0x560a73302d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 >> 172.21.15.33:0/1717901226 conn(0x560a732ecac0 msgr2=0x560a732f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88d3400640 0 client.15696 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 shutdown_connections 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 1 -- 172.21.15.33:0/1717901226 wait complete. 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.207+0000 7f88f7232740 20 client.15696 trim_cache size 0 max 16384 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:58:07.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 msgr2=0x7f88d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 0x7f88d40b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f88e4104950 tx=0x7f88e410ac90 comp rx=0 tx=0).stop 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 msgr2=0x7f88ec19ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f88e4005e30 tx=0x7f88e4003ba0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 shutdown_connections 2024-09-10T23:58:07.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f88d40b52e0 0x7f88d40b77a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88ec1084a0 0x7f88ec19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1058f0 0x7f88ec19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 --2- 172.21.15.33:0/3095058926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88ec06b470 0x7f88ec19ace0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 >> 172.21.15.33:0/3095058926 conn(0x7f88ec0fcf30 msgr2=0x7f88ec0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 shutdown_connections 2024-09-10T23:58:07.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:07.208+0000 7f88f2e00640 1 -- 172.21.15.33:0/3095058926 wait complete. 2024-09-10T23:58:07.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:07.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:58:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:58:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:58:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:58:08.341 INFO:teuthology.orchestra.run.smithi033.stderr:1000000 of 3200000 tuples (31%) done (elapsed 39.73 s, remaining 87.40 s) 2024-09-10T23:58:08.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:08 smithi033 ceph-mon[30593]: pgmap v477: 129 pgs: 129 active+clean; 209 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2024-09-10T23:58:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:08 smithi189 ceph-mon[34000]: pgmap v477: 129 pgs: 129 active+clean; 209 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2024-09-10T23:58:08.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:08 smithi052 ceph-mon[33526]: pgmap v477: 129 pgs: 129 active+clean; 209 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2024-09-10T23:58:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:1100000 of 3200000 tuples (34%) done (elapsed 41.47 s, remaining 79.17 s) 2024-09-10T23:58:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:10 smithi189 ceph-mon[34000]: pgmap v478: 129 pgs: 129 active+clean; 243 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-10T23:58:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:10 smithi052 ceph-mon[33526]: pgmap v478: 129 pgs: 129 active+clean; 243 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-10T23:58:11.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:10 smithi033 ceph-mon[30593]: pgmap v478: 129 pgs: 129 active+clean; 243 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 22 op/s 2024-09-10T23:58:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:1200000 of 3200000 tuples (37%) done (elapsed 42.72 s, remaining 71.20 s) 2024-09-10T23:58:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:12 smithi189 ceph-mon[34000]: pgmap v479: 129 pgs: 129 active+clean; 255 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-10T23:58:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:12 smithi052 ceph-mon[33526]: pgmap v479: 129 pgs: 129 active+clean; 255 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-10T23:58:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:1300000 of 3200000 tuples (40%) done (elapsed 44.34 s, remaining 64.81 s) 2024-09-10T23:58:13.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:12 smithi033 ceph-mon[30593]: pgmap v479: 129 pgs: 129 active+clean; 255 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 24 op/s 2024-09-10T23:58:14.760 INFO:teuthology.orchestra.run.smithi033.stderr:1400000 of 3200000 tuples (43%) done (elapsed 46.14 s, remaining 59.33 s) 2024-09-10T23:58:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:14 smithi189 ceph-mon[34000]: pgmap v480: 129 pgs: 129 active+clean; 301 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-10T23:58:14.959 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:14 smithi052 ceph-mon[33526]: pgmap v480: 129 pgs: 129 active+clean; 301 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-10T23:58:15.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:14 smithi033 ceph-mon[30593]: pgmap v480: 129 pgs: 129 active+clean; 301 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-10T23:58:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:1500000 of 3200000 tuples (46%) done (elapsed 47.39 s, remaining 53.71 s) 2024-09-10T23:58:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:16 smithi189 ceph-mon[34000]: pgmap v481: 129 pgs: 129 active+clean; 317 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:16 smithi052 ceph-mon[33526]: pgmap v481: 129 pgs: 129 active+clean; 317 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:17.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:16 smithi033 ceph-mon[30593]: pgmap v481: 129 pgs: 129 active+clean; 317 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:17.760 INFO:teuthology.orchestra.run.smithi033.stderr:1600000 of 3200000 tuples (50%) done (elapsed 49.14 s, remaining 49.14 s) 2024-09-10T23:58:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:18 smithi189 ceph-mon[34000]: pgmap v482: 129 pgs: 129 active+clean; 357 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:18.942 INFO:teuthology.orchestra.run.smithi033.stderr:1700000 of 3200000 tuples (53%) done (elapsed 50.33 s, remaining 44.41 s) 2024-09-10T23:58:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:18 smithi052 ceph-mon[33526]: pgmap v482: 129 pgs: 129 active+clean; 357 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:19.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:18 smithi033 ceph-mon[30593]: pgmap v482: 129 pgs: 129 active+clean; 357 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.344+0000 7f3236e00640 1 -- 172.21.15.33:0/2003942079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230108680 msgr2=0x7f323010ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.344+0000 7f3236e00640 1 --2- 172.21.15.33:0/2003942079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230108680 0x7f323010ab40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3228009ca0 tx=0x7f322802a8c0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 -- 172.21.15.33:0/2003942079 shutdown_connections 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 --2- 172.21.15.33:0/2003942079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230108680 0x7f323010ab40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 --2- 172.21.15.33:0/2003942079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230105ad0 0x7f3230107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 --2- 172.21.15.33:0/2003942079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 0x7f3230105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 -- 172.21.15.33:0/2003942079 >> 172.21.15.33:0/2003942079 conn(0x7f32300fd130 msgr2=0x7f32300ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 -- 172.21.15.33:0/2003942079 shutdown_connections 2024-09-10T23:58:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.345+0000 7f3236e00640 1 -- 172.21.15.33:0/2003942079 wait complete. 2024-09-10T23:58:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 Processor -- start 2024-09-10T23:58:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 -- start start 2024-09-10T23:58:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 0x7f3230102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 0x7f3230101a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f323010e4d0 con 0x7f3230105ad0 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f323010e350 con 0x7f3230108680 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.346+0000 7f3236e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f323010e650 con 0x7f323006bc90 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56984/0 (socket says 172.21.15.33:56984) 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 -- 172.21.15.33:0/3226356589 learned_addr learned my addr 172.21.15.33:0/3226356589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f3234e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 0x7f3230101a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322fe00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 0x7f3230102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 -- 172.21.15.33:0/3226356589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 msgr2=0x7f3230102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 0x7f3230102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 -- 172.21.15.33:0/3226356589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 msgr2=0x7f3230101a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 0x7f3230101a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f322f400640 1 -- 172.21.15.33:0/3226356589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3230102290 con 0x7f3230105ad0 2024-09-10T23:58:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.347+0000 7f3234e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 0x7f3230101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f322f400640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f321c00e9f0 tx=0x7f321c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f322cc00640 1 -- 172.21.15.33:0/3226356589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c00cd80 con 0x7f3230105ad0 2024-09-10T23:58:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f322cc00640 1 -- 172.21.15.33:0/3226356589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f321c0108c0 con 0x7f3230105ad0 2024-09-10T23:58:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f322cc00640 1 -- 172.21.15.33:0/3226356589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0187c0 con 0x7f3230105ad0 2024-09-10T23:58:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32301a2d00 con 0x7f3230105ad0 2024-09-10T23:58:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.348+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32301a3210 con 0x7f3230105ad0 2024-09-10T23:58:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.353+0000 7f3239e64740 1 Processor -- start 2024-09-10T23:58:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.353+0000 7f3239e64740 1 -- start start 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f322cc00640 1 -- 172.21.15.33:0/3226356589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f321c010430 con 0x7f3230105ad0 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b3d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 0x559bf3b3ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559bf3aab6b0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559bf3a9aae0 con 0x559bf3b3db00 2024-09-10T23:58:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3239e64740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bf3a9e8f0 con 0x559bf3b38790 2024-09-10T23:58:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.354+0000 7f3234e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.355+0000 7f3234e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:60570/0 (socket says 172.21.15.33:60570) 2024-09-10T23:58:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.355+0000 7f3234e00640 1 -- 172.21.15.33:0/1394925848 learned_addr learned my addr 172.21.15.33:0/1394925848 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.355+0000 7f322fe00640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b3d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.355+0000 7f322f400640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 0x559bf3b3ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f3234e00640 1 -- 172.21.15.33:0/1394925848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 msgr2=0x559bf3b3ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f3234e00640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 0x559bf3b3ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f3234e00640 1 -- 172.21.15.33:0/1394925848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 msgr2=0x559bf3b3d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f3234e00640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b3d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f3234e00640 1 -- 172.21.15.33:0/1394925848 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf3a67780 con 0x559bf3b38790 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f322fe00640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b3d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.356+0000 7f322f400640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 0x559bf3b3ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:58:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.357+0000 7f3234e00640 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f322802aeb0 tx=0x7f3228009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e6d8b57da0d75e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.357+0000 7f3225600640 1 -- 172.21.15.33:0/1394925848 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228031d80 con 0x559bf3b38790 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.357+0000 7f3225600640 1 -- 172.21.15.33:0/1394925848 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3228036030 con 0x559bf3b38790 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.357+0000 7f3225600640 1 -- 172.21.15.33:0/1394925848 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228004810 con 0x559bf3b38790 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.357+0000 7f322cc00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 0x7f32140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f322cc00640 1 -- 172.21.15.33:0/3226356589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f321c0e6250 con 0x7f3230105ad0 2024-09-10T23:58:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f322fe00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 0x7f32140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 -- 172.21.15.33:0/1394925848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 msgr2=0x559bf3b3ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f322802aeb0 tx=0x7f3228009a20 comp rx=0 tx=0).stop 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 -- 172.21.15.33:0/1394925848 shutdown_connections 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3db00 0x559bf3b3ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b3d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 --2- 172.21.15.33:0/1394925848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b38790 0x559bf3b3ab80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.358+0000 7f3239e64740 1 -- 172.21.15.33:0/1394925848 >> 172.21.15.33:0/1394925848 conn(0x559bf3b338e0 msgr2=0x559bf3b34670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.359+0000 7f3239e64740 1 -- 172.21.15.33:0/1394925848 shutdown_connections 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.359+0000 7f3239e64740 1 -- 172.21.15.33:0/1394925848 wait complete. 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.359+0000 7f322fe00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 0x7f32140b7820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3220005fd0 tx=0x7f322000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.359+0000 7f3239e64740 1 -- start start 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 Processor -- start 2024-09-10T23:58:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b4a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b4b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559bf39d2ab0 con 0x559bf3b38790 2024-09-10T23:58:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559bf3a41570 con 0x559bf3b3b0c0 2024-09-10T23:58:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bf3b49110 con 0x559bf3b3db00 2024-09-10T23:58:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.360+0000 7f3239e64740 10 client.0 _ll_register_callbacks cb 0x559bf3a50100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.361+0000 7f322f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.361+0000 7f322f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59974/0 (socket says 172.21.15.33:59974) 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.361+0000 7f322f400640 1 -- 172.21.15.33:0/3428233397 learned_addr learned my addr 172.21.15.33:0/3428233397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.361+0000 7f3234e00640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b4b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.361+0000 7f322fe00640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b4a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 -- 172.21.15.33:0/3428233397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 msgr2=0x559bf3b4b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b4b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 -- 172.21.15.33:0/3428233397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 msgr2=0x559bf3b4a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b4a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 -- 172.21.15.33:0/3428233397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf37fc790 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f322f400640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f321c0a8cf0 tx=0x7f321c0a85c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51897e7cedb1c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f321a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0abe90 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3228036030 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.362+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f321c0b5970 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f321c0ac230 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 10 client.35477 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bf3875620 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3228036030 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f321c0a8200 con 0x559bf3b3b0c0 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 10 client.35477 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 10 client.35477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 20 client.35477 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3b55dd0 0x559bf3b581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 4 client.35477 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.363+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf3aad600 con 0x559bf3b55dd0 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.364+0000 7f322fe00640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3b55dd0 0x559bf3b581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.365+0000 7f321a000640 10 client.35477 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.365+0000 7f322fe00640 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3b55dd0 0x559bf3b581c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821e8fc4c0696d50 server_cookie=2d9896a8c3347846 in_seq=0 out_seq=0 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.365+0000 7f321a000640 1 -- 172.21.15.33:0/3428233397 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bf3aad600 con 0x559bf3b55dd0 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.365+0000 7f321a000640 10 client.35477 handle_command_reply: tid=0 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 client.35477 shutdown 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 msgr2=0x559bf3b4ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f321c0a8cf0 tx=0x7f321c0a85c0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 shutdown_connections 2024-09-10T23:58:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3b55dd0 0x559bf3b581c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b4b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b4ab30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f321a000640 0 client.35477 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 --2- 172.21.15.33:0/3428233397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b4a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 >> 172.21.15.33:0/3428233397 conn(0x559bf3b338e0 msgr2=0x559bf3b32a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 shutdown_connections 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 1 -- 172.21.15.33:0/3428233397 wait complete. 2024-09-10T23:58:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.366+0000 7f3239e64740 20 client.35477 trim_cache size 0 max 16384 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 Processor -- start 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 -- start start 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b5dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32301abad0 con 0x559bf3b38790 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32301a93a0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3239e64740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32301a71f0 con 0x559bf3b3db00 2024-09-10T23:58:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f322fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f3234e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b5dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f322fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b32240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57008/0 (socket says 172.21.15.33:57008) 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.385+0000 7f322fe00640 1 -- 172.21.15.33:0/500669259 learned_addr learned my addr 172.21.15.33:0/500669259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f322f400640 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 -- 172.21.15.33:0/500669259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 msgr2=0x559bf3b32780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b32780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 -- 172.21.15.33:0/500669259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 msgr2=0x559bf3b32240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b32240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 -- 172.21.15.33:0/500669259 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf3b3d820 con 0x559bf3b3db00 2024-09-10T23:58:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f322f400640 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:58:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.386+0000 7f3234e00640 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b5dad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3228005e30 tx=0x7f3228000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869669a6df8d1339 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3224c00640 1 -- 172.21.15.33:0/500669259 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322804a040 con 0x559bf3b3db00 2024-09-10T23:58:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3224c00640 1 -- 172.21.15.33:0/500669259 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3228036050 con 0x559bf3b3db00 2024-09-10T23:58:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3224c00640 1 -- 172.21.15.33:0/500669259 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280044a0 con 0x559bf3b3db00 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 -- 172.21.15.33:0/500669259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 msgr2=0x559bf3b5dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b5dad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3228005e30 tx=0x7f3228000f40 comp rx=0 tx=0).stop 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 -- 172.21.15.33:0/500669259 shutdown_connections 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b5dad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b3b0c0 0x559bf3b32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 --2- 172.21.15.33:0/500669259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b38790 0x559bf3b32240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.387+0000 7f3239e64740 1 -- 172.21.15.33:0/500669259 >> 172.21.15.33:0/500669259 conn(0x559bf3b338e0 msgr2=0x559bf3b37bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.388+0000 7f3239e64740 1 -- 172.21.15.33:0/500669259 shutdown_connections 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.388+0000 7f3239e64740 1 -- 172.21.15.33:0/500669259 wait complete. 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.388+0000 7f3239e64740 1 -- start start 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.388+0000 7f3239e64740 1 Processor -- start 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b38790 0x559bf3b510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b51b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32301a7860 con 0x559bf3b3b0c0 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32301a8cd0 con 0x559bf3b38790 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32301a7f30 con 0x559bf3b3db00 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3239e64740 10 client.0 _ll_register_callbacks cb 0x7f321c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57010/0 (socket says 172.21.15.33:57010) 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 -- 172.21.15.33:0/3206252308 learned_addr learned my addr 172.21.15.33:0/3206252308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f3234e00640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b51b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322fe00640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b38790 0x559bf3b510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 -- 172.21.15.33:0/3206252308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 msgr2=0x559bf3b51b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b51b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 -- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b38790 msgr2=0x559bf3b510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b38790 0x559bf3b510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.389+0000 7f322f400640 1 -- 172.21.15.33:0/3206252308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf3b4ffe0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f322f400640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f321c0a8ca0 tx=0x7f321c0a82a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4e291819a2db00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f321a000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c0abe90 con 0x559bf3b3b0c0 2024-09-10T23:58:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f321c0b22e0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3228036050 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f321c0ac4f0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f3239e64740 10 client.15714 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.390+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bf3bc3200 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3228036050 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f321c0b24e0 con 0x559bf3b3b0c0 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 10 client.15714 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 20 client.15714 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3bc3bb0 0x559bf3bc5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 4 client.15714 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:58:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559bf3aa90b0 con 0x559bf3bc3bb0 2024-09-10T23:58:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.391+0000 7f322fe00640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3bc3bb0 0x559bf3bc5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.392+0000 7f322fe00640 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3bc3bb0 0x559bf3bc5fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6da118001fdaa8b2 server_cookie=512ff66402f3bec8 in_seq=0 out_seq=0 2024-09-10T23:58:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.392+0000 7f321a000640 10 client.15714 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f321a000640 1 -- 172.21.15.33:0/3206252308 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559bf3aa90b0 con 0x559bf3bc3bb0 2024-09-10T23:58:20.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f321a000640 10 client.15714 handle_command_reply: tid=0 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 client.15714 shutdown 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 msgr2=0x559bf3b51630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f321c0a8ca0 tx=0x7f321c0a82a0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 shutdown_connections 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559bf3bc3bb0 0x559bf3bc5fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bf3b3db00 0x559bf3b51b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559bf3b3b0c0 0x559bf3b51630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f321a000640 0 client.15714 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 --2- 172.21.15.33:0/3206252308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bf3b38790 0x559bf3b510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 >> 172.21.15.33:0/3206252308 conn(0x559bf3b338e0 msgr2=0x559bf3b32240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 shutdown_connections 2024-09-10T23:58:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 1 -- 172.21.15.33:0/3206252308 wait complete. 2024-09-10T23:58:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.412+0000 7f3239e64740 20 client.15714 trim_cache size 0 max 16384 2024-09-10T23:58:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:58:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:58:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:58:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 msgr2=0x7f32140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 0x7f32140b7820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3220005fd0 tx=0x7f322000b390 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 msgr2=0x7f32301014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f321c00e9f0 tx=0x7f321c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 shutdown_connections 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f32140b5360 0x7f32140b7820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3230108680 0x7f3230101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3230105ad0 0x7f32301014e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 --2- 172.21.15.33:0/3226356589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f323006bc90 0x7f3230102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 >> 172.21.15.33:0/3226356589 conn(0x7f32300fd130 msgr2=0x7f3230103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 shutdown_connections 2024-09-10T23:58:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:20.413+0000 7f3236e00640 1 -- 172.21.15.33:0/3226356589 wait complete. 2024-09-10T23:58:20.628 INFO:teuthology.orchestra.run.smithi033.stderr:1800000 of 3200000 tuples (56%) done (elapsed 52.01 s, remaining 40.45 s) 2024-09-10T23:58:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:20 smithi189 ceph-mon[34000]: pgmap v483: 129 pgs: 129 active+clean; 377 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:20 smithi052 ceph-mon[33526]: pgmap v483: 129 pgs: 129 active+clean; 377 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:21.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:20 smithi033 ceph-mon[30593]: pgmap v483: 129 pgs: 129 active+clean; 377 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 27 op/s 2024-09-10T23:58:21.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:21 smithi052 ceph-mon[33526]: pgmap v484: 129 pgs: 129 active+clean; 401 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:22.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:21 smithi033 ceph-mon[30593]: pgmap v484: 129 pgs: 129 active+clean; 401 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:22.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:21 smithi189 ceph-mon[34000]: pgmap v484: 129 pgs: 129 active+clean; 401 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:22.320 INFO:teuthology.orchestra.run.smithi033.stderr:1900000 of 3200000 tuples (59%) done (elapsed 53.70 s, remaining 36.75 s) 2024-09-10T23:58:23.595 INFO:teuthology.orchestra.run.smithi033.stderr:2000000 of 3200000 tuples (62%) done (elapsed 54.98 s, remaining 32.99 s) 2024-09-10T23:58:24.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:23 smithi052 ceph-mon[33526]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 34 op/s 2024-09-10T23:58:24.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:23 smithi033 ceph-mon[30593]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 34 op/s 2024-09-10T23:58:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:23 smithi189 ceph-mon[34000]: pgmap v485: 129 pgs: 129 active+clean; 445 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 34 op/s 2024-09-10T23:58:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2100000 of 3200000 tuples (65%) done (elapsed 56.58 s, remaining 29.64 s) 2024-09-10T23:58:26.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:25 smithi052 ceph-mon[33526]: pgmap v486: 129 pgs: 129 active+clean; 461 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-10T23:58:26.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:25 smithi033 ceph-mon[30593]: pgmap v486: 129 pgs: 129 active+clean; 461 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-10T23:58:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:25 smithi189 ceph-mon[34000]: pgmap v486: 129 pgs: 129 active+clean; 461 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 MiB/s wr, 26 op/s 2024-09-10T23:58:26.918 INFO:teuthology.orchestra.run.smithi033.stderr:2200000 of 3200000 tuples (68%) done (elapsed 58.30 s, remaining 26.50 s) 2024-09-10T23:58:28.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:27 smithi052 ceph-mon[33526]: pgmap v487: 129 pgs: 129 active+clean; 510 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:28.229 INFO:teuthology.orchestra.run.smithi033.stderr:2300000 of 3200000 tuples (71%) done (elapsed 59.61 s, remaining 23.33 s) 2024-09-10T23:58:28.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:27 smithi033 ceph-mon[30593]: pgmap v487: 129 pgs: 129 active+clean; 510 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:27 smithi189 ceph-mon[34000]: pgmap v487: 129 pgs: 129 active+clean; 510 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:29.935 INFO:teuthology.orchestra.run.smithi033.stderr:2400000 of 3200000 tuples (75%) done (elapsed 61.32 s, remaining 20.44 s) 2024-09-10T23:58:30.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:29 smithi052 ceph-mon[33526]: pgmap v488: 129 pgs: 129 active+clean; 530 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:30.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:29 smithi033 ceph-mon[30593]: pgmap v488: 129 pgs: 129 active+clean; 530 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:29 smithi189 ceph-mon[34000]: pgmap v488: 129 pgs: 129 active+clean; 530 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 27 op/s 2024-09-10T23:58:31.637 INFO:teuthology.orchestra.run.smithi033.stderr:2500000 of 3200000 tuples (78%) done (elapsed 63.02 s, remaining 17.65 s) 2024-09-10T23:58:32.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:31 smithi052 ceph-mon[33526]: pgmap v489: 129 pgs: 129 active+clean; 558 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-10T23:58:32.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:31 smithi033 ceph-mon[30593]: pgmap v489: 129 pgs: 129 active+clean; 558 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-10T23:58:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:31 smithi189 ceph-mon[34000]: pgmap v489: 129 pgs: 129 active+clean; 558 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 MiB/s wr, 28 op/s 2024-09-10T23:58:32.820 INFO:teuthology.orchestra.run.smithi033.stderr:2600000 of 3200000 tuples (81%) done (elapsed 64.20 s, remaining 14.82 s) 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 -- 172.21.15.33:0/3520010149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 msgr2=0x7fe37c10ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 --2- 172.21.15.33:0/3520010149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c10ce60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe374009cd0 tx=0x7fe37402a8e0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 -- 172.21.15.33:0/3520010149 shutdown_connections 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 --2- 172.21.15.33:0/3520010149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c10ce60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 --2- 172.21.15.33:0/3520010149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 0x7fe37c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 --2- 172.21.15.33:0/3520010149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 0x7fe37c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 -- 172.21.15.33:0/3520010149 >> 172.21.15.33:0/3520010149 conn(0x7fe37c100270 msgr2=0x7fe37c1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 -- 172.21.15.33:0/3520010149 shutdown_connections 2024-09-10T23:58:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.565+0000 7fe380e00640 1 -- 172.21.15.33:0/3520010149 wait complete. 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 Processor -- start 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 -- start start 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 0x7fe37c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 0x7fe37c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c110520 con 0x7fe37c1064e0 2024-09-10T23:58:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1103a0 con 0x7fe37c1049d0 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.566+0000 7fe380e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1106a0 con 0x7fe37c105b20 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46604/0 (socket says 172.21.15.33:46604) 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 -- 172.21.15.33:0/3217179515 learned_addr learned my addr 172.21.15.33:0/3217179515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37aa00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 0x7fe37c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37b400640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 0x7fe37c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 -- 172.21.15.33:0/3217179515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 msgr2=0x7fe37c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 0x7fe37c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 -- 172.21.15.33:0/3217179515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 msgr2=0x7fe37c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 0x7fe37c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 -- 172.21.15.33:0/3217179515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c19c7c0 con 0x7fe37c1064e0 2024-09-10T23:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.567+0000 7fe37be00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe374003ba0 tx=0x7fe374003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.568+0000 7fe373e00640 1 -- 172.21.15.33:0/3217179515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374004240 con 0x7fe37c1064e0 2024-09-10T23:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.568+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c19ca50 con 0x7fe37c1064e0 2024-09-10T23:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.568+0000 7fe373e00640 1 -- 172.21.15.33:0/3217179515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3740305a0 con 0x7fe37c1064e0 2024-09-10T23:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.568+0000 7fe373e00640 1 -- 172.21.15.33:0/3217179515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374046480 con 0x7fe37c1064e0 2024-09-10T23:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.568+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1a3180 con 0x7fe37c1064e0 2024-09-10T23:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.572+0000 7fe3852d7740 1 Processor -- start 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.572+0000 7fe373e00640 1 -- 172.21.15.33:0/3217179515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe37404e070 con 0x7fe37c1064e0 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 -- start start 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e252d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e255690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56151e1c36b0 con 0x56151e255ce0 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56151e1b2ae0 con 0x56151e250970 2024-09-10T23:58:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe3852d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56151e1b68f0 con 0x56151e2532a0 2024-09-10T23:58:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe37b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e255690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46618/0 (socket says 172.21.15.33:46618) 2024-09-10T23:58:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe37aa00640 1 -- 172.21.15.33:0/15295649 learned_addr learned my addr 172.21.15.33:0/15295649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.573+0000 7fe37aa00640 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e252d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 -- 172.21.15.33:0/15295649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 msgr2=0x56151e252d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e252d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 -- 172.21.15.33:0/15295649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 msgr2=0x56151e2581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 -- 172.21.15.33:0/15295649 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151e17f780 con 0x56151e2532a0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37aa00640 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe373e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37b400640 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e255690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00bbf0 tx=0x7fe36c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f068152940ee233b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe373e00640 1 -- 172.21.15.33:0/3217179515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe374107160 con 0x7fe37c1064e0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.574+0000 7fe37aa00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe370c00640 1 -- 172.21.15.33:0/15295649 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c004030 con 0x56151e2532a0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe370c00640 1 -- 172.21.15.33:0/15295649 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe36c0035f0 con 0x56151e2532a0 2024-09-10T23:58:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe370c00640 1 -- 172.21.15.33:0/15295649 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011640 con 0x56151e2532a0 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe3852d7740 1 -- 172.21.15.33:0/15295649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 msgr2=0x56151e255690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe3852d7740 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e255690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00bbf0 tx=0x7fe36c0107a0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.575+0000 7fe37aa00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 0x7fe3600b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe36800bfd0 tx=0x7fe36800b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 -- 172.21.15.33:0/15295649 shutdown_connections 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e255ce0 0x56151e2581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e255690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 --2- 172.21.15.33:0/15295649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e252d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 -- 172.21.15.33:0/15295649 >> 172.21.15.33:0/15295649 conn(0x56151e24bac0 msgr2=0x56151e24c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 -- 172.21.15.33:0/15295649 shutdown_connections 2024-09-10T23:58:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 -- 172.21.15.33:0/15295649 wait complete. 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 -- start start 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.576+0000 7fe3852d7740 1 Processor -- start 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e25a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 0x56151e25b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56151e0eaab0 con 0x56151e250970 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56151e159570 con 0x56151e255ce0 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56151e258cc0 con 0x56151e2532a0 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe3852d7740 10 client.0 _ll_register_callbacks cb 0x56151e168100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe37b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe37b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46626/0 (socket says 172.21.15.33:46626) 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe37b400640 1 -- 172.21.15.33:0/4274306872 learned_addr learned my addr 172.21.15.33:0/4274306872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe37aa00640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e25a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.577+0000 7fe37be00640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 0x56151e25b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 -- 172.21.15.33:0/4274306872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 msgr2=0x56151e25a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e25a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 -- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 msgr2=0x56151e25b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 0x56151e25b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 -- 172.21.15.33:0/4274306872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151df14790 con 0x56151e250970 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37be00640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 0x56151e25b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe37b400640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe36c011010 tx=0x7fe36c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1837241937a970 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe365600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c02a060 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe36c003a30 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.578+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe36c0035f0 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe36c031050 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 10 client.15726 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56151df8d620 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe36c0035f0 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe36c0046c0 con 0x56151e250970 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 20 client.15726 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e265650 0x56151e267a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 4 client.15726 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.579+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151e1c5600 con 0x56151e265650 2024-09-10T23:58:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.580+0000 7fe37aa00640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e265650 0x56151e267a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.580+0000 7fe37aa00640 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e265650 0x56151e267a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f3494a70d462796 server_cookie=eb76dd6fe3b0160a in_seq=0 out_seq=0 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.580+0000 7fe365600640 10 client.15726 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.581+0000 7fe365600640 1 -- 172.21.15.33:0/4274306872 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56151e1c5600 con 0x56151e265650 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.581+0000 7fe365600640 10 client.15726 handle_command_reply: tid=0 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.581+0000 7fe3852d7740 1 client.15726 shutdown 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 msgr2=0x56151e25a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe36c011010 tx=0x7fe36c00bfd0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 shutdown_connections 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e255ce0 0x56151e25b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e265650 0x56151e267a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e2532a0 0x56151e25a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 --2- 172.21.15.33:0/4274306872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e250970 0x56151e25a0a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 >> 172.21.15.33:0/4274306872 conn(0x56151e24bac0 msgr2=0x56151e24abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe365600640 0 client.15726 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 shutdown_connections 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 1 -- 172.21.15.33:0/4274306872 wait complete. 2024-09-10T23:58:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.582+0000 7fe3852d7740 20 client.15726 trim_cache size 0 max 16384 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 Processor -- start 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 -- start start 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e24fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e24eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1afde0 con 0x56151e2532a0 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1ad6b0 con 0x56151e250970 2024-09-10T23:58:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe3852d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1ab500 con 0x56151e255ce0 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe37aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46642/0 (socket says 172.21.15.33:46642) 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.600+0000 7fe37aa00640 1 -- 172.21.15.33:0/100649052 learned_addr learned my addr 172.21.15.33:0/100649052 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37b400640 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e24fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37be00640 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e24eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 -- 172.21.15.33:0/100649052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 msgr2=0x56151e24eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e24eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 -- 172.21.15.33:0/100649052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 msgr2=0x56151e24fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e24fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 -- 172.21.15.33:0/100649052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151e25b000 con 0x56151e2532a0 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.601+0000 7fe37aa00640 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe368005fd0 tx=0x7fe3680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fef07b30c0bc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe367e00640 1 -- 172.21.15.33:0/100649052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368004020 con 0x56151e2532a0 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe367e00640 1 -- 172.21.15.33:0/100649052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3680041c0 con 0x56151e2532a0 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe367e00640 1 -- 172.21.15.33:0/100649052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3680235b0 con 0x56151e2532a0 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 -- 172.21.15.33:0/100649052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 msgr2=0x56151e250340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe368005fd0 tx=0x7fe3680046c0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 -- 172.21.15.33:0/100649052 shutdown_connections 2024-09-10T23:58:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e24eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e250340 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 --2- 172.21.15.33:0/100649052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e24fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.602+0000 7fe3852d7740 1 -- 172.21.15.33:0/100649052 >> 172.21.15.33:0/100649052 conn(0x56151e24bac0 msgr2=0x56151e259240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.603+0000 7fe3852d7740 1 -- 172.21.15.33:0/100649052 shutdown_connections 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.603+0000 7fe3852d7740 1 -- 172.21.15.33:0/100649052 wait complete. 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.603+0000 7fe3852d7740 1 -- start start 2024-09-10T23:58:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.603+0000 7fe3852d7740 1 Processor -- start 2024-09-10T23:58:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e260e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e261340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1abb70 con 0x56151e2532a0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1acfe0 con 0x56151e250970 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1ac240 con 0x56151e255ce0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe3852d7740 10 client.0 _ll_register_callbacks cb 0x7fe36800bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.604+0000 7fe37be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40376/0 (socket says 172.21.15.33:40376) 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37be00640 1 -- 172.21.15.33:0/1689232420 learned_addr learned my addr 172.21.15.33:0/1689232420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37b400640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e260e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e261340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 -- 172.21.15.33:0/1689232420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 msgr2=0x56151e2618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 -- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 msgr2=0x56151e260e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e260e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37aa00640 1 -- 172.21.15.33:0/1689232420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151e25fbe0 con 0x56151e2532a0 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.605+0000 7fe37be00640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.606+0000 7fe37aa00640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e261340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe36800baf0 tx=0x7fe3680043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2a224467b9b524 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.606+0000 7fe365600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.606+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368037020 con 0x56151e2532a0 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.606+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe368030040 con 0x56151e2532a0 2024-09-10T23:58:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.606+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3680041c0 con 0x56151e2532a0 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.607+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe36800e7c0 con 0x56151e2532a0 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.607+0000 7fe3852d7740 10 client.15732 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.607+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56151e2db1d0 con 0x56151e2532a0 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.607+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3680041c0 con 0x56151e2532a0 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe3680054d0 con 0x56151e2532a0 2024-09-10T23:58:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 10 client.15732 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 20 client.15732 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e2dbbb0 0x56151e2ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 4 client.15732 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56151e1c10b0 con 0x56151e2dbbb0 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.608+0000 7fe37b400640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e2dbbb0 0x56151e2ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.609+0000 7fe37b400640 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e2dbbb0 0x56151e2ddfd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16746eb912510529 server_cookie=c5763294100fb5d1 in_seq=0 out_seq=0 2024-09-10T23:58:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.609+0000 7fe365600640 10 client.15732 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe365600640 1 -- 172.21.15.33:0/1689232420 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56151e1c10b0 con 0x56151e2dbbb0 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe365600640 10 client.15732 handle_command_reply: tid=0 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 client.15732 shutdown 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 msgr2=0x56151e261340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e261340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe36800baf0 tx=0x7fe3680043f0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 shutdown_connections 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56151e2dbbb0 0x56151e2ddfd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56151e255ce0 0x56151e2618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56151e2532a0 0x56151e261340 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 --2- 172.21.15.33:0/1689232420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56151e250970 0x56151e260e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe365600640 0 client.15732 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.630+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 >> 172.21.15.33:0/1689232420 conn(0x56151e24bac0 msgr2=0x56151e24fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 shutdown_connections 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe3852d7740 1 -- 172.21.15.33:0/1689232420 wait complete. 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe3852d7740 20 client.15732 trim_cache size 0 max 16384 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:58:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 msgr2=0x7fe3600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 0x7fe3600b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe36800bfd0 tx=0x7fe36800b650 comp rx=0 tx=0).stop 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 msgr2=0x7fe37c19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe374003ba0 tx=0x7fe374003bd0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 shutdown_connections 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3600b52e0 0x7fe3600b77a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe37c1064e0 0x7fe37c19bf00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe37c105b20 0x7fe37c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.631+0000 7fe380e00640 1 --2- 172.21.15.33:0/3217179515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c1049d0 0x7fe37c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.632+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 >> 172.21.15.33:0/3217179515 conn(0x7fe37c100270 msgr2=0x7fe37c108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.632+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 shutdown_connections 2024-09-10T23:58:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:33.632+0000 7fe380e00640 1 -- 172.21.15.33:0/3217179515 wait complete. 2024-09-10T23:58:34.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:33 smithi052 ceph-mon[33526]: pgmap v490: 129 pgs: 129 active+clean; 600 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:34.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:33 smithi033 ceph-mon[30593]: pgmap v490: 129 pgs: 129 active+clean; 600 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:33 smithi189 ceph-mon[34000]: pgmap v490: 129 pgs: 129 active+clean; 600 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 MiB/s wr, 33 op/s 2024-09-10T23:58:34.507 INFO:teuthology.orchestra.run.smithi033.stderr:2700000 of 3200000 tuples (84%) done (elapsed 65.89 s, remaining 12.20 s) 2024-09-10T23:58:35.836 INFO:teuthology.orchestra.run.smithi033.stderr:2800000 of 3200000 tuples (87%) done (elapsed 67.22 s, remaining 9.60 s) 2024-09-10T23:58:36.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:35 smithi052 ceph-mon[33526]: pgmap v491: 129 pgs: 129 active+clean; 620 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-10T23:58:36.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:35 smithi033 ceph-mon[30593]: pgmap v491: 129 pgs: 129 active+clean; 620 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-10T23:58:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:35 smithi189 ceph-mon[34000]: pgmap v491: 129 pgs: 129 active+clean; 620 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 29 MiB/s wr, 25 op/s 2024-09-10T23:58:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2900000 of 3200000 tuples (90%) done (elapsed 68.83 s, remaining 7.12 s) 2024-09-10T23:58:38.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:37 smithi052 ceph-mon[33526]: pgmap v492: 129 pgs: 129 active+clean; 666 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 35 op/s 2024-09-10T23:58:38.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:37 smithi033 ceph-mon[30593]: pgmap v492: 129 pgs: 129 active+clean; 666 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 35 op/s 2024-09-10T23:58:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:37 smithi189 ceph-mon[34000]: pgmap v492: 129 pgs: 129 active+clean; 666 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 35 op/s 2024-09-10T23:58:39.148 INFO:teuthology.orchestra.run.smithi033.stderr:3000000 of 3200000 tuples (93%) done (elapsed 70.53 s, remaining 4.70 s) 2024-09-10T23:58:40.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:39 smithi052 ceph-mon[33526]: pgmap v493: 129 pgs: 129 active+clean; 686 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-10T23:58:40.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:39 smithi033 ceph-mon[30593]: pgmap v493: 129 pgs: 129 active+clean; 686 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-10T23:58:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:39 smithi189 ceph-mon[34000]: pgmap v493: 129 pgs: 129 active+clean; 686 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 29 op/s 2024-09-10T23:58:40.416 INFO:teuthology.orchestra.run.smithi033.stderr:3100000 of 3200000 tuples (96%) done (elapsed 71.80 s, remaining 2.32 s) 2024-09-10T23:58:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:3200000 of 3200000 tuples (100%) done (elapsed 73.52 s, remaining 0.00 s) 2024-09-10T23:58:42.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:41 smithi052 ceph-mon[33526]: pgmap v494: 129 pgs: 129 active+clean; 710 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-09-10T23:58:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:vacuuming... 2024-09-10T23:58:42.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:41 smithi033 ceph-mon[30593]: pgmap v494: 129 pgs: 129 active+clean; 710 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-09-10T23:58:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:41 smithi189 ceph-mon[34000]: pgmap v494: 129 pgs: 129 active+clean; 710 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 30 MiB/s wr, 32 op/s 2024-09-10T23:58:42.852 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-10T23:58:42.852 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-10T23:58:42.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:58:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.890+0000 7f0f95400640 1 -- 172.21.15.33:0/2798103410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 msgr2=0x7f0f90111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.890+0000 7f0f95400640 1 --2- 172.21.15.33:0/2798103410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f90111640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009ca0 tx=0x7f0f8802a950 comp rx=0 tx=0).stop 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 -- 172.21.15.33:0/2798103410 shutdown_connections 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 --2- 172.21.15.33:0/2798103410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f90111640 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 --2- 172.21.15.33:0/2798103410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f90101fc0 0x7f0f9010ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 --2- 172.21.15.33:0/2798103410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f901016a0 0x7f0f90101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 -- 172.21.15.33:0/2798103410 >> 172.21.15.33:0/2798103410 conn(0x7f0f900fd5b0 msgr2=0x7f0f900ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 -- 172.21.15.33:0/2798103410 shutdown_connections 2024-09-10T23:58:43.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.891+0000 7f0f95400640 1 -- 172.21.15.33:0/2798103410 wait complete. 2024-09-10T23:58:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 Processor -- start 2024-09-10T23:58:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 -- start start 2024-09-10T23:58:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 0x7f0f9019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 0x7f0f9019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f901a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90114cd0 con 0x7f0f9010f250 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90114b50 con 0x7f0f90101fc0 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.892+0000 7f0f95400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90114e50 con 0x7f0f901016a0 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f8f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 0x7f0f9019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f8fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 0x7f0f9019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f901a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f8f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 0x7f0f9019b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:46874/0 (socket says 172.21.15.33:46874) 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f8f400640 1 -- 172.21.15.33:0/2821774897 learned_addr learned my addr 172.21.15.33:0/2821774897 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f8fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 0x7f0f9019b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54758/0 (socket says 172.21.15.33:54758) 2024-09-10T23:58:43.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 -- 172.21.15.33:0/2821774897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 msgr2=0x7f0f9019b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 0x7f0f9019b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 -- 172.21.15.33:0/2821774897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 msgr2=0x7f0f9019b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 0x7f0f9019b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.893+0000 7f0f94a00640 1 -- 172.21.15.33:0/2821774897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f901a1170 con 0x7f0f9010f250 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f94a00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f901a09a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0f88005e30 tx=0x7f0f88003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88034040 con 0x7f0f9010f250 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f901a1400 con 0x7f0f9010f250 2024-09-10T23:58:43.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f88030850 con 0x7f0f9010f250 2024-09-10T23:58:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880045a0 con 0x7f0f9010f250 2024-09-10T23:58:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.894+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f901a7b20 con 0x7f0f9010f250 2024-09-10T23:58:43.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.896+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f90101a80 con 0x7f0f9010f250 2024-09-10T23:58:43.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.901+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0f8802f860 con 0x7f0f9010f250 2024-09-10T23:58:43.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.903+0000 7f0f8cc00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 0x7f0f740b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.903+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0f88106f40 con 0x7f0f9010f250 2024-09-10T23:58:43.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.903+0000 7f0f8fe00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 0x7f0f740b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.903+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f8802fb80 con 0x7f0f9010f250 2024-09-10T23:58:43.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:43.904+0000 7f0f8fe00640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 0x7f0f740b78d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005d00 tx=0x7f0f8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:44.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:43 smithi033 ceph-mon[30593]: pgmap v495: 129 pgs: 129 active+clean; 758 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-10T23:58:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.190+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f901a7e10 con 0x7f0f9010f250 2024-09-10T23:58:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.191+0000 7f0f8cc00640 1 -- 172.21.15.33:0/2821774897 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f0f880cda00 con 0x7f0f9010f250 2024-09-10T23:58:44.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:58:44.194 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:58:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:58:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 msgr2=0x7f0f740b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 0x7f0f740b78d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f80005d00 tx=0x7f0f8000b410 comp rx=0 tx=0).stop 2024-09-10T23:58:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 msgr2=0x7f0f901a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f901a09a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0f88005e30 tx=0x7f0f88003ce0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 shutdown_connections 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0f740b5410 0x7f0f740b78d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f9010f250 0x7f0f901a09a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f90101fc0 0x7f0f9019b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 --2- 172.21.15.33:0/2821774897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f901016a0 0x7f0f9019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.194+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 >> 172.21.15.33:0/2821774897 conn(0x7f0f900fd5b0 msgr2=0x7f0f9010fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.195+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 shutdown_connections 2024-09-10T23:58:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:44.195+0000 7f0f95400640 1 -- 172.21.15.33:0/2821774897 wait complete. 2024-09-10T23:58:44.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:43 smithi052 ceph-mon[33526]: pgmap v495: 129 pgs: 129 active+clean; 758 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-10T23:58:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:43 smithi189 ceph-mon[34000]: pgmap v495: 129 pgs: 129 active+clean; 758 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-10T23:58:45.146 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-10T23:58:45.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-10T23:58:45.202 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:44 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2821774897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:58:45.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:44 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2821774897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:58:45.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:44 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2821774897' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:58:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:58:45.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:45 smithi033 ceph-mon[30593]: pgmap v496: 129 pgs: 129 active+clean; 764 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 30 op/s 2024-09-10T23:58:46.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:45 smithi052 ceph-mon[33526]: pgmap v496: 129 pgs: 129 active+clean; 764 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 30 op/s 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 -- 172.21.15.33:0/421686352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810a820 msgr2=0x7f669810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 --2- 172.21.15.33:0/421686352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810a820 0x7f669810ac60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6680009900 tx=0x7f668002a410 comp rx=0 tx=0).stop 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 -- 172.21.15.33:0/421686352 shutdown_connections 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 --2- 172.21.15.33:0/421686352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810b1a0 0x7f66981119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 --2- 172.21.15.33:0/421686352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810a820 0x7f669810ac60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 --2- 172.21.15.33:0/421686352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f66981051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 -- 172.21.15.33:0/421686352 >> 172.21.15.33:0/421686352 conn(0x7f6698100840 msgr2=0x7f6698102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 -- 172.21.15.33:0/421686352 shutdown_connections 2024-09-10T23:58:46.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.248+0000 7f669d200640 1 -- 172.21.15.33:0/421686352 wait complete. 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.249+0000 7f669d200640 1 Processor -- start 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 -- start start 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f669819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810b1a0 0x7f66981a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6698114d10 con 0x7f669810b1a0 2024-09-10T23:58:46.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6698114b90 con 0x7f669810a820 2024-09-10T23:58:46.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f669d200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6698114e90 con 0x7f6698104e10 2024-09-10T23:58:46.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f668fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f6697400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f669819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f668fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:46902/0 (socket says 172.21.15.33:46902) 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f668fe00640 1 -- 172.21.15.33:0/2865980703 learned_addr learned my addr 172.21.15.33:0/2865980703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.250+0000 7f6697e00640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810b1a0 0x7f66981a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 -- 172.21.15.33:0/2865980703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 msgr2=0x7f669819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f669819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 -- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810b1a0 msgr2=0x7f66981a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810b1a0 0x7f66981a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 -- 172.21.15.33:0/2865980703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981a1270 con 0x7f669810a820 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f6697400640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f669819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.251+0000 7f668fe00640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6680009230 tx=0x7f6680004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.252+0000 7f6694c00640 1 -- 172.21.15.33:0/2865980703 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668003f030 con 0x7f669810a820 2024-09-10T23:58:46.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.252+0000 7f6694c00640 1 -- 172.21.15.33:0/2865980703 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6680003a80 con 0x7f669810a820 2024-09-10T23:58:46.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.252+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66981a1500 con 0x7f669810a820 2024-09-10T23:58:46.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.252+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66981a7c20 con 0x7f669810a820 2024-09-10T23:58:46.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.252+0000 7f6694c00640 1 -- 172.21.15.33:0/2865980703 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680035070 con 0x7f669810a820 2024-09-10T23:58:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 Processor -- start 2024-09-10T23:58:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 -- start start 2024-09-10T23:58:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e42660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e44f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563470dabca0 con 0x563470e362f0 2024-09-10T23:58:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563470d9b0d0 con 0x563470e36c10 2024-09-10T23:58:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.256+0000 7f66a12c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563470d9eee0 con 0x563470e42ba0 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6694c00640 1 -- 172.21.15.33:0/2865980703 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f66800035f0 con 0x7f669810a820 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56726/0 (socket says 172.21.15.33:56726) 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 -- 172.21.15.33:0/1507273895 learned_addr learned my addr 172.21.15.33:0/1507273895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 -- 172.21.15.33:0/1507273895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 msgr2=0x563470e44f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e44f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 -- 172.21.15.33:0/1507273895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 msgr2=0x563470e42660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e42660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.257+0000 7f6697e00640 1 -- 172.21.15.33:0/1507273895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563470d4d400 con 0x563470e362f0 2024-09-10T23:58:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.258+0000 7f6697e00640 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6690009f70 tx=0x7f6690010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef778bdd655f897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.258+0000 7f668cc00640 1 -- 172.21.15.33:0/1507273895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690016070 con 0x563470e362f0 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.258+0000 7f668cc00640 1 -- 172.21.15.33:0/1507273895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6690004d20 con 0x563470e362f0 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.258+0000 7f668cc00640 1 -- 172.21.15.33:0/1507273895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690012760 con 0x563470e362f0 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.259+0000 7f6694c00640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 0x7f667c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.259+0000 7f6694c00640 1 -- 172.21.15.33:0/2865980703 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6680106940 con 0x7f669810a820 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.259+0000 7f6697400640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 0x7f667c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.259+0000 7f66a12c7740 1 -- 172.21.15.33:0/1507273895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 msgr2=0x563470e366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.259+0000 7f66a12c7740 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6690009f70 tx=0x7f6690010800 comp rx=0 tx=0).stop 2024-09-10T23:58:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 -- 172.21.15.33:0/1507273895 shutdown_connections 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e44f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e42660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 --2- 172.21.15.33:0/1507273895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e362f0 0x563470e366d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 -- 172.21.15.33:0/1507273895 >> 172.21.15.33:0/1507273895 conn(0x563470e34120 msgr2=0x563470e352c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 -- 172.21.15.33:0/1507273895 shutdown_connections 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 -- 172.21.15.33:0/1507273895 wait complete. 2024-09-10T23:58:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f6697400640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 0x7f667c0b7850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6688005d00 tx=0x7f6688005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.260+0000 7f66a12c7740 1 -- start start 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 Processor -- start 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e36c10 0x563470e3f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563470bfc7a0 con 0x563470e36c10 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563470d40a10 con 0x563470e362f0 2024-09-10T23:58:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563470e45820 con 0x563470e42ba0 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.261+0000 7f66a12c7740 10 client.0 _ll_register_callbacks cb 0x563470d50be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54806/0 (socket says 172.21.15.33:54806) 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 -- 172.21.15.33:0/3342401614 learned_addr learned my addr 172.21.15.33:0/3342401614 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697400640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f668fe00640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e36c10 0x563470e3f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 -- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 msgr2=0x563470e424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 -- 172.21.15.33:0/3342401614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e36c10 msgr2=0x563470e3f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e36c10 0x563470e3f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.262+0000 7f6697e00640 1 -- 172.21.15.33:0/3342401614 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563470b08b90 con 0x563470e42ba0 2024-09-10T23:58:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.263+0000 7f6697e00640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6690011010 tx=0x7f6690004ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc0b13e94689483 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.263+0000 7f6685600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.263+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690016070 con 0x563470e42ba0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.263+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6690004d20 con 0x563470e42ba0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.263+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6690003d80 con 0x563470e42ba0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.264+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f669002f050 con 0x563470e42ba0 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.264+0000 7f66a12c7740 10 client.25492 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.264+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563470e51180 con 0x563470e42ba0 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.265+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6690004d20 con 0x563470e42ba0 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.265+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f669000f040 con 0x563470e42ba0 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.265+0000 7f66a12c7740 10 client.25492 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.265+0000 7f66a12c7740 10 client.25492 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.265+0000 7f66a12c7740 20 client.25492 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.266+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470e52530 0x563470e54920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.266+0000 7f66a12c7740 4 client.25492 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.266+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563470dadbf0 con 0x563470e52530 2024-09-10T23:58:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.267+0000 7f6697400640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470e52530 0x563470e54920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.268+0000 7f6697400640 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470e52530 0x563470e54920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe50ad674c11ed6b server_cookie=abc2af41c5f7eace in_seq=0 out_seq=0 2024-09-10T23:58:46.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.268+0000 7f6685600640 10 client.25492 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.269+0000 7f6685600640 1 -- 172.21.15.33:0/3342401614 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563470dadbf0 con 0x563470e52530 2024-09-10T23:58:46.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.269+0000 7f6685600640 10 client.25492 handle_command_reply: tid=0 2024-09-10T23:58:46.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.269+0000 7f66a12c7740 1 client.25492 shutdown 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 msgr2=0x563470e3ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6690011010 tx=0x7f6690004ed0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 shutdown_connections 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470e52530 0x563470e54920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e42ba0 0x563470e3ff40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e36c10 0x563470e3f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 --2- 172.21.15.33:0/3342401614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 >> 172.21.15.33:0/3342401614 conn(0x563470e34120 msgr2=0x563470e39cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.270+0000 7f6685600640 0 client.25492 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.271+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 shutdown_connections 2024-09-10T23:58:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.271+0000 7f66a12c7740 1 -- 172.21.15.33:0/3342401614 wait complete. 2024-09-10T23:58:46.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.271+0000 7f66a12c7740 20 client.25492 trim_cache size 0 max 16384 2024-09-10T23:58:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 Processor -- start 2024-09-10T23:58:46.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 -- start start 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e33af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 0x563470e4e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66981b42a0 con 0x563470e42ba0 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f66981b1b70 con 0x563470e362f0 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.290+0000 7f66a12c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66981af9c0 con 0x563470e36c10 2024-09-10T23:58:46.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56748/0 (socket says 172.21.15.33:56748) 2024-09-10T23:58:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 0x563470e4e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f6697e00640 1 -- 172.21.15.33:0/396969047 learned_addr learned my addr 172.21.15.33:0/396969047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f6697400640 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e33af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 -- 172.21.15.33:0/396969047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 msgr2=0x563470e33af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e33af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 -- 172.21.15.33:0/396969047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 msgr2=0x563470e59f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f668fe00640 1 -- 172.21.15.33:0/396969047 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563470e349a0 con 0x563470e36c10 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.291+0000 7f6697e00640 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.292+0000 7f668fe00640 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 0x563470e4e970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6680104050 tx=0x7f66800c8d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c8e9220363dde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.292+0000 7f6687e00640 1 -- 172.21.15.33:0/396969047 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680049030 con 0x563470e36c10 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.292+0000 7f6687e00640 1 -- 172.21.15.33:0/396969047 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66800cc900 con 0x563470e36c10 2024-09-10T23:58:46.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.292+0000 7f6687e00640 1 -- 172.21.15.33:0/396969047 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800c9060 con 0x563470e36c10 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 -- 172.21.15.33:0/396969047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 msgr2=0x563470e4e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 0x563470e4e970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6680104050 tx=0x7f66800c8d50 comp rx=0 tx=0).stop 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 -- 172.21.15.33:0/396969047 shutdown_connections 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e59f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e36c10 0x563470e4e970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 --2- 172.21.15.33:0/396969047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e362f0 0x563470e33af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 -- 172.21.15.33:0/396969047 >> 172.21.15.33:0/396969047 conn(0x563470e34120 msgr2=0x563470e4e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 -- 172.21.15.33:0/396969047 shutdown_connections 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.293+0000 7f66a12c7740 1 -- 172.21.15.33:0/396969047 wait complete. 2024-09-10T23:58:46.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 -- start start 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 Processor -- start 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e362f0 0x563470e4b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66981b0030 con 0x563470e42ba0 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f66981b14a0 con 0x563470e36c10 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66981b0700 con 0x563470e362f0 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.294+0000 7f66a12c7740 10 client.0 _ll_register_callbacks cb 0x7f6690009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56764/0 (socket says 172.21.15.33:56764) 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e362f0 0x563470e4b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 -- 172.21.15.33:0/2418621414 learned_addr learned my addr 172.21.15.33:0/2418621414 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f668fe00640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 -- 172.21.15.33:0/2418621414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e362f0 msgr2=0x563470e4b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e362f0 0x563470e4b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 -- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 msgr2=0x563470e47880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e47880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.295+0000 7f6697e00640 1 -- 172.21.15.33:0/2418621414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563470ebf130 con 0x563470e42ba0 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f6697e00640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6690009ec0 tx=0x7f6690010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b139202979a30b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f6685600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690016030 con 0x563470e42ba0 2024-09-10T23:58:46.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66800cc900 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6690012760 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6690044050 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f66a12c7740 10 client.15756 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.296+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563470ec02b0 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66800cc900 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f66900050d0 con 0x563470e42ba0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 10 client.15756 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 10 client.15756 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 20 client.15756 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470ec09d0 0x563470ec2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 4 client.15756 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.297+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x563470da96a0 con 0x563470ec09d0 2024-09-10T23:58:46.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.298+0000 7f6697400640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470ec09d0 0x563470ec2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.298+0000 7f6697400640 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470ec09d0 0x563470ec2df0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e42b216d86966e55 server_cookie=2403fa587245a4d in_seq=0 out_seq=0 2024-09-10T23:58:46.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.298+0000 7f6685600640 10 client.15756 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:45 smithi189 ceph-mon[34000]: pgmap v496: 129 pgs: 129 active+clean; 764 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 30 op/s 2024-09-10T23:58:46.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f6685600640 1 -- 172.21.15.33:0/2418621414 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563470da96a0 con 0x563470ec09d0 2024-09-10T23:58:46.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f6685600640 10 client.15756 handle_command_reply: tid=0 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 client.15756 shutdown 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 msgr2=0x563470e47f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6690009ec0 tx=0x7f6690010df0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 shutdown_connections 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563470e42ba0 0x563470e47f00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563470e36c10 0x563470e47880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563470ec09d0 0x563470ec2df0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 --2- 172.21.15.33:0/2418621414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563470e362f0 0x563470e4b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 >> 172.21.15.33:0/2418621414 conn(0x563470e34120 msgr2=0x563470e32ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f6685600640 0 client.15756 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 shutdown_connections 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 1 -- 172.21.15.33:0/2418621414 wait complete. 2024-09-10T23:58:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.533+0000 7f66a12c7740 20 client.15756 trim_cache size 0 max 16384 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 6, 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "15f2d0e1": { 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 6, 2024-09-10T23:58:46.537 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:58:46.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 msgr2=0x7f667c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 0x7f667c0b7850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6688005d00 tx=0x7f6688005c90 comp rx=0 tx=0).stop 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 msgr2=0x7f669819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6680009230 tx=0x7f6680004270 comp rx=0 tx=0).stop 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 shutdown_connections 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f667c0b5390 0x7f667c0b7850 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f669810b1a0 0x7f66981a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f669810a820 0x7f669819b700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 --2- 172.21.15.33:0/2865980703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6698104e10 0x7f669819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.534+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 >> 172.21.15.33:0/2865980703 conn(0x7f6698100840 msgr2=0x7f6698102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.535+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 shutdown_connections 2024-09-10T23:58:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:58:46.535+0000 7f669d200640 1 -- 172.21.15.33:0/2865980703 wait complete. 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.749+0000 7f78fb800640 1 -- 172.21.15.33:0/481427308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4105cf0 msgr2=0x7f78f4106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.749+0000 7f78fb800640 1 --2- 172.21.15.33:0/481427308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4105cf0 0x7f78f4106170 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009930 tx=0x7f78e002a420 comp rx=0 tx=0).stop 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 -- 172.21.15.33:0/481427308 shutdown_connections 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 --2- 172.21.15.33:0/481427308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f41066b0 0x7f78f410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 --2- 172.21.15.33:0/481427308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4105cf0 0x7f78f4106170 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 --2- 172.21.15.33:0/481427308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f4104ba0 0x7f78f4104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 -- 172.21.15.33:0/481427308 >> 172.21.15.33:0/481427308 conn(0x7f78f4100460 msgr2=0x7f78f4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 -- 172.21.15.33:0/481427308 shutdown_connections 2024-09-10T23:58:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.750+0000 7f78fb800640 1 -- 172.21.15.33:0/481427308 wait complete. 2024-09-10T23:58:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 Processor -- start 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 -- start start 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4105cf0 0x7f78f419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f41066b0 0x7f78f419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41106f0 con 0x7f78f4104ba0 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4110570 con 0x7f78f4105cf0 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78fb800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78f4110870 con 0x7f78f41066b0 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78f8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78f8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56784/0 (socket says 172.21.15.33:56784) 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78f8e00640 1 -- 172.21.15.33:0/3572589990 learned_addr learned my addr 172.21.15.33:0/3572589990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.751+0000 7f78f3e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4105cf0 0x7f78f419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f9800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f41066b0 0x7f78f419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 -- 172.21.15.33:0/3572589990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f41066b0 msgr2=0x7f78f419c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f41066b0 0x7f78f419c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 -- 172.21.15.33:0/3572589990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4105cf0 msgr2=0x7f78f419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4105cf0 0x7f78f419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 -- 172.21.15.33:0/3572589990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f419c9b0 con 0x7f78f4104ba0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f8e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f78e800d950 tx=0x7f78e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.752+0000 7f78f1600640 1 -- 172.21.15.33:0/3572589990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8017070 con 0x7f78f4104ba0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.753+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f419cca0 con 0x7f78f4104ba0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.753+0000 7f78f1600640 1 -- 172.21.15.33:0/3572589990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78e8009c30 con 0x7f78f4104ba0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.753+0000 7f78f1600640 1 -- 172.21.15.33:0/3572589990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e800f620 con 0x7f78f4104ba0 2024-09-10T23:58:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.753+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a3370 con 0x7f78f4104ba0 2024-09-10T23:58:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.756+0000 7f78fe6d6740 1 Processor -- start 2024-09-10T23:58:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 -- start start 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c9b00 0x5582271cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5582271376b0 con 0x5582271c4790 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558227126ae0 con 0x5582271c9b00 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55822712a8f0 con 0x5582271c70c0 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56800/0 (socket says 172.21.15.33:56800) 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.757+0000 7f78f9800640 1 -- 172.21.15.33:0/163227641 learned_addr learned my addr 172.21.15.33:0/163227641 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f3e00640 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c9b00 0x5582271cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f1600640 1 -- 172.21.15.33:0/3572589990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f78e8010460 con 0x7f78f4104ba0 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 -- 172.21.15.33:0/163227641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 msgr2=0x5582271c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 -- 172.21.15.33:0/163227641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c9b00 msgr2=0x5582271cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c9b00 0x5582271cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 -- 172.21.15.33:0/163227641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582270f3780 con 0x5582271c4790 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.758+0000 7f78f9800640 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009f80 tx=0x7f78ec010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d895115ae67660 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78e6000640 1 -- 172.21.15.33:0/163227641 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec003b70 con 0x5582271c4790 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78e6000640 1 -- 172.21.15.33:0/163227641 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78ec003d10 con 0x5582271c4790 2024-09-10T23:58:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78e6000640 1 -- 172.21.15.33:0/163227641 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec011a10 con 0x5582271c4790 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78fe6d6740 1 -- 172.21.15.33:0/163227641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 msgr2=0x5582271c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009f80 tx=0x7f78ec010860 comp rx=0 tx=0).stop 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.759+0000 7f78f1600640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 0x7f78dc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 -- 172.21.15.33:0/163227641 shutdown_connections 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c9b00 0x5582271cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/163227641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271c6b80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 -- 172.21.15.33:0/163227641 >> 172.21.15.33:0/163227641 conn(0x5582271bf8e0 msgr2=0x5582271c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78f1600640 1 -- 172.21.15.33:0/3572589990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f78e80e5c10 con 0x7f78f4104ba0 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78f8e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 0x7f78dc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 -- 172.21.15.33:0/163227641 shutdown_connections 2024-09-10T23:58:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 -- 172.21.15.33:0/163227641 wait complete. 2024-09-10T23:58:46.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.760+0000 7f78fe6d6740 1 -- start start 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78f8e00640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 0x7f78dc0b77a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f78e800dfe0 tx=0x7f78e800bf60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 Processor -- start 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c4790 0x5582271cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55822705eab0 con 0x5582271c9b00 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5582270cd570 con 0x5582271c70c0 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5582271ccae0 con 0x5582271c4790 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78fe6d6740 10 client.0 _ll_register_callbacks cb 0x5582270dc100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56814/0 (socket says 172.21.15.33:56814) 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.761+0000 7f78f9800640 1 -- 172.21.15.33:0/1579062513 learned_addr learned my addr 172.21.15.33:0/1579062513 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f9800640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c4790 0x5582271cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 -- 172.21.15.33:0/1579062513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c4790 msgr2=0x5582271cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c4790 0x5582271cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 -- 172.21.15.33:0/1579062513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 msgr2=0x5582271cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 -- 172.21.15.33:0/1579062513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226e88790 con 0x5582271c70c0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271ce540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78e002a940 tx=0x7f78e0004440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7d975eecc38e265 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.762+0000 7f78daa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:58:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78ec003d10 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f78e0003ac0 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78e004e050 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78fe6d6740 10 client.35531 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558226f01620 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.763+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78ec003d10 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f78e003c440 con 0x5582271c70c0 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 10 client.35531 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 10 client.35531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 20 client.35531 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5582271d97f0 0x5582271dbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 4 client.35531 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558227139600 con 0x5582271d97f0 2024-09-10T23:58:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.764+0000 7f78f9800640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5582271d97f0 0x5582271dbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.765+0000 7f78f9800640 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5582271d97f0 0x5582271dbbe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bff8c50dcac60c9 server_cookie=1496e6572b7d70eb in_seq=0 out_seq=0 2024-09-10T23:58:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.765+0000 7f78daa00640 10 client.35531 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.765+0000 7f78daa00640 1 -- 172.21.15.33:0/1579062513 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558227139600 con 0x5582271d97f0 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.765+0000 7f78daa00640 10 client.35531 handle_command_reply: tid=0 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 client.35531 shutdown 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 msgr2=0x5582271ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271ce540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78e002a940 tx=0x7f78e0004440 comp rx=0 tx=0).stop 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 shutdown_connections 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271ce540 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5582271d97f0 0x5582271dbbe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1579062513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c4790 0x5582271cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78daa00640 0 client.35531 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 >> 172.21.15.33:0/1579062513 conn(0x5582271bf8e0 msgr2=0x5582271bea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 shutdown_connections 2024-09-10T23:58:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1579062513 wait complete. 2024-09-10T23:58:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.766+0000 7f78fe6d6740 20 client.35531 trim_cache size 0 max 16384 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 Processor -- start 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 -- start start 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c4790 0x5582271ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41b0010 con 0x5582271c9b00 2024-09-10T23:58:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ad8e0 con 0x5582271c4790 2024-09-10T23:58:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ab730 con 0x5582271c70c0 2024-09-10T23:58:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78f3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78f3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54862/0 (socket says 172.21.15.33:54862) 2024-09-10T23:58:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.782+0000 7f78f3e00640 1 -- 172.21.15.33:0/313228796 learned_addr learned my addr 172.21.15.33:0/313228796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f9800640 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c4790 0x5582271ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 -- 172.21.15.33:0/313228796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c4790 msgr2=0x5582271ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c4790 0x5582271ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 -- 172.21.15.33:0/313228796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 msgr2=0x5582271ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 -- 172.21.15.33:0/313228796 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582271c9820 con 0x5582271c70c0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78f3e00640 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005aa0 tx=0x7f78e0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76d1eae443e295ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78e5600640 1 -- 172.21.15.33:0/313228796 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e004b070 con 0x5582271c70c0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78e5600640 1 -- 172.21.15.33:0/313228796 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78e0005850 con 0x5582271c70c0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.783+0000 7f78e5600640 1 -- 172.21.15.33:0/313228796 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035070 con 0x5582271c70c0 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 -- 172.21.15.33:0/313228796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 msgr2=0x5582271cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005aa0 tx=0x7f78e0000bc0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 -- 172.21.15.33:0/313228796 shutdown_connections 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c9b00 0x5582271ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c70c0 0x5582271cdea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/313228796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c4790 0x5582271ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 -- 172.21.15.33:0/313228796 >> 172.21.15.33:0/313228796 conn(0x5582271bf8e0 msgr2=0x5582271c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 -- 172.21.15.33:0/313228796 shutdown_connections 2024-09-10T23:58:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.784+0000 7f78fe6d6740 1 -- 172.21.15.33:0/313228796 wait complete. 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 -- start start 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 Processor -- start 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271d5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271d4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c9b00 0x5582271d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41abda0 con 0x5582271c4790 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ad210 con 0x5582271c70c0 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78f41ac470 con 0x5582271c9b00 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.785+0000 7f78fe6d6740 10 client.0 _ll_register_callbacks cb 0x7f78e0005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271d5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271d5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56828/0 (socket says 172.21.15.33:56828) 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f9800640 1 -- 172.21.15.33:0/1693742692 learned_addr learned my addr 172.21.15.33:0/1693742692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271d4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f9800640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c9b00 0x5582271d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 -- 172.21.15.33:0/1693742692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c9b00 msgr2=0x5582271d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c9b00 0x5582271d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 -- 172.21.15.33:0/1693742692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 msgr2=0x5582271d5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271d5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 -- 172.21.15.33:0/1693742692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582271d3250 con 0x5582271c70c0 2024-09-10T23:58:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78f3e00640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271d4730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e003c980 tx=0x7f78e003dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10daacd0c5a53a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.786+0000 7f78daa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e004b070 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e0005850 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f78e0003ac0 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 10 client.35537 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5582272467e0 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78e0005850 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f78e0053440 con 0x5582271c70c0 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 10 client.35537 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 10 client.35537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 20 client.35537 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.787+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558227247160 0x558227249580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.788+0000 7f78fe6d6740 4 client.35537 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.788+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582271350b0 con 0x558227247160 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.788+0000 7f78f9800640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558227247160 0x558227249580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.788+0000 7f78f9800640 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558227247160 0x558227249580 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfd648a35b3047c server_cookie=9ec742735c9cbe4c in_seq=0 out_seq=0 2024-09-10T23:58:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.788+0000 7f78daa00640 10 client.35537 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78daa00640 1 -- 172.21.15.33:0/1693742692 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582271350b0 con 0x558227247160 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78daa00640 10 client.35537 handle_command_reply: tid=0 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 client.35537 shutdown 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 msgr2=0x5582271d4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271d4730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e003c980 tx=0x7f78e003dde0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 shutdown_connections 2024-09-10T23:58:46.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558227247160 0x558227249580 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5582271c9b00 0x5582271d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5582271c70c0 0x5582271d4730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 --2- 172.21.15.33:0/1693742692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5582271c4790 0x5582271d5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78daa00640 0 client.35537 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.815+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 >> 172.21.15.33:0/1693742692 conn(0x5582271bf8e0 msgr2=0x5582271c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 shutdown_connections 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fe6d6740 1 -- 172.21.15.33:0/1693742692 wait complete. 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fe6d6740 20 client.35537 trim_cache size 0 max 16384 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:58:46.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:58:46.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:58:46.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:58:46.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 msgr2=0x7f78dc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 0x7f78dc0b77a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f78e800dfe0 tx=0x7f78e800bf60 comp rx=0 tx=0).stop 2024-09-10T23:58:46.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 msgr2=0x7f78f419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f78e800d950 tx=0x7f78e800de10 comp rx=0 tx=0).stop 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 shutdown_connections 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78dc0b52e0 0x7f78dc0b77a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78f41066b0 0x7f78f419c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f4105cf0 0x7f78f419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 --2- 172.21.15.33:0/3572589990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f4104ba0 0x7f78f419ae70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.816+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 >> 172.21.15.33:0/3572589990 conn(0x7f78f4100460 msgr2=0x7f78f41090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.817+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 shutdown_connections 2024-09-10T23:58:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:46.817+0000 7f78fb800640 1 -- 172.21.15.33:0/3572589990 wait complete. 2024-09-10T23:58:47.444 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '15f2d0e1', quiesce took 4.6 seconds. Will release after: 15.9 2024-09-10T23:58:48.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:47 smithi033 ceph-mon[30593]: pgmap v497: 129 pgs: 129 active+clean; 772 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 MiB/s wr, 37 op/s 2024-09-10T23:58:48.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:47 smithi189 ceph-mon[34000]: pgmap v497: 129 pgs: 129 active+clean; 772 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 MiB/s wr, 37 op/s 2024-09-10T23:58:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:47 smithi052 ceph-mon[33526]: pgmap v497: 129 pgs: 129 active+clean; 772 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 MiB/s wr, 37 op/s 2024-09-10T23:58:50.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:49 smithi033 ceph-mon[30593]: pgmap v498: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-10T23:58:50.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:49 smithi189 ceph-mon[34000]: pgmap v498: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-10T23:58:50.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:49 smithi052 ceph-mon[33526]: pgmap v498: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 27 op/s 2024-09-10T23:58:52.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:51 smithi033 ceph-mon[30593]: pgmap v499: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-10T23:58:52.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:51 smithi189 ceph-mon[34000]: pgmap v499: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-10T23:58:52.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:51 smithi052 ceph-mon[33526]: pgmap v499: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 28 op/s 2024-09-10T23:58:54.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:53 smithi033 ceph-mon[30593]: pgmap v500: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 33 op/s 2024-09-10T23:58:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:53 smithi189 ceph-mon[34000]: pgmap v500: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 33 op/s 2024-09-10T23:58:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:53 smithi052 ceph-mon[33526]: pgmap v500: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 20 MiB/s wr, 33 op/s 2024-09-10T23:58:56.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:55 smithi033 ceph-mon[30593]: pgmap v501: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-09-10T23:58:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:55 smithi189 ceph-mon[34000]: pgmap v501: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-09-10T23:58:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:55 smithi052 ceph-mon[33526]: pgmap v501: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 26 op/s 2024-09-10T23:58:58.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:57 smithi033 ceph-mon[30593]: pgmap v502: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T23:58:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:57 smithi189 ceph-mon[34000]: pgmap v502: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T23:58:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:57 smithi052 ceph-mon[33526]: pgmap v502: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 27 op/s 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 -- 172.21.15.33:0/2743929883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 msgr2=0x7f40e4105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 --2- 172.21.15.33:0/2743929883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e4105fa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009930 tx=0x7f40d002a420 comp rx=0 tx=0).stop 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 -- 172.21.15.33:0/2743929883 shutdown_connections 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 --2- 172.21.15.33:0/2743929883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 0x7f40e410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 --2- 172.21.15.33:0/2743929883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e4105fa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 --2- 172.21.15.33:0/2743929883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 0x7f40e4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 -- 172.21.15.33:0/2743929883 >> 172.21.15.33:0/2743929883 conn(0x7f40e4100270 msgr2=0x7f40e41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 -- 172.21.15.33:0/2743929883 shutdown_connections 2024-09-10T23:58:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.946+0000 7f40eac00640 1 -- 172.21.15.33:0/2743929883 wait complete. 2024-09-10T23:58:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.947+0000 7f40eac00640 1 Processor -- start 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.947+0000 7f40eac00640 1 -- start start 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 0x7f40e419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 0x7f40e419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41104f0 con 0x7f40e4105b20 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4110370 con 0x7f40e41064e0 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40eac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4110670 con 0x7f40e41049d0 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40e8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40e8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53028/0 (socket says 172.21.15.33:53028) 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40e8e00640 1 -- 172.21.15.33:0/76359307 learned_addr learned my addr 172.21.15.33:0/76359307 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40e9800640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 0x7f40e419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.948+0000 7f40ea200640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 0x7f40e419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 -- 172.21.15.33:0/76359307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 msgr2=0x7f40e419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 0x7f40e419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 -- 172.21.15.33:0/76359307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 msgr2=0x7f40e419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 0x7f40e419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 -- 172.21.15.33:0/76359307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e419c7c0 con 0x7f40e4105b20 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e8e00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005ab0 tx=0x7f40d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e2000640 1 -- 172.21.15.33:0/76359307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d003f030 con 0x7f40e4105b20 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e2000640 1 -- 172.21.15.33:0/76359307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d0003c90 con 0x7f40e4105b20 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40e2000640 1 -- 172.21.15.33:0/76359307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0035070 con 0x7f40e4105b20 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.949+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e419ca50 con 0x7f40e4105b20 2024-09-10T23:58:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.950+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41a2fa0 con 0x7f40e4105b20 2024-09-10T23:58:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 Processor -- start 2024-09-10T23:58:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 -- start start 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9394690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c4c93026b0 con 0x55c4c938f970 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c4c92f1ae0 con 0x55c4c93922a0 2024-09-10T23:58:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ef068740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c4c92f58f0 con 0x55c4c9394ce0 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40e2000640 1 -- 172.21.15.33:0/76359307 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f40d0003800 con 0x7f40e4105b20 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ea200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ea200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53044/0 (socket says 172.21.15.33:53044) 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.953+0000 7f40ea200640 1 -- 172.21.15.33:0/3554818141 learned_addr learned my addr 172.21.15.33:0/3554818141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40e9800640 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9394690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 -- 172.21.15.33:0/3554818141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 msgr2=0x55c4c93971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 -- 172.21.15.33:0/3554818141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 msgr2=0x55c4c9394690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9394690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 -- 172.21.15.33:0/3554818141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c92be780 con 0x55c4c938f970 2024-09-10T23:58:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.954+0000 7f40ea200640 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e20 tx=0x7f40dc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8db15b0eb719927 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40d6a00640 1 -- 172.21.15.33:0/3554818141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc014070 con 0x55c4c938f970 2024-09-10T23:58:59.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40d6a00640 1 -- 172.21.15.33:0/3554818141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc004d20 con 0x55c4c938f970 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40d6a00640 1 -- 172.21.15.33:0/3554818141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc005280 con 0x55c4c938f970 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40e2000640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 0x7f40cc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 -- 172.21.15.33:0/3554818141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 msgr2=0x55c4c9391d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e20 tx=0x7f40dc00e720 comp rx=0 tx=0).stop 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40e2000640 1 -- 172.21.15.33:0/76359307 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f40d0106be0 con 0x7f40e4105b20 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40e9800640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 0x7f40cc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 -- 172.21.15.33:0/3554818141 shutdown_connections 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9394690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 --2- 172.21.15.33:0/3554818141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9391d60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.955+0000 7f40ef068740 1 -- 172.21.15.33:0/3554818141 >> 172.21.15.33:0/3554818141 conn(0x55c4c938aac0 msgr2=0x55c4c938b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.956+0000 7f40ef068740 1 -- 172.21.15.33:0/3554818141 shutdown_connections 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.956+0000 7f40ef068740 1 -- 172.21.15.33:0/3554818141 wait complete. 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.956+0000 7f40e9800640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 0x7f40cc0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40d8005fd0 tx=0x7f40d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.956+0000 7f40ef068740 1 -- start start 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.956+0000 7f40ef068740 1 Processor -- start 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 0x55c4c9399800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c9394ce0 0x55c4c939a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c4c9229ab0 con 0x55c4c938f970 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c4c9298570 con 0x55c4c9394ce0 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c4c9397cc0 con 0x55c4c93922a0 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ef068740 10 client.0 _ll_register_callbacks cb 0x55c4c92a7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40e9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40e9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53058/0 (socket says 172.21.15.33:53058) 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40e9800640 1 -- 172.21.15.33:0/1568117215 learned_addr learned my addr 172.21.15.33:0/1568117215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40ea200640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c9394ce0 0x55c4c939a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.957+0000 7f40e8e00640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 0x55c4c9399800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 -- 172.21.15.33:0/1568117215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 msgr2=0x55c4c9399800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 0x55c4c9399800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 -- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c9394ce0 msgr2=0x55c4c939a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c9394ce0 0x55c4c939a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 -- 172.21.15.33:0/1568117215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c9053790 con 0x55c4c938f970 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e8e00640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 0x55c4c9399800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40e9800640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f40d8003e30 tx=0x7f40d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6d701cf80200aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40cb400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d801b870 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f40d801ba10 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40dc004d20 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f40d8003e60 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40ef068740 10 client.15786 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.958+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c4c90cc620 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc004d20 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f40d8024070 con 0x55c4c938f970 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 10 client.15786 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 20 client.15786 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c93a4b60 0x55c4c93a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 4 client.15786 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:58:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4c9304600 con 0x55c4c93a4b60 2024-09-10T23:58:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.959+0000 7f40e8e00640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c93a4b60 0x55c4c93a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.960+0000 7f40e8e00640 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c93a4b60 0x55c4c93a6f90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e53d2b6093490a server_cookie=d29993fc77226500 in_seq=0 out_seq=0 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.960+0000 7f40cb400640 10 client.15786 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.961+0000 7f40cb400640 1 -- 172.21.15.33:0/1568117215 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4c9304600 con 0x55c4c93a4b60 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.961+0000 7f40cb400640 10 client.15786 handle_command_reply: tid=0 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.961+0000 7f40ef068740 1 client.15786 shutdown 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.961+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 msgr2=0x55c4c9399160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.961+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f40d8003e30 tx=0x7f40d80046c0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 shutdown_connections 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c9394ce0 0x55c4c939a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c93a4b60 0x55c4c93a6f90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c93922a0 0x55c4c9399800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 --2- 172.21.15.33:0/1568117215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c938f970 0x55c4c9399160 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 >> 172.21.15.33:0/1568117215 conn(0x55c4c938aac0 msgr2=0x55c4c9389bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40cb400640 0 client.15786 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 shutdown_connections 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 1 -- 172.21.15.33:0/1568117215 wait complete. 2024-09-10T23:58:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.962+0000 7f40ef068740 20 client.15786 trim_cache size 0 max 16384 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.977+0000 7f40ef068740 1 Processor -- start 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.977+0000 7f40ef068740 1 -- start start 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9395170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41afdf0 con 0x55c4c9394ce0 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ad6c0 con 0x55c4c93922a0 2024-09-10T23:58:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ef068740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ab510 con 0x55c4c938f970 2024-09-10T23:58:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ea200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40e9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40e8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9395170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40e9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38734/0 (socket says 172.21.15.33:38734) 2024-09-10T23:58:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40e9800640 1 -- 172.21.15.33:0/2031565196 learned_addr learned my addr 172.21.15.33:0/2031565196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40ea200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53068/0 (socket says 172.21.15.33:53068) 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.978+0000 7f40e9800640 1 -- 172.21.15.33:0/2031565196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 msgr2=0x55c4c9395170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40e9800640 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9395170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40e9800640 1 -- 172.21.15.33:0/2031565196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 msgr2=0x55c4c93956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40e9800640 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40e9800640 1 -- 172.21.15.33:0/2031565196 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c93920d0 con 0x55c4c938f970 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40ea200640 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:58:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.979+0000 7f40e9800640 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40d8010f80 tx=0x7f40d8004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5561f397cdf8901e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.983+0000 7f40d6000640 1 -- 172.21.15.33:0/2031565196 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8005240 con 0x55c4c938f970 2024-09-10T23:58:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.983+0000 7f40d6000640 1 -- 172.21.15.33:0/2031565196 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d80053e0 con 0x55c4c938f970 2024-09-10T23:58:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.983+0000 7f40d6000640 1 -- 172.21.15.33:0/2031565196 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d801ba90 con 0x55c4c938f970 2024-09-10T23:58:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- 172.21.15.33:0/2031565196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 msgr2=0x55c4c9385ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40d8010f80 tx=0x7f40d8004530 comp rx=0 tx=0).stop 2024-09-10T23:58:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- 172.21.15.33:0/2031565196 shutdown_connections 2024-09-10T23:58:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c9394ce0 0x55c4c93956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c93922a0 0x55c4c9395170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 --2- 172.21.15.33:0/2031565196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c938f970 0x55c4c9385ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- 172.21.15.33:0/2031565196 >> 172.21.15.33:0/2031565196 conn(0x55c4c938aac0 msgr2=0x55c4c938b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- 172.21.15.33:0/2031565196 shutdown_connections 2024-09-10T23:58:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- 172.21.15.33:0/2031565196 wait complete. 2024-09-10T23:58:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.984+0000 7f40ef068740 1 -- start start 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 Processor -- start 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c938f970 0x55c4c93a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41abb80 con 0x55c4c93922a0 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41acff0 con 0x55c4c938f970 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e41ac250 con 0x55c4c9394ce0 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ef068740 10 client.0 _ll_register_callbacks cb 0x7f40d80043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40e8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40e8e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53084/0 (socket says 172.21.15.33:53084) 2024-09-10T23:58:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40e8e00640 1 -- 172.21.15.33:0/2468996315 learned_addr learned my addr 172.21.15.33:0/2468996315 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40ea200640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.985+0000 7f40e9800640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c938f970 0x55c4c93a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 -- 172.21.15.33:0/2468996315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 msgr2=0x55c4c93a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 -- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c938f970 msgr2=0x55c4c93a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c938f970 0x55c4c93a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 -- 172.21.15.33:0/2468996315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c939e630 con 0x55c4c93922a0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40e8e00640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f40d0106fd0 tx=0x7f40d0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bf47424cc1f59b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40cb400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0049040 con 0x55c4c93922a0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f40d00b8200 con 0x55c4c93922a0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.986+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d80053e0 con 0x55c4c93922a0 2024-09-10T23:58:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f40d00c8e40 con 0x55c4c93922a0 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 10 client.15792 fetch_fsmap learned FSMap version 26 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c4c9411d80 con 0x55c4c93922a0 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d80053e0 con 0x55c4c93922a0 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f40d00f1070 con 0x55c4c93922a0 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 10 client.15792 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 20 client.15792 populate_metadata read hostname 'smithi033' 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c9412730 0x55c4c9414b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 4 client.15792 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4c93000b0 con 0x55c4c9412730 2024-09-10T23:58:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.987+0000 7f40e9800640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c9412730 0x55c4c9414b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.988+0000 7f40cb400640 10 client.15792 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:58:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:58:59.988+0000 7f40e9800640 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c9412730 0x55c4c9414b50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e45741d8a80b471 server_cookie=a5471e97ab391504 in_seq=0 out_seq=0 2024-09-10T23:59:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.003+0000 7f40cb400640 1 -- 172.21.15.33:0/2468996315 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4c93000b0 con 0x55c4c9412730 2024-09-10T23:59:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.003+0000 7f40cb400640 10 client.15792 handle_command_reply: tid=0 2024-09-10T23:59:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.003+0000 7f40ef068740 1 client.15792 shutdown 2024-09-10T23:59:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 msgr2=0x55c4c939fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f40d0106fd0 tx=0x7f40d0009260 comp rx=0 tx=0).stop 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 shutdown_connections 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c4c9412730 0x55c4c9414b50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c4c9394ce0 0x55c4c93a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c4c93922a0 0x55c4c939fb10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40cb400640 0 client.15792 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 --2- 172.21.15.33:0/2468996315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c4c938f970 0x55c4c93a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 >> 172.21.15.33:0/2468996315 conn(0x55c4c938aac0 msgr2=0x55c4c93950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 shutdown_connections 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 1 -- 172.21.15.33:0/2468996315 wait complete. 2024-09-10T23:59:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.004+0000 7f40ef068740 20 client.15792 trim_cache size 0 max 16384 2024-09-10T23:59:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:59:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:59:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:59:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:59:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 msgr2=0x7f40cc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 0x7f40cc0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40d8005fd0 tx=0x7f40d800b390 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 msgr2=0x7f40e419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005ab0 tx=0x7f40d00042f0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 shutdown_connections 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f40cc0b5360 0x7f40cc0b7820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e41064e0 0x7f40e419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e4105b20 0x7f40e419b2d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 --2- 172.21.15.33:0/76359307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e41049d0 0x7f40e419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 >> 172.21.15.33:0/76359307 conn(0x7f40e4100270 msgr2=0x7f40e4108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 shutdown_connections 2024-09-10T23:59:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:00.005+0000 7f40eac00640 1 -- 172.21.15.33:0/76359307 wait complete. 2024-09-10T23:59:00.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:58:59 smithi033 ceph-mon[30593]: pgmap v503: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 18 op/s 2024-09-10T23:59:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:58:59 smithi189 ceph-mon[34000]: pgmap v503: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 18 op/s 2024-09-10T23:59:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:58:59 smithi052 ceph-mon[33526]: pgmap v503: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.9 MiB/s wr, 18 op/s 2024-09-10T23:59:02.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:01 smithi033 ceph-mon[30593]: pgmap v504: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T23:59:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:01 smithi189 ceph-mon[34000]: pgmap v504: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T23:59:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:01 smithi052 ceph-mon[33526]: pgmap v504: 129 pgs: 129 active+clean; 772 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.9 MiB/s wr, 15 op/s 2024-09-10T23:59:03.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:04.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:03 smithi033 ceph-mon[30593]: pgmap v505: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 507 KiB/s wr, 16 op/s 2024-09-10T23:59:04.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:03 smithi189 ceph-mon[34000]: pgmap v505: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 507 KiB/s wr, 16 op/s 2024-09-10T23:59:04.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:03 smithi052 ceph-mon[33526]: pgmap v505: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 507 KiB/s wr, 16 op/s 2024-09-10T23:59:06.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:05 smithi033 ceph-mon[30593]: pgmap v506: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T23:59:06.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:05 smithi189 ceph-mon[34000]: pgmap v506: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T23:59:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:05 smithi052 ceph-mon[33526]: pgmap v506: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 -- 172.21.15.33:0/3738902294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac10f3c0 msgr2=0x7f15ac1117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 --2- 172.21.15.33:0/3738902294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac10f3c0 0x7f15ac1117b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009900 tx=0x7f15a402a3f0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 -- 172.21.15.33:0/3738902294 shutdown_connections 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 --2- 172.21.15.33:0/3738902294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac10f3c0 0x7f15ac1117b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 --2- 172.21.15.33:0/3738902294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac075f40 0x7f15ac10edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 --2- 172.21.15.33:0/3738902294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 0x7f15ac075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 -- 172.21.15.33:0/3738902294 >> 172.21.15.33:0/3738902294 conn(0x7f15ac0fe810 msgr2=0x7f15ac100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 -- 172.21.15.33:0/3738902294 shutdown_connections 2024-09-10T23:59:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.605+0000 7f15b2c00640 1 -- 172.21.15.33:0/3738902294 wait complete. 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 Processor -- start 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 -- start start 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 0x7f15ac102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 0x7f15ac103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac114e40 con 0x7f15ac075f40 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac114cc0 con 0x7f15ac10f3c0 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.606+0000 7f15b2c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac114fc0 con 0x7f15ac075540 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 0x7f15ac102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57718/0 (socket says 172.21.15.33:57718) 2024-09-10T23:59:06.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 -- 172.21.15.33:0/2441460337 learned_addr learned my addr 172.21.15.33:0/2441460337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15b0c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 0x7f15ac103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 -- 172.21.15.33:0/2441460337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 msgr2=0x7f15ac102aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 0x7f15ac102aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 -- 172.21.15.33:0/2441460337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 msgr2=0x7f15ac103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 0x7f15ac103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15a3400640 1 -- 172.21.15.33:0/2441460337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac1ab8a0 con 0x7f15ac075f40 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.607+0000 7f15b0c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 0x7f15ac103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15a3400640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f159400e9f0 tx=0x7f159400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400cd80 con 0x7f15ac075f40 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15940108c0 con 0x7f15ac075f40 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac1abb90 con 0x7f15ac075f40 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940187c0 con 0x7f15ac075f40 2024-09-10T23:59:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.608+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac1ac120 con 0x7f15ac075f40 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.609+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ac075920 con 0x7f15ac075f40 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.613+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1594010430 con 0x7f15ac075f40 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.615+0000 7f15a9600640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 0x7f15900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.615+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f15940e6360 con 0x7f15ac075f40 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.615+0000 7f15abe00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 0x7f15900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.616+0000 7f15abe00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 0x7f15900b7820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f159c007ec0 tx=0x7f159c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.619+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f15940ace20 con 0x7f15ac075f40 2024-09-10T23:59:06.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.858+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15ac103da0 con 0x7f15ac075f40 2024-09-10T23:59:06.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.859+0000 7f15a9600640 1 -- 172.21.15.33:0/2441460337 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f15940a6e20 con 0x7f15ac075f40 2024-09-10T23:59:06.861 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:59:06.861 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:59:06.861 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:59:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 msgr2=0x7f15900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 0x7f15900b7820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f159c007ec0 tx=0x7f159c0075b0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 msgr2=0x7f15ac102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f159400e9f0 tx=0x7f159400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 shutdown_connections 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f15900b5360 0x7f15900b7820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15ac10f3c0 0x7f15ac103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15ac075f40 0x7f15ac102fe0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 --2- 172.21.15.33:0/2441460337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15ac075540 0x7f15ac102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 >> 172.21.15.33:0/2441460337 conn(0x7f15ac0fe810 msgr2=0x7f15ac1115c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 shutdown_connections 2024-09-10T23:59:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:06.862+0000 7f15b2c00640 1 -- 172.21.15.33:0/2441460337 wait complete. 2024-09-10T23:59:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:06 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:07.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:06 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2441460337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:06 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:07.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:06 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2441460337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:07.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:06 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T23:59:07.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:06 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2441460337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:07.844 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id 15f2d0e1 --release --await' 2024-09-10T23:59:07.844 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id 15f2d0e1 --release --await 2024-09-10T23:59:08.227 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:08.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:08 smithi033 ceph-mon[30593]: pgmap v507: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T23:59:08.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:08.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:08.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:59:08.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:08 smithi189 ceph-mon[34000]: pgmap v507: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T23:59:08.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:08.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:08.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:59:08.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:08 smithi052 ceph-mon[33526]: pgmap v507: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-10T23:59:08.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T23:59:08.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T23:59:08.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-10T23:59:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.850+0000 7f08f0200640 1 -- 172.21.15.33:0/333392519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8109130 msgr2=0x7f08e810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.850+0000 7f08f0200640 1 --2- 172.21.15.33:0/333392519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8109130 0x7f08e810f930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009ca0 tx=0x7f08e002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 -- 172.21.15.33:0/333392519 shutdown_connections 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 --2- 172.21.15.33:0/333392519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8109130 0x7f08e810f930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 --2- 172.21.15.33:0/333392519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 0x7f08e8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 --2- 172.21.15.33:0/333392519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8102da0 0x7f08e8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 -- 172.21.15.33:0/333392519 >> 172.21.15.33:0/333392519 conn(0x7f08e80fe810 msgr2=0x7f08e8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 -- 172.21.15.33:0/333392519 shutdown_connections 2024-09-10T23:59:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.851+0000 7f08f0200640 1 -- 172.21.15.33:0/333392519 wait complete. 2024-09-10T23:59:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 Processor -- start 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 -- start start 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 0x7f08e819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 0x7f08e81a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8112cb0 con 0x7f08e8102da0 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8112b30 con 0x7f08e8109130 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.852+0000 7f08f0200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8112e30 con 0x7f08e81087b0 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ee200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 0x7f08e81a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ece00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 0x7f08e819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ee200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 0x7f08e81a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42578/0 (socket says 172.21.15.33:42578) 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57738/0 (socket says 172.21.15.33:57738) 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ee200640 1 -- 172.21.15.33:0/2996899446 learned_addr learned my addr 172.21.15.33:0/2996899446 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 -- 172.21.15.33:0/2996899446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 msgr2=0x7f08e819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 0x7f08e819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 -- 172.21.15.33:0/2996899446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 msgr2=0x7f08e81a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 0x7f08e81a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.853+0000 7f08ed800640 1 -- 172.21.15.33:0/2996899446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e81a1420 con 0x7f08e8102da0 2024-09-10T23:59:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08ed800640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00d6d0 tx=0x7f08dc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08e6000640 1 -- 172.21.15.33:0/2996899446 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc017070 con 0x7f08e8102da0 2024-09-10T23:59:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08e6000640 1 -- 172.21.15.33:0/2996899446 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08dc009820 con 0x7f08e8102da0 2024-09-10T23:59:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e81a1710 con 0x7f08e8102da0 2024-09-10T23:59:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08e6000640 1 -- 172.21.15.33:0/2996899446 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc004bc0 con 0x7f08e8102da0 2024-09-10T23:59:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.854+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e81a7dd0 con 0x7f08e8102da0 2024-09-10T23:59:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.857+0000 7f08f2e68740 1 Processor -- start 2024-09-10T23:59:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 -- start start 2024-09-10T23:59:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff36b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08e6000640 1 -- 172.21.15.33:0/2996899446 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f08dc005220 con 0x7f08e8102da0 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff379c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561dff2e2290 con 0x561dff36b910 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561dff2d16c0 con 0x561dff3778a0 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08f2e68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561dff2d54d0 con 0x561dff36aff0 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08ece00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff379c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57752/0 (socket says 172.21.15.33:57752) 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08ed800640 1 -- 172.21.15.33:0/1504200190 learned_addr learned my addr 172.21.15.33:0/1504200190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.858+0000 7f08ee200640 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff36b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 -- 172.21.15.33:0/1504200190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 msgr2=0x561dff36b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff36b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 -- 172.21.15.33:0/1504200190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 msgr2=0x561dff379c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff379c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 -- 172.21.15.33:0/1504200190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dff25e460 con 0x561dff36b910 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.859+0000 7f08ed800640 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0ebc00 tx=0x7f08dc0ed670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6906ea3fe5e02a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08daa00640 1 -- 172.21.15.33:0/1504200190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0f4070 con 0x561dff36b910 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08daa00640 1 -- 172.21.15.33:0/1504200190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08dc0f0ab0 con 0x561dff36b910 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08daa00640 1 -- 172.21.15.33:0/1504200190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0ef7e0 con 0x561dff36b910 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08e6000640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 0x7f08d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08e6000640 1 -- 172.21.15.33:0/2996899446 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f08dc0e5a40 con 0x7f08e8102da0 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08ee200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 0x7f08d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08f2e68740 1 -- 172.21.15.33:0/1504200190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 msgr2=0x561dff377360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.860+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0ebc00 tx=0x7f08dc0ed670 comp rx=0 tx=0).stop 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 -- 172.21.15.33:0/1504200190 shutdown_connections 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff379c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff377360 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1504200190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff36b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 -- 172.21.15.33:0/1504200190 >> 172.21.15.33:0/1504200190 conn(0x561dff368e20 msgr2=0x561dff369fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 -- 172.21.15.33:0/1504200190 shutdown_connections 2024-09-10T23:59:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 -- 172.21.15.33:0/1504200190 wait complete. 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08ee200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 0x7f08d00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009a60 tx=0x7f08e0004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.861+0000 7f08f2e68740 1 -- start start 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 Processor -- start 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36b910 0x561dff374760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff374ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561dff132bb0 con 0x561dff36aff0 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561dff26c6c0 con 0x561dff36b910 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561dff37a5a0 con 0x561dff3778a0 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.862+0000 7f08f2e68740 10 client.0 _ll_register_callbacks cb 0x561dff287490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ee200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff374ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57762/0 (socket says 172.21.15.33:57762) 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 -- 172.21.15.33:0/1502314188 learned_addr learned my addr 172.21.15.33:0/1502314188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ece00640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36b910 0x561dff374760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 -- 172.21.15.33:0/1502314188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 msgr2=0x561dff374ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff374ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 -- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36b910 msgr2=0x561dff374760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36b910 0x561dff374760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 -- 172.21.15.33:0/1502314188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dff02fb00 con 0x561dff36aff0 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08ed800640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0a9120 tx=0x7f08dc004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee1d86d7f0b06ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.863+0000 7f08cf400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc020020 con 0x561dff36aff0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f08dc0a8120 con 0x561dff36aff0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08dc0f0ab0 con 0x561dff36aff0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08dc0f4070 con 0x561dff36aff0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 10 client.15810 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561dff0a6960 con 0x561dff36aff0 2024-09-10T23:59:08.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08dc0f0ab0 con 0x561dff36aff0 2024-09-10T23:59:08.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f08dc0f0c60 con 0x561dff36aff0 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 10 client.15810 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 10 client.15810 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 20 client.15810 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff387210 0x561dff389600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 4 client.15810 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.864+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dff2e41e0 con 0x561dff387210 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.865+0000 7f08ece00640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff387210 0x561dff389600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.865+0000 7f08ece00640 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff387210 0x561dff389600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25dfb4826c33ef6 server_cookie=4fe46d9ffc21e8cc in_seq=0 out_seq=0 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.865+0000 7f08cf400640 10 client.15810 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.866+0000 7f08cf400640 1 -- 172.21.15.33:0/1502314188 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561dff2e41e0 con 0x561dff387210 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.866+0000 7f08cf400640 10 client.15810 handle_command_reply: tid=0 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 client.15810 shutdown 2024-09-10T23:59:08.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 msgr2=0x561dff377310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0a9120 tx=0x7f08dc004720 comp rx=0 tx=0).stop 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 shutdown_connections 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff387210 0x561dff389600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff374ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36b910 0x561dff374760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 --2- 172.21.15.33:0/1502314188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36aff0 0x561dff377310 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 >> 172.21.15.33:0/1502314188 conn(0x561dff368e20 msgr2=0x561dff36e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08cf400640 0 client.15810 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 shutdown_connections 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 1 -- 172.21.15.33:0/1502314188 wait complete. 2024-09-10T23:59:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.867+0000 7f08f2e68740 20 client.15810 trim_cache size 0 max 16384 2024-09-10T23:59:08.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 Processor -- start 2024-09-10T23:59:08.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 -- start start 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36aff0 0x561dff371b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff369cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81b4570 con 0x561dff36b910 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81b1e40 con 0x561dff36aff0 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.886+0000 7f08f2e68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81afc90 con 0x561dff3778a0 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57766/0 (socket says 172.21.15.33:57766) 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 -- 172.21.15.33:0/2660819287 learned_addr learned my addr 172.21.15.33:0/2660819287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ed800640 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36aff0 0x561dff371b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ee200640 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff369cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 -- 172.21.15.33:0/2660819287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 msgr2=0x561dff369cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff369cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 -- 172.21.15.33:0/2660819287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36aff0 msgr2=0x561dff371b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36aff0 0x561dff371b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 -- 172.21.15.33:0/2660819287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dff3698a0 con 0x561dff36b910 2024-09-10T23:59:08.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.887+0000 7f08ece00640 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08d4005fd0 tx=0x7f08d400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc412797c21c0ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08da000640 1 -- 172.21.15.33:0/2660819287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005220 con 0x561dff36b910 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08da000640 1 -- 172.21.15.33:0/2660819287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08d4004c30 con 0x561dff36b910 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08da000640 1 -- 172.21.15.33:0/2660819287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d40238e0 con 0x561dff36b910 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 -- 172.21.15.33:0/2660819287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 msgr2=0x561dff3720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08d4005fd0 tx=0x7f08d400b410 comp rx=0 tx=0).stop 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 -- 172.21.15.33:0/2660819287 shutdown_connections 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff3778a0 0x561dff369cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff3720c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2660819287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff36aff0 0x561dff371b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.888+0000 7f08f2e68740 1 -- 172.21.15.33:0/2660819287 >> 172.21.15.33:0/2660819287 conn(0x561dff368e20 msgr2=0x561dff38f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.889+0000 7f08f2e68740 1 -- 172.21.15.33:0/2660819287 shutdown_connections 2024-09-10T23:59:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.889+0000 7f08f2e68740 1 -- 172.21.15.33:0/2660819287 wait complete. 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.889+0000 7f08f2e68740 1 -- start start 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.889+0000 7f08f2e68740 1 Processor -- start 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff38c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff389280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81b0300 con 0x561dff36b910 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81b1770 con 0x561dff3778a0 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81b09d0 con 0x561dff36aff0 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08f2e68740 10 client.0 _ll_register_callbacks cb 0x7f08d400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08ece00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08ece00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57768/0 (socket says 172.21.15.33:57768) 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08ece00640 1 -- 172.21.15.33:0/2935945878 learned_addr learned my addr 172.21.15.33:0/2935945878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08ed800640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff38c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.890+0000 7f08ee200640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff389280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 -- 172.21.15.33:0/2935945878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 msgr2=0x561dff38c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff38c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 -- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 msgr2=0x561dff389280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff389280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 -- 172.21.15.33:0/2935945878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dff389ab0 con 0x561dff36b910 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ee200640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff389280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08ece00640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f08d40234f0 tx=0x7f08d400bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8fd4e8c58943ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08cf400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4030030 con 0x561dff36b910 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f08d4029040 con 0x561dff36b910 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.891+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d4004c30 con 0x561dff36b910 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08d4004940 con 0x561dff36b910 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 10 client.15816 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561dff3f4940 con 0x561dff36b910 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08d4004c30 con 0x561dff36b910 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f08d4023920 con 0x561dff36b910 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 10 client.15816 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 10 client.15816 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 20 client.15816 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff3f5080 0x561dff3f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 4 client.15816 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "15f2d0e1", "release": true, "await": true}] 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.892+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "15f2d0e1", "release": true, "await": true}) -- 0x561dff2dfc90 con 0x561dff3f5080 2024-09-10T23:59:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.893+0000 7f08ed800640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff3f5080 0x561dff3f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.893+0000 7f08ed800640 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff3f5080 0x561dff3f74a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6108fd67a646e232 server_cookie=d75bd02a3c139ae in_seq=0 out_seq=0 2024-09-10T23:59:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.893+0000 7f08cf400640 10 client.15816 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:08.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.943+0000 7f08cf400640 1 -- 172.21.15.33:0/2935945878 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561dff2dfc90 con 0x561dff3f5080 2024-09-10T23:59:08.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.943+0000 7f08cf400640 10 client.15816 handle_command_reply: tid=0 2024-09-10T23:59:08.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.943+0000 7f08f2e68740 1 client.15816 shutdown 2024-09-10T23:59:08.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.943+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 msgr2=0x561dff38cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.943+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f08d40234f0 tx=0x7f08d400bb00 comp rx=0 tx=0).stop 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 shutdown_connections 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561dff3778a0 0x561dff389280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561dff36b910 0x561dff38cab0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561dff3f5080 0x561dff3f74a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 --2- 172.21.15.33:0/2935945878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dff36aff0 0x561dff38c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 >> 172.21.15.33:0/2935945878 conn(0x561dff368e20 msgr2=0x561dff371b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08cf400640 0 client.15816 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 shutdown_connections 2024-09-10T23:59:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.944+0000 7f08f2e68740 1 -- 172.21.15.33:0/2935945878 wait complete. 2024-09-10T23:59:08.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.945+0000 7f08f2e68740 20 client.15816 trim_cache size 0 max 16384 2024-09-10T23:59:08.947 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:59:08.947 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:59:08.947 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 8, 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "15f2d0e1": { 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 8, 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:59:08.948 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:08.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:08.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:08.950 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:59:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.946+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 msgr2=0x7f08d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.946+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 0x7f08d00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009a60 tx=0x7f08e0004a80 comp rx=0 tx=0).stop 2024-09-10T23:59:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.946+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 msgr2=0x7f08e819b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.946+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00d6d0 tx=0x7f08dc00db90 comp rx=0 tx=0).stop 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 shutdown_connections 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08d00b52e0 0x7f08d00b77a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e8109130 0x7f08e81a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08e81087b0 0x7f08e819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 --2- 172.21.15.33:0/2996899446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8102da0 0x7f08e819b370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 >> 172.21.15.33:0/2996899446 conn(0x7f08e80fe810 msgr2=0x7f08e80753d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 shutdown_connections 2024-09-10T23:59:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:08.947+0000 7f08f0200640 1 -- 172.21.15.33:0/2996899446 wait complete. 2024-09-10T23:59:10.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '15f2d0e1', total seconds elapsed: 27.1 2024-09-10T23:59:10.001 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-10T23:59:10.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:10.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:10 smithi033 ceph-mon[30593]: pgmap v508: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T23:59:10.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:10 smithi189 ceph-mon[34000]: pgmap v508: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T23:59:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:10 smithi052 ceph-mon[33526]: pgmap v508: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T23:59:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.063+0000 7f66d5000640 1 -- 172.21.15.33:0/3671172293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 msgr2=0x7f66d0103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.063+0000 7f66d5000640 1 --2- 172.21.15.33:0/3671172293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d0103ef0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009900 tx=0x7f66c002a400 comp rx=0 tx=0).stop 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 -- 172.21.15.33:0/3671172293 shutdown_connections 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 --2- 172.21.15.33:0/3671172293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d010f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 --2- 172.21.15.33:0/3671172293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 0x7f66d010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 --2- 172.21.15.33:0/3671172293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d0103ef0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 -- 172.21.15.33:0/3671172293 >> 172.21.15.33:0/3671172293 conn(0x7f66d00fd5b0 msgr2=0x7f66d00ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 -- 172.21.15.33:0/3671172293 shutdown_connections 2024-09-10T23:59:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.064+0000 7f66d5000640 1 -- 172.21.15.33:0/3671172293 wait complete. 2024-09-10T23:59:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 Processor -- start 2024-09-10T23:59:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 -- start start 2024-09-10T23:59:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 0x7f66d019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0112a90 con 0x7f66d0103b10 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0112910 con 0x7f66d010cf70 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.065+0000 7f66d5000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0112c10 con 0x7f66d0104430 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57646/0 (socket says 172.21.15.33:57646) 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 -- 172.21.15.33:0/2568516666 learned_addr learned my addr 172.21.15.33:0/2568516666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49900/0 (socket says 172.21.15.33:49900) 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cea00640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 0x7f66d019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 -- 172.21.15.33:0/2568516666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 msgr2=0x7f66d019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 0x7f66d019b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 -- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 msgr2=0x7f66d019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.066+0000 7f66cfe00640 1 -- 172.21.15.33:0/2568516666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d01a1210 con 0x7f66d010cf70 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66cfe00640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009fd0 tx=0x7f66c800b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8017070 con 0x7f66d010cf70 2024-09-10T23:59:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66c8003e00 con 0x7f66d010cf70 2024-09-10T23:59:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8010460 con 0x7f66d010cf70 2024-09-10T23:59:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d01a1500 con 0x7f66d010cf70 2024-09-10T23:59:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.067+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d01a7bc0 con 0x7f66d010cf70 2024-09-10T23:59:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.068+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0103ef0 con 0x7f66d010cf70 2024-09-10T23:59:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.072+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f66c8003970 con 0x7f66d010cf70 2024-09-10T23:59:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.073+0000 7f66c7e00640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 0x7f66b40b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.074+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f66c80e60b0 con 0x7f66d010cf70 2024-09-10T23:59:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.074+0000 7f66cf400640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 0x7f66b40b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.074+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f66c80ac520 con 0x7f66d010cf70 2024-09-10T23:59:11.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.075+0000 7f66cf400640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 0x7f66b40b7850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66c00057c0 tx=0x7f66c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.359+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66d019c290 con 0x7f66d010cf70 2024-09-10T23:59:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:59:11.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.360+0000 7f66c7e00640 1 -- 172.21.15.33:0/2568516666 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7f66c80b5320 con 0x7f66d010cf70 2024-09-10T23:59:11.362 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:59:11.363 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:59:11.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.363+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 msgr2=0x7f66b40b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:11.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 0x7f66b40b7850 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66c00057c0 tx=0x7f66c00058d0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 msgr2=0x7f66d01a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:11.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009fd0 tx=0x7f66c800b260 comp rx=0 tx=0).stop 2024-09-10T23:59:11.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 shutdown_connections 2024-09-10T23:59:11.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f66b40b5390 0x7f66b40b7850 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66d010cf70 0x7f66d01a0a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f66d0104430 0x7f66d019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 --2- 172.21.15.33:0/2568516666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66d0103b10 0x7f66d019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:11.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.364+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 >> 172.21.15.33:0/2568516666 conn(0x7f66d00fd5b0 msgr2=0x7f66d00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:11.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.365+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 shutdown_connections 2024-09-10T23:59:11.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:11.365+0000 7f66d5000640 1 -- 172.21.15.33:0/2568516666 wait complete. 2024-09-10T23:59:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:12 smithi033 ceph-mon[30593]: pgmap v509: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 707 KiB/s wr, 9 op/s 2024-09-10T23:59:12.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:12 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2568516666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:12.294 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-10T23:59:12.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-10T23:59:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:12 smithi189 ceph-mon[34000]: pgmap v509: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 707 KiB/s wr, 9 op/s 2024-09-10T23:59:12.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:12 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2568516666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:12.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:12 smithi052 ceph-mon[33526]: pgmap v509: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 707 KiB/s wr, 9 op/s 2024-09-10T23:59:12.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:12 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2568516666' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 -- 172.21.15.33:0/87007324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0103ae0 msgr2=0x7fd4e0103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 --2- 172.21.15.33:0/87007324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0103ae0 0x7fd4e0103f60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009930 tx=0x7fd4cc02a420 comp rx=0 tx=0).stop 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 -- 172.21.15.33:0/87007324 shutdown_connections 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 --2- 172.21.15.33:0/87007324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e01044a0 0x7fd4e010ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 --2- 172.21.15.33:0/87007324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0103ae0 0x7fd4e0103f60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 --2- 172.21.15.33:0/87007324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e0102990 0x7fd4e0102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 -- 172.21.15.33:0/87007324 >> 172.21.15.33:0/87007324 conn(0x7fd4e00fe250 msgr2=0x7fd4e0100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 -- 172.21.15.33:0/87007324 shutdown_connections 2024-09-10T23:59:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.141+0000 7fd4e7000640 1 -- 172.21.15.33:0/87007324 wait complete. 2024-09-10T23:59:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 Processor -- start 2024-09-10T23:59:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 -- start start 2024-09-10T23:59:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 0x7fd4e019aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e01044a0 0x7fd4e019c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010e4e0 con 0x7fd4e0103ae0 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010e360 con 0x7fd4e01044a0 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.143+0000 7fd4e7000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010e660 con 0x7fd4e0102990 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49916/0 (socket says 172.21.15.33:49916) 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 -- 172.21.15.33:0/1134503642 learned_addr learned my addr 172.21.15.33:0/1134503642 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 0x7fd4e019aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4e5000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e01044a0 0x7fd4e019c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 -- 172.21.15.33:0/1134503642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 msgr2=0x7fd4e019aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 0x7fd4e019aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 -- 172.21.15.33:0/1134503642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e01044a0 msgr2=0x7fd4e019c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e01044a0 0x7fd4e019c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 -- 172.21.15.33:0/1134503642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e019c9e0 con 0x7fd4e0103ae0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 0x7fd4e019aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.144+0000 7fd4df400640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc031460 tx=0x7fd4cc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.145+0000 7fd4dcc00640 1 -- 172.21.15.33:0/1134503642 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc03f070 con 0x7fd4e0103ae0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.145+0000 7fd4dcc00640 1 -- 172.21.15.33:0/1134503642 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4cc031da0 con 0x7fd4e0103ae0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.145+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e019cc70 con 0x7fd4e0103ae0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.145+0000 7fd4dcc00640 1 -- 172.21.15.33:0/1134503642 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc035030 con 0x7fd4e0103ae0 2024-09-10T23:59:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.145+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01a33a0 con 0x7fd4e0103ae0 2024-09-10T23:59:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.148+0000 7fd4ea011740 1 Processor -- start 2024-09-10T23:59:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.148+0000 7fd4ea011740 1 -- start start 2024-09-10T23:59:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a9ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b8b9a0b6b0 con 0x55b8b9a9db00 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8b99faae0 con 0x55b8b9a9b0c0 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4ea011740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8b99fe8f0 con 0x55b8b9a98790 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4e5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4dcc00640 1 -- 172.21.15.33:0/1134503642 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd4cc03b460 con 0x7fd4e0103ae0 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4e5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52080/0 (socket says 172.21.15.33:52080) 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4e5000640 1 -- 172.21.15.33:0/425598695 learned_addr learned my addr 172.21.15.33:0/425598695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.149+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4df400640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a9ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 -- 172.21.15.33:0/425598695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 msgr2=0x55b8b9a9d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 -- 172.21.15.33:0/425598695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 msgr2=0x55b8b9a9ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a9ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 -- 172.21.15.33:0/425598695 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b99c7780 con 0x55b8b9a98790 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4df400640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a9ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.150+0000 7fd4e5000640 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8007e20 tx=0x7fd4d800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ed20e0225e51e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4d5600640 1 -- 172.21.15.33:0/425598695 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8014070 con 0x55b8b9a98790 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4d5600640 1 -- 172.21.15.33:0/425598695 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d8004d20 con 0x55b8b9a98790 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4d5600640 1 -- 172.21.15.33:0/425598695 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80052f0 con 0x55b8b9a98790 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4dcc00640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 0x7fd4c40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4ea011740 1 -- 172.21.15.33:0/425598695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 msgr2=0x55b8b9a9ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.151+0000 7fd4ea011740 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8007e20 tx=0x7fd4d800e720 comp rx=0 tx=0).stop 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 -- 172.21.15.33:0/425598695 shutdown_connections 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a9ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 --2- 172.21.15.33:0/425598695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9ab80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 -- 172.21.15.33:0/425598695 >> 172.21.15.33:0/425598695 conn(0x55b8b9a938e0 msgr2=0x55b8b9a94670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4dcc00640 1 -- 172.21.15.33:0/1134503642 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4cc106b40 con 0x7fd4e0103ae0 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 -- 172.21.15.33:0/425598695 shutdown_connections 2024-09-10T23:59:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 0x7fd4c40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 -- 172.21.15.33:0/425598695 wait complete. 2024-09-10T23:59:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4ea011740 1 -- start start 2024-09-10T23:59:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.152+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 0x7fd4c40b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d000b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 Processor -- start 2024-09-10T23:59:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 0x55b8b9aa1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b8b9932ab0 con 0x55b8b9a9b0c0 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8b99a1570 con 0x55b8b9a98790 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8b9aa0ae0 con 0x55b8b9a9db00 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.153+0000 7fd4ea011740 10 client.0 _ll_register_callbacks cb 0x55b8b99b0100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4e5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49942/0 (socket says 172.21.15.33:49942) 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4df400640 1 -- 172.21.15.33:0/608240534 learned_addr learned my addr 172.21.15.33:0/608240534 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 0x55b8b9aa1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4e5000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52086/0 (socket says 172.21.15.33:52086) 2024-09-10T23:59:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 -- 172.21.15.33:0/608240534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 msgr2=0x55b8b9aa3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 -- 172.21.15.33:0/608240534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 msgr2=0x55b8b9aa2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.154+0000 7fd4dfe00640 1 -- 172.21.15.33:0/608240534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b975c790 con 0x55b8b9a98790 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.155+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 0x55b8b9aa1ef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001e630 tx=0x7fd4d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9732c690b04bff8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.155+0000 7fd4ca000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.155+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001f9b0 con 0x55b8b9a98790 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.156+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4d001fb50 con 0x55b8b9a98790 2024-09-10T23:59:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.156+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d8004d20 con 0x55b8b9a98790 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.156+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd4d0032050 con 0x55b8b9a98790 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.156+0000 7fd4ea011740 10 client.35594 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.156+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8b97d5620 con 0x55b8b9a98790 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d8004d20 con 0x55b8b9a98790 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd4d0010450 con 0x55b8b9a98790 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 10 client.35594 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 10 client.35594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 20 client.35594 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9aad810 0x55b8b9aafc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 4 client.35594 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.157+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8b9a0d600 con 0x55b8b9aad810 2024-09-10T23:59:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.158+0000 7fd4df400640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9aad810 0x55b8b9aafc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.158+0000 7fd4df400640 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9aad810 0x55b8b9aafc20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9556623a5f3eb923 server_cookie=b1bd9cdf681ac98 in_seq=0 out_seq=0 2024-09-10T23:59:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.158+0000 7fd4ca000640 10 client.35594 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.159+0000 7fd4ca000640 1 -- 172.21.15.33:0/608240534 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8b9a0d600 con 0x55b8b9aad810 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.159+0000 7fd4ca000640 10 client.35594 handle_command_reply: tid=0 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.159+0000 7fd4ea011740 1 client.35594 shutdown 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.159+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 msgr2=0x55b8b9aa1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.159+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 0x55b8b9aa1ef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001e630 tx=0x7fd4d00046c0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 shutdown_connections 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9aad810 0x55b8b9aafc20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 --2- 172.21.15.33:0/608240534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a98790 0x55b8b9aa1ef0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ca000640 0 client.35594 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 >> 172.21.15.33:0/608240534 conn(0x55b8b9a938e0 msgr2=0x55b8b9a9b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 shutdown_connections 2024-09-10T23:59:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 1 -- 172.21.15.33:0/608240534 wait complete. 2024-09-10T23:59:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.160+0000 7fd4ea011740 20 client.35594 trim_cache size 0 max 16384 2024-09-10T23:59:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 Processor -- start 2024-09-10T23:59:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 -- start start 2024-09-10T23:59:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a95730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01b0050 con 0x55b8b9a9db00 2024-09-10T23:59:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ad920 con 0x55b8b9a9b0c0 2024-09-10T23:59:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.179+0000 7fd4ea011740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ab770 con 0x55b8b9a98790 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4e5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a95730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52092/0 (socket says 172.21.15.33:52092) 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 -- 172.21.15.33:0/4004415264 learned_addr learned my addr 172.21.15.33:0/4004415264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4df400640 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 -- 172.21.15.33:0/4004415264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 msgr2=0x55b8b9a9c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 -- 172.21.15.33:0/4004415264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 msgr2=0x55b8b9a95730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a95730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 -- 172.21.15.33:0/4004415264 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b9a9aef0 con 0x55b8b9a98790 2024-09-10T23:59:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.180+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00108c0 tx=0x7fd4d000b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d769e2f376906f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4d4c00640 1 -- 172.21.15.33:0/4004415264 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d003b070 con 0x55b8b9a98790 2024-09-10T23:59:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4d4c00640 1 -- 172.21.15.33:0/4004415264 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d0010ab0 con 0x55b8b9a98790 2024-09-10T23:59:13.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4d4c00640 1 -- 172.21.15.33:0/4004415264 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00052d0 con 0x55b8b9a98790 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 -- 172.21.15.33:0/4004415264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 msgr2=0x55b8b9a9c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00108c0 tx=0x7fd4d000b610 comp rx=0 tx=0).stop 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 -- 172.21.15.33:0/4004415264 shutdown_connections 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a9db00 0x55b8b9a95730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9a9c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.181+0000 7fd4ea011740 1 --2- 172.21.15.33:0/4004415264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a98790 0x55b8b9a9c4b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.182+0000 7fd4ea011740 1 -- 172.21.15.33:0/4004415264 >> 172.21.15.33:0/4004415264 conn(0x55b8b9a938e0 msgr2=0x55b8b9a97c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.182+0000 7fd4ea011740 1 -- 172.21.15.33:0/4004415264 shutdown_connections 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.182+0000 7fd4ea011740 1 -- 172.21.15.33:0/4004415264 wait complete. 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.182+0000 7fd4ea011740 1 -- start start 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.182+0000 7fd4ea011740 1 Processor -- start 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01abde0 con 0x55b8b9a98790 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ad250 con 0x55b8b9a9b0c0 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01ac4b0 con 0x55b8b9a9db00 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4ea011740 10 client.0 _ll_register_callbacks cb 0x7fd4d000b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49954/0 (socket says 172.21.15.33:49954) 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 -- 172.21.15.33:0/3104768512 learned_addr learned my addr 172.21.15.33:0/3104768512 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4e5000640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4df400640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 -- 172.21.15.33:0/3104768512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 msgr2=0x55b8b9aa8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 -- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 msgr2=0x55b8b9aa8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.183+0000 7fd4dfe00640 1 -- 172.21.15.33:0/3104768512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b9aa9460 con 0x55b8b9a98790 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4dfe00640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00059d0 tx=0x7fd4d0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8894855c7b2f39e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ca000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d003b040 con 0x55b8b9a98790 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4d0004220 con 0x55b8b9a98790 2024-09-10T23:59:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d0010ab0 con 0x55b8b9a98790 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd4d0010c60 con 0x55b8b9a98790 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ea011740 10 client.15834 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.184+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8b9b1aca0 con 0x55b8b9a98790 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d0010ab0 con 0x55b8b9a98790 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd4d00037f0 con 0x55b8b9a98790 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 10 client.15834 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 20 client.15834 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9b1b650 0x55b8b9b1da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 4 client.15834 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:59:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.185+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8b9a090b0 con 0x55b8b9b1b650 2024-09-10T23:59:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.186+0000 7fd4df400640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9b1b650 0x55b8b9b1da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.186+0000 7fd4df400640 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9b1b650 0x55b8b9b1da70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e3893496fbaf976 server_cookie=bf4b236abedb52b in_seq=0 out_seq=0 2024-09-10T23:59:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.186+0000 7fd4ca000640 10 client.15834 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ca000640 1 -- 172.21.15.33:0/3104768512 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8b9a090b0 con 0x55b8b9b1b650 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ca000640 10 client.15834 handle_command_reply: tid=0 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 client.15834 shutdown 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 msgr2=0x55b8b9aa8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00059d0 tx=0x7fd4d0005700 comp rx=0 tx=0).stop 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 shutdown_connections 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b8b9b1b650 0x55b8b9b1da70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8b9a9db00 0x55b8b9aa8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8b9a9b0c0 0x55b8b9aa8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ca000640 0 client.15834 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 --2- 172.21.15.33:0/3104768512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8b9a98790 0x55b8b9aa8020 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.200+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 >> 172.21.15.33:0/3104768512 conn(0x55b8b9a938e0 msgr2=0x55b8b9a98030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 shutdown_connections 2024-09-10T23:59:13.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4ea011740 1 -- 172.21.15.33:0/3104768512 wait complete. 2024-09-10T23:59:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4ea011740 20 client.15834 trim_cache size 0 max 16384 2024-09-10T23:59:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:59:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:59:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:59:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 msgr2=0x7fd4c40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 0x7fd4c40b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0005fd0 tx=0x7fd4d000b5a0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 msgr2=0x7fd4e019b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc031460 tx=0x7fd4cc003c80 comp rx=0 tx=0).stop 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.201+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 shutdown_connections 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4c40b5360 0x7fd4c40b7820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e01044a0 0x7fd4e019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e0103ae0 0x7fd4e019b4f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 --2- 172.21.15.33:0/1134503642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e0102990 0x7fd4e019aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 >> 172.21.15.33:0/1134503642 conn(0x7fd4e00fe250 msgr2=0x7fd4e0109270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 shutdown_connections 2024-09-10T23:59:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:13.202+0000 7fd4e7000640 1 -- 172.21.15.33:0/1134503642 wait complete. 2024-09-10T23:59:13.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 -- 172.21.15.33:0/4087884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010b1a0 msgr2=0x7fbc701119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 --2- 172.21.15.33:0/4087884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010b1a0 0x7fbc701119a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009ca0 tx=0x7fbc6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 -- 172.21.15.33:0/4087884256 shutdown_connections 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 --2- 172.21.15.33:0/4087884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010b1a0 0x7fbc701119a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 --2- 172.21.15.33:0/4087884256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7010a820 0x7fbc7010ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 --2- 172.21.15.33:0/4087884256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc70104e10 0x7fbc701051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 -- 172.21.15.33:0/4087884256 >> 172.21.15.33:0/4087884256 conn(0x7fbc70100840 msgr2=0x7fbc70102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 -- 172.21.15.33:0/4087884256 shutdown_connections 2024-09-10T23:59:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.363+0000 7fbc77200640 1 -- 172.21.15.33:0/4087884256 wait complete. 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 Processor -- start 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 -- start start 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010a820 0x7fbc7019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 0x7fbc701a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70114d60 con 0x7fbc7010a820 2024-09-10T23:59:13.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70114be0 con 0x7fbc70104e10 2024-09-10T23:59:13.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.365+0000 7fbc77200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc70114ee0 con 0x7fbc7010b1a0 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57726/0 (socket says 172.21.15.33:57726) 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 -- 172.21.15.33:0/2852851298 learned_addr learned my addr 172.21.15.33:0/2852851298 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75400640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010a820 0x7fbc7019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc76800640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 0x7fbc701a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 -- 172.21.15.33:0/2852851298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 msgr2=0x7fbc701a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 0x7fbc701a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 -- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010a820 msgr2=0x7fbc7019b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.366+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010a820 0x7fbc7019b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc75e00640 1 -- 172.21.15.33:0/2852851298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc701a1200 con 0x7fbc70104e10 2024-09-10T23:59:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc76800640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 0x7fbc701a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e9f0 tx=0x7fbc6400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc6aa00640 1 -- 172.21.15.33:0/2852851298 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400cd80 con 0x7fbc70104e10 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc701a14f0 con 0x7fbc70104e10 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc6aa00640 1 -- 172.21.15.33:0/2852851298 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc640054b0 con 0x7fbc70104e10 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc6aa00640 1 -- 172.21.15.33:0/2852851298 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64010430 con 0x7fbc70104e10 2024-09-10T23:59:13.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.367+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc701a7bb0 con 0x7fbc70104e10 2024-09-10T23:59:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.371+0000 7fbc7b271740 1 Processor -- start 2024-09-10T23:59:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 -- start start 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c4af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d421bb1ca0 con 0x55d421c3c2f0 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d421ba10d0 con 0x55d421c48ba0 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc7b271740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d421ba4ee0 con 0x55d421c3cc10 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c3c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49970/0 (socket says 172.21.15.33:49970) 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.372+0000 7fbc76800640 1 -- 172.21.15.33:0/2796527262 learned_addr learned my addr 172.21.15.33:0/2796527262 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c4af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc6aa00640 1 -- 172.21.15.33:0/2852851298 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbc64005020 con 0x7fbc70104e10 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 -- 172.21.15.33:0/2796527262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 msgr2=0x55d421c48660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 -- 172.21.15.33:0/2796527262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 msgr2=0x55d421c3c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c3c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.373+0000 7fbc75400640 1 -- 172.21.15.33:0/2796527262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d421b53400 con 0x55d421c48ba0 2024-09-10T23:59:13.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.374+0000 7fbc75400640 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c4af90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000bb40 tx=0x7fbc600103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc202da158b154d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.374+0000 7fbc5f000640 1 -- 172.21.15.33:0/2796527262 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60004030 con 0x55d421c48ba0 2024-09-10T23:59:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.374+0000 7fbc5f000640 1 -- 172.21.15.33:0/2796527262 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc600035f0 con 0x55d421c48ba0 2024-09-10T23:59:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.374+0000 7fbc5f000640 1 -- 172.21.15.33:0/2796527262 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600116a0 con 0x55d421c48ba0 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc6aa00640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 0x7fbc580b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 -- 172.21.15.33:0/2796527262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 msgr2=0x55d421c4af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c4af90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000bb40 tx=0x7fbc600103d0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc6aa00640 1 -- 172.21.15.33:0/2852851298 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fbc640e63a0 con 0x7fbc70104e10 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc76800640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 0x7fbc580b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 -- 172.21.15.33:0/2796527262 shutdown_connections 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c4af90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c48660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2796527262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c3c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.375+0000 7fbc7b271740 1 -- 172.21.15.33:0/2796527262 >> 172.21.15.33:0/2796527262 conn(0x55d421c3a120 msgr2=0x55d421c3b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.376+0000 7fbc7b271740 1 -- 172.21.15.33:0/2796527262 shutdown_connections 2024-09-10T23:59:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.376+0000 7fbc7b271740 1 -- 172.21.15.33:0/2796527262 wait complete. 2024-09-10T23:59:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.376+0000 7fbc76800640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 0x7fbc580b78d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005e30 tx=0x7fbc6c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.376+0000 7fbc7b271740 1 -- start start 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.376+0000 7fbc7b271740 1 Processor -- start 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3c2f0 0x55d421c48480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 0x55d421c458d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d421a027a0 con 0x55d421c48ba0 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d421b46a10 con 0x55d421c3cc10 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d421c4b820 con 0x55d421c3c2f0 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc7b271740 10 client.0 _ll_register_callbacks cb 0x55d421b56be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.377+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49976/0 (socket says 172.21.15.33:49976) 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 0x55d421c458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc76800640 1 -- 172.21.15.33:0/2737291928 learned_addr learned my addr 172.21.15.33:0/2737291928 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3c2f0 0x55d421c48480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 -- 172.21.15.33:0/2737291928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3c2f0 msgr2=0x55d421c48480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3c2f0 0x55d421c48480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 -- 172.21.15.33:0/2737291928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 msgr2=0x55d421c45f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc75400640 1 -- 172.21.15.33:0/2737291928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42190eb90 con 0x55d421c3cc10 2024-09-10T23:59:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.378+0000 7fbc76800640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc75400640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 0x55d421c458d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003f30 tx=0x7fbc60010ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1597b870613d39d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc53400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6002a060 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc600035f0 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fbc60003f90 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.379+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc60031050 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 10 client.35612 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d421c57170 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc600035f0 con 0x55d421c3cc10 2024-09-10T23:59:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc600046c0 con 0x55d421c3cc10 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 10 client.35612 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 10 client.35612 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 20 client.35612 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421c584c0 0x55d421c5a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 4 client.35612 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.380+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d421bb3bf0 con 0x55d421c584c0 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.381+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421c584c0 0x55d421c5a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.381+0000 7fbc75e00640 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421c584c0 0x55d421c5a8b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725b47f044349a91 server_cookie=9881b23f73b66cd5 in_seq=0 out_seq=0 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.381+0000 7fbc53400640 10 client.35612 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.382+0000 7fbc53400640 1 -- 172.21.15.33:0/2737291928 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d421bb3bf0 con 0x55d421c584c0 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.382+0000 7fbc53400640 10 client.35612 handle_command_reply: tid=0 2024-09-10T23:59:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.382+0000 7fbc7b271740 1 client.35612 shutdown 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.382+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 msgr2=0x55d421c458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.382+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 0x55d421c458d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003f30 tx=0x7fbc60010ef0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 shutdown_connections 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421c45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3cc10 0x55d421c458d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421c584c0 0x55d421c5a8b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 --2- 172.21.15.33:0/2737291928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3c2f0 0x55d421c48480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 >> 172.21.15.33:0/2737291928 conn(0x55d421c3a120 msgr2=0x55d421c3fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc53400640 0 client.35612 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 shutdown_connections 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 1 -- 172.21.15.33:0/2737291928 wait complete. 2024-09-10T23:59:13.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.383+0000 7fbc7b271740 20 client.35612 trim_cache size 0 max 16384 2024-09-10T23:59:13.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.404+0000 7fbc7b271740 1 Processor -- start 2024-09-10T23:59:13.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.404+0000 7fbc7b271740 1 -- start start 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c39730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b42f0 con 0x55d421c3c2f0 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b1bc0 con 0x55d421c48ba0 2024-09-10T23:59:13.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc7b271740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701afa10 con 0x55d421c3cc10 2024-09-10T23:59:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49986/0 (socket says 172.21.15.33:49986) 2024-09-10T23:59:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 -- 172.21.15.33:0/3526706045 learned_addr learned my addr 172.21.15.33:0/3526706045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc76800640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c39730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75400640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 -- 172.21.15.33:0/3526706045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 msgr2=0x55d421c391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 -- 172.21.15.33:0/3526706045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 msgr2=0x55d421c39730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c39730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.405+0000 7fbc75e00640 1 -- 172.21.15.33:0/3526706045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d421c3aba0 con 0x55d421c3c2f0 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.406+0000 7fbc75400640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.406+0000 7fbc75e00640 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbc640a99d0 tx=0x7fbc64009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca23d5c144c0ec9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.406+0000 7fbc5e600640 1 -- 172.21.15.33:0/3526706045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc640a6e60 con 0x55d421c3c2f0 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.406+0000 7fbc5e600640 1 -- 172.21.15.33:0/3526706045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc640b1030 con 0x55d421c3c2f0 2024-09-10T23:59:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.406+0000 7fbc5e600640 1 -- 172.21.15.33:0/3526706045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc640b1240 con 0x55d421c3c2f0 2024-09-10T23:59:13.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 -- 172.21.15.33:0/3526706045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 msgr2=0x55d421c54a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbc640a99d0 tx=0x7fbc64009720 comp rx=0 tx=0).stop 2024-09-10T23:59:13.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 -- 172.21.15.33:0/3526706045 shutdown_connections 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c48ba0 0x55d421c39730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 --2- 172.21.15.33:0/3526706045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c3c2f0 0x55d421c54a80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 -- 172.21.15.33:0/3526706045 >> 172.21.15.33:0/3526706045 conn(0x55d421c3a120 msgr2=0x55d421c38ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 -- 172.21.15.33:0/3526706045 shutdown_connections 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.407+0000 7fbc7b271740 1 -- 172.21.15.33:0/3526706045 wait complete. 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.408+0000 7fbc7b271740 1 -- start start 2024-09-10T23:59:13.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.408+0000 7fbc7b271740 1 Processor -- start 2024-09-10T23:59:13.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3c2f0 0x55d421c4d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c4d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b0080 con 0x55d421c48ba0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b14f0 con 0x55d421c3c2f0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc701b0750 con 0x55d421c3cc10 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc7b271740 10 client.0 _ll_register_callbacks cb 0x7fbc64005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3c2f0 0x55d421c4d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49996/0 (socket says 172.21.15.33:49996) 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 -- 172.21.15.33:0/231365190 learned_addr learned my addr 172.21.15.33:0/231365190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc75400640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c4d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 -- 172.21.15.33:0/231365190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 msgr2=0x55d421c4d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c4d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 -- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3c2f0 msgr2=0x55d421c4d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.409+0000 7fbc76800640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3c2f0 0x55d421c4d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc76800640 1 -- 172.21.15.33:0/231365190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d421cbe760 con 0x55d421c48ba0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc76800640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c031ea0 tx=0x7fbc6c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67e03f41c75b880 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc53400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c059060 con 0x55d421c48ba0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fbc6c030890 con 0x55d421c48ba0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.410+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc640b1030 con 0x55d421c48ba0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc6c060050 con 0x55d421c48ba0 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 10 client.15852 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:13.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d421cc5ae0 con 0x55d421c48ba0 2024-09-10T23:59:13.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc640b1030 con 0x55d421c48ba0 2024-09-10T23:59:13.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc6c049b10 con 0x55d421c48ba0 2024-09-10T23:59:13.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 10 client.15852 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 10 client.15852 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 20 client.15852 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421cc6330 0x55d421cc8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 4 client.15852 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.411+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x55d421baf6a0 con 0x55d421cc6330 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.412+0000 7fbc75e00640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421cc6330 0x55d421cc8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.413+0000 7fbc53400640 10 client.15852 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.413+0000 7fbc75e00640 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421cc6330 0x55d421cc8750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f0489bf6a02da5 server_cookie=645d8e01e2b78020 in_seq=0 out_seq=0 2024-09-10T23:59:13.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc53400640 1 -- 172.21.15.33:0/231365190 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d421baf6a0 con 0x55d421cc6330 2024-09-10T23:59:13.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc53400640 10 client.15852 handle_command_reply: tid=0 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 client.15852 shutdown 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 msgr2=0x55d421cbe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c031ea0 tx=0x7fbc6c0095c0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 shutdown_connections 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d421c48ba0 0x55d421cbe050 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d421cc6330 0x55d421cc8750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d421c3cc10 0x55d421c4d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 --2- 172.21.15.33:0/231365190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d421c3c2f0 0x55d421c4d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 >> 172.21.15.33:0/231365190 conn(0x55d421c3a120 msgr2=0x55d421c39300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc53400640 0 client.15852 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 shutdown_connections 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.624+0000 7fbc7b271740 1 -- 172.21.15.33:0/231365190 wait complete. 2024-09-10T23:59:13.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc7b271740 20 client.15852 trim_cache size 0 max 16384 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 10, 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "b3899b1b": { 2024-09-10T23:59:13.627 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 10, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:13.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:59:13.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 msgr2=0x7fbc580b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 0x7fbc580b78d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005e30 tx=0x7fbc6c005d80 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 msgr2=0x7fbc7019b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e9f0 tx=0x7fbc6400edf0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 shutdown_connections 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fbc580b5410 0x7fbc580b78d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc7010b1a0 0x7fbc701a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc7010a820 0x7fbc7019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 --2- 172.21.15.33:0/2852851298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc70104e10 0x7fbc7019b150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.625+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 >> 172.21.15.33:0/2852851298 conn(0x7fbc70100840 msgr2=0x7fbc70102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.626+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 shutdown_connections 2024-09-10T23:59:13.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:13.626+0000 7fbc77200640 1 -- 172.21.15.33:0/2852851298 wait complete. 2024-09-10T23:59:14.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:14 smithi033 ceph-mon[30593]: pgmap v510: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-09-10T23:59:14.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:14 smithi189 ceph-mon[34000]: pgmap v510: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-09-10T23:59:14.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:14 smithi052 ceph-mon[33526]: pgmap v510: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.2 MiB/s wr, 12 op/s 2024-09-10T23:59:14.561 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b3899b1b', quiesce took 4.6 seconds. Will release after: 15.9 2024-09-10T23:59:16.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:16 smithi033 ceph-mon[30593]: pgmap v511: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6.5 MiB/s wr, 8 op/s 2024-09-10T23:59:16.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:16 smithi189 ceph-mon[34000]: pgmap v511: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6.5 MiB/s wr, 8 op/s 2024-09-10T23:59:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:16 smithi052 ceph-mon[33526]: pgmap v511: 129 pgs: 129 active+clean; 772 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6.5 MiB/s wr, 8 op/s 2024-09-10T23:59:18.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:18 smithi033 ceph-mon[30593]: pgmap v512: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 15 op/s 2024-09-10T23:59:18.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:18 smithi189 ceph-mon[34000]: pgmap v512: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 15 op/s 2024-09-10T23:59:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:18 smithi052 ceph-mon[33526]: pgmap v512: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 15 op/s 2024-09-10T23:59:20.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:20 smithi033 ceph-mon[30593]: pgmap v513: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:20.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:20 smithi189 ceph-mon[34000]: pgmap v513: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:20 smithi052 ceph-mon[33526]: pgmap v513: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:22.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:22 smithi189 ceph-mon[34000]: pgmap v514: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:22 smithi052 ceph-mon[33526]: pgmap v514: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:22.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:22 smithi033 ceph-mon[30593]: pgmap v514: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 13 op/s 2024-09-10T23:59:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:24 smithi189 ceph-mon[34000]: pgmap v515: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-10T23:59:24.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:24 smithi052 ceph-mon[33526]: pgmap v515: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-10T23:59:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:24 smithi033 ceph-mon[30593]: pgmap v515: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 15 op/s 2024-09-10T23:59:26.328 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:26 smithi033 ceph-mon[30593]: pgmap v516: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 MiB/s wr, 11 op/s 2024-09-10T23:59:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:26 smithi189 ceph-mon[34000]: pgmap v516: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 MiB/s wr, 11 op/s 2024-09-10T23:59:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 -- 172.21.15.33:0/682168511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810e4e0 msgr2=0x7f6d1810e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 --2- 172.21.15.33:0/682168511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810e4e0 0x7f6d1810e960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009930 tx=0x7f6d0002a420 comp rx=0 tx=0).stop 2024-09-10T23:59:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 -- 172.21.15.33:0/682168511 shutdown_connections 2024-09-10T23:59:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 --2- 172.21.15.33:0/682168511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810eea0 0x7f6d18115800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 --2- 172.21.15.33:0/682168511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810e4e0 0x7f6d1810e960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 --2- 172.21.15.33:0/682168511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810d420 0x7f6d1810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 -- 172.21.15.33:0/682168511 >> 172.21.15.33:0/682168511 conn(0x7f6d1806d300 msgr2=0x7f6d1806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 -- 172.21.15.33:0/682168511 shutdown_connections 2024-09-10T23:59:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.332+0000 7f6d1d200640 1 -- 172.21.15.33:0/682168511 wait complete. 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 Processor -- start 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 -- start start 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810e4e0 0x7f6d181a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 0x7f6d181a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18118eb0 con 0x7f6d1810d420 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18118d30 con 0x7f6d1810eea0 2024-09-10T23:59:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.333+0000 7f6d1d200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18119030 con 0x7f6d1810e4e0 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35900/0 (socket says 172.21.15.33:35900) 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 -- 172.21.15.33:0/2172886528 learned_addr learned my addr 172.21.15.33:0/2172886528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d16800640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 0x7f6d181a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d0d400640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810e4e0 0x7f6d181a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 -- 172.21.15.33:0/2172886528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810e4e0 msgr2=0x7f6d181a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810e4e0 0x7f6d181a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 -- 172.21.15.33:0/2172886528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 msgr2=0x7f6d181a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 0x7f6d181a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 -- 172.21.15.33:0/2172886528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d181a5220 con 0x7f6d1810d420 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d16800640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 0x7f6d181a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:26.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d15e00640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800d950 tx=0x7f6d0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.334+0000 7f6d0f400640 1 -- 172.21.15.33:0/2172886528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08017030 con 0x7f6d1810d420 2024-09-10T23:59:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.335+0000 7f6d0f400640 1 -- 172.21.15.33:0/2172886528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d08004020 con 0x7f6d1810d420 2024-09-10T23:59:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.335+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d181a5510 con 0x7f6d1810d420 2024-09-10T23:59:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.335+0000 7f6d0f400640 1 -- 172.21.15.33:0/2172886528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080055d0 con 0x7f6d1810d420 2024-09-10T23:59:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.335+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d181abbe0 con 0x7f6d1810d420 2024-09-10T23:59:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 Processor -- start 2024-09-10T23:59:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 -- start start 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb58fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d0f400640 1 -- 172.21.15.33:0/2172886528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6d08009a30 con 0x7f6d1810d420 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5585afac46b0 con 0x5585afb51790 2024-09-10T23:59:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5585afab3ae0 con 0x5585afb540c0 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d201cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585afab78f0 con 0x5585afb56b00 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35912/0 (socket says 172.21.15.33:35912) 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.338+0000 7f6d16800640 1 -- 172.21.15.33:0/3298774591 learned_addr learned my addr 172.21.15.33:0/3298774591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d0d400640 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb58fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d15e00640 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 -- 172.21.15.33:0/3298774591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 msgr2=0x5585afb58fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb58fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 -- 172.21.15.33:0/3298774591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 msgr2=0x5585afb564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 -- 172.21.15.33:0/3298774591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585afa80780 con 0x5585afb51790 2024-09-10T23:59:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.339+0000 7f6d16800640 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fc0 tx=0x7f6d10010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7855e4ea3cf9eef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d07400640 1 -- 172.21.15.33:0/3298774591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011700 con 0x5585afb51790 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d07400640 1 -- 172.21.15.33:0/3298774591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d10011d30 con 0x5585afb51790 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d07400640 1 -- 172.21.15.33:0/3298774591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1001cd70 con 0x5585afb51790 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d0f400640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 0x7f6cfc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d201cf740 1 -- 172.21.15.33:0/3298774591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 msgr2=0x5585afb53b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d201cf740 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009fc0 tx=0x7f6d10010860 comp rx=0 tx=0).stop 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d0f400640 1 -- 172.21.15.33:0/2172886528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6d080e5a80 con 0x7f6d1810d420 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.340+0000 7f6d201cf740 1 -- 172.21.15.33:0/3298774591 shutdown_connections 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb58fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 --2- 172.21.15.33:0/3298774591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb53b80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 -- 172.21.15.33:0/3298774591 >> 172.21.15.33:0/3298774591 conn(0x5585afb4c8e0 msgr2=0x5585afb4d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d15e00640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 0x7f6cfc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 -- 172.21.15.33:0/3298774591 shutdown_connections 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 -- 172.21.15.33:0/3298774591 wait complete. 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 -- start start 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d15e00640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 0x7f6cfc0b7820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6d080e3180 tx=0x7f6d08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.341+0000 7f6d201cf740 1 Processor -- start 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb51790 0x5585afb5af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb5c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5585af9ebab0 con 0x5585afb540c0 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5585afa5a570 con 0x5585afb51790 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5585afb59ae0 con 0x5585afb56b00 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d201cf740 10 client.0 _ll_register_callbacks cb 0x5585afa69100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d0d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d0d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35926/0 (socket says 172.21.15.33:35926) 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d0d400640 1 -- 172.21.15.33:0/269059804 learned_addr learned my addr 172.21.15.33:0/269059804 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d16800640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb51790 0x5585afb5af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.342+0000 7f6d16800640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb5c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 -- 172.21.15.33:0/269059804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 msgr2=0x5585afb5c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb5c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 -- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb51790 msgr2=0x5585afb5af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb51790 0x5585afb5af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 -- 172.21.15.33:0/269059804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585af815790 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d16800640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb5c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d0d400640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d00031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c52338e40253165 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6cfbe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00035040 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d10011d30 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6d00004240 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6d0004e050 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d201cf740 10 client.15864 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.343+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5585af88e620 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d10011d30 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6d0003d450 con 0x5585afb540c0 2024-09-10T23:59:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 10 client.15864 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 20 client.15864 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afb667f0 0x5585afb68c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 4 client.15864 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.344+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585afac6600 con 0x5585afb667f0 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.345+0000 7f6d16800640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afb667f0 0x5585afb68c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.345+0000 7f6d16800640 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afb667f0 0x5585afb68c30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb79c362203184e server_cookie=ff6a4128b412a8fb in_seq=0 out_seq=0 2024-09-10T23:59:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.345+0000 7f6cfbe00640 10 client.15864 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6cfbe00640 1 -- 172.21.15.33:0/269059804 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585afac6600 con 0x5585afb667f0 2024-09-10T23:59:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6cfbe00640 10 client.15864 handle_command_reply: tid=0 2024-09-10T23:59:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 client.15864 shutdown 2024-09-10T23:59:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 msgr2=0x5585afb5b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d00031900 comp rx=0 tx=0).stop 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 shutdown_connections 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afb667f0 0x5585afb68c30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb5c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb540c0 0x5585afb5b620 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 --2- 172.21.15.33:0/269059804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb51790 0x5585afb5af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6cfbe00640 0 client.15864 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.346+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 >> 172.21.15.33:0/269059804 conn(0x5585afb4c8e0 msgr2=0x5585afb4ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.347+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 shutdown_connections 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.347+0000 7f6d201cf740 1 -- 172.21.15.33:0/269059804 wait complete. 2024-09-10T23:59:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.347+0000 7f6d201cf740 20 client.15864 trim_cache size 0 max 16384 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.362+0000 7f6d201cf740 1 Processor -- start 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.362+0000 7f6d201cf740 1 -- start start 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb4d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb56ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b8830 con 0x5585afb51790 2024-09-10T23:59:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b6100 con 0x5585afb540c0 2024-09-10T23:59:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d201cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b3f50 con 0x5585afb56b00 2024-09-10T23:59:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35938/0 (socket says 172.21.15.33:35938) 2024-09-10T23:59:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 -- 172.21.15.33:0/291085328 learned_addr learned my addr 172.21.15.33:0/291085328 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 -- 172.21.15.33:0/291085328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 msgr2=0x5585afb56ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb56ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 -- 172.21.15.33:0/291085328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 msgr2=0x5585afb4d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb4d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.363+0000 7f6d16800640 1 -- 172.21.15.33:0/291085328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585afb5aa80 con 0x5585afb51790 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d16800640 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001b000 tx=0x7f6d10009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac884c129e563303 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d06a00640 1 -- 172.21.15.33:0/291085328 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100049c0 con 0x5585afb51790 2024-09-10T23:59:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d06a00640 1 -- 172.21.15.33:0/291085328 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d1001c760 con 0x5585afb51790 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d06a00640 1 -- 172.21.15.33:0/291085328 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011500 con 0x5585afb51790 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d201cf740 1 -- 172.21.15.33:0/291085328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 msgr2=0x5585afb5b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.364+0000 7f6d201cf740 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001b000 tx=0x7f6d10009500 comp rx=0 tx=0).stop 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 -- 172.21.15.33:0/291085328 shutdown_connections 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb56b00 0x5585afb56ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb4d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 --2- 172.21.15.33:0/291085328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb51790 0x5585afb5b690 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 -- 172.21.15.33:0/291085328 >> 172.21.15.33:0/291085328 conn(0x5585afb4c8e0 msgr2=0x5585afb5af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 -- 172.21.15.33:0/291085328 shutdown_connections 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 -- 172.21.15.33:0/291085328 wait complete. 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 -- start start 2024-09-10T23:59:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 Processor -- start 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.365+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb51790 0x5585afb61ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb61ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b45c0 con 0x5585afb56b00 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b5a30 con 0x5585afb540c0 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181b4c90 con 0x5585afb51790 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d201cf740 10 client.0 _ll_register_callbacks cb 0x7f6d00009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d0d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb61ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35944/0 (socket says 172.21.15.33:35944) 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 -- 172.21.15.33:0/1156369017 learned_addr learned my addr 172.21.15.33:0/1156369017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb51790 0x5585afb61ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 -- 172.21.15.33:0/1156369017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb51790 msgr2=0x5585afb61ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb51790 0x5585afb61ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 -- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 msgr2=0x5585afb61ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb61ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.366+0000 7f6d16800640 1 -- 172.21.15.33:0/1156369017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585afb60720 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6d16800640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001ce30 tx=0x7f6d10005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b32e8f509ee6c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10004d60 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6d10011500 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d1001c760 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6d10048050 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6d201cf740 10 client.15870 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5585afbd3b00 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d1001c760 con 0x5585afb56b00 2024-09-10T23:59:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.367+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6d10005300 con 0x5585afb56b00 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 10 client.15870 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 20 client.15870 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afbd4240 0x5585afbd6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 4 client.15870 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5585afac20b0 con 0x5585afbd4240 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.368+0000 7f6d0d400640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afbd4240 0x5585afbd6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.369+0000 7f6d0d400640 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afbd4240 0x5585afbd6660 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fad8d3e37739ac7 server_cookie=2e18321eb4a4cae5 in_seq=0 out_seq=0 2024-09-10T23:59:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.369+0000 7f6cfbe00640 10 client.15870 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6cfbe00640 1 -- 172.21.15.33:0/1156369017 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5585afac20b0 con 0x5585afbd4240 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6cfbe00640 10 client.15870 handle_command_reply: tid=0 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 client.15870 shutdown 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 msgr2=0x5585afb62530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001ce30 tx=0x7f6d10005c80 comp rx=0 tx=0).stop 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 shutdown_connections 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5585afb56b00 0x5585afb62530 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585afb540c0 0x5585afb61ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5585afbd4240 0x5585afbd6660 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 --2- 172.21.15.33:0/1156369017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5585afb51790 0x5585afb61ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6cfbe00640 0 client.15870 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.384+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 >> 172.21.15.33:0/1156369017 conn(0x5585afb4c8e0 msgr2=0x5585afb56ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 shutdown_connections 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d201cf740 1 -- 172.21.15.33:0/1156369017 wait complete. 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d201cf740 20 client.15870 trim_cache size 0 max 16384 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:59:26.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 msgr2=0x7f6cfc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 0x7f6cfc0b7820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6d080e3180 tx=0x7f6d08000bc0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 msgr2=0x7f6d181a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800d950 tx=0x7f6d0800de10 comp rx=0 tx=0).stop 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 shutdown_connections 2024-09-10T23:59:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6cfc0b5360 0x7f6cfc0b7820 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d1810eea0 0x7f6d181a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1810e4e0 0x7f6d181a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 --2- 172.21.15.33:0/2172886528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d1810d420 0x7f6d181a36e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.385+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 >> 172.21.15.33:0/2172886528 conn(0x7f6d1806d300 msgr2=0x7f6d18111930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.386+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 shutdown_connections 2024-09-10T23:59:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:26.386+0000 7f6d1d200640 1 -- 172.21.15.33:0/2172886528 wait complete. 2024-09-10T23:59:26.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:26 smithi052 ceph-mon[33526]: pgmap v516: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.1 MiB/s wr, 11 op/s 2024-09-10T23:59:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:28 smithi189 ceph-mon[34000]: pgmap v517: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-09-10T23:59:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:28 smithi052 ceph-mon[33526]: pgmap v517: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-09-10T23:59:28.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:28 smithi033 ceph-mon[30593]: pgmap v517: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.8 MiB/s wr, 15 op/s 2024-09-10T23:59:30.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:30 smithi189 ceph-mon[34000]: pgmap v518: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-09-10T23:59:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:30 smithi052 ceph-mon[33526]: pgmap v518: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-09-10T23:59:30.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T23:59:30.519 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:30 smithi033 ceph-mon[30593]: pgmap v518: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2024-09-10T23:59:30.862 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 -- 172.21.15.33:0/3313503647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1810f200 msgr2=0x7fcb181115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 --2- 172.21.15.33:0/3313503647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1810f200 0x7fcb181115f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009ca0 tx=0x7fcb1002a8c0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 -- 172.21.15.33:0/3313503647 shutdown_connections 2024-09-10T23:59:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 --2- 172.21.15.33:0/3313503647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb1810f200 0x7fcb181115f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 --2- 172.21.15.33:0/3313503647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb18075e00 0x7fcb1810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 --2- 172.21.15.33:0/3313503647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb180754e0 0x7fcb180758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 -- 172.21.15.33:0/3313503647 >> 172.21.15.33:0/3313503647 conn(0x7fcb180fe660 msgr2=0x7fcb18100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 -- 172.21.15.33:0/3313503647 shutdown_connections 2024-09-10T23:59:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.508+0000 7fcb17200640 1 -- 172.21.15.33:0/3313503647 wait complete. 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.509+0000 7fcb17200640 1 Processor -- start 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.509+0000 7fcb17200640 1 -- start start 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 0x7fcb1819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1810f200 0x7fcb181a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18114ce0 con 0x7fcb180754e0 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18114b60 con 0x7fcb18075e00 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb17200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18114e60 con 0x7fcb1810f200 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb15e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55312/0 (socket says 172.21.15.33:55312) 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.510+0000 7fcb15e00640 1 -- 172.21.15.33:0/3117658384 learned_addr learned my addr 172.21.15.33:0/3117658384 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb16800640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1810f200 0x7fcb181a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15400640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 0x7fcb1819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 -- 172.21.15.33:0/3117658384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1810f200 msgr2=0x7fcb181a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1810f200 0x7fcb181a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 -- 172.21.15.33:0/3117658384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 msgr2=0x7fcb1819b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 0x7fcb1819b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 -- 172.21.15.33:0/3117658384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb181a1140 con 0x7fcb180754e0 2024-09-10T23:59:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15400640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 0x7fcb1819b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb15e00640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800c920 tx=0x7fcb0800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08007c70 con 0x7fcb180754e0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb08007e10 con 0x7fcb180754e0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08018710 con 0x7fcb180754e0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.511+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb181a1430 con 0x7fcb180754e0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.512+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181a7af0 con 0x7fcb180754e0 2024-09-10T23:59:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.513+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb180758c0 con 0x7fcb180754e0 2024-09-10T23:59:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.515+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcb0800f450 con 0x7fcb180754e0 2024-09-10T23:59:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.516+0000 7fcb0ea00640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 0x7fcafc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:31.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.517+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcb080e61c0 con 0x7fcb180754e0 2024-09-10T23:59:31.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.517+0000 7fcb15400640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 0x7fcafc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:31.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.517+0000 7fcb15400640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 0x7fcafc0b78d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb18100d60 tx=0x7fcb0400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.520+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcb08014030 con 0x7fcb180754e0 2024-09-10T23:59:31.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.762+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb1802e5c0 con 0x7fcb180754e0 2024-09-10T23:59:31.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.763+0000 7fcb0ea00640 1 -- 172.21.15.33:0/3117658384 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11910 (secure 0 0 0) 0x7fcb080acc80 con 0x7fcb180754e0 2024-09-10T23:59:31.765 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-10T23:59:31.765 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"btime":"2024-09-10T23:56:46:376493+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:56:45.854905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-10T23:59:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-09-10T23:59:31.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 msgr2=0x7fcafc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 0x7fcafc0b78d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb18100d60 tx=0x7fcb0400b5f0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 msgr2=0x7fcb1819b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800c920 tx=0x7fcb0800cde0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 shutdown_connections 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcafc0b5410 0x7fcafc0b78d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1810f200 0x7fcb181a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb18075e00 0x7fcb1819b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 --2- 172.21.15.33:0/3117658384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb180754e0 0x7fcb1819b090 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 >> 172.21.15.33:0/3117658384 conn(0x7fcb180fe660 msgr2=0x7fcb18106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 shutdown_connections 2024-09-10T23:59:31.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:31.766+0000 7fcb17200640 1 -- 172.21.15.33:0/3117658384 wait complete. 2024-09-10T23:59:32.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:32 smithi189 ceph-mon[34000]: pgmap v519: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 KiB/s wr, 9 op/s 2024-09-10T23:59:32.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:32 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3117658384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:32.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:32 smithi052 ceph-mon[33526]: pgmap v519: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 KiB/s wr, 9 op/s 2024-09-10T23:59:32.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:32 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3117658384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:32 smithi033 ceph-mon[30593]: pgmap v519: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 KiB/s wr, 9 op/s 2024-09-10T23:59:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:32 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3117658384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T23:59:32.780 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id b3899b1b --release --await' 2024-09-10T23:59:32.781 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id b3899b1b --release --await 2024-09-10T23:59:33.176 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 -- 172.21.15.33:0/1092865797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 msgr2=0x7f959410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 --2- 172.21.15.33:0/1092865797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959410ece0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9580009900 tx=0x7f958002a410 comp rx=0 tx=0).stop 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 -- 172.21.15.33:0/1092865797 shutdown_connections 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 --2- 172.21.15.33:0/1092865797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f9594111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 --2- 172.21.15.33:0/1092865797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959410ece0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 --2- 172.21.15.33:0/1092865797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 0x7f95940758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 -- 172.21.15.33:0/1092865797 >> 172.21.15.33:0/1092865797 conn(0x7f95940fe6c0 msgr2=0x7f9594100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 -- 172.21.15.33:0/1092865797 shutdown_connections 2024-09-10T23:59:33.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.766+0000 7f959ac00640 1 -- 172.21.15.33:0/1092865797 wait complete. 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.767+0000 7f959ac00640 1 Processor -- start 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.767+0000 7f959ac00640 1 -- start start 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 0x7f959419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f95941a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9594114cb0 con 0x7f9594075de0 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9594114b30 con 0x7f959410f220 2024-09-10T23:59:33.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959ac00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9594114e30 con 0x7f95940754c0 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f9598e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f9598e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55328/0 (socket says 172.21.15.33:55328) 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f9598e00640 1 -- 172.21.15.33:0/4085612250 learned_addr learned my addr 172.21.15.33:0/4085612250 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f9599800640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 0x7f959419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.768+0000 7f959a200640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f95941a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 -- 172.21.15.33:0/4085612250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 msgr2=0x7f959419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 0x7f959419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 -- 172.21.15.33:0/4085612250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 msgr2=0x7f95941a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f95941a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 -- 172.21.15.33:0/4085612250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95941a12b0 con 0x7f9594075de0 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f959a200640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f95941a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:33.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9598e00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9580009230 tx=0x7f95800319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9592000640 1 -- 172.21.15.33:0/4085612250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958003f030 con 0x7f9594075de0 2024-09-10T23:59:33.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f9592000640 1 -- 172.21.15.33:0/4085612250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95800043d0 con 0x7f9594075de0 2024-09-10T23:59:33.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.769+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95941a1540 con 0x7f9594075de0 2024-09-10T23:59:33.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.770+0000 7f9592000640 1 -- 172.21.15.33:0/4085612250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580035070 con 0x7f9594075de0 2024-09-10T23:59:33.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.770+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95941a7c60 con 0x7f9594075de0 2024-09-10T23:59:33.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 Processor -- start 2024-09-10T23:59:33.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 -- start start 2024-09-10T23:59:33.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f9592000640 1 -- 172.21.15.33:0/4085612250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f958003b8a0 con 0x7f9594075de0 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce060540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce062e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555fcdfcb290 con 0x555fce0541d0 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555fcdfba6c0 con 0x555fce054af0 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.773+0000 7f959ee6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fcdfbe4d0 con 0x555fce060a80 2024-09-10T23:59:33.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55340/0 (socket says 172.21.15.33:55340) 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 -- 172.21.15.33:0/2196159737 learned_addr learned my addr 172.21.15.33:0/2196159737 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f9598e00640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f9599800640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce060540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 -- 172.21.15.33:0/2196159737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 msgr2=0x555fce062e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce062e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 -- 172.21.15.33:0/2196159737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 msgr2=0x555fce060540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce060540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f959a200640 1 -- 172.21.15.33:0/2196159737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fcdf47460 con 0x555fce0541d0 2024-09-10T23:59:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.774+0000 7f9599800640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce060540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.775+0000 7f959a200640 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f958c010400 tx=0x7f958c0108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222615b25c1d01c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.775+0000 7f9586a00640 1 -- 172.21.15.33:0/2196159737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c011760 con 0x555fce0541d0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.775+0000 7f9586a00640 1 -- 172.21.15.33:0/2196159737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f958c011d90 con 0x555fce0541d0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.775+0000 7f9586a00640 1 -- 172.21.15.33:0/2196159737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c01a380 con 0x555fce0541d0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.775+0000 7f9592000640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 0x7f957c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f9592000640 1 -- 172.21.15.33:0/4085612250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9580106620 con 0x7f9594075de0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f9599800640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 0x7f957c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 -- 172.21.15.33:0/2196159737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 msgr2=0x555fce0545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f958c010400 tx=0x7f958c0108c0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 -- 172.21.15.33:0/2196159737 shutdown_connections 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce062e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce060540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2196159737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce0545b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 -- 172.21.15.33:0/2196159737 >> 172.21.15.33:0/2196159737 conn(0x555fce052000 msgr2=0x555fce0531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.776+0000 7f959ee6d740 1 -- 172.21.15.33:0/2196159737 shutdown_connections 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.777+0000 7f959ee6d740 1 -- 172.21.15.33:0/2196159737 wait complete. 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.777+0000 7f9599800640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 0x7f957c0b78d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x555fce057350 tx=0x7f9588005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.777+0000 7f959ee6d740 1 -- start start 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.777+0000 7f959ee6d740 1 Processor -- start 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce05df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce05e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555fcde1bbb0 con 0x555fce0541d0 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555fcdf556c0 con 0x555fce054af0 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fce063730 con 0x555fce060a80 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959ee6d740 10 client.0 _ll_register_callbacks cb 0x555fcdf70490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f9599800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f9599800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55352/0 (socket says 172.21.15.33:55352) 2024-09-10T23:59:33.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f9599800640 1 -- 172.21.15.33:0/2911957540 learned_addr learned my addr 172.21.15.33:0/2911957540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:33.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f9598e00640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce05df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.778+0000 7f959a200640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce05e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 -- 172.21.15.33:0/2911957540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 msgr2=0x555fce05e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce05e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 -- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 msgr2=0x555fce05df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce05df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 -- 172.21.15.33:0/2911957540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fcdd18b00 con 0x555fce0541d0 2024-09-10T23:59:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f959a200640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce05e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9598e00640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce05df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f9599800640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f958801e9f0 tx=0x7f9588004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1038643f8e3590 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f957b400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958802e060 con 0x555fce0541d0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9588018030 con 0x555fce0541d0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.779+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c011d90 con 0x555fce0541d0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9588035050 con 0x555fce0541d0 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 10 client.15888 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555fcdd8f960 con 0x555fce0541d0 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f958c011d90 con 0x555fce0541d0 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f958801c3a0 con 0x555fce0541d0 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 10 client.15888 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 10 client.15888 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 20 client.15888 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce078e90 0x555fce07b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 4 client.15888 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.780+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fcdfcd1e0 con 0x555fce078e90 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.781+0000 7f9598e00640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce078e90 0x555fce07b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.781+0000 7f9598e00640 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce078e90 0x555fce07b330 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d56167a90636dd37 server_cookie=1b887120c754f46f in_seq=0 out_seq=0 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.781+0000 7f957b400640 10 client.15888 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.782+0000 7f957b400640 1 -- 172.21.15.33:0/2911957540 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fcdfcd1e0 con 0x555fce078e90 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.782+0000 7f957b400640 10 client.15888 handle_command_reply: tid=0 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.782+0000 7f959ee6d740 1 client.15888 shutdown 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 msgr2=0x555fce05da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f958801e9f0 tx=0x7f9588004730 comp rx=0 tx=0).stop 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 shutdown_connections 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce078e90 0x555fce07b330 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce05e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce05df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 --2- 172.21.15.33:0/2911957540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05da30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 >> 172.21.15.33:0/2911957540 conn(0x555fce052000 msgr2=0x555fce057ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f957b400640 0 client.15888 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 shutdown_connections 2024-09-10T23:59:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 1 -- 172.21.15.33:0/2911957540 wait complete. 2024-09-10T23:59:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.783+0000 7f959ee6d740 20 client.15888 trim_cache size 0 max 16384 2024-09-10T23:59:33.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.801+0000 7f959ee6d740 1 Processor -- start 2024-09-10T23:59:33.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.801+0000 7f959ee6d740 1 -- start start 2024-09-10T23:59:33.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce052f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce080c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95941afeb0 con 0x555fce0541d0 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ad780 con 0x555fce054af0 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959ee6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ab5d0 con 0x555fce060a80 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55360/0 (socket says 172.21.15.33:55360) 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 -- 172.21.15.33:0/3546530265 learned_addr learned my addr 172.21.15.33:0/3546530265 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959a200640 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce080c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 -- 172.21.15.33:0/3546530265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 msgr2=0x555fce080c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce080c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 -- 172.21.15.33:0/3546530265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 msgr2=0x555fce052f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce052f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f9599800640 1 -- 172.21.15.33:0/3546530265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fce05d7e0 con 0x555fce0541d0 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.802+0000 7f959a200640 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce080c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.803+0000 7f9599800640 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f958801c770 tx=0x7f9588005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c9d6f48190c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.803+0000 7f9586000640 1 -- 172.21.15.33:0/3546530265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958801e7c0 con 0x555fce0541d0 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.803+0000 7f9586000640 1 -- 172.21.15.33:0/3546530265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f958801c3a0 con 0x555fce0541d0 2024-09-10T23:59:33.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.803+0000 7f9586000640 1 -- 172.21.15.33:0/3546530265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95880035f0 con 0x555fce0541d0 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- 172.21.15.33:0/3546530265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 msgr2=0x555fce05f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f958801c770 tx=0x7f9588005d30 comp rx=0 tx=0).stop 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- 172.21.15.33:0/3546530265 shutdown_connections 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce060a80 0x555fce080c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce052f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 --2- 172.21.15.33:0/3546530265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce0541d0 0x555fce05f6d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- 172.21.15.33:0/3546530265 >> 172.21.15.33:0/3546530265 conn(0x555fce052000 msgr2=0x555fce057ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- 172.21.15.33:0/3546530265 shutdown_connections 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- 172.21.15.33:0/3546530265 wait complete. 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.804+0000 7f959ee6d740 1 -- start start 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 Processor -- start 2024-09-10T23:59:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 0x555fce0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95941abc40 con 0x555fce060a80 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ad0b0 con 0x555fce054af0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ac310 con 0x555fce0541d0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959ee6d740 10 client.0 _ll_register_callbacks cb 0x7f9588009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55366/0 (socket says 172.21.15.33:55366) 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.805+0000 7f959a200640 1 -- 172.21.15.33:0/1105780127 learned_addr learned my addr 172.21.15.33:0/1105780127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f9599800640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 0x555fce0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f9598e00640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 -- 172.21.15.33:0/1105780127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 msgr2=0x555fce0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 0x555fce0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 -- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 msgr2=0x555fce071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 -- 172.21.15.33:0/1105780127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fce06d630 con 0x555fce060a80 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f9599800640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 0x555fce0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f9598e00640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f959a200640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f958c009f20 tx=0x7f958c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e78abab8ed9058 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.806+0000 7f957b400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c011970 con 0x555fce060a80 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958801c3a0 con 0x555fce060a80 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f958c011b10 con 0x555fce060a80 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f958c032050 con 0x555fce060a80 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 10 client.15894 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:33.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555fce0e7aa0 con 0x555fce060a80 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f958801c3a0 con 0x555fce060a80 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f958c02d030 con 0x555fce060a80 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 10 client.15894 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 10 client.15894 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 20 client.15894 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce0e7ee0 0x555fce0ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 4 client.15894 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b3899b1b", "release": true, "await": true}] 2024-09-10T23:59:33.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.807+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b3899b1b", "release": true, "await": true}) -- 0x555fce059600 con 0x555fce0e7ee0 2024-09-10T23:59:33.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.808+0000 7f9599800640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce0e7ee0 0x555fce0ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:33.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.809+0000 7f9599800640 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce0e7ee0 0x555fce0ea2d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a9a60cd30467b2 server_cookie=66abe7dfa55d2a8 in_seq=0 out_seq=0 2024-09-10T23:59:33.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.809+0000 7f957b400640 10 client.15894 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.861+0000 7f957b400640 1 -- 172.21.15.33:0/1105780127 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555fce059600 con 0x555fce0e7ee0 2024-09-10T23:59:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.861+0000 7f957b400640 10 client.15894 handle_command_reply: tid=0 2024-09-10T23:59:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.861+0000 7f959ee6d740 1 client.15894 shutdown 2024-09-10T23:59:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 msgr2=0x555fce06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f958c009f20 tx=0x7f958c005bf0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 shutdown_connections 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555fce060a80 0x555fce06ce00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555fce054af0 0x555fce071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555fce0e7ee0 0x555fce0ea2d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 --2- 172.21.15.33:0/1105780127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fce0541d0 0x555fce0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 >> 172.21.15.33:0/1105780127 conn(0x555fce052000 msgr2=0x555fce057380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.862+0000 7f957b400640 0 client.15894 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.863+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 shutdown_connections 2024-09-10T23:59:33.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.863+0000 7f959ee6d740 1 -- 172.21.15.33:0/1105780127 wait complete. 2024-09-10T23:59:33.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.863+0000 7f959ee6d740 20 client.15894 trim_cache size 0 max 16384 2024-09-10T23:59:33.865 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-10T23:59:33.866 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 26, 2024-09-10T23:59:33.866 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-10T23:59:33.866 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 12, 2024-09-10T23:59:33.866 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "b3899b1b": { 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 12, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-10T23:59:33.867 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-10T23:59:33.868 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 msgr2=0x7f957c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 0x7f957c0b78d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x555fce057350 tx=0x7f9588005f90 comp rx=0 tx=0).stop 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 msgr2=0x7f959419b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9580009230 tx=0x7f95800319a0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 shutdown_connections 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f957c0b5410 0x7f957c0b78d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f959410f220 0x7f95941a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9594075de0 0x7f959419b740 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 --2- 172.21.15.33:0/4085612250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95940754c0 0x7f959419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:33.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 >> 172.21.15.33:0/4085612250 conn(0x7f95940fe6c0 msgr2=0x7f95940ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:33.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 shutdown_connections 2024-09-10T23:59:33.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-10T23:59:33.865+0000 7f959ac00640 1 -- 172.21.15.33:0/4085612250 wait complete. 2024-09-10T23:59:34.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:34 smithi189 ceph-mon[34000]: pgmap v520: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T23:59:34.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:34 smithi033 ceph-mon[30593]: pgmap v520: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T23:59:34.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:34 smithi052 ceph-mon[33526]: pgmap v520: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-10T23:59:34.948 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b3899b1b', total seconds elapsed: 24.9 2024-09-10T23:59:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:36 smithi189 ceph-mon[34000]: pgmap v521: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 345 KiB/s wr, 9 op/s 2024-09-10T23:59:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:36 smithi052 ceph-mon[33526]: pgmap v521: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 345 KiB/s wr, 9 op/s 2024-09-10T23:59:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:36 smithi033 ceph-mon[30593]: pgmap v521: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 345 KiB/s wr, 9 op/s 2024-09-10T23:59:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:38 smithi189 ceph-mon[34000]: pgmap v522: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-09-10T23:59:38.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:38 smithi052 ceph-mon[33526]: pgmap v522: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-09-10T23:59:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:38 smithi033 ceph-mon[30593]: pgmap v522: 129 pgs: 129 active+clean; 772 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.3 MiB/s wr, 15 op/s 2024-09-10T23:59:39.021 INFO:teuthology.orchestra.run.smithi033.stderr:creating primary keys... 2024-09-10T23:59:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 -- 172.21.15.33:0/1446826480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e41064e0 msgr2=0x7f00e410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 --2- 172.21.15.33:0/1446826480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e41064e0 0x7f00e410ce60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009cd0 tx=0x7f00dc02a8e0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 -- 172.21.15.33:0/1446826480 shutdown_connections 2024-09-10T23:59:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 --2- 172.21.15.33:0/1446826480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e41064e0 0x7f00e410ce60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 --2- 172.21.15.33:0/1446826480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e4105b20 0x7f00e4105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 --2- 172.21.15.33:0/1446826480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 -- 172.21.15.33:0/1446826480 >> 172.21.15.33:0/1446826480 conn(0x7f00e4100270 msgr2=0x7f00e41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 -- 172.21.15.33:0/1446826480 shutdown_connections 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.534+0000 7f00ea800640 1 -- 172.21.15.33:0/1446826480 wait complete. 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 Processor -- start 2024-09-10T23:59:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 -- start start 2024-09-10T23:59:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e419acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e41064e0 0x7f00e419bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4110540 con 0x7f00e4105b20 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41103c0 con 0x7f00e41049d0 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00ea800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41106c0 con 0x7f00e41064e0 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.536+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55388/0 (socket says 172.21.15.33:55388) 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 -- 172.21.15.33:0/52941013 learned_addr learned my addr 172.21.15.33:0/52941013 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e9400640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e419acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e9e00640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e41064e0 0x7f00e419bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 -- 172.21.15.33:0/52941013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e41064e0 msgr2=0x7f00e419bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e41064e0 0x7f00e419bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 -- 172.21.15.33:0/52941013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 msgr2=0x7f00e419acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e419acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 -- 172.21.15.33:0/52941013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e419c800 con 0x7f00e4105b20 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e9400640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e419acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.537+0000 7f00e8a00640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00d000e9f0 tx=0x7f00d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.538+0000 7f00e2000640 1 -- 172.21.15.33:0/52941013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d000cd80 con 0x7f00e4105b20 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.538+0000 7f00e2000640 1 -- 172.21.15.33:0/52941013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00d00054b0 con 0x7f00e4105b20 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.538+0000 7f00e2000640 1 -- 172.21.15.33:0/52941013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0010430 con 0x7f00e4105b20 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.538+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e419caf0 con 0x7f00e4105b20 2024-09-10T23:59:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.538+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e41a31c0 con 0x7f00e4105b20 2024-09-10T23:59:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 Processor -- start 2024-09-10T23:59:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 -- start start 2024-09-10T23:59:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a38bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38ece0 0x56137a3911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56137a2fc6b0 con 0x56137a389970 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56137a2ebae0 con 0x56137a38c2a0 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.542+0000 7f00eee43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56137a2ef8f0 con 0x56137a38ece0 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38756/0 (socket says 172.21.15.33:38756) 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9400640 1 -- 172.21.15.33:0/1862250990 learned_addr learned my addr 172.21.15.33:0/1862250990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a38bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 -- 172.21.15.33:0/1862250990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38ece0 msgr2=0x56137a3911a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38ece0 0x56137a3911a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 -- 172.21.15.33:0/1862250990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 msgr2=0x56137a38e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.543+0000 7f00e9e00640 1 -- 172.21.15.33:0/1862250990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137a2b8780 con 0x56137a389970 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.544+0000 7f00e9400640 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.544+0000 7f00e2000640 1 -- 172.21.15.33:0/52941013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f00d0005020 con 0x7f00e4105b20 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.544+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a38bd60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009ca0 tx=0x7f00dc0093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d8ff9ce58a0321 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.545+0000 7f00d6600640 1 -- 172.21.15.33:0/1862250990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc048070 con 0x56137a389970 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.545+0000 7f00d6600640 1 -- 172.21.15.33:0/1862250990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00dc036070 con 0x56137a389970 2024-09-10T23:59:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.545+0000 7f00d6600640 1 -- 172.21.15.33:0/1862250990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc004410 con 0x56137a389970 2024-09-10T23:59:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 -- 172.21.15.33:0/1862250990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 msgr2=0x56137a38bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a38bd60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009ca0 tx=0x7f00dc0093c0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00e2000640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 0x7f00cc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00e2000640 1 -- 172.21.15.33:0/52941013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00d00e6310 con 0x7f00e4105b20 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 -- 172.21.15.33:0/1862250990 shutdown_connections 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38ece0 0x56137a3911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38c2a0 0x56137a38e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 --2- 172.21.15.33:0/1862250990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a38bd60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00eee43740 1 -- 172.21.15.33:0/1862250990 >> 172.21.15.33:0/1862250990 conn(0x56137a384ac0 msgr2=0x56137a385850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.546+0000 7f00e9400640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 0x7f00cc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.547+0000 7f00eee43740 1 -- 172.21.15.33:0/1862250990 shutdown_connections 2024-09-10T23:59:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.547+0000 7f00eee43740 1 -- 172.21.15.33:0/1862250990 wait complete. 2024-09-10T23:59:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.547+0000 7f00e9400640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 0x7f00cc0b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f00d80126e0 tx=0x7f00d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.548+0000 7f00eee43740 1 -- start start 2024-09-10T23:59:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.548+0000 7f00eee43740 1 Processor -- start 2024-09-10T23:59:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.548+0000 7f00eee43740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.548+0000 7f00eee43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 0x56137a3937d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00eee43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a394330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00eee43740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56137a223ab0 con 0x56137a389970 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00eee43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56137a292570 con 0x56137a38ece0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00eee43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56137a391c60 con 0x56137a38c2a0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00eee43740 10 client.0 _ll_register_callbacks cb 0x56137a2a1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e9400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55400/0 (socket says 172.21.15.33:55400) 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e9400640 1 -- 172.21.15.33:0/1612580654 learned_addr learned my addr 172.21.15.33:0/1612580654 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 0x56137a3937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a394330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 -- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 msgr2=0x56137a394330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a394330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 -- 172.21.15.33:0/1612580654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 msgr2=0x56137a393130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.549+0000 7f00e8a00640 1 -- 172.21.15.33:0/1612580654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56137a04d790 con 0x56137a38c2a0 2024-09-10T23:59:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00e9e00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a394330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00e9400640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00e8a00640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 0x56137a3937d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00d00e3a10 tx=0x7f00d00ac560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5372243d878b4e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00caa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0093e60 con 0x56137a38c2a0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00d00b59d0 con 0x56137a38c2a0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.550+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00dc036070 con 0x56137a38c2a0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.551+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00d00acdd0 con 0x56137a38c2a0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.551+0000 7f00eee43740 10 client.25630 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.551+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56137a0c6620 con 0x56137a38c2a0 2024-09-10T23:59:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.551+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00dc036070 con 0x56137a38c2a0 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f00d00a8020 con 0x56137a38c2a0 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 10 client.25630 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 10 client.25630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 20 client.25630 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a39e980 0x56137a3a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 4 client.25630 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56137a2fe600 con 0x56137a39e980 2024-09-10T23:59:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.552+0000 7f00e9400640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a39e980 0x56137a3a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.553+0000 7f00e9400640 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a39e980 0x56137a3a0da0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a57dea894590011 server_cookie=89bf3b5baca953c9 in_seq=0 out_seq=0 2024-09-10T23:59:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.553+0000 7f00caa00640 10 client.25630 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.555+0000 7f00caa00640 1 -- 172.21.15.33:0/1612580654 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56137a2fe600 con 0x56137a39e980 2024-09-10T23:59:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.555+0000 7f00caa00640 10 client.25630 handle_command_reply: tid=0 2024-09-10T23:59:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.555+0000 7f00eee43740 1 client.25630 shutdown 2024-09-10T23:59:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.555+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 msgr2=0x56137a3937d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.555+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 0x56137a3937d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00d00e3a10 tx=0x7f00d00ac560 comp rx=0 tx=0).stop 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 shutdown_connections 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a394330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a39e980 0x56137a3a0da0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a38c2a0 0x56137a3937d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 --2- 172.21.15.33:0/1612580654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a389970 0x56137a393130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 >> 172.21.15.33:0/1612580654 conn(0x56137a384ac0 msgr2=0x56137a383bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00caa00640 0 client.25630 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 shutdown_connections 2024-09-10T23:59:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 1 -- 172.21.15.33:0/1612580654 wait complete. 2024-09-10T23:59:39.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.556+0000 7f00eee43740 20 client.25630 trim_cache size 0 max 16384 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.580+0000 7f00eee43740 1 Processor -- start 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 -- start start 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a394310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a38f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41afd20 con 0x56137a38c2a0 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41ad5f0 con 0x56137a38ece0 2024-09-10T23:59:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00eee43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41ab440 con 0x56137a389970 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55406/0 (socket says 172.21.15.33:55406) 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00e8a00640 1 -- 172.21.15.33:0/2833580749 learned_addr learned my addr 172.21.15.33:0/2833580749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.581+0000 7f00e9400640 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a394310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e9e00640 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a38f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 -- 172.21.15.33:0/2833580749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 msgr2=0x56137a394310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a394310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 -- 172.21.15.33:0/2833580749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 msgr2=0x56137a38f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a38f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 -- 172.21.15.33:0/2833580749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137a392c30 con 0x56137a38c2a0 2024-09-10T23:59:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00e8a00640 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b5e20 tx=0x7f00d0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d12efd838358df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00d5c00640 1 -- 172.21.15.33:0/2833580749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00cc070 con 0x56137a38c2a0 2024-09-10T23:59:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00d5c00640 1 -- 172.21.15.33:0/2833580749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00d00ac6d0 con 0x56137a38c2a0 2024-09-10T23:59:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.582+0000 7f00d5c00640 1 -- 172.21.15.33:0/2833580749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0093e60 con 0x56137a38c2a0 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 -- 172.21.15.33:0/2833580749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 msgr2=0x56137a38f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b5e20 tx=0x7f00d0009720 comp rx=0 tx=0).stop 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 -- 172.21.15.33:0/2833580749 shutdown_connections 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a38f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a38f150 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 --2- 172.21.15.33:0/2833580749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a394310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 -- 172.21.15.33:0/2833580749 >> 172.21.15.33:0/2833580749 conn(0x56137a384ac0 msgr2=0x56137a392030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.583+0000 7f00eee43740 1 -- 172.21.15.33:0/2833580749 shutdown_connections 2024-09-10T23:59:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.584+0000 7f00eee43740 1 -- 172.21.15.33:0/2833580749 wait complete. 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.584+0000 7f00eee43740 1 -- start start 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.584+0000 7f00eee43740 1 Processor -- start 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a39aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a399cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41abab0 con 0x56137a38c2a0 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41acf20 con 0x56137a38ece0 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41ac180 con 0x56137a389970 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00eee43740 10 client.0 _ll_register_callbacks cb 0x7f00d0004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00e8a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55408/0 (socket says 172.21.15.33:55408) 2024-09-10T23:59:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00e8a00640 1 -- 172.21.15.33:0/3177650336 learned_addr learned my addr 172.21.15.33:0/3177650336 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00e9e00640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a399cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.585+0000 7f00e9400640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a39aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 -- 172.21.15.33:0/3177650336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 msgr2=0x56137a39aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a39aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 -- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 msgr2=0x56137a399cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a399cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 -- 172.21.15.33:0/3177650336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56137a39a500 con 0x56137a38c2a0 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e9400640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a39aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00e8a00640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f00d0004ab0 tx=0x7f00d00a8480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfeb9e9b0c64313 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00caa00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00cc060 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.586+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00d00ab930 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.587+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d00ac6d0 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.587+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00d0093e60 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.587+0000 7f00eee43740 10 client.15912 fetch_fsmap learned FSMap version 26 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.587+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56137a40b850 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.587+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00d00ac6d0 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f00d00cfa20 con 0x56137a38c2a0 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 10 client.15912 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 20 client.15912 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a40bfc0 0x56137a40e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 4 client.15912 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:59:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56137a2fa0b0 con 0x56137a40bfc0 2024-09-10T23:59:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.588+0000 7f00e9400640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a40bfc0 0x56137a40e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.589+0000 7f00e9400640 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a40bfc0 0x56137a40e3e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5217eb00782c8a73 server_cookie=b7fb3d72bf146627 in_seq=0 out_seq=0 2024-09-10T23:59:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.589+0000 7f00caa00640 10 client.15912 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.614+0000 7f00caa00640 1 -- 172.21.15.33:0/3177650336 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56137a2fa0b0 con 0x56137a40bfc0 2024-09-10T23:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.614+0000 7f00caa00640 10 client.15912 handle_command_reply: tid=0 2024-09-10T23:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.614+0000 7f00eee43740 1 client.15912 shutdown 2024-09-10T23:59:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 msgr2=0x56137a399790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f00d0004ab0 tx=0x7f00d00a8480 comp rx=0 tx=0).stop 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 shutdown_connections 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56137a38ece0 0x56137a399cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56137a38c2a0 0x56137a399790 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56137a40bfc0 0x56137a40e3e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 --2- 172.21.15.33:0/3177650336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56137a389970 0x56137a39aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00caa00640 0 client.15912 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 >> 172.21.15.33:0/3177650336 conn(0x56137a384ac0 msgr2=0x56137a385320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 shutdown_connections 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 1 -- 172.21.15.33:0/3177650336 wait complete. 2024-09-10T23:59:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.615+0000 7f00eee43740 20 client.15912 trim_cache size 0 max 16384 2024-09-10T23:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:59:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 msgr2=0x7f00cc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 0x7f00cc0b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f00d80126e0 tx=0x7f00d8005f90 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 msgr2=0x7f00e419b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00d000e9f0 tx=0x7f00d000edf0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 shutdown_connections 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00cc0b5360 0x7f00cc0b7820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00e41064e0 0x7f00e419bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00e4105b20 0x7f00e419b310 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 --2- 172.21.15.33:0/52941013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00e41049d0 0x7f00e419acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 >> 172.21.15.33:0/52941013 conn(0x7f00e4100270 msgr2=0x7f00e4108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 shutdown_connections 2024-09-10T23:59:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:39.616+0000 7f00ea800640 1 -- 172.21.15.33:0/52941013 wait complete. 2024-09-10T23:59:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:40 smithi189 ceph-mon[34000]: pgmap v523: 129 pgs: 129 active+clean; 784 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-09-10T23:59:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:40 smithi052 ceph-mon[33526]: pgmap v523: 129 pgs: 129 active+clean; 784 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-09-10T23:59:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:40 smithi033 ceph-mon[30593]: pgmap v523: 129 pgs: 129 active+clean; 784 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 11 op/s 2024-09-10T23:59:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:42 smithi189 ceph-mon[34000]: pgmap v524: 129 pgs: 129 active+clean; 788 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-10T23:59:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:42 smithi052 ceph-mon[33526]: pgmap v524: 129 pgs: 129 active+clean; 788 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-10T23:59:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:42 smithi033 ceph-mon[30593]: pgmap v524: 129 pgs: 129 active+clean; 788 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 17 op/s 2024-09-10T23:59:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:44 smithi189 ceph-mon[34000]: pgmap v525: 129 pgs: 129 active+clean; 830 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 31 op/s 2024-09-10T23:59:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:44 smithi052 ceph-mon[33526]: pgmap v525: 129 pgs: 129 active+clean; 830 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 31 op/s 2024-09-10T23:59:44.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:44 smithi033 ceph-mon[30593]: pgmap v525: 129 pgs: 129 active+clean; 830 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 31 op/s 2024-09-10T23:59:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:46 smithi189 ceph-mon[34000]: pgmap v526: 129 pgs: 129 active+clean; 850 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 32 op/s 2024-09-10T23:59:46.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:46 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:46.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:46 smithi052 ceph-mon[33526]: pgmap v526: 129 pgs: 129 active+clean; 850 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 32 op/s 2024-09-10T23:59:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:46 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:46 smithi033 ceph-mon[30593]: pgmap v526: 129 pgs: 129 active+clean; 850 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 32 op/s 2024-09-10T23:59:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:46 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:done in 139.60 s (drop tables 0.01 s, create tables 0.07 s, client-side generate 73.69 s, vacuum 56.75 s, primary keys 9.08 s). 2024-09-10T23:59:48.107 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-10T23:59:48.326 INFO:teuthology.orchestra.run.smithi033.stderr:starting vacuum...end. 2024-09-10T23:59:48.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:48 smithi189 ceph-mon[34000]: pgmap v527: 129 pgs: 129 active+clean; 878 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-10T23:59:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:48 smithi052 ceph-mon[33526]: pgmap v527: 129 pgs: 129 active+clean; 878 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-10T23:59:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:48 smithi033 ceph-mon[30593]: pgmap v527: 129 pgs: 129 active+clean; 878 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-10T23:59:50.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:50 smithi052 ceph-mon[33526]: pgmap v528: 129 pgs: 129 active+clean; 910 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 36 op/s 2024-09-10T23:59:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:50 smithi033 ceph-mon[30593]: pgmap v528: 129 pgs: 129 active+clean; 910 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 36 op/s 2024-09-10T23:59:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:50 smithi189 ceph-mon[34000]: pgmap v528: 129 pgs: 129 active+clean; 910 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 36 op/s 2024-09-10T23:59:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:52 smithi052 ceph-mon[33526]: pgmap v529: 129 pgs: 129 active+clean; 938 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-09-10T23:59:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:52 smithi033 ceph-mon[30593]: pgmap v529: 129 pgs: 129 active+clean; 938 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-09-10T23:59:52.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:52 smithi189 ceph-mon[34000]: pgmap v529: 129 pgs: 129 active+clean; 938 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 37 op/s 2024-09-10T23:59:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 -- 172.21.15.33:0/3973783704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e81066a0 msgr2=0x7fd4e810d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 --2- 172.21.15.33:0/3973783704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e81066a0 0x7fd4e810d020 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009c60 tx=0x7fd4e002a740 comp rx=0 tx=0).stop 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 -- 172.21.15.33:0/3973783704 shutdown_connections 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 --2- 172.21.15.33:0/3973783704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e81066a0 0x7fd4e810d020 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 --2- 172.21.15.33:0/3973783704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e8105ce0 0x7fd4e8106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 --2- 172.21.15.33:0/3973783704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8104b90 0x7fd4e8104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 -- 172.21.15.33:0/3973783704 >> 172.21.15.33:0/3973783704 conn(0x7fd4e8100410 msgr2=0x7fd4e8102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 -- 172.21.15.33:0/3973783704 shutdown_connections 2024-09-10T23:59:52.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.813+0000 7fd4ede00640 1 -- 172.21.15.33:0/3973783704 wait complete. 2024-09-10T23:59:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.815+0000 7fd4ede00640 1 Processor -- start 2024-09-10T23:59:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.815+0000 7fd4ede00640 1 -- start start 2024-09-10T23:59:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.816+0000 7fd4ede00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 0x7fd4e8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.816+0000 7fd4ede00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 0x7fd4e80722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.816+0000 7fd4ede00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 0x7fd4e8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.816+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 0x7fd4e80722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.816+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 0x7fd4e80722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33694/0 (socket says 172.21.15.33:33694) 2024-09-10T23:59:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4e6000640 1 -- 172.21.15.33:0/4234561287 learned_addr learned my addr 172.21.15.33:0/4234561287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 0x7fd4e8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81106b0 con 0x7fd4e8104b90 2024-09-10T23:59:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 0x7fd4e8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8110530 con 0x7fd4e8105ce0 2024-09-10T23:59:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.817+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8110830 con 0x7fd4e81066a0 2024-09-10T23:59:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.818+0000 7fd4e7400640 1 -- 172.21.15.33:0/4234561287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 msgr2=0x7fd4e80722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.818+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 0x7fd4e80722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.818+0000 7fd4e7400640 1 -- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 msgr2=0x7fd4e8071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.818+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 0x7fd4e8071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.819+0000 7fd4e7400640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e80737a0 con 0x7fd4e81066a0 2024-09-10T23:59:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.819+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 0x7fd4e8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.819+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 0x7fd4e8072ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034040 tx=0x7fd4e00305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.820+0000 7fd4eca00640 1 -- 172.21.15.33:0/4234561287 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0036070 con 0x7fd4e81066a0 2024-09-10T23:59:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.821+0000 7fd4eca00640 1 -- 172.21.15.33:0/4234561287 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4e0037040 con 0x7fd4e81066a0 2024-09-10T23:59:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.821+0000 7fd4eca00640 1 -- 172.21.15.33:0/4234561287 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0004680 con 0x7fd4e81066a0 2024-09-10T23:59:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.821+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e8073a30 con 0x7fd4e81066a0 2024-09-10T23:59:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.821+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e8073f50 con 0x7fd4e81066a0 2024-09-10T23:59:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.828+0000 7fd4f0c50740 1 Processor -- start 2024-09-10T23:59:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.828+0000 7fd4eca00640 1 -- 172.21.15.33:0/4234561287 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd4e004e060 con 0x7fd4e81066a0 2024-09-10T23:59:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 -- start start 2024-09-10T23:59:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8549390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 0x55f7d854bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f7d84b16b0 con 0x55f7d854c310 2024-09-10T23:59:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f7d84a0ae0 con 0x55f7d85498d0 2024-09-10T23:59:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.829+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f7d84a48f0 con 0x55f7d8546fa0 2024-09-10T23:59:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37420/0 (socket says 172.21.15.33:37420) 2024-09-10T23:59:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4e6000640 1 -- 172.21.15.33:0/2971014509 learned_addr learned my addr 172.21.15.33:0/2971014509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4e6000640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8549390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4eca00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 0x7fd4cc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 0x55f7d854bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.831+0000 7fd4eca00640 1 -- 172.21.15.33:0/4234561287 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4e01069d0 con 0x7fd4e81066a0 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.832+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 0x7fd4cc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.832+0000 7fd4e6000640 1 -- 172.21.15.33:0/2971014509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 msgr2=0x55f7d8549390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.832+0000 7fd4e6000640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8549390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.832+0000 7fd4e6000640 1 -- 172.21.15.33:0/2971014509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 msgr2=0x55f7d854bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.832+0000 7fd4e6000640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 0x55f7d854bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.833+0000 7fd4e6000640 1 -- 172.21.15.33:0/2971014509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d846d780 con 0x55f7d854c310 2024-09-10T23:59:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.833+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 0x55f7d854bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:52.835 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.833+0000 7fd4e7400640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 0x7fd4cc0b78f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00308b0 tx=0x7fd4e0003d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.834+0000 7fd4e6000640 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009fc0 tx=0x7fd4d40098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290d6e86bd7173c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.834+0000 7fd4d3e00640 1 -- 172.21.15.33:0/2971014509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40131b0 con 0x55f7d854c310 2024-09-10T23:59:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.834+0000 7fd4d3e00640 1 -- 172.21.15.33:0/2971014509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d400fd50 con 0x55f7d854c310 2024-09-10T23:59:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.834+0000 7fd4d3e00640 1 -- 172.21.15.33:0/2971014509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4010be0 con 0x55f7d854c310 2024-09-10T23:59:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 -- 172.21.15.33:0/2971014509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 msgr2=0x55f7d854e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009fc0 tx=0x7fd4d40098d0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 -- 172.21.15.33:0/2971014509 shutdown_connections 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854c310 0x55f7d854e7d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d85498d0 0x55f7d854bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/2971014509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8549390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.835+0000 7fd4f0c50740 1 -- 172.21.15.33:0/2971014509 >> 172.21.15.33:0/2971014509 conn(0x55f7d85420f0 msgr2=0x55f7d8542e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.836+0000 7fd4f0c50740 1 -- 172.21.15.33:0/2971014509 shutdown_connections 2024-09-10T23:59:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.836+0000 7fd4f0c50740 1 -- 172.21.15.33:0/2971014509 wait complete. 2024-09-10T23:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.837+0000 7fd4f0c50740 1 -- start start 2024-09-10T23:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.837+0000 7fd4f0c50740 1 Processor -- start 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 0x55f7d85519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f7d83d8ab0 con 0x55f7d85498d0 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f7d8447570 con 0x55f7d854c310 2024-09-10T23:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f7d854f2f0 con 0x55f7d8546fa0 2024-09-10T23:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.838+0000 7fd4f0c50740 10 client.0 _ll_register_callbacks cb 0x55f7d8456100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.839+0000 7fd4e6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.839+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 0x55f7d85519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.839+0000 7fd4e6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37430/0 (socket says 172.21.15.33:37430) 2024-09-10T23:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.839+0000 7fd4e6a00640 1 -- 172.21.15.33:0/112200612 learned_addr learned my addr 172.21.15.33:0/112200612 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6a00640 1 -- 172.21.15.33:0/112200612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 msgr2=0x55f7d8550740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6a00640 1 -- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 msgr2=0x55f7d85519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 0x55f7d85519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6a00640 1 -- 172.21.15.33:0/112200612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d8202790 con 0x55f7d85498d0 2024-09-10T23:59:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.840+0000 7fd4e6000640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 0x55f7d85519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:59:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.841+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8012720 tx=0x7fd4d8012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582fb95fe9a916ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.841+0000 7fd4d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-10T23:59:52.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.843+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8011bb0 con 0x55f7d85498d0 2024-09-10T23:59:52.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.843+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d400fd50 con 0x55f7d85498d0 2024-09-10T23:59:52.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.843+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4d8011d50 con 0x55f7d85498d0 2024-09-10T23:59:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.844+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4d800f460 con 0x55f7d85498d0 2024-09-10T23:59:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.844+0000 7fd4f0c50740 10 client.15924 fetch_fsmap learned FSMap version 27 2024-09-10T23:59:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.844+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f7d827b620 con 0x55f7d85498d0 2024-09-10T23:59:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.845+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d400fd50 con 0x55f7d85498d0 2024-09-10T23:59:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.845+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd4d801c590 con 0x55f7d85498d0 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.845+0000 7fd4f0c50740 10 client.15924 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.845+0000 7fd4f0c50740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.846+0000 7fd4f0c50740 20 client.15924 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.846+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d855c120 0x55f7d855e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.846+0000 7fd4f0c50740 4 client.15924 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.846+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7d84b3600 con 0x55f7d855c120 2024-09-10T23:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.846+0000 7fd4e6000640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d855c120 0x55f7d855e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.848+0000 7fd4e6000640 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d855c120 0x55f7d855e5c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448736627feb6cdd server_cookie=1c587d9bf9db81d2 in_seq=0 out_seq=0 2024-09-10T23:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.848+0000 7fd4d0c00640 10 client.15924 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.849+0000 7fd4d0c00640 1 -- 172.21.15.33:0/112200612 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7d84b3600 con 0x55f7d855c120 2024-09-10T23:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.849+0000 7fd4d0c00640 10 client.15924 handle_command_reply: tid=0 2024-09-10T23:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.849+0000 7fd4f0c50740 1 client.15924 shutdown 2024-09-10T23:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.849+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 msgr2=0x55f7d8550de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.849+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8012720 tx=0x7fd4d8012be0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 shutdown_connections 2024-09-10T23:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854c310 0x55f7d85519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d85498d0 0x55f7d8550de0 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8012720 tx=0x7fd4d8012be0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d855c120 0x55f7d855e5c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/112200612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4d0c00640 0 client.15924 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 >> 172.21.15.33:0/112200612 conn(0x55f7d85420f0 msgr2=0x55f7d8538a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 shutdown_connections 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.850+0000 7fd4f0c50740 1 -- 172.21.15.33:0/112200612 wait complete. 2024-09-10T23:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.851+0000 7fd4f0c50740 20 client.15924 trim_cache size 0 max 16384 2024-09-10T23:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.879+0000 7fd4f0c50740 1 Processor -- start 2024-09-10T23:59:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 -- start start 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854ce70 0x55f7d8542950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81b4470 con 0x55f7d8546fa0 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81b1d40 con 0x55f7d854ce70 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.880+0000 7fd4f0c50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81afb50 con 0x55f7d854c310 2024-09-10T23:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.881+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854ce70 0x55f7d8542950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.881+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.881+0000 7fd4e6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.881+0000 7fd4e6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38778/0 (socket says 172.21.15.33:38778) 2024-09-10T23:59:52.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.881+0000 7fd4e6a00640 1 -- 172.21.15.33:0/3211234060 learned_addr learned my addr 172.21.15.33:0/3211234060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:52.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.882+0000 7fd4e6a00640 1 -- 172.21.15.33:0/3211234060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854ce70 msgr2=0x55f7d8542950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.882+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854ce70 0x55f7d8542950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.882+0000 7fd4e6a00640 1 -- 172.21.15.33:0/3211234060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d8546fa0 msgr2=0x55f7d8550740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.882+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.882+0000 7fd4e6a00640 1 -- 172.21.15.33:0/3211234060 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d8549700 con 0x55f7d854c310 2024-09-10T23:59:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.884+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8014040 tx=0x7fd4d8009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69663e0b494f4489 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.884+0000 7fd4d3400640 1 -- 172.21.15.33:0/3211234060 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800f460 con 0x55f7d854c310 2024-09-10T23:59:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.884+0000 7fd4d3400640 1 -- 172.21.15.33:0/3211234060 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d8005040 con 0x55f7d854c310 2024-09-10T23:59:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.884+0000 7fd4d3400640 1 -- 172.21.15.33:0/3211234060 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80035f0 con 0x55f7d854c310 2024-09-10T23:59:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.885+0000 7fd4f0c50740 1 -- 172.21.15.33:0/3211234060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 msgr2=0x55f7d8550c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.885+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8014040 tx=0x7fd4d8009ec0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.886+0000 7fd4f0c50740 1 -- 172.21.15.33:0/3211234060 shutdown_connections 2024-09-10T23:59:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.886+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d854ce70 0x55f7d8542950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.886+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8550c80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.886+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/3211234060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d8546fa0 0x55f7d8550740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.886+0000 7fd4f0c50740 1 -- 172.21.15.33:0/3211234060 >> 172.21.15.33:0/3211234060 conn(0x55f7d85420f0 msgr2=0x55f7d854c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.887+0000 7fd4f0c50740 1 -- 172.21.15.33:0/3211234060 shutdown_connections 2024-09-10T23:59:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.887+0000 7fd4f0c50740 1 -- 172.21.15.33:0/3211234060 wait complete. 2024-09-10T23:59:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.887+0000 7fd4f0c50740 1 -- start start 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.888+0000 7fd4f0c50740 1 Processor -- start 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.888+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8558140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854ce70 0x55f7d8556430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33734/0 (socket says 172.21.15.33:33734) 2024-09-10T23:59:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4e6000640 1 -- 172.21.15.33:0/608057199 learned_addr learned my addr 172.21.15.33:0/608057199 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-10T23:59:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81b0200 con 0x55f7d854ce70 2024-09-10T23:59:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81b1670 con 0x55f7d8546fa0 2024-09-10T23:59:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e81b08d0 con 0x55f7d854c310 2024-09-10T23:59:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4f0c50740 10 client.0 _ll_register_callbacks cb 0x7fd4d80097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:59:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.889+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8558140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854ce70 0x55f7d8556430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 -- 172.21.15.33:0/608057199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 msgr2=0x55f7d8558140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8558140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 -- 172.21.15.33:0/608057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854ce70 msgr2=0x55f7d8556430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:59:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854ce70 0x55f7d8556430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.890+0000 7fd4e6000640 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d8556bc0 con 0x55f7d8546fa0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.891+0000 7fd4e6000640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400f790 tx=0x7fd4d4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187d7802c8ae94a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.891+0000 7fd4d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.891+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d402d070 con 0x55f7d8546fa0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.892+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4d4005030 con 0x55f7d8546fa0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.892+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d8005040 con 0x55f7d8546fa0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.892+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4d403c050 con 0x55f7d8546fa0 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.893+0000 7fd4f0c50740 10 client.35687 fetch_fsmap learned FSMap version 27 2024-09-10T23:59:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.893+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f7d85c9af0 con 0x55f7d8546fa0 2024-09-10T23:59:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4d8005040 con 0x55f7d8546fa0 2024-09-10T23:59:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fd4d4004680 con 0x55f7d8546fa0 2024-09-10T23:59:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 10 client.35687 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T23:59:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 10 client.35687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T23:59:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 20 client.35687 populate_metadata read hostname 'smithi033' 2024-09-10T23:59:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d85ca390 0x55f7d85cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 4 client.35687 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:59:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.894+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7d84af0b0 con 0x55f7d85ca390 2024-09-10T23:59:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.895+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d85ca390 0x55f7d85cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.896+0000 7fd4e6a00640 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d85ca390 0x55f7d85cc7b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e1cfc0fa95d7d94 server_cookie=bb22aa80d549a36 in_seq=0 out_seq=0 2024-09-10T23:59:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.896+0000 7fd4d0c00640 10 client.35687 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.951+0000 7fd4d0c00640 1 -- 172.21.15.33:0/608057199 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7d84af0b0 con 0x55f7d85ca390 2024-09-10T23:59:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.951+0000 7fd4d0c00640 10 client.35687 handle_command_reply: tid=0 2024-09-10T23:59:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.951+0000 7fd4f0c50740 1 client.35687 shutdown 2024-09-10T23:59:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 msgr2=0x55f7d8557b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400f790 tx=0x7fd4d4005f90 comp rx=0 tx=0).stop 2024-09-10T23:59:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 shutdown_connections 2024-09-10T23:59:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7d854ce70 0x55f7d8556430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f7d85ca390 0x55f7d85cc7b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7d854c310 0x55f7d8558140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 --2- 172.21.15.33:0/608057199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f7d8546fa0 0x55f7d8557b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 >> 172.21.15.33:0/608057199 conn(0x55f7d85420f0 msgr2=0x55f7d8542950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4d0c00640 0 client.35687 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 shutdown_connections 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.952+0000 7fd4f0c50740 1 -- 172.21.15.33:0/608057199 wait complete. 2024-09-10T23:59:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.953+0000 7fd4f0c50740 20 client.35687 trim_cache size 0 max 16384 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.955+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 msgr2=0x7fd4cc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.955+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 0x7fd4cc0b78f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00308b0 tx=0x7fd4e0003d80 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.955+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 msgr2=0x7fd4e8072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.955+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 0x7fd4e8072ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0034040 tx=0x7fd4e00305d0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 shutdown_connections 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4cc0b5430 0x7fd4cc0b78f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4e81066a0 0x7fd4e8072ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4e8105ce0 0x7fd4e80722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 --2- 172.21.15.33:0/4234561287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4e8104b90 0x7fd4e8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 >> 172.21.15.33:0/4234561287 conn(0x7fd4e8100410 msgr2=0x7fd4e8109150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 shutdown_connections 2024-09-10T23:59:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-10T23:59:52.956+0000 7fd4ede00640 1 -- 172.21.15.33:0/4234561287 wait complete. 2024-09-10T23:59:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 5.0 s, 699.6 tps, lat 128.052 ms stddev 153.586 2024-09-10T23:59:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:54 smithi052 ceph-mon[33526]: pgmap v530: 129 pgs: 129 active+clean; 930 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 79 op/s 2024-09-10T23:59:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:54 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:54 smithi033 ceph-mon[30593]: pgmap v530: 129 pgs: 129 active+clean; 930 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 79 op/s 2024-09-10T23:59:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:54 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:54 smithi189 ceph-mon[34000]: pgmap v530: 129 pgs: 129 active+clean; 930 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 79 op/s 2024-09-10T23:59:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:54 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T23:59:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:56 smithi052 ceph-mon[33526]: pgmap v531: 129 pgs: 129 active+clean; 930 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 23 MiB/s wr, 111 op/s 2024-09-10T23:59:56.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:56 smithi033 ceph-mon[30593]: pgmap v531: 129 pgs: 129 active+clean; 930 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 23 MiB/s wr, 111 op/s 2024-09-10T23:59:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:56 smithi189 ceph-mon[34000]: pgmap v531: 129 pgs: 129 active+clean; 930 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 23 MiB/s wr, 111 op/s 2024-09-10T23:59:58.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 10 23:59:58 smithi033 ceph-mon[30593]: pgmap v532: 129 pgs: 129 active+clean; 929 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 20 MiB/s wr, 119 op/s 2024-09-10T23:59:58.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 10.0 s, 1005.0 tps, lat 98.959 ms stddev 26.961 2024-09-10T23:59:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 23:59:58 smithi052 ceph-mon[33526]: pgmap v532: 129 pgs: 129 active+clean; 929 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 20 MiB/s wr, 119 op/s 2024-09-10T23:59:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 23:59:58 smithi189 ceph-mon[34000]: pgmap v532: 129 pgs: 129 active+clean; 929 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 20 MiB/s wr, 119 op/s 2024-09-11T00:00:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:00 smithi052 ceph-mon[33526]: pgmap v533: 129 pgs: 129 active+clean; 929 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 112 op/s 2024-09-11T00:00:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:00 smithi052 ceph-mon[33526]: overall HEALTH_OK 2024-09-11T00:00:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:00 smithi033 ceph-mon[30593]: pgmap v533: 129 pgs: 129 active+clean; 929 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 112 op/s 2024-09-11T00:00:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:00 smithi033 ceph-mon[30593]: overall HEALTH_OK 2024-09-11T00:00:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:00 smithi189 ceph-mon[34000]: pgmap v533: 129 pgs: 129 active+clean; 929 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 112 op/s 2024-09-11T00:00:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:00 smithi189 ceph-mon[34000]: overall HEALTH_OK 2024-09-11T00:00:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:02 smithi052 ceph-mon[33526]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 11 MiB/s wr, 168 op/s 2024-09-11T00:00:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:02 smithi033 ceph-mon[30593]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 11 MiB/s wr, 168 op/s 2024-09-11T00:00:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:02 smithi189 ceph-mon[34000]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 11 MiB/s wr, 168 op/s 2024-09-11T00:00:03.326 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 15.0 s, 749.4 tps, lat 133.211 ms stddev 42.369 2024-09-11T00:00:04.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:04 smithi189 ceph-mon[34000]: pgmap v535: 129 pgs: 129 active+clean; 930 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.9 MiB/s wr, 199 op/s 2024-09-11T00:00:04.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:04 smithi052 ceph-mon[33526]: pgmap v535: 129 pgs: 129 active+clean; 930 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.9 MiB/s wr, 199 op/s 2024-09-11T00:00:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:04 smithi033 ceph-mon[30593]: pgmap v535: 129 pgs: 129 active+clean; 930 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.9 MiB/s wr, 199 op/s 2024-09-11T00:00:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.146+0000 7f0710e00640 1 -- 172.21.15.33:0/2973876803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c103ae0 msgr2=0x7f070c103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.146+0000 7f0710e00640 1 --2- 172.21.15.33:0/2973876803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c103ae0 0x7f070c103f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009930 tx=0x7f06f802a460 comp rx=0 tx=0).stop 2024-09-11T00:00:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 -- 172.21.15.33:0/2973876803 shutdown_connections 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 --2- 172.21.15.33:0/2973876803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c1044a0 0x7f070c10ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 --2- 172.21.15.33:0/2973876803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c103ae0 0x7f070c103f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 --2- 172.21.15.33:0/2973876803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c102990 0x7f070c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 -- 172.21.15.33:0/2973876803 >> 172.21.15.33:0/2973876803 conn(0x7f070c0fe250 msgr2=0x7f070c100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 -- 172.21.15.33:0/2973876803 shutdown_connections 2024-09-11T00:00:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.147+0000 7f0710e00640 1 -- 172.21.15.33:0/2973876803 wait complete. 2024-09-11T00:00:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.150+0000 7f0710e00640 1 Processor -- start 2024-09-11T00:00:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.150+0000 7f0710e00640 1 -- start start 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 0x7f070c198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c103ae0 0x7f070c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10e4e0 con 0x7f070c102990 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10e360 con 0x7f070c103ae0 2024-09-11T00:00:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.151+0000 7f0710e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10e660 con 0x7f070c1044a0 2024-09-11T00:00:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.152+0000 7f0709e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 0x7f070c198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.152+0000 7f070a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.152+0000 7f070a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:60828/0 (socket says 172.21.15.33:60828) 2024-09-11T00:00:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.152+0000 7f070a800640 1 -- 172.21.15.33:0/833094197 learned_addr learned my addr 172.21.15.33:0/833094197 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.152+0000 7f0709400640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c103ae0 0x7f070c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f070a800640 1 -- 172.21.15.33:0/833094197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c103ae0 msgr2=0x7f070c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f070a800640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c103ae0 0x7f070c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f070a800640 1 -- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 msgr2=0x7f070c198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f070a800640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 0x7f070c198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f070a800640 1 -- 172.21.15.33:0/833094197 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c19a620 con 0x7f070c1044a0 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.153+0000 7f0709e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 0x7f070c198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.154+0000 7f070a800640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f070400eb10 tx=0x7f070400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.154+0000 7f0702a00640 1 -- 172.21.15.33:0/833094197 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704004b20 con 0x7f070c1044a0 2024-09-11T00:00:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.155+0000 7f0702a00640 1 -- 172.21.15.33:0/833094197 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0704004cc0 con 0x7f070c1044a0 2024-09-11T00:00:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.155+0000 7f0702a00640 1 -- 172.21.15.33:0/833094197 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704010690 con 0x7f070c1044a0 2024-09-11T00:00:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.155+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c19a910 con 0x7f070c1044a0 2024-09-11T00:00:06.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.156+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c19efd0 con 0x7f070c1044a0 2024-09-11T00:00:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.162+0000 7f0702a00640 1 -- 172.21.15.33:0/833094197 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0704005020 con 0x7f070c1044a0 2024-09-11T00:00:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.163+0000 7f0713c39740 1 Processor -- start 2024-09-11T00:00:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.164+0000 7f0713c39740 1 -- start start 2024-09-11T00:00:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d49124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d4914fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0702a00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 0x7f06f00b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0709400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0709400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57978/0 (socket says 172.21.15.33:57978) 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0709400640 1 -- 172.21.15.33:0/2446528976 learned_addr learned my addr 172.21.15.33:0/2446528976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5595d48806b0 con 0x5595d49100c0 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5595d486fae0 con 0x5595d490d790 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595d48738f0 con 0x5595d4912b00 2024-09-11T00:00:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f0709400640 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d4914fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.165+0000 7f070a800640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 0x7f06f00b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.168 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 -- 172.21.15.33:0/2446528976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 msgr2=0x5595d4914fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d4914fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 -- 172.21.15.33:0/2446528976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 msgr2=0x5595d49124b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d49124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 -- 172.21.15.33:0/2446528976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d483c780 con 0x5595d490d790 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0709400640 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06f80096c0 tx=0x7f06f8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e3f6a8a11dbc758 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f0702a00640 1 -- 172.21.15.33:0/833094197 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f07040e6560 con 0x7f070c1044a0 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f06f7400640 1 -- 172.21.15.33:0/2446528976 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040270 con 0x5595d490d790 2024-09-11T00:00:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f06f7400640 1 -- 172.21.15.33:0/2446528976 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06f80409c0 con 0x5595d490d790 2024-09-11T00:00:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.166+0000 7f06f7400640 1 -- 172.21.15.33:0/2446528976 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031810 con 0x5595d490d790 2024-09-11T00:00:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f070a800640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 0x7f06f00b7860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07040a9bf0 tx=0x7f070400cee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 msgr2=0x5595d490fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06f80096c0 tx=0x7f06f8005d50 comp rx=0 tx=0).stop 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 shutdown_connections 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d4914fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d49124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 --2- 172.21.15.33:0/2446528976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d490fb80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.168+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 >> 172.21.15.33:0/2446528976 conn(0x5595d49088e0 msgr2=0x5595d4909670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.169+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 shutdown_connections 2024-09-11T00:00:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.169+0000 7f0713c39740 1 -- 172.21.15.33:0/2446528976 wait complete. 2024-09-11T00:00:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.170+0000 7f0713c39740 1 -- start start 2024-09-11T00:00:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.170+0000 7f0713c39740 1 Processor -- start 2024-09-11T00:00:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d4916f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 0x5595d4917620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d49181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5595d47a7ab0 con 0x5595d4912b00 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5595d4816570 con 0x5595d49100c0 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595d4915a80 con 0x5595d490d790 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0713c39740 10 client.0 _ll_register_callbacks cb 0x5595d4825100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0709e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 0x5595d4917620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0709e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 0x5595d4917620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57994/0 (socket says 172.21.15.33:57994) 2024-09-11T00:00:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0709e00640 1 -- 172.21.15.33:0/4086980819 learned_addr learned my addr 172.21.15.33:0/4086980819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.171+0000 7f0709400640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d4916f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.172+0000 7f0709400640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d49181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.172+0000 7f0709400640 1 -- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 msgr2=0x5595d4917620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.172+0000 7f0709400640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 0x5595d4917620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f0709400640 1 -- 172.21.15.33:0/4086980819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 msgr2=0x5595d49181f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f0709400640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d49181f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f0709400640 1 -- 172.21.15.33:0/4086980819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d45d1790 con 0x5595d490d790 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f0709400640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d4916f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009850 tx=0x7f06f8042040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1a3a06f548132e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f06ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:00:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.173+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040d80 con 0x5595d490d790 2024-09-11T00:00:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.174+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f80409c0 con 0x5595d490d790 2024-09-11T00:00:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.174+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f06f8040110 con 0x5595d490d790 2024-09-11T00:00:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.174+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06f8031590 con 0x5595d490d790 2024-09-11T00:00:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.175+0000 7f0713c39740 10 client.25660 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.175+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595d464a620 con 0x5595d490d790 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.175+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06f80409c0 con 0x5595d490d790 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06f8031730 con 0x5595d490d790 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 10 client.25660 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 10 client.25660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 20 client.25660 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4922420 0x5595d4924810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 4 client.25660 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:00:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.176+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d4882600 con 0x5595d4922420 2024-09-11T00:00:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.177+0000 7f0709e00640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4922420 0x5595d4924810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.177+0000 7f0709e00640 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4922420 0x5595d4924810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd485ae1fdac672 server_cookie=55f9475469903ab6 in_seq=0 out_seq=0 2024-09-11T00:00:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.177+0000 7f06ebe00640 10 client.25660 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.178+0000 7f06ebe00640 1 -- 172.21.15.33:0/4086980819 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595d4882600 con 0x5595d4922420 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.178+0000 7f06ebe00640 10 client.25660 handle_command_reply: tid=0 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.178+0000 7f0713c39740 1 client.25660 shutdown 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 msgr2=0x5595d4916f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d4916f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009850 tx=0x7f06f8042040 comp rx=0 tx=0).stop 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 shutdown_connections 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d49181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d49100c0 0x5595d4917620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4922420 0x5595d4924810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 --2- 172.21.15.33:0/4086980819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d4916f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 >> 172.21.15.33:0/4086980819 conn(0x5595d49088e0 msgr2=0x5595d4907a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.179+0000 7f06ebe00640 0 client.25660 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.180+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 shutdown_connections 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.180+0000 7f0713c39740 1 -- 172.21.15.33:0/4086980819 wait complete. 2024-09-11T00:00:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.180+0000 7f0713c39740 20 client.25660 trim_cache size 0 max 16384 2024-09-11T00:00:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.205+0000 7f0713c39740 1 Processor -- start 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 -- start start 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d4912ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d490a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1b44b0 con 0x5595d49100c0 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1b1d50 con 0x5595d490d790 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.206+0000 7f0713c39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1afba0 con 0x5595d4912b00 2024-09-11T00:00:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.207+0000 7f0709e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.207+0000 7f0709400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d4912ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.207+0000 7f0709e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52340/0 (socket says 172.21.15.33:52340) 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.207+0000 7f0709e00640 1 -- 172.21.15.33:0/550139194 learned_addr learned my addr 172.21.15.33:0/550139194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.207+0000 7f0709400640 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d490a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.208+0000 7f0709e00640 1 -- 172.21.15.33:0/550139194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 msgr2=0x5595d490a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.208+0000 7f0709e00640 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d490a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.208+0000 7f0709e00640 1 -- 172.21.15.33:0/550139194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 msgr2=0x5595d4912ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.208+0000 7f0709e00640 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d4912ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.208+0000 7f0709e00640 1 -- 172.21.15.33:0/550139194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d4924b80 con 0x5595d49100c0 2024-09-11T00:00:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.209+0000 7f0709e00640 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x5595d4924d50 tx=0x7f06fc013ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11afd1b0152000ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.209+0000 7f06f6a00640 1 -- 172.21.15.33:0/550139194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc005220 con 0x5595d49100c0 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.209+0000 7f06f6a00640 1 -- 172.21.15.33:0/550139194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06fc004c30 con 0x5595d49100c0 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.209+0000 7f06f6a00640 1 -- 172.21.15.33:0/550139194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc01c800 con 0x5595d49100c0 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 -- 172.21.15.33:0/550139194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 msgr2=0x5595d4913420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x5595d4924d50 tx=0x7f06fc013ab0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 -- 172.21.15.33:0/550139194 shutdown_connections 2024-09-11T00:00:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d4912b00 0x5595d490a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d49100c0 0x5595d4913420 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 --2- 172.21.15.33:0/550139194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d490d790 0x5595d4912ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.210+0000 7f0713c39740 1 -- 172.21.15.33:0/550139194 >> 172.21.15.33:0/550139194 conn(0x5595d49088e0 msgr2=0x5595d4916120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.211+0000 7f0713c39740 1 -- 172.21.15.33:0/550139194 shutdown_connections 2024-09-11T00:00:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.211+0000 7f0713c39740 1 -- 172.21.15.33:0/550139194 wait complete. 2024-09-11T00:00:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.211+0000 7f0713c39740 1 -- start start 2024-09-11T00:00:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.211+0000 7f0713c39740 1 Processor -- start 2024-09-11T00:00:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d491e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d491ca80 0x5595d491cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1b0210 con 0x5595d4912b00 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1b1680 con 0x5595d491ca80 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f070c1b08e0 con 0x5595d490d790 2024-09-11T00:00:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0713c39740 10 client.0 _ll_register_callbacks cb 0x7f06fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0709400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0709400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:60850/0 (socket says 172.21.15.33:60850) 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0709400640 1 -- 172.21.15.33:0/2435328051 learned_addr learned my addr 172.21.15.33:0/2435328051 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.212+0000 7f0709400640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d491ca80 0x5595d491cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 -- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d491ca80 msgr2=0x5595d491cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d491ca80 0x5595d491cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 -- 172.21.15.33:0/2435328051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 msgr2=0x5595d491e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709e00640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d491e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d491e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 -- 172.21.15.33:0/2435328051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d491d440 con 0x5595d490d790 2024-09-11T00:00:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709e00640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d491e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f0709400640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06f802aa50 tx=0x7f06f8004920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe3624aeb06ffe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.213+0000 7f06ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040110 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f06f8040840 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06fc004c30 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06f80402b0 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f0713c39740 10 client.25666 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.214+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595d498fc50 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06fc004c30 con 0x5595d490d790 2024-09-11T00:00:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06f803e430 con 0x5595d490d790 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 10 client.25666 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 10 client.25666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 20 client.25666 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4990660 0x5595d4992a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 4 client.25666 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:00:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595d487e0b0 con 0x5595d4990660 2024-09-11T00:00:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.215+0000 7f0709e00640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4990660 0x5595d4992a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.217+0000 7f0709e00640 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4990660 0x5595d4992a80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4174131ed1576c0d server_cookie=bfa216fcd6a0ede4 in_seq=0 out_seq=0 2024-09-11T00:00:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.217+0000 7f06ebe00640 10 client.25666 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.241+0000 7f06ebe00640 1 -- 172.21.15.33:0/2435328051 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595d487e0b0 con 0x5595d4990660 2024-09-11T00:00:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.241+0000 7f06ebe00640 10 client.25666 handle_command_reply: tid=0 2024-09-11T00:00:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 client.25666 shutdown 2024-09-11T00:00:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 msgr2=0x5595d491def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06f802aa50 tx=0x7f06f8004920 comp rx=0 tx=0).stop 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 shutdown_connections 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5595d491ca80 0x5595d491cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595d4912b00 0x5595d491e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5595d4990660 0x5595d4992a80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 --2- 172.21.15.33:0/2435328051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595d490d790 0x5595d491def0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 >> 172.21.15.33:0/2435328051 conn(0x5595d49088e0 msgr2=0x5595d4912ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f06ebe00640 0 client.25666 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 shutdown_connections 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.242+0000 7f0713c39740 1 -- 172.21.15.33:0/2435328051 wait complete. 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.243+0000 7f0713c39740 20 client.25666 trim_cache size 0 max 16384 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.243+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 msgr2=0x7f06f00b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 0x7f06f00b7860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07040a9bf0 tx=0x7f070400cee0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 msgr2=0x7f070c199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f070400eb10 tx=0x7f070400c2d0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 shutdown_connections 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06f00b53a0 0x7f06f00b7860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f070c1044a0 0x7f070c199f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f070c103ae0 0x7f070c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 --2- 172.21.15.33:0/833094197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f070c102990 0x7f070c198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 >> 172.21.15.33:0/833094197 conn(0x7f070c0fe250 msgr2=0x7f070c106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 shutdown_connections 2024-09-11T00:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:06.244+0000 7f0710e00640 1 -- 172.21.15.33:0/833094197 wait complete. 2024-09-11T00:00:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:06 smithi052 ceph-mon[33526]: pgmap v536: 129 pgs: 129 active+clean; 930 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-11T00:00:06.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:06 smithi033 ceph-mon[30593]: pgmap v536: 129 pgs: 129 active+clean; 930 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-11T00:00:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:06 smithi189 ceph-mon[34000]: pgmap v536: 129 pgs: 129 active+clean; 930 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-11T00:00:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 20.0 s, 575.4 tps, lat 173.113 ms stddev 103.328 2024-09-11T00:00:08.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:08 smithi052 ceph-mon[33526]: pgmap v537: 129 pgs: 129 active+clean; 933 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.8 MiB/s wr, 403 op/s 2024-09-11T00:00:08.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:08 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:08.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:08 smithi033 ceph-mon[30593]: pgmap v537: 129 pgs: 129 active+clean; 933 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.8 MiB/s wr, 403 op/s 2024-09-11T00:00:08.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:08 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:08 smithi189 ceph-mon[34000]: pgmap v537: 129 pgs: 129 active+clean; 933 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.8 MiB/s wr, 403 op/s 2024-09-11T00:00:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:08 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:00:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:10 smithi052 ceph-mon[33526]: pgmap v538: 129 pgs: 129 active+clean; 933 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-09-11T00:00:10.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:10.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:10.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:00:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:10 smithi033 ceph-mon[30593]: pgmap v538: 129 pgs: 129 active+clean; 933 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-09-11T00:00:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:00:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:10 smithi189 ceph-mon[34000]: pgmap v538: 129 pgs: 129 active+clean; 933 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-09-11T00:00:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:00:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:00:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:00:12.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:12 smithi033 ceph-mon[30593]: pgmap v539: 129 pgs: 129 active+clean; 933 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 673 op/s 2024-09-11T00:00:12.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:12 smithi052 ceph-mon[33526]: pgmap v539: 129 pgs: 129 active+clean; 933 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 673 op/s 2024-09-11T00:00:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:12 smithi189 ceph-mon[34000]: pgmap v539: 129 pgs: 129 active+clean; 933 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 673 op/s 2024-09-11T00:00:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 25.0 s, 665.2 tps, lat 150.812 ms stddev 44.839 2024-09-11T00:00:14.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:14 smithi052 ceph-mon[33526]: pgmap v540: 129 pgs: 129 active+clean; 933 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 793 op/s 2024-09-11T00:00:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:14 smithi033 ceph-mon[30593]: pgmap v540: 129 pgs: 129 active+clean; 933 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 793 op/s 2024-09-11T00:00:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:14 smithi189 ceph-mon[34000]: pgmap v540: 129 pgs: 129 active+clean; 933 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 793 op/s 2024-09-11T00:00:16.447 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:16 smithi052 ceph-mon[33526]: pgmap v541: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.7 MiB/s wr, 852 op/s 2024-09-11T00:00:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:16 smithi033 ceph-mon[30593]: pgmap v541: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.7 MiB/s wr, 852 op/s 2024-09-11T00:00:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:16 smithi189 ceph-mon[34000]: pgmap v541: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.7 MiB/s wr, 852 op/s 2024-09-11T00:00:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 30.0 s, 703.3 tps, lat 142.151 ms stddev 40.502 2024-09-11T00:00:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:18 smithi052 ceph-mon[33526]: pgmap v542: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 923 op/s 2024-09-11T00:00:18.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:18 smithi033 ceph-mon[30593]: pgmap v542: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 923 op/s 2024-09-11T00:00:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:18 smithi189 ceph-mon[34000]: pgmap v542: 129 pgs: 129 active+clean; 933 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 923 op/s 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 -- 172.21.15.33:0/1546740075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4077a20 msgr2=0x7f97c4077e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 --2- 172.21.15.33:0/1546740075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4077a20 0x7f97c4077e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009900 tx=0x7f97b402a410 comp rx=0 tx=0).stop 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 -- 172.21.15.33:0/1546740075 shutdown_connections 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 --2- 172.21.15.33:0/1546740075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4079530 0x7f97c4079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 --2- 172.21.15.33:0/1546740075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4078b70 0x7f97c4078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.434 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 --2- 172.21.15.33:0/1546740075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4077a20 0x7f97c4077e20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.432+0000 7f97ca400640 1 -- 172.21.15.33:0/1546740075 >> 172.21.15.33:0/1546740075 conn(0x7f97c4100470 msgr2=0x7f97c4102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.433+0000 7f97ca400640 1 -- 172.21.15.33:0/1546740075 shutdown_connections 2024-09-11T00:00:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.433+0000 7f97ca400640 1 -- 172.21.15.33:0/1546740075 wait complete. 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.433+0000 7f97ca400640 1 Processor -- start 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 -- start start 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4078b70 0x7f97c419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4079530 0x7f97c41a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4114b30 con 0x7f97c4078b70 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41149b0 con 0x7f97c4079530 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97ca400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4114cb0 con 0x7f97c4077a20 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4078b70 0x7f97c419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4079530 0x7f97c41a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54840/0 (socket says 172.21.15.33:54840) 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.434+0000 7f97c3400640 1 -- 172.21.15.33:0/978240856 learned_addr learned my addr 172.21.15.33:0/978240856 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 -- 172.21.15.33:0/978240856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4079530 msgr2=0x7f97c41a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4079530 0x7f97c41a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 -- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4078b70 msgr2=0x7f97c419f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4078b70 0x7f97c419f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 -- 172.21.15.33:0/978240856 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c41a0dc0 con 0x7f97c4077a20 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97c3400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97b4031460 tx=0x7f97b4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97bbe00640 1 -- 172.21.15.33:0/978240856 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b403f070 con 0x7f97c4077a20 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97bbe00640 1 -- 172.21.15.33:0/978240856 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97b4031ba0 con 0x7f97c4077a20 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c41a1050 con 0x7f97c4077a20 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97bbe00640 1 -- 172.21.15.33:0/978240856 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4035030 con 0x7f97c4077a20 2024-09-11T00:00:19.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.435+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c41a7780 con 0x7f97c4077a20 2024-09-11T00:00:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.439+0000 7f97cd3ce740 1 Processor -- start 2024-09-11T00:00:19.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.439+0000 7f97cd3ce740 1 -- start start 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e34226b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e342294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561e341976b0 con 0x561e342270c0 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561e34186ae0 con 0x561e34229b00 2024-09-11T00:00:19.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e3418a8f0 con 0x561e34224790 2024-09-11T00:00:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42464/0 (socket says 172.21.15.33:42464) 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97c2a00640 1 -- 172.21.15.33:0/1656568531 learned_addr learned my addr 172.21.15.33:0/1656568531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97bbe00640 1 -- 172.21.15.33:0/978240856 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f97b4031710 con 0x7f97c4077a20 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.440+0000 7f97c3e00640 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e34226b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 -- 172.21.15.33:0/1656568531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 msgr2=0x561e34226b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e34226b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 -- 172.21.15.33:0/1656568531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 msgr2=0x561e342294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e342294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 -- 172.21.15.33:0/1656568531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e34153780 con 0x561e34229b00 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97c2a00640 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009cf0 tx=0x7f97b0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b29b78153003ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97b8c00640 1 -- 172.21.15.33:0/1656568531 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0004230 con 0x561e34229b00 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97b8c00640 1 -- 172.21.15.33:0/1656568531 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97b00043d0 con 0x561e34229b00 2024-09-11T00:00:19.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.441+0000 7f97b8c00640 1 -- 172.21.15.33:0/1656568531 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0019750 con 0x561e34229b00 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 -- 172.21.15.33:0/1656568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 msgr2=0x561e3422bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009cf0 tx=0x7f97b0011810 comp rx=0 tx=0).stop 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97bbe00640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 0x7f97a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97bbe00640 1 -- 172.21.15.33:0/978240856 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f97b4106a20 con 0x7f97c4077a20 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 -- 172.21.15.33:0/1656568531 shutdown_connections 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422bfc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e342294b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/1656568531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e34226b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97cd3ce740 1 -- 172.21.15.33:0/1656568531 >> 172.21.15.33:0/1656568531 conn(0x561e3421f8e0 msgr2=0x561e34220670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.442+0000 7f97c3e00640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 0x7f97a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.443+0000 7f97c3e00640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 0x7f97a80b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97c41a0000 tx=0x7f97bc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.443+0000 7f97cd3ce740 1 -- 172.21.15.33:0/1656568531 shutdown_connections 2024-09-11T00:00:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.443+0000 7f97cd3ce740 1 -- 172.21.15.33:0/1656568531 wait complete. 2024-09-11T00:00:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 -- start start 2024-09-11T00:00:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 Processor -- start 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e342270c0 0x561e3422e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561e340beab0 con 0x561e34224790 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561e3412d570 con 0x561e34229b00 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e3422cae0 con 0x561e342270c0 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97cd3ce740 10 client.0 _ll_register_callbacks cb 0x561e3413c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97c3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97c3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38108/0 (socket says 172.21.15.33:38108) 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97c3400640 1 -- 172.21.15.33:0/724973141 learned_addr learned my addr 172.21.15.33:0/724973141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.444+0000 7f97c2a00640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e342270c0 0x561e3422e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3e00640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 -- 172.21.15.33:0/724973141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e342270c0 msgr2=0x561e3422e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e342270c0 0x561e3422e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 -- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 msgr2=0x561e3422f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 -- 172.21.15.33:0/724973141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e33ee8790 con 0x561e34224790 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3e00640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97c3400640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f97b4000c00 tx=0x7f97b40cccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9ecd02d2d02be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97ad600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40cf030 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f97b403b460 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.445+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b00043d0 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97b4049070 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 10 client.15948 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e33f61620 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97b00043d0 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97b40b8080 con 0x561e34224790 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 10 client.15948 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 20 client.15948 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e34239720 0x561e3423bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 4 client.15948 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e34199600 con 0x561e34239720 2024-09-11T00:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.446+0000 7f97c2a00640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e34239720 0x561e3423bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.447+0000 7f97c2a00640 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e34239720 0x561e3423bb60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3da50abf481ee4 server_cookie=3a5db99cd513bd8d in_seq=0 out_seq=0 2024-09-11T00:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.447+0000 7f97ad600640 10 client.15948 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97ad600640 1 -- 172.21.15.33:0/724973141 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e34199600 con 0x561e34239720 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97ad600640 10 client.15948 handle_command_reply: tid=0 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 client.15948 shutdown 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 msgr2=0x561e3422dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f97b4000c00 tx=0x7f97b40cccc0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 shutdown_connections 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34229b00 0x561e3422f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e34239720 0x561e3423bb60 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e342270c0 0x561e3422e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/724973141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34224790 0x561e3422dfb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 >> 172.21.15.33:0/724973141 conn(0x561e3421f8e0 msgr2=0x561e3421ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97ad600640 0 client.15948 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 shutdown_connections 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 1 -- 172.21.15.33:0/724973141 wait complete. 2024-09-11T00:00:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.448+0000 7f97cd3ce740 20 client.15948 trim_cache size 0 max 16384 2024-09-11T00:00:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 Processor -- start 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 -- start start 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e3422a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e342270c0 0x561e3421f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b43e0 con 0x561e34229b00 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b1c80 con 0x561e342270c0 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41afad0 con 0x561e34224790 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.464+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38112/0 (socket says 172.21.15.33:38112) 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 -- 172.21.15.33:0/4268343559 learned_addr learned my addr 172.21.15.33:0/4268343559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3400640 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e3422a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c2a00640 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e342270c0 0x561e3421f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 -- 172.21.15.33:0/4268343559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 msgr2=0x561e3422a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e3422a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 -- 172.21.15.33:0/4268343559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e342270c0 msgr2=0x561e3421f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e342270c0 0x561e3421f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 -- 172.21.15.33:0/4268343559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3422dab0 con 0x561e34229b00 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.465+0000 7f97c3e00640 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f97bc003f10 tx=0x7f97bc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee55a9a53a963f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97afe00640 1 -- 172.21.15.33:0/4268343559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc004660 con 0x561e34229b00 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97afe00640 1 -- 172.21.15.33:0/4268343559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97bc004800 con 0x561e34229b00 2024-09-11T00:00:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97afe00640 1 -- 172.21.15.33:0/4268343559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc01e5a0 con 0x561e34229b00 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 -- 172.21.15.33:0/4268343559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 msgr2=0x561e34220140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f97bc003f10 tx=0x7f97bc011f90 comp rx=0 tx=0).stop 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 -- 172.21.15.33:0/4268343559 shutdown_connections 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e34229b00 0x561e34220140 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e342270c0 0x561e3421f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/4268343559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34224790 0x561e3422a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 -- 172.21.15.33:0/4268343559 >> 172.21.15.33:0/4268343559 conn(0x561e3421f8e0 msgr2=0x561e34229ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 -- 172.21.15.33:0/4268343559 shutdown_connections 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.466+0000 7f97cd3ce740 1 -- 172.21.15.33:0/4268343559 wait complete. 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 -- start start 2024-09-11T00:00:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 Processor -- start 2024-09-11T00:00:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 0x561e34235750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 0x561e34234990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b0140 con 0x561e342270c0 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b15b0 con 0x561e34224790 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b0810 con 0x561e34229b00 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.467+0000 7f97cd3ce740 10 client.0 _ll_register_callbacks cb 0x7f97b4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 0x561e34235750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38118/0 (socket says 172.21.15.33:38118) 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 -- 172.21.15.33:0/198528940 learned_addr learned my addr 172.21.15.33:0/198528940 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c3e00640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 0x561e34234990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 -- 172.21.15.33:0/198528940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 msgr2=0x561e34234990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 0x561e34234990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 -- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 msgr2=0x561e34235750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 0x561e34235750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 -- 172.21.15.33:0/198528940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e34234ed0 con 0x561e342270c0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c3e00640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 0x561e34234990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c3400640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 0x561e34235750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97c2a00640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97b0011d10 tx=0x7f97b0009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e253892cab5b26a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.468+0000 7f97ad600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0005450 con 0x561e342270c0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97bc004800 con 0x561e342270c0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f97b00055f0 con 0x561e342270c0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97b0004660 con 0x561e342270c0 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97cd3ce740 10 client.15954 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e34233d90 con 0x561e342270c0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97bc004800 con 0x561e342270c0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97b0034720 con 0x561e342270c0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.469+0000 7f97cd3ce740 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97cd3ce740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97cd3ce740 20 client.15954 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e342a6cb0 0x561e342a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97cd3ce740 4 client.15954 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e341950b0 con 0x561e342a6cb0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.470+0000 7f97c3400640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e342a6cb0 0x561e342a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.471+0000 7f97c3400640 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e342a6cb0 0x561e342a90a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6324e8598b92a450 server_cookie=e348af47e4b9866 in_seq=0 out_seq=0 2024-09-11T00:00:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.471+0000 7f97ad600640 10 client.15954 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:19.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.733+0000 7f97ad600640 1 -- 172.21.15.33:0/198528940 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e341950b0 con 0x561e342a6cb0 2024-09-11T00:00:19.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.733+0000 7f97ad600640 10 client.15954 handle_command_reply: tid=0 2024-09-11T00:00:19.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.733+0000 7f97cd3ce740 1 client.15954 shutdown 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.733+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 msgr2=0x561e34234450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.733+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97b0011d10 tx=0x7f97b0009ea0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 shutdown_connections 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e342a6cb0 0x561e342a90a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e34229b00 0x561e34234990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e342270c0 0x561e34234450 secure :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97b0011d10 tx=0x7f97b0009ea0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 --2- 172.21.15.33:0/198528940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e34224790 0x561e34235750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 >> 172.21.15.33:0/198528940 conn(0x561e3421f8e0 msgr2=0x561e34220140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97ad600640 0 client.15954 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 shutdown_connections 2024-09-11T00:00:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.734+0000 7f97cd3ce740 1 -- 172.21.15.33:0/198528940 wait complete. 2024-09-11T00:00:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.735+0000 7f97cd3ce740 20 client.15954 trim_cache size 0 max 16384 2024-09-11T00:00:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:00:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:00:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:00:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:00:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.736+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 msgr2=0x7f97a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 0x7f97a80b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f97c41a0000 tx=0x7f97bc009500 comp rx=0 tx=0).stop 2024-09-11T00:00:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 msgr2=0x7f97c419f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97b4031460 tx=0x7f97b4003c10 comp rx=0 tx=0).stop 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 shutdown_connections 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f97a80b52e0 0x7f97a80b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4079530 0x7f97c41a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c4078b70 0x7f97c419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 --2- 172.21.15.33:0/978240856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97c4077a20 0x7f97c419f280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.737+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 >> 172.21.15.33:0/978240856 conn(0x7f97c4100470 msgr2=0x7f97c4102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.738+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 shutdown_connections 2024-09-11T00:00:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:19.738+0000 7f97ca400640 1 -- 172.21.15.33:0/978240856 wait complete. 2024-09-11T00:00:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:20 smithi052 ceph-mon[33526]: pgmap v543: 129 pgs: 129 active+clean; 933 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 831 op/s 2024-09-11T00:00:20.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:20 smithi033 ceph-mon[30593]: pgmap v543: 129 pgs: 129 active+clean; 933 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 831 op/s 2024-09-11T00:00:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:20 smithi189 ceph-mon[34000]: pgmap v543: 129 pgs: 129 active+clean; 933 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 831 op/s 2024-09-11T00:00:22.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:22 smithi052 ceph-mon[33526]: pgmap v544: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2024-09-11T00:00:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:22 smithi033 ceph-mon[30593]: pgmap v544: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2024-09-11T00:00:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:22 smithi189 ceph-mon[34000]: pgmap v544: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 730 op/s 2024-09-11T00:00:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 35.0 s, 586.4 tps, lat 170.253 ms stddev 72.693 2024-09-11T00:00:24.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:24 smithi052 ceph-mon[33526]: pgmap v545: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 854 op/s 2024-09-11T00:00:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:24 smithi033 ceph-mon[30593]: pgmap v545: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 854 op/s 2024-09-11T00:00:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:24 smithi189 ceph-mon[34000]: pgmap v545: 129 pgs: 129 active+clean; 933 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 854 op/s 2024-09-11T00:00:26.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:26 smithi052 ceph-mon[33526]: pgmap v546: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 761 op/s 2024-09-11T00:00:26.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:26 smithi033 ceph-mon[30593]: pgmap v546: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 761 op/s 2024-09-11T00:00:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:26 smithi189 ceph-mon[34000]: pgmap v546: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 761 op/s 2024-09-11T00:00:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 40.0 s, 598.0 tps, lat 166.471 ms stddev 60.828 2024-09-11T00:00:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:28 smithi052 ceph-mon[33526]: pgmap v547: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 820 op/s 2024-09-11T00:00:28.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:28 smithi033 ceph-mon[30593]: pgmap v547: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 820 op/s 2024-09-11T00:00:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:28 smithi189 ceph-mon[34000]: pgmap v547: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.9 MiB/s wr, 820 op/s 2024-09-11T00:00:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:30 smithi052 ceph-mon[33526]: pgmap v548: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-09-11T00:00:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:30 smithi033 ceph-mon[30593]: pgmap v548: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-09-11T00:00:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:30 smithi189 ceph-mon[34000]: pgmap v548: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-09-11T00:00:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:32 smithi052 ceph-mon[33526]: pgmap v549: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 738 op/s 2024-09-11T00:00:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:32 smithi033 ceph-mon[30593]: pgmap v549: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 738 op/s 2024-09-11T00:00:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:32 smithi189 ceph-mon[34000]: pgmap v549: 129 pgs: 129 active+clean; 933 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 738 op/s 2024-09-11T00:00:32.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 -- 172.21.15.33:0/306432107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10c160 msgr2=0x7fba4c10e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 --2- 172.21.15.33:0/306432107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10c160 0x7fba4c10e5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba38009900 tx=0x7fba3802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 -- 172.21.15.33:0/306432107 shutdown_connections 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 --2- 172.21.15.33:0/306432107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c10ec60 0x7fba4c111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 --2- 172.21.15.33:0/306432107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10c160 0x7fba4c10e5f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 --2- 172.21.15.33:0/306432107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0748e0 0x7fba4c074ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.946+0000 7fba52000640 1 -- 172.21.15.33:0/306432107 >> 172.21.15.33:0/306432107 conn(0x7fba4c070440 msgr2=0x7fba4c072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.947+0000 7fba52000640 1 -- 172.21.15.33:0/306432107 shutdown_connections 2024-09-11T00:00:32.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.947+0000 7fba52000640 1 -- 172.21.15.33:0/306432107 wait complete. 2024-09-11T00:00:32.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.948+0000 7fba52000640 1 Processor -- start 2024-09-11T00:00:32.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.949+0000 7fba52000640 1 -- start start 2024-09-11T00:00:32.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.949+0000 7fba52000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.949+0000 7fba52000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c10c160 0x7fba4c116e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.949+0000 7fba52000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 0x7fba4c117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.949+0000 7fba4b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba52000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c11d250 con 0x7fba4c10c160 2024-09-11T00:00:32.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba52000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c11d0d0 con 0x7fba4c10ec60 2024-09-11T00:00:32.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba52000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c11d3d0 con 0x7fba4c0748e0 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:44184/0 (socket says 172.21.15.33:44184) 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4b400640 1 -- 172.21.15.33:0/2496688738 learned_addr learned my addr 172.21.15.33:0/2496688738 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4aa00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c10c160 0x7fba4c116e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4be00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 0x7fba4c117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4b400640 1 -- 172.21.15.33:0/2496688738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 msgr2=0x7fba4c117a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.950+0000 7fba4b400640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 0x7fba4c117a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.951+0000 7fba4b400640 1 -- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c10c160 msgr2=0x7fba4c116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.951+0000 7fba4b400640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c10c160 0x7fba4c116e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.951+0000 7fba4b400640 1 -- 172.21.15.33:0/2496688738 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c118330 con 0x7fba4c0748e0 2024-09-11T00:00:32.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.951+0000 7fba4be00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 0x7fba4c117a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.952+0000 7fba4b400640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00d950 tx=0x7fba3c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.952+0000 7fba43e00640 1 -- 172.21.15.33:0/2496688738 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c017030 con 0x7fba4c0748e0 2024-09-11T00:00:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.953+0000 7fba43e00640 1 -- 172.21.15.33:0/2496688738 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba3c004020 con 0x7fba4c0748e0 2024-09-11T00:00:32.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.953+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c118620 con 0x7fba4c0748e0 2024-09-11T00:00:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.953+0000 7fba43e00640 1 -- 172.21.15.33:0/2496688738 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0055d0 con 0x7fba4c0748e0 2024-09-11T00:00:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.954+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c118cc0 con 0x7fba4c0748e0 2024-09-11T00:00:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.957+0000 7fba43e00640 1 -- 172.21.15.33:0/2496688738 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fba3c009a30 con 0x7fba4c0748e0 2024-09-11T00:00:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.958+0000 7fba55042740 1 Processor -- start 2024-09-11T00:00:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.958+0000 7fba55042740 1 -- start start 2024-09-11T00:00:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.958+0000 7fba55042740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.958+0000 7fba4be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba4be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60240/0 (socket says 172.21.15.33:60240) 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba55042740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 0x55d7f6e054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba4be00640 1 -- 172.21.15.33:0/1287551913 learned_addr learned my addr 172.21.15.33:0/1287551913 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba55042740 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e07fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6d736b0 con 0x55d7f6e00790 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6d62ae0 con 0x55d7f6e030c0 2024-09-11T00:00:32.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba4b400640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 0x55d7f6e054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba4aa00640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e07fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6d668f0 con 0x55d7f6e05b00 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.959+0000 7fba43e00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 0x7fba300b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba43e00640 1 -- 172.21.15.33:0/2496688738 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fba3c0e5140 con 0x7fba4c0748e0 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4be00640 1 -- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 msgr2=0x55d7f6e07fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4be00640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e07fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4be00640 1 -- 172.21.15.33:0/1287551913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 msgr2=0x55d7f6e054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4be00640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 0x55d7f6e054b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4be00640 1 -- 172.21.15.33:0/1287551913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f6d2f780 con 0x55d7f6e00790 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4aa00640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e07fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:32.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.960+0000 7fba4b400640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 0x55d7f6e054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.961+0000 7fba4be00640 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba44010720 tx=0x7fba44010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a19bf23f863c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.961+0000 7fba4be00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 0x7fba300b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.962+0000 7fba37e00640 1 -- 172.21.15.33:0/1287551913 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4401f040 con 0x55d7f6e00790 2024-09-11T00:00:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.962+0000 7fba37e00640 1 -- 172.21.15.33:0/1287551913 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba4400ee10 con 0x55d7f6e00790 2024-09-11T00:00:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.962+0000 7fba37e00640 1 -- 172.21.15.33:0/1287551913 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4401a8b0 con 0x55d7f6e00790 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 msgr2=0x55d7f6e02b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fba44010720 tx=0x7fba44010be0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba4be00640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 0x7fba300b78a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fba4401a000 tx=0x7fba440197a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 shutdown_connections 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e07fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e030c0 0x55d7f6e054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 --2- 172.21.15.33:0/1287551913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e02b80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.963+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 >> 172.21.15.33:0/1287551913 conn(0x55d7f6dfb8e0 msgr2=0x55d7f6dfc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.964+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 shutdown_connections 2024-09-11T00:00:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.964+0000 7fba55042740 1 -- 172.21.15.33:0/1287551913 wait complete. 2024-09-11T00:00:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.964+0000 7fba55042740 1 -- start start 2024-09-11T00:00:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.964+0000 7fba55042740 1 Processor -- start 2024-09-11T00:00:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e0a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e0b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6c9aab0 con 0x55d7f6e030c0 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6d09570 con 0x55d7f6e00790 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7f6e08ae0 con 0x55d7f6e05b00 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.965+0000 7fba55042740 10 client.0 _ll_register_callbacks cb 0x55d7f6d18100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53190/0 (socket says 172.21.15.33:53190) 2024-09-11T00:00:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 -- 172.21.15.33:0/3337158994 learned_addr learned my addr 172.21.15.33:0/3337158994 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 -- 172.21.15.33:0/3337158994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 msgr2=0x55d7f6e0b110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e0b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 -- 172.21.15.33:0/3337158994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 msgr2=0x55d7f6e0a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e0a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 -- 172.21.15.33:0/3337158994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f6ac4790 con 0x55d7f6e00790 2024-09-11T00:00:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.966+0000 7fba4b400640 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0a8770 tx=0x7fba3c0aad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27930bc3af871ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.968+0000 7fba34c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.968+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0ab500 con 0x55d7f6e00790 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.968+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fba3c0e70f0 con 0x55d7f6e00790 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.968+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba4400ee10 con 0x55d7f6e00790 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.968+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fba3c0affe0 con 0x55d7f6e00790 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.969+0000 7fba55042740 10 client.35732 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.969+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7f6b3d620 con 0x55d7f6e00790 2024-09-11T00:00:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.969+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba4400ee10 con 0x55d7f6e00790 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fba3c0a6e50 con 0x55d7f6e00790 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 10 client.35732 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 10 client.35732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 20 client.35732 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e15770 0x55d7f6e17bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 4 client.35732 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:00:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.970+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7f6d75600 con 0x55d7f6e15770 2024-09-11T00:00:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.971+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e15770 0x55d7f6e17bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.972+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e15770 0x55d7f6e17bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6692db72cf9464 server_cookie=17c5303146a99cd8 in_seq=0 out_seq=0 2024-09-11T00:00:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.973+0000 7fba34c00640 10 client.35732 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.973+0000 7fba34c00640 1 -- 172.21.15.33:0/3337158994 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7f6d75600 con 0x55d7f6e15770 2024-09-11T00:00:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba34c00640 10 client.35732 handle_command_reply: tid=0 2024-09-11T00:00:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 client.35732 shutdown 2024-09-11T00:00:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 msgr2=0x55d7f6e09ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0a8770 tx=0x7fba3c0aad30 comp rx=0 tx=0).stop 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 shutdown_connections 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e15770 0x55d7f6e17bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e0b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e0a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 --2- 172.21.15.33:0/3337158994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e09ea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 >> 172.21.15.33:0/3337158994 conn(0x55d7f6dfb8e0 msgr2=0x55d7f6dfaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.974+0000 7fba34c00640 0 client.35732 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:32.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.975+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 shutdown_connections 2024-09-11T00:00:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.976+0000 7fba55042740 1 -- 172.21.15.33:0/3337158994 wait complete. 2024-09-11T00:00:32.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:32.976+0000 7fba55042740 20 client.35732 trim_cache size 0 max 16384 2024-09-11T00:00:33.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.014+0000 7fba55042740 1 Processor -- start 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 -- start start 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 0x55d7f6e06420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 0x55d7f6e11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c54e0 con 0x55d7f6e00790 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c2d80 con 0x55d7f6e05b00 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.015+0000 7fba55042740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c0bd0 con 0x55d7f6e030c0 2024-09-11T00:00:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.016+0000 7fba4b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.016+0000 7fba4b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60258/0 (socket says 172.21.15.33:60258) 2024-09-11T00:00:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.016+0000 7fba4b400640 1 -- 172.21.15.33:0/1691654060 learned_addr learned my addr 172.21.15.33:0/1691654060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.017+0000 7fba4aa00640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 0x55d7f6e06420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.017+0000 7fba4be00640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 0x55d7f6e11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.018+0000 7fba4b400640 1 -- 172.21.15.33:0/1691654060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 msgr2=0x55d7f6e06420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.018+0000 7fba4b400640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 0x55d7f6e06420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.018+0000 7fba4b400640 1 -- 172.21.15.33:0/1691654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 msgr2=0x55d7f6e11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.019+0000 7fba4b400640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 0x55d7f6e11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.019+0000 7fba4b400640 1 -- 172.21.15.33:0/1691654060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f6dff900 con 0x55d7f6e00790 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.019+0000 7fba4aa00640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 0x55d7f6e06420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.019+0000 7fba4be00640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 0x55d7f6e11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.020+0000 7fba4b400640 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0a7ad0 tx=0x7fba3c005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f3b188784a8113 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.021+0000 7fba37400640 1 -- 172.21.15.33:0/1691654060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0aa330 con 0x55d7f6e00790 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.021+0000 7fba37400640 1 -- 172.21.15.33:0/1691654060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba3c0ab500 con 0x55d7f6e00790 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.021+0000 7fba37400640 1 -- 172.21.15.33:0/1691654060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0b1170 con 0x55d7f6e00790 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 -- 172.21.15.33:0/1691654060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 msgr2=0x55d7f6e05ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0a7ad0 tx=0x7fba3c005ab0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 -- 172.21.15.33:0/1691654060 shutdown_connections 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e05b00 0x55d7f6e11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e030c0 0x55d7f6e06420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 --2- 172.21.15.33:0/1691654060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e00790 0x55d7f6e05ee0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.022+0000 7fba55042740 1 -- 172.21.15.33:0/1691654060 >> 172.21.15.33:0/1691654060 conn(0x55d7f6dfb8e0 msgr2=0x55d7f6e09060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.023+0000 7fba55042740 1 -- 172.21.15.33:0/1691654060 shutdown_connections 2024-09-11T00:00:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.023+0000 7fba55042740 1 -- 172.21.15.33:0/1691654060 wait complete. 2024-09-11T00:00:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.023+0000 7fba55042740 1 -- start start 2024-09-11T00:00:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.024+0000 7fba55042740 1 Processor -- start 2024-09-11T00:00:33.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.026+0000 7fba55042740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.026+0000 7fba55042740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.027+0000 7fba4b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.027+0000 7fba4b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e119b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53210/0 (socket says 172.21.15.33:53210) 2024-09-11T00:00:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.029+0000 7fba4b400640 1 -- 172.21.15.33:0/3157577408 learned_addr learned my addr 172.21.15.33:0/3157577408 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.030+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e10c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.030+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.031+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c1240 con 0x55d7f6e030c0 2024-09-11T00:00:33.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.031+0000 7fba4be00640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e10c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c26b0 con 0x55d7f6e00790 2024-09-11T00:00:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1c1910 con 0x55d7f6e05b00 2024-09-11T00:00:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba55042740 10 client.0 _ll_register_callbacks cb 0x7fba3c005770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba4aa00640 1 -- 172.21.15.33:0/3157577408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 msgr2=0x55d7f6e10c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e10c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba4aa00640 1 -- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 msgr2=0x55d7f6e119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.032+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.033+0000 7fba4aa00640 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f6e11440 con 0x55d7f6e030c0 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.033+0000 7fba4aa00640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e106b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba3802a910 tx=0x7fba38009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3116f21aeec0fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.033+0000 7fba34c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.034+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38035040 con 0x55d7f6e030c0 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.034+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fba3803c440 con 0x55d7f6e030c0 2024-09-11T00:00:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.034+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba3c0ab500 con 0x55d7f6e030c0 2024-09-11T00:00:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.035+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fba38051050 con 0x55d7f6e030c0 2024-09-11T00:00:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.035+0000 7fba55042740 10 client.15969 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.035+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7f6e82850 con 0x55d7f6e030c0 2024-09-11T00:00:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.036+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba3c0ab500 con 0x55d7f6e030c0 2024-09-11T00:00:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.036+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fba3804c610 con 0x55d7f6e030c0 2024-09-11T00:00:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 20 client.15969 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e83180 0x55d7f6e855a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 4 client.15969 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:00:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7f6d710b0 con 0x55d7f6e83180 2024-09-11T00:00:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.037+0000 7fba4b400640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e83180 0x55d7f6e855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.038+0000 7fba4b400640 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e83180 0x55d7f6e855a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c02065ba1d6eeb54 server_cookie=55d2348c5fa874be in_seq=0 out_seq=0 2024-09-11T00:00:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:33.038+0000 7fba34c00640 10 client.15969 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 45.0 s, 504.6 tps, lat 196.684 ms stddev 76.917 2024-09-11T00:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.254+0000 7fba34c00640 1 -- 172.21.15.33:0/3157577408 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7f6d710b0 con 0x55d7f6e83180 2024-09-11T00:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.254+0000 7fba34c00640 10 client.15969 handle_command_reply: tid=0 2024-09-11T00:00:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.254+0000 7fba55042740 1 client.15969 shutdown 2024-09-11T00:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 msgr2=0x55d7f6e106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e106b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fba3802a910 tx=0x7fba38009680 comp rx=0 tx=0).stop 2024-09-11T00:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 shutdown_connections 2024-09-11T00:00:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7f6e83180 0x55d7f6e855a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7f6e05b00 0x55d7f6e10c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.255+0000 7fba34c00640 0 client.15969 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7f6e030c0 0x55d7f6e106b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 1 --2- 172.21.15.33:0/3157577408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7f6e00790 0x55d7f6e119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 >> 172.21.15.33:0/3157577408 conn(0x55d7f6dfb8e0 msgr2=0x55d7f6dffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:34.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 shutdown_connections 2024-09-11T00:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 1 -- 172.21.15.33:0/3157577408 wait complete. 2024-09-11T00:00:34.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.256+0000 7fba55042740 20 client.15969 trim_cache size 0 max 16384 2024-09-11T00:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:00:34.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.258+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 msgr2=0x7fba300b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.258+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 0x7fba300b78a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fba4401a000 tx=0x7fba440197a0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.258+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 msgr2=0x7fba4c1167f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:34.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.258+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00d950 tx=0x7fba3c00de10 comp rx=0 tx=0).stop 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 shutdown_connections 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fba300b53e0 0x7fba300b78a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c10ec60 0x7fba4c117a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c10c160 0x7fba4c116e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 --2- 172.21.15.33:0/2496688738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba4c0748e0 0x7fba4c1167f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 >> 172.21.15.33:0/2496688738 conn(0x7fba4c070440 msgr2=0x7fba4c10fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 shutdown_connections 2024-09-11T00:00:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:34.259+0000 7fba52000640 1 -- 172.21.15.33:0/2496688738 wait complete. 2024-09-11T00:00:34.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:34 smithi033 ceph-mon[30593]: pgmap v550: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 814 op/s 2024-09-11T00:00:34.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:34 smithi189 ceph-mon[34000]: pgmap v550: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 814 op/s 2024-09-11T00:00:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:34 smithi052 ceph-mon[33526]: pgmap v550: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 814 op/s 2024-09-11T00:00:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:36 smithi189 ceph-mon[34000]: pgmap v551: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 680 op/s 2024-09-11T00:00:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:36 smithi033 ceph-mon[30593]: pgmap v551: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 680 op/s 2024-09-11T00:00:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:36 smithi052 ceph-mon[33526]: pgmap v551: 129 pgs: 129 active+clean; 933 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 680 op/s 2024-09-11T00:00:38.326 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 50.0 s, 483.0 tps, lat 211.395 ms stddev 219.729 2024-09-11T00:00:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:38 smithi033 ceph-mon[30593]: pgmap v552: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.1 MiB/s wr, 725 op/s 2024-09-11T00:00:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:38 smithi189 ceph-mon[34000]: pgmap v552: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.1 MiB/s wr, 725 op/s 2024-09-11T00:00:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:38 smithi052 ceph-mon[33526]: pgmap v552: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.1 MiB/s wr, 725 op/s 2024-09-11T00:00:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:40 smithi033 ceph-mon[30593]: pgmap v553: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 670 op/s 2024-09-11T00:00:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:40 smithi189 ceph-mon[34000]: pgmap v553: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 670 op/s 2024-09-11T00:00:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:40 smithi052 ceph-mon[33526]: pgmap v553: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 670 op/s 2024-09-11T00:00:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:42 smithi033 ceph-mon[30593]: pgmap v554: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 689 op/s 2024-09-11T00:00:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:42 smithi189 ceph-mon[34000]: pgmap v554: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 689 op/s 2024-09-11T00:00:42.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:42 smithi052 ceph-mon[33526]: pgmap v554: 129 pgs: 129 active+clean; 934 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 689 op/s 2024-09-11T00:00:43.326 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 55.0 s, 750.2 tps, lat 132.321 ms stddev 35.697 2024-09-11T00:00:44.507 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:44 smithi052 ceph-mon[33526]: pgmap v555: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:44.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:44 smithi033 ceph-mon[30593]: pgmap v555: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:44 smithi189 ceph-mon[34000]: pgmap v555: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:46 smithi033 ceph-mon[30593]: pgmap v556: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-11T00:00:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:46 smithi189 ceph-mon[34000]: pgmap v556: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-11T00:00:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:46 smithi052 ceph-mon[33526]: pgmap v556: 129 pgs: 129 active+clean; 950 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-11T00:00:47.474 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 -- 172.21.15.33:0/2421380514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 msgr2=0x7f244c078ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 --2- 172.21.15.33:0/2421380514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c078ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2438009900 tx=0x7f243802a410 comp rx=0 tx=0).stop 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 -- 172.21.15.33:0/2421380514 shutdown_connections 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 --2- 172.21.15.33:0/2421380514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c079530 0x7f244c079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 --2- 172.21.15.33:0/2421380514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c078ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.472+0000 7f2452a00640 1 --2- 172.21.15.33:0/2421380514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c077a20 0x7f244c077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.473+0000 7f2452a00640 1 -- 172.21.15.33:0/2421380514 >> 172.21.15.33:0/2421380514 conn(0x7f244c100470 msgr2=0x7f244c102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.473+0000 7f2452a00640 1 -- 172.21.15.33:0/2421380514 shutdown_connections 2024-09-11T00:00:47.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.473+0000 7f2452a00640 1 -- 172.21.15.33:0/2421380514 wait complete. 2024-09-11T00:00:47.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.474+0000 7f2452a00640 1 Processor -- start 2024-09-11T00:00:47.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.475+0000 7f2452a00640 1 -- start start 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 0x7f244c19f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 0x7f244c1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f244c114b30 con 0x7f244c077a20 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1149b0 con 0x7f244c079530 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2452a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f244c114cb0 con 0x7f244c078b70 2024-09-11T00:00:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f244b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f2450a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 0x7f244c1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f244b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c19f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58706/0 (socket says 172.21.15.33:58706) 2024-09-11T00:00:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f244be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 0x7f244c19f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.476+0000 7f244b400640 1 -- 172.21.15.33:0/4089052036 learned_addr learned my addr 172.21.15.33:0/4089052036 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f244be00640 1 -- 172.21.15.33:0/4089052036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 msgr2=0x7f244c19f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f244be00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c19f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f244be00640 1 -- 172.21.15.33:0/4089052036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 msgr2=0x7f244c1a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f244be00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 0x7f244c1a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f244be00640 1 -- 172.21.15.33:0/4089052036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c1a0df0 con 0x7f244c077a20 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.477+0000 7f2450a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 0x7f244c1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.478+0000 7f244be00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 0x7f244c19f2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e9f0 tx=0x7f243c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.478+0000 7f2448c00640 1 -- 172.21.15.33:0/4089052036 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c00ccc0 con 0x7f244c077a20 2024-09-11T00:00:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.478+0000 7f2448c00640 1 -- 172.21.15.33:0/4089052036 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f243c0108c0 con 0x7f244c077a20 2024-09-11T00:00:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.478+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244c1a10e0 con 0x7f244c077a20 2024-09-11T00:00:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.478+0000 7f2448c00640 1 -- 172.21.15.33:0/4089052036 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0187c0 con 0x7f244c077a20 2024-09-11T00:00:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.479+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244c1a77b0 con 0x7f244c077a20 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 Processor -- start 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 -- start start 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367ec0d0 0x5570367ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55703674b6b0 con 0x5570367ec0d0 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55703673aae0 con 0x5570367e97a0 2024-09-11T00:00:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2455857740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55703673e8f0 con 0x5570367eeb10 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.483+0000 7f2450a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36040/0 (socket says 172.21.15.33:36040) 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 -- 172.21.15.33:0/2383902070 learned_addr learned my addr 172.21.15.33:0/2383902070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f244b400640 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 -- 172.21.15.33:0/2383902070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 msgr2=0x5570367f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 -- 172.21.15.33:0/2383902070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367ec0d0 msgr2=0x5570367ee4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367ec0d0 0x5570367ee4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 -- 172.21.15.33:0/2383902070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557036707780 con 0x5570367e97a0 2024-09-11T00:00:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.484+0000 7f2450a00640 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24440337b0 tx=0x7f2444033c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383f529f29963d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.485+0000 7f2441200640 1 -- 172.21.15.33:0/2383902070 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444033220 con 0x5570367e97a0 2024-09-11T00:00:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.485+0000 7f2441200640 1 -- 172.21.15.33:0/2383902070 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24440319b0 con 0x5570367e97a0 2024-09-11T00:00:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.485+0000 7f2441200640 1 -- 172.21.15.33:0/2383902070 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444004510 con 0x5570367e97a0 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2448c00640 1 -- 172.21.15.33:0/4089052036 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f243c010430 con 0x7f244c077a20 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 -- 172.21.15.33:0/2383902070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 msgr2=0x5570367ebb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24440337b0 tx=0x7f2444033c70 comp rx=0 tx=0).stop 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 -- 172.21.15.33:0/2383902070 shutdown_connections 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367ec0d0 0x5570367ee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 --2- 172.21.15.33:0/2383902070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367ebb90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.486+0000 7f2455857740 1 -- 172.21.15.33:0/2383902070 >> 172.21.15.33:0/2383902070 conn(0x5570367d38e0 msgr2=0x5570367d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.487+0000 7f2455857740 1 -- 172.21.15.33:0/2383902070 shutdown_connections 2024-09-11T00:00:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.487+0000 7f2455857740 1 -- 172.21.15.33:0/2383902070 wait complete. 2024-09-11T00:00:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.488+0000 7f2455857740 1 -- start start 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.489+0000 7f2455857740 1 Processor -- start 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367d9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 0x5570367da5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557036672ab0 con 0x5570367eeb10 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5570366e1570 con 0x5570367db1a0 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5570367d8a20 con 0x5570367e97a0 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2455857740 10 client.0 _ll_register_callbacks cb 0x5570366f0100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f244b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f244b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36056/0 (socket says 172.21.15.33:36056) 2024-09-11T00:00:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f244b400640 1 -- 172.21.15.33:0/1275758839 learned_addr learned my addr 172.21.15.33:0/1275758839 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2448c00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 0x7f24300b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f2450a00640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367d9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.490+0000 7f244be00640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 0x5570367da5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244b400640 1 -- 172.21.15.33:0/1275758839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 msgr2=0x5570367d9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244b400640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367d9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f2450a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 0x7f24300b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244b400640 1 -- 172.21.15.33:0/1275758839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 msgr2=0x5570367da5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f2448c00640 1 -- 172.21.15.33:0/4089052036 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f243c0e6220 con 0x7f244c077a20 2024-09-11T00:00:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244b400640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 0x5570367da5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244b400640 1 -- 172.21.15.33:0/1275758839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703649c790 con 0x5570367db1a0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.491+0000 7f244be00640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 0x5570367da5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.492+0000 7f244b400640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f243802a930 tx=0x7f24380043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3188f68767bf4fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.492+0000 7f2435600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.492+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438035070 con 0x5570367db1a0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.492+0000 7f2450a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 0x7f24300b7740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f244400a010 tx=0x7f2444009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f2438003800 con 0x5570367db1a0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24440319b0 con 0x5570367db1a0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2438003a00 con 0x5570367db1a0 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2455857740 10 client.35750 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557036515620 con 0x5570367db1a0 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.493+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24440319b0 con 0x5570367db1a0 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2438031c70 con 0x5570367db1a0 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 10 client.35750 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 10 client.35750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 20 client.35750 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5570367e5ba0 0x5570367e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 4 client.35750 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:00:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55703674d600 con 0x5570367e5ba0 2024-09-11T00:00:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.495+0000 7f244be00640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5570367e5ba0 0x5570367e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.496+0000 7f244be00640 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5570367e5ba0 0x5570367e7fc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d745928ed42104e server_cookie=7d34989d1b4e7eb4 in_seq=0 out_seq=0 2024-09-11T00:00:47.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.496+0000 7f2435600640 10 client.35750 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:47.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.497+0000 7f2435600640 1 -- 172.21.15.33:0/1275758839 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55703674d600 con 0x5570367e5ba0 2024-09-11T00:00:47.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.497+0000 7f2435600640 10 client.35750 handle_command_reply: tid=0 2024-09-11T00:00:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.497+0000 7f2455857740 1 client.35750 shutdown 2024-09-11T00:00:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 msgr2=0x5570367db620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f243802a930 tx=0x7f24380043b0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 shutdown_connections 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367db1a0 0x5570367db620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367eeb10 0x5570367da5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5570367e5ba0 0x5570367e7fc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 --2- 172.21.15.33:0/1275758839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367d9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 >> 172.21.15.33:0/1275758839 conn(0x5570367d38e0 msgr2=0x5570367d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.498+0000 7f2435600640 0 client.35750 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.499+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 shutdown_connections 2024-09-11T00:00:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.499+0000 7f2455857740 1 -- 172.21.15.33:0/1275758839 wait complete. 2024-09-11T00:00:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.499+0000 7f2455857740 20 client.35750 trim_cache size 0 max 16384 2024-09-11T00:00:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 Processor -- start 2024-09-11T00:00:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 -- start start 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367eeb10 0x5570367e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1abd60 con 0x5570367db1a0 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1a9600 con 0x5570367eeb10 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.535+0000 7f2455857740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f244c074d80 con 0x5570367e97a0 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.536+0000 7f244be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.536+0000 7f244be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58866/0 (socket says 172.21.15.33:58866) 2024-09-11T00:00:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.536+0000 7f244be00640 1 -- 172.21.15.33:0/63787364 learned_addr learned my addr 172.21.15.33:0/63787364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.536+0000 7f244b400640 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 -- 172.21.15.33:0/63787364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 msgr2=0x5570367e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367e8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 -- 172.21.15.33:0/63787364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367eeb10 msgr2=0x5570367e8d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367eeb10 0x5570367e8d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 -- 172.21.15.33:0/63787364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570367cf270 con 0x5570367db1a0 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.537+0000 7f244be00640 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f243c0e3920 tx=0x7f243c0788c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babe2b5acb2ae60c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.538+0000 7f2437e00640 1 -- 172.21.15.33:0/63787364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0b10c0 con 0x5570367db1a0 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.538+0000 7f2437e00640 1 -- 172.21.15.33:0/63787364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f243c0b5b70 con 0x5570367db1a0 2024-09-11T00:00:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.538+0000 7f2437e00640 1 -- 172.21.15.33:0/63787364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ab5c0 con 0x5570367db1a0 2024-09-11T00:00:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.539+0000 7f2455857740 1 -- 172.21.15.33:0/63787364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 msgr2=0x5570367ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.539+0000 7f2455857740 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f243c0e3920 tx=0x7f243c0788c0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 -- 172.21.15.33:0/63787364 shutdown_connections 2024-09-11T00:00:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367eeb10 0x5570367e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367e97a0 0x5570367e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 --2- 172.21.15.33:0/63787364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ef600 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 -- 172.21.15.33:0/63787364 >> 172.21.15.33:0/63787364 conn(0x5570367d38e0 msgr2=0x5570367eeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 -- 172.21.15.33:0/63787364 shutdown_connections 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.540+0000 7f2455857740 1 -- 172.21.15.33:0/63787364 wait complete. 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.541+0000 7f2455857740 1 -- start start 2024-09-11T00:00:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.541+0000 7f2455857740 1 Processor -- start 2024-09-11T00:00:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.543+0000 7f2455857740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.543+0000 7f2455857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.543+0000 7f2455857740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.543+0000 7f244b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.543+0000 7f244b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36080/0 (socket says 172.21.15.33:36080) 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f2455857740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1a7ac0 con 0x5570367db1a0 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f2455857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1a8f30 con 0x5570367e97a0 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f2455857740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f244c1a8190 con 0x5570367eeb10 2024-09-11T00:00:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f2455857740 10 client.0 _ll_register_callbacks cb 0x7f2438009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f244be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f244be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58876/0 (socket says 172.21.15.33:58876) 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f244be00640 1 -- 172.21.15.33:0/2466851734 learned_addr learned my addr 172.21.15.33:0/2466851734 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.544+0000 7f2450a00640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244be00640 1 -- 172.21.15.33:0/2466851734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 msgr2=0x5570367dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244be00640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244be00640 1 -- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 msgr2=0x5570367df3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244be00640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244be00640 1 -- 172.21.15.33:0/2466851734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570367e06f0 con 0x5570367db1a0 2024-09-11T00:00:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.545+0000 7f244b400640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.546+0000 7f244be00640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f243c0ac620 tx=0x7f243c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69e61c7b5d518dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.546+0000 7f2435600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:00:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.547+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0d3020 con 0x5570367db1a0 2024-09-11T00:00:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.547+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f243c0b5b70 con 0x5570367db1a0 2024-09-11T00:00:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.548+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f243c010a70 con 0x5570367db1a0 2024-09-11T00:00:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.548+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f243c0d3020 con 0x5570367db1a0 2024-09-11T00:00:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.548+0000 7f2455857740 10 client.15984 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.548+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570367e1b50 con 0x5570367db1a0 2024-09-11T00:00:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.549+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f243c0b5b70 con 0x5570367db1a0 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.549+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f243c0d32b0 con 0x5570367db1a0 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.549+0000 7f2455857740 10 client.15984 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.549+0000 7f2455857740 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.549+0000 7f2455857740 20 client.15984 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.550+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55703685bec0 0x55703685e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.550+0000 7f2455857740 4 client.15984 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.550+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570367490b0 con 0x55703685bec0 2024-09-11T00:00:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.550+0000 7f244b400640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55703685bec0 0x55703685e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.551+0000 7f244b400640 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55703685bec0 0x55703685e2e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eed99ff067eb0ec server_cookie=f11bfc56843afdf5 in_seq=0 out_seq=0 2024-09-11T00:00:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.551+0000 7f2435600640 10 client.15984 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.574+0000 7f2435600640 1 -- 172.21.15.33:0/2466851734 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570367490b0 con 0x55703685bec0 2024-09-11T00:00:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.574+0000 7f2435600640 10 client.15984 handle_command_reply: tid=0 2024-09-11T00:00:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.574+0000 7f2455857740 1 client.15984 shutdown 2024-09-11T00:00:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.574+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 msgr2=0x5570367ded10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.574+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f243c0ac620 tx=0x7f243c00c7d0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 shutdown_connections 2024-09-11T00:00:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55703685bec0 0x55703685e2e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570367eeb10 0x5570367dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5570367e97a0 0x5570367df3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 --2- 172.21.15.33:0/2466851734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5570367db1a0 0x5570367ded10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 >> 172.21.15.33:0/2466851734 conn(0x5570367d38e0 msgr2=0x5570367e8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2435600640 0 client.15984 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 shutdown_connections 2024-09-11T00:00:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.575+0000 7f2455857740 1 -- 172.21.15.33:0/2466851734 wait complete. 2024-09-11T00:00:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.576+0000 7f2455857740 20 client.15984 trim_cache size 0 max 16384 2024-09-11T00:00:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:00:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:00:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:00:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.578+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 msgr2=0x7f24300b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.578+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 0x7f24300b7740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f244400a010 tx=0x7f2444009500 comp rx=0 tx=0).stop 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 msgr2=0x7f244c19f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 0x7f244c19f2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e9f0 tx=0x7f243c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 shutdown_connections 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f24300b5280 0x7f24300b7740 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c079530 0x7f244c1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f244c078b70 0x7f244c19f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 --2- 172.21.15.33:0/4089052036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f244c077a20 0x7f244c19f2b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.579+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 >> 172.21.15.33:0/4089052036 conn(0x7f244c100470 msgr2=0x7f244c101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.580+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 shutdown_connections 2024-09-11T00:00:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:00:47.581+0000 7f2452a00640 1 -- 172.21.15.33:0/4089052036 wait complete. 2024-09-11T00:00:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 60.0 s, 676.0 tps, lat 148.093 ms stddev 38.028 2024-09-11T00:00:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:48 smithi033 ceph-mon[30593]: pgmap v557: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-11T00:00:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:48 smithi189 ceph-mon[34000]: pgmap v557: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-11T00:00:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:48 smithi052 ceph-mon[33526]: pgmap v557: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-11T00:00:50.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:50 smithi033 ceph-mon[30593]: pgmap v558: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:50 smithi189 ceph-mon[34000]: pgmap v558: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:50 smithi052 ceph-mon[33526]: pgmap v558: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 781 op/s 2024-09-11T00:00:51.092 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:00:51.092 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T00:00:51.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:00:51.828 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:52.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:52 smithi033 ceph-mon[30593]: pgmap v559: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:00:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:52 smithi189 ceph-mon[34000]: pgmap v559: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:00:52.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 -- 172.21.15.33:0/3483941061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c109140 msgr2=0x7f4d0c10f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:52.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3483941061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c109140 0x7f4d0c10f940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009be0 tx=0x7f4d0402a6f0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 -- 172.21.15.33:0/3483941061 shutdown_connections 2024-09-11T00:00:52.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3483941061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c109140 0x7f4d0c10f940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3483941061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3483941061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c102db0 0x7f4d0c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.579+0000 7f4d13e00640 1 -- 172.21.15.33:0/3483941061 >> 172.21.15.33:0/3483941061 conn(0x7f4d0c0fe800 msgr2=0x7f4d0c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.580+0000 7f4d13e00640 1 -- 172.21.15.33:0/3483941061 shutdown_connections 2024-09-11T00:00:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.580+0000 7f4d13e00640 1 -- 172.21.15.33:0/3483941061 wait complete. 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.581+0000 7f4d13e00640 1 Processor -- start 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 -- start start 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 0x7f4d0c074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 0x7f4d0c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c114ea0 con 0x7f4d0c109140 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c114d20 con 0x7f4d0c102db0 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.582+0000 7f4d13e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c115020 con 0x7f4d0c1087c0 2024-09-11T00:00:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d10a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d10a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34930/0 (socket says 172.21.15.33:34930) 2024-09-11T00:00:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d10a00640 1 -- 172.21.15.33:0/3864015188 learned_addr learned my addr 172.21.15.33:0/3864015188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d11400640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 0x7f4d0c074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d10a00640 1 -- 172.21.15.33:0/3864015188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 msgr2=0x7f4d0c074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.583+0000 7f4d11e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 0x7f4d0c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d10a00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 0x7f4d0c074810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d10a00640 1 -- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 msgr2=0x7f4d0c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d10a00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 0x7f4d0c06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d10a00640 1 -- 172.21.15.33:0/3864015188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c06e4c0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d11e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 0x7f4d0c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d11400640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 0x7f4d0c074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.584+0000 7f4d10a00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800e9c0 tx=0x7f4cf800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.585+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800ccc0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.585+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cf80054b0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.585+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8010430 con 0x7f4d0c1087c0 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.586+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c06e7b0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.586+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c0736b0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.588+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c104060 con 0x7f4d0c1087c0 2024-09-11T00:00:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.595+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4cf8004eb0 con 0x7f4d0c1087c0 2024-09-11T00:00:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.598+0000 7f4d0a000640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 0x7f4cf40b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.599+0000 7f4d11400640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 0x7f4cf40b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.600+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4cf80e6450 con 0x7f4d0c1087c0 2024-09-11T00:00:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.601+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4cf80e6970 con 0x7f4d0c1087c0 2024-09-11T00:00:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:52.602+0000 7f4d11400640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 0x7f4cf40b7930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000a8b0 tx=0x7f4d00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:52 smithi052 ceph-mon[33526]: pgmap v559: 129 pgs: 129 active+clean; 950 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:00:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.026+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d0c103190 con 0x7f4d0c1087c0 2024-09-11T00:00:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.027+0000 7f4d0a000640 1 -- 172.21.15.33:0/3864015188 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11912 (secure 0 0 0) 0x7f4cf80acff0 con 0x7f4d0c1087c0 2024-09-11T00:00:53.030 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:00:53.030 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-09-10T23:59:53:088652+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:59:52.844016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:00:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-09-11T00:00:53.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.032+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 msgr2=0x7f4cf40b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.032+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 0x7f4cf40b7930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000a8b0 tx=0x7f4d00008040 comp rx=0 tx=0).stop 2024-09-11T00:00:53.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.032+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 msgr2=0x7f4d0c074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:53.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.032+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800e9c0 tx=0x7f4cf800ee80 comp rx=0 tx=0).stop 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 shutdown_connections 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4cf40b5470 0x7f4cf40b7930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d0c109140 0x7f4d0c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d0c1087c0 0x7f4d0c074d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 --2- 172.21.15.33:0/3864015188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d0c102db0 0x7f4d0c074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 >> 172.21.15.33:0/3864015188 conn(0x7f4d0c0fe800 msgr2=0x7f4d0c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.033+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 shutdown_connections 2024-09-11T00:00:53.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:53.034+0000 7f4d13e00640 1 -- 172.21.15.33:0/3864015188 wait complete. 2024-09-11T00:00:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 65.0 s, 581.0 tps, lat 171.711 ms stddev 78.701 2024-09-11T00:00:53.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3864015188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3864015188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:53.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3864015188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:00:54.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T00:00:54.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T00:00:54.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:54 smithi033 ceph-mon[30593]: pgmap v560: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 903 op/s 2024-09-11T00:00:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:54 smithi189 ceph-mon[34000]: pgmap v560: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 903 op/s 2024-09-11T00:00:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:54 smithi052 ceph-mon[33526]: pgmap v560: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 903 op/s 2024-09-11T00:00:54.774 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:00:55.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.621+0000 7f4da3200640 1 -- 172.21.15.33:0/4175870567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da4104e10 msgr2=0x7f4da41051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.621+0000 7f4da3200640 1 --2- 172.21.15.33:0/4175870567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da4104e10 0x7f4da41051f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009900 tx=0x7f4d9402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 -- 172.21.15.33:0/4175870567 shutdown_connections 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 --2- 172.21.15.33:0/4175870567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 0x7f4da41119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 --2- 172.21.15.33:0/4175870567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4da410a820 0x7f4da410ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 --2- 172.21.15.33:0/4175870567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da4104e10 0x7f4da41051f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 -- 172.21.15.33:0/4175870567 >> 172.21.15.33:0/4175870567 conn(0x7f4da4100840 msgr2=0x7f4da4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 -- 172.21.15.33:0/4175870567 shutdown_connections 2024-09-11T00:00:55.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.622+0000 7f4da3200640 1 -- 172.21.15.33:0/4175870567 wait complete. 2024-09-11T00:00:55.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.625+0000 7f4da3200640 1 Processor -- start 2024-09-11T00:00:55.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.626+0000 7f4da3200640 1 -- start start 2024-09-11T00:00:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.627+0000 7f4da3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4da4104e10 0x7f4da4111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.627+0000 7f4da3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.627+0000 7f4da3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 0x7f4da410edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4114d60 con 0x7f4da410b1a0 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4114be0 con 0x7f4da410a820 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da3200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4114ee0 con 0x7f4da4104e10 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58062/0 (socket says 172.21.15.33:58062) 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.628+0000 7f4da1400640 1 -- 172.21.15.33:0/3292636404 learned_addr learned my addr 172.21.15.33:0/3292636404 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da2800640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 0x7f4da410edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da1400640 1 -- 172.21.15.33:0/3292636404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4da4104e10 msgr2=0x7f4da4111640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da1400640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4da4104e10 0x7f4da4111640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da1400640 1 -- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 msgr2=0x7f4da410edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da1400640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 0x7f4da410edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.629+0000 7f4da1400640 1 -- 172.21.15.33:0/3292636404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da410f5d0 con 0x7f4da410a820 2024-09-11T00:00:55.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.630+0000 7f4da1400640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ea60 tx=0x7f4d9000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.630+0000 7f4d9aa00640 1 -- 172.21.15.33:0/3292636404 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000cde0 con 0x7f4da410a820 2024-09-11T00:00:55.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.630+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da41abaa0 con 0x7f4da410a820 2024-09-11T00:00:55.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.630+0000 7f4d9aa00640 1 -- 172.21.15.33:0/3292636404 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d900035f0 con 0x7f4da410a820 2024-09-11T00:00:55.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.630+0000 7f4d9aa00640 1 -- 172.21.15.33:0/3292636404 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90010690 con 0x7f4da410a820 2024-09-11T00:00:55.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.631+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41ac000 con 0x7f4da410a820 2024-09-11T00:00:55.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.639+0000 7f4d9aa00640 1 -- 172.21.15.33:0/3292636404 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4d90004000 con 0x7f4da410a820 2024-09-11T00:00:55.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.640+0000 7f4dabc6b740 1 Processor -- start 2024-09-11T00:00:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.641+0000 7f4dabc6b740 1 -- start start 2024-09-11T00:00:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.641+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 0x559ebdaa46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdab0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 0x559ebdab2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559ebda19ca0 con 0x559ebdaa42f0 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559ebda090d0 con 0x559ebdaa4c10 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ebda0cee0 con 0x559ebdab0ba0 2024-09-11T00:00:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4d9aa00640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 0x7f4d880b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4da2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 0x559ebdaa46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4da1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdab0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4da2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 0x559ebdaa46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35762/0 (socket says 172.21.15.33:35762) 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.642+0000 7f4da2800640 1 -- 172.21.15.33:0/3289656081 learned_addr learned my addr 172.21.15.33:0/3289656081 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.643+0000 7f4d9aa00640 1 -- 172.21.15.33:0/3292636404 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4d900e63d0 con 0x7f4da410a820 2024-09-11T00:00:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.643+0000 7f4da1400640 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 0x559ebdab2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1400640 1 -- 172.21.15.33:0/3289656081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 msgr2=0x559ebdab0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1400640 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdab0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1400640 1 -- 172.21.15.33:0/3289656081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 msgr2=0x559ebdaa46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1400640 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 0x559ebdaa46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1400640 1 -- 172.21.15.33:0/3289656081 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebd9bb400 con 0x559ebdab0ba0 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da1e00640 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdab0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:00:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.644+0000 7f4da2800640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 0x7f4d880b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.646+0000 7f4da1400640 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 0x559ebdab2f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d90003fd0 tx=0x7f4d900a8790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ef6929f604ec47d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.646+0000 7f4d8f400640 1 -- 172.21.15.33:0/3289656081 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d900038e0 con 0x559ebdab0ba0 2024-09-11T00:00:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.646+0000 7f4d8f400640 1 -- 172.21.15.33:0/3289656081 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d900ac300 con 0x559ebdab0ba0 2024-09-11T00:00:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.646+0000 7f4d8f400640 1 -- 172.21.15.33:0/3289656081 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90092610 con 0x559ebdab0ba0 2024-09-11T00:00:55.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.647+0000 7f4da2800640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 0x7f4d880b7850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009fd0 tx=0x7f4d9c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 -- 172.21.15.33:0/3289656081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 msgr2=0x559ebdab2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 0x559ebdab2f90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d90003fd0 tx=0x7f4d900a8790 comp rx=0 tx=0).stop 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 -- 172.21.15.33:0/3289656081 shutdown_connections 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdab0ba0 0x559ebdab2f90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdab0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/3289656081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa42f0 0x559ebdaa46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.650+0000 7f4dabc6b740 1 -- 172.21.15.33:0/3289656081 >> 172.21.15.33:0/3289656081 conn(0x559ebdaa2120 msgr2=0x559ebdaa32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.651+0000 7f4dabc6b740 1 -- 172.21.15.33:0/3289656081 shutdown_connections 2024-09-11T00:00:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.651+0000 7f4dabc6b740 1 -- 172.21.15.33:0/3289656081 wait complete. 2024-09-11T00:00:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.652+0000 7f4dabc6b740 1 -- start start 2024-09-11T00:00:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.653+0000 7f4dabc6b740 1 Processor -- start 2024-09-11T00:00:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdab0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdaad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaade90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559ebd86a7a0 con 0x559ebdab0ba0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559ebd9aea10 con 0x559ebdaa4c10 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ebdab3820 con 0x559ebdaa42f0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.654+0000 7f4dabc6b740 10 client.0 _ll_register_callbacks cb 0x559ebd9bebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.655+0000 7f4da1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdaad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.655+0000 7f4da1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdab0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.655+0000 7f4da2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.655+0000 7f4da1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdab0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34966/0 (socket says 172.21.15.33:34966) 2024-09-11T00:00:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.655+0000 7f4da1e00640 1 -- 172.21.15.33:0/894170993 learned_addr learned my addr 172.21.15.33:0/894170993 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.656+0000 7f4da2800640 1 -- 172.21.15.33:0/894170993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 msgr2=0x559ebdab0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.656+0000 7f4da2800640 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdab0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.656+0000 7f4da2800640 1 -- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 msgr2=0x559ebdaad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.656+0000 7f4da2800640 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdaad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.656+0000 7f4da2800640 1 -- 172.21.15.33:0/894170993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebd776b90 con 0x559ebdab0ba0 2024-09-11T00:00:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.658+0000 7f4da2800640 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaade90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00fc50 tx=0x7f4d9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7248f04e5c4539e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.658+0000 7f4d83e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:00:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.660+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c024020 con 0x559ebdab0ba0 2024-09-11T00:00:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.660+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4d9c010c60 con 0x559ebdab0ba0 2024-09-11T00:00:55.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.660+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d900ac300 con 0x559ebdab0ba0 2024-09-11T00:00:55.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.661+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d9c019070 con 0x559ebdab0ba0 2024-09-11T00:00:55.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.661+0000 7f4dabc6b740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:55.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.661+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ebdabf1d0 con 0x559ebdab0ba0 2024-09-11T00:00:55.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.663+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d900ac300 con 0x559ebdab0ba0 2024-09-11T00:00:55.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d9c020400 con 0x559ebdab0ba0 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 10 client.15996 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 20 client.15996 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdac06e0 0x559ebdac2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 4 client.15996 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.664+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ebda1bbf0 con 0x559ebdac06e0 2024-09-11T00:00:55.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.665+0000 7f4da1e00640 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdac06e0 0x559ebdac2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.667+0000 7f4da1e00640 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdac06e0 0x559ebdac2b00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23ecb27481f0602 server_cookie=ca39b2d4fb34107e in_seq=0 out_seq=0 2024-09-11T00:00:55.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.667+0000 7f4d83e00640 10 client.15996 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:55.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.668+0000 7f4d83e00640 1 -- 172.21.15.33:0/894170993 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ebda1bbf0 con 0x559ebdac06e0 2024-09-11T00:00:55.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.668+0000 7f4d83e00640 10 client.15996 handle_command_reply: tid=0 2024-09-11T00:00:55.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.668+0000 7f4dabc6b740 1 client.15996 shutdown 2024-09-11T00:00:55.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 msgr2=0x559ebdaade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaade90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00fc50 tx=0x7f4d9c004a40 comp rx=0 tx=0).stop 2024-09-11T00:00:55.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 shutdown_connections 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaade90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa4c10 0x559ebdaad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdac06e0 0x559ebdac2b00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/894170993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdab0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.669+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 >> 172.21.15.33:0/894170993 conn(0x559ebdaa2120 msgr2=0x559ebdaa7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.670+0000 7f4d83e00640 0 client.15996 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:55.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.670+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 shutdown_connections 2024-09-11T00:00:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.670+0000 7f4dabc6b740 1 -- 172.21.15.33:0/894170993 wait complete. 2024-09-11T00:00:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.670+0000 7f4dabc6b740 20 client.15996 trim_cache size 0 max 16384 2024-09-11T00:00:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.707+0000 7f4dabc6b740 1 Processor -- start 2024-09-11T00:00:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.707+0000 7f4dabc6b740 1 -- start start 2024-09-11T00:00:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 0x559ebdabca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 0x559ebdaaaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b87c0 con 0x559ebdab0ba0 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b6060 con 0x559ebdaa42f0 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.708+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b3eb0 con 0x559ebdaa4c10 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.709+0000 7f4da1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 0x559ebdabca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.709+0000 7f4da2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.709+0000 7f4da1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 0x559ebdabca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58098/0 (socket says 172.21.15.33:58098) 2024-09-11T00:00:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.709+0000 7f4da1e00640 1 -- 172.21.15.33:0/1112617029 learned_addr learned my addr 172.21.15.33:0/1112617029 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.709+0000 7f4da1400640 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 0x559ebdaaaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da1400640 1 -- 172.21.15.33:0/1112617029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 msgr2=0x559ebdabca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da1400640 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 0x559ebdabca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da1400640 1 -- 172.21.15.33:0/1112617029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 msgr2=0x559ebdaab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da1400640 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da1400640 1 -- 172.21.15.33:0/1112617029 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebdaa3850 con 0x559ebdaa4c10 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.710+0000 7f4da2800640 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.711+0000 7f4da1400640 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 0x559ebdaaaac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ea30 tx=0x7f4d9000e9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8392a15b10f687cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.712+0000 7f4d8ea00640 1 -- 172.21.15.33:0/1112617029 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90097070 con 0x559ebdaa4c10 2024-09-11T00:00:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.712+0000 7f4d8ea00640 1 -- 172.21.15.33:0/1112617029 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d900ac300 con 0x559ebdaa4c10 2024-09-11T00:00:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.712+0000 7f4d8ea00640 1 -- 172.21.15.33:0/1112617029 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d900b5d80 con 0x559ebdaa4c10 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1112617029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 msgr2=0x559ebdaaaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 0x559ebdaaaac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ea30 tx=0x7f4d9000e9b0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1112617029 shutdown_connections 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdab0ba0 0x559ebdaab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa4c10 0x559ebdaaaac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1112617029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdaa42f0 0x559ebdabca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.713+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1112617029 >> 172.21.15.33:0/1112617029 conn(0x559ebdaa2120 msgr2=0x559ebdaa8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.714+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1112617029 shutdown_connections 2024-09-11T00:00:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.714+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1112617029 wait complete. 2024-09-11T00:00:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.715+0000 7f4dabc6b740 1 -- start start 2024-09-11T00:00:55.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.716+0000 7f4dabc6b740 1 Processor -- start 2024-09-11T00:00:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.717+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdb28e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 0x559ebdb27320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b4520 con 0x559ebdaa4c10 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b5990 con 0x559ebdab0ba0 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41b4bf0 con 0x559ebdaa42f0 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.718+0000 7f4dabc6b740 10 client.0 _ll_register_callbacks cb 0x7f4d9c013f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.719+0000 7f4da2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.719+0000 7f4da2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58108/0 (socket says 172.21.15.33:58108) 2024-09-11T00:00:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.719+0000 7f4da2800640 1 -- 172.21.15.33:0/1979164546 learned_addr learned my addr 172.21.15.33:0/1979164546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:00:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.719+0000 7f4da1e00640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdb28e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.720+0000 7f4da1400640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 0x559ebdb27320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.720+0000 7f4da1e00640 1 -- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 msgr2=0x559ebdb27860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.720+0000 7f4da1e00640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.720+0000 7f4da1e00640 1 -- 172.21.15.33:0/1979164546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 msgr2=0x559ebdb27320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:00:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4da1e00640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 0x559ebdb27320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4da1e00640 1 -- 172.21.15.33:0/1979164546 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebdb28090 con 0x559ebdaa42f0 2024-09-11T00:00:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4da2800640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:00:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4da1400640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 0x559ebdb27320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:00:55.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4da1e00640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdb28e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4d94005c40 tx=0x7f4d940044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0572120cf48b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.721+0000 7f4d83e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:00:55.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.722+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9404d060 con 0x559ebdaa42f0 2024-09-11T00:00:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.723+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4d94005510 con 0x559ebdaa42f0 2024-09-11T00:00:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.723+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d900ac300 con 0x559ebdaa42f0 2024-09-11T00:00:55.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.723+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d94035040 con 0x559ebdaa42f0 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.723+0000 7f4dabc6b740 10 client.25726 fetch_fsmap learned FSMap version 28 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.723+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ebdab8b50 con 0x559ebdaa42f0 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d900ac300 con 0x559ebdaa42f0 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d9403a040 con 0x559ebdaa42f0 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 10 client.25726 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 10 client.25726 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 20 client.25726 populate_metadata read hostname 'smithi033' 2024-09-11T00:00:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdab92b0 0x559ebdb42640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 4 client.25726 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T00:00:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.724+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x559ebda176a0 con 0x559ebdab92b0 2024-09-11T00:00:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.725+0000 7f4da1400640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdab92b0 0x559ebdb42640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.725+0000 7f4da1400640 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdab92b0 0x559ebdb42640 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4fffff3b1fd53eb server_cookie=e1b68879a69d5948 in_seq=0 out_seq=0 2024-09-11T00:00:55.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:55.725+0000 7f4d83e00640 10 client.25726 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:56.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.018+0000 7f4d83e00640 1 -- 172.21.15.33:0/1979164546 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559ebda176a0 con 0x559ebdab92b0 2024-09-11T00:00:56.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.018+0000 7f4d83e00640 10 client.25726 handle_command_reply: tid=0 2024-09-11T00:00:56.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.018+0000 7f4dabc6b740 1 client.25726 shutdown 2024-09-11T00:00:56.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.018+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 msgr2=0x559ebdb28e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.018+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdb28e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4d94005c40 tx=0x7f4d940044f0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 shutdown_connections 2024-09-11T00:00:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ebdab0ba0 0x559ebdb27860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ebdaa4c10 0x559ebdb27320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559ebdab92b0 0x559ebdb42640 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 --2- 172.21.15.33:0/1979164546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebdaa42f0 0x559ebdb28e20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 >> 172.21.15.33:0/1979164546 conn(0x559ebdaa2120 msgr2=0x559ebdaaeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.019+0000 7f4d83e00640 0 client.25726 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.020+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 shutdown_connections 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.020+0000 7f4dabc6b740 1 -- 172.21.15.33:0/1979164546 wait complete. 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.020+0000 7f4dabc6b740 20 client.25726 trim_cache size 0 max 16384 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:00:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 14, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "e4ad3766": { 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 14, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:00:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:00:56.027 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.021+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 msgr2=0x7f4d880b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.021+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 0x7f4d880b7850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009fd0 tx=0x7f4d9c004ab0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.021+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 msgr2=0x7f4da410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.021+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ea60 tx=0x7f4d9000ef20 comp rx=0 tx=0).stop 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 shutdown_connections 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4d880b5390 0x7f4d880b7850 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4da410b1a0 0x7f4da410edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4da410a820 0x7f4da410e890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 --2- 172.21.15.33:0/3292636404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4da4104e10 0x7f4da4111640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 >> 172.21.15.33:0/3292636404 conn(0x7f4da4100840 msgr2=0x7f4da41020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 shutdown_connections 2024-09-11T00:00:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:00:56.022+0000 7f4da3200640 1 -- 172.21.15.33:0/3292636404 wait complete. 2024-09-11T00:00:56.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:56 smithi033 ceph-mon[30593]: pgmap v561: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-09-11T00:00:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:56 smithi189 ceph-mon[34000]: pgmap v561: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-09-11T00:00:56.684 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:56 smithi052 ceph-mon[33526]: pgmap v561: 129 pgs: 129 active+clean; 946 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-09-11T00:00:57.581 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e4ad3766', quiesce took 6.5 seconds. Will release after: 23.5 2024-09-11T00:00:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 70.0 s, 295.7 tps, lat 173.039 ms stddev 44.749 2024-09-11T00:00:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:00:58 smithi189 ceph-mon[34000]: pgmap v562: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 MiB/s wr, 859 op/s 2024-09-11T00:00:58.594 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:00:58 smithi033 ceph-mon[30593]: pgmap v562: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 MiB/s wr, 859 op/s 2024-09-11T00:00:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:00:58 smithi052 ceph-mon[33526]: pgmap v562: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.2 MiB/s wr, 859 op/s 2024-09-11T00:01:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:00 smithi189 ceph-mon[34000]: pgmap v563: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 691 op/s 2024-09-11T00:01:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:00 smithi052 ceph-mon[33526]: pgmap v563: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 691 op/s 2024-09-11T00:01:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 -- 172.21.15.33:0/3137955985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1070105b00 msgr2=0x7f1070105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 --2- 172.21.15.33:0/3137955985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1070105b00 0x7f1070105f80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f105c009cd0 tx=0x7f105c02a8e0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 -- 172.21.15.33:0/3137955985 shutdown_connections 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 --2- 172.21.15.33:0/3137955985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 0x7f107010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 --2- 172.21.15.33:0/3137955985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1070105b00 0x7f1070105f80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 --2- 172.21.15.33:0/3137955985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10701049b0 0x7f1070104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 -- 172.21.15.33:0/3137955985 >> 172.21.15.33:0/3137955985 conn(0x7f1070100270 msgr2=0x7f1070102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 -- 172.21.15.33:0/3137955985 shutdown_connections 2024-09-11T00:01:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.733+0000 7f106f200640 1 -- 172.21.15.33:0/3137955985 wait complete. 2024-09-11T00:01:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 Processor -- start 2024-09-11T00:01:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 -- start start 2024-09-11T00:01:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1070105b00 0x7f107019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 0x7f107019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1070110520 con 0x7f10701049b0 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10701103a0 con 0x7f1070105b00 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.734+0000 7f106f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10701106a0 con 0x7f10701064c0 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35802/0 (socket says 172.21.15.33:35802) 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 -- 172.21.15.33:0/1172796484 learned_addr learned my addr 172.21.15.33:0/1172796484 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106d400640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1070105b00 0x7f107019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106e800640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 0x7f107019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 -- 172.21.15.33:0/1172796484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 msgr2=0x7f107019bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 0x7f107019bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 -- 172.21.15.33:0/1172796484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1070105b00 msgr2=0x7f107019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1070105b00 0x7f107019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.735+0000 7f106de00640 1 -- 172.21.15.33:0/1172796484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107019c820 con 0x7f10701049b0 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f106de00640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f106000d950 tx=0x7f106000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f1066a00640 1 -- 172.21.15.33:0/1172796484 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060017030 con 0x7f10701049b0 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f1066a00640 1 -- 172.21.15.33:0/1172796484 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1060004020 con 0x7f10701049b0 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107019cb10 con 0x7f10701049b0 2024-09-11T00:01:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f1066a00640 1 -- 172.21.15.33:0/1172796484 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600055d0 con 0x7f10701049b0 2024-09-11T00:01:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.736+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10701a31e0 con 0x7f10701049b0 2024-09-11T00:01:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.739+0000 7f107802f740 1 Processor -- start 2024-09-11T00:01:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.739+0000 7f107802f740 1 -- start start 2024-09-11T00:01:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.739+0000 7f107802f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.739+0000 7f1066a00640 1 -- 172.21.15.33:0/1172796484 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1060009a30 con 0x7f10701049b0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.739+0000 7f107802f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f107802f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f107802f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560be57356b0 con 0x560be57c52a0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f107802f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560be5724ae0 con 0x560be57c2970 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f107802f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560be57288f0 con 0x560be57c7ce0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35808/0 (socket says 172.21.15.33:35808) 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 -- 172.21.15.33:0/1795167151 learned_addr learned my addr 172.21.15.33:0/1795167151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106e800640 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106d400640 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 -- 172.21.15.33:0/1795167151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 msgr2=0x560be57ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 -- 172.21.15.33:0/1795167151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 msgr2=0x560be57c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.740+0000 7f106de00640 1 -- 172.21.15.33:0/1795167151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be56f1780 con 0x560be57c52a0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f106de00640 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f10600eba00 tx=0x7f10600ebec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d72a67fee8e7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f105b400640 1 -- 172.21.15.33:0/1795167151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600f4070 con 0x560be57c52a0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f1066a00640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 0x7f10540b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f105b400640 1 -- 172.21.15.33:0/1795167151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10600edba0 con 0x560be57c52a0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f105b400640 1 -- 172.21.15.33:0/1795167151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600f0e60 con 0x560be57c52a0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f1066a00640 1 -- 172.21.15.33:0/1172796484 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f10600e5a00 con 0x7f10701049b0 2024-09-11T00:01:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.741+0000 7f106e800640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 0x7f10540b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 -- 172.21.15.33:0/1795167151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 msgr2=0x560be57c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f10600eba00 tx=0x7f10600ebec0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f106e800640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 0x7f10540b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f107019ba60 tx=0x7f1068005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 -- 172.21.15.33:0/1795167151 shutdown_connections 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57c7690 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 --2- 172.21.15.33:0/1795167151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 -- 172.21.15.33:0/1795167151 >> 172.21.15.33:0/1795167151 conn(0x560be57bdac0 msgr2=0x560be57be850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 -- 172.21.15.33:0/1795167151 shutdown_connections 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.742+0000 7f107802f740 1 -- 172.21.15.33:0/1795167151 wait complete. 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 -- start start 2024-09-11T00:01:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 Processor -- start 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560be565cab0 con 0x560be57c52a0 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560be56cb570 con 0x560be57c2970 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560be57cacc0 con 0x560be57c7ce0 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.743+0000 7f107802f740 10 client.0 _ll_register_callbacks cb 0x560be56da100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35824/0 (socket says 172.21.15.33:35824) 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 -- 172.21.15.33:0/2433190723 learned_addr learned my addr 172.21.15.33:0/2433190723 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106de00640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106e800640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 -- 172.21.15.33:0/2433190723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 msgr2=0x560be57cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 -- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 msgr2=0x560be57cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106d400640 1 -- 172.21.15.33:0/2433190723 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be5486790 con 0x560be57c52a0 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.744+0000 7f106de00640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f106d400640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f105c02ae00 tx=0x7f105c031550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262d4544b388bdc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f104fe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c049060 con 0x560be57c52a0 2024-09-11T00:01:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f105c003c40 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10600edba0 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f105c050050 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f107802f740 10 client.16011 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560be54ff620 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.745+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10600edba0 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f105c043070 con 0x560be57c52a0 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 10 client.16011 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 20 client.16011 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be57d79b0 0x560be57d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 4 client.16011 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be5737600 con 0x560be57d79b0 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.746+0000 7f106de00640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be57d79b0 0x560be57d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.747+0000 7f106de00640 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be57d79b0 0x560be57d9e30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ce64b4ab31a8a92 server_cookie=2ed3bd79632aa4f4 in_seq=0 out_seq=0 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.747+0000 7f104fe00640 10 client.16011 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f104fe00640 1 -- 172.21.15.33:0/2433190723 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560be5737600 con 0x560be57d79b0 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f104fe00640 10 client.16011 handle_command_reply: tid=0 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 client.16011 shutdown 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 msgr2=0x560be57cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f105c02ae00 tx=0x7f105c031550 comp rx=0 tx=0).stop 2024-09-11T00:01:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 shutdown_connections 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be57d79b0 0x560be57d9e30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c52a0 0x560be57cc6f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f104fe00640 0 client.16011 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 --2- 172.21.15.33:0/2433190723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 >> 172.21.15.33:0/2433190723 conn(0x560be57bdac0 msgr2=0x560be57bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 shutdown_connections 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.748+0000 7f107802f740 1 -- 172.21.15.33:0/2433190723 wait complete. 2024-09-11T00:01:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.749+0000 7f107802f740 20 client.16011 trim_cache size 0 max 16384 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 Processor -- start 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 -- start start 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 0x560be57c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f10701afef0 con 0x560be57c2970 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10701ad790 con 0x560be57c52a0 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.764+0000 7f107802f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10701ab5e0 con 0x560be57c7ce0 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35830/0 (socket says 172.21.15.33:35830) 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 -- 172.21.15.33:0/3561231458 learned_addr learned my addr 172.21.15.33:0/3561231458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106d400640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 0x560be57c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106e800640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 -- 172.21.15.33:0/3561231458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 msgr2=0x560be57cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 -- 172.21.15.33:0/3561231458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 msgr2=0x560be57c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 0x560be57c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 -- 172.21.15.33:0/3561231458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be57c50d0 con 0x560be57c2970 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106d400640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 0x560be57c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f106de00640 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10600abac0 tx=0x7f10600eb530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42fc03085292589 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.765+0000 7f105aa00640 1 -- 172.21.15.33:0/3561231458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600ab900 con 0x560be57c2970 2024-09-11T00:01:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f105aa00640 1 -- 172.21.15.33:0/3561231458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10600ac4c0 con 0x560be57c2970 2024-09-11T00:01:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f105aa00640 1 -- 172.21.15.33:0/3561231458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10600abb90 con 0x560be57c2970 2024-09-11T00:01:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 -- 172.21.15.33:0/3561231458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 msgr2=0x560be57c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10600abac0 tx=0x7f10600eb530 comp rx=0 tx=0).stop 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 -- 172.21.15.33:0/3561231458 shutdown_connections 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c7ce0 0x560be57cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c52a0 0x560be57c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 --2- 172.21.15.33:0/3561231458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c2970 0x560be57c80c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 -- 172.21.15.33:0/3561231458 >> 172.21.15.33:0/3561231458 conn(0x560be57bdac0 msgr2=0x560be57c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 -- 172.21.15.33:0/3561231458 shutdown_connections 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.766+0000 7f107802f740 1 -- 172.21.15.33:0/3561231458 wait complete. 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 -- start start 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 Processor -- start 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c52a0 0x560be57d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f10701abc50 con 0x560be57c7ce0 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10701ad0c0 con 0x560be57c2970 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10701ac320 con 0x560be57c52a0 2024-09-11T00:01:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.767+0000 7f107802f740 10 client.0 _ll_register_callbacks cb 0x7f105c031430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35846/0 (socket says 172.21.15.33:35846) 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 -- 172.21.15.33:0/1003665396 learned_addr learned my addr 172.21.15.33:0/1003665396 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106de00640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106d400640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c52a0 0x560be57d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 -- 172.21.15.33:0/1003665396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c52a0 msgr2=0x560be57d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c52a0 0x560be57d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 -- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 msgr2=0x560be57d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 -- 172.21.15.33:0/1003665396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be57d3740 con 0x560be57c7ce0 2024-09-11T00:01:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f106e800640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f106801f6f0 tx=0x7f1068004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b04ba5bbabc568e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.768+0000 7f104fe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106802f060 con 0x560be57c7ce0 2024-09-11T00:01:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1068004030 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10600ac4c0 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1068036050 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f107802f740 10 client.16017 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560be5844b40 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10600ac4c0 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.769+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1068003780 con 0x560be57c7ce0 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 10 client.16017 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 20 client.16017 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be5845550 0x560be5847970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 4 client.16017 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560be57330b0 con 0x560be5845550 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.770+0000 7f106de00640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be5845550 0x560be5847970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.771+0000 7f106de00640 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be5845550 0x560be5847970 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b8d39f25b823a server_cookie=babd6ae1e8755811 in_seq=0 out_seq=0 2024-09-11T00:01:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.771+0000 7f104fe00640 10 client.16017 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:00.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:00 smithi033 ceph-mon[30593]: pgmap v563: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 691 op/s 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f104fe00640 1 -- 172.21.15.33:0/1003665396 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560be57330b0 con 0x560be5845550 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f104fe00640 10 client.16017 handle_command_reply: tid=0 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 client.16017 shutdown 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 msgr2=0x560be57d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f106801f6f0 tx=0x7f1068004730 comp rx=0 tx=0).stop 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 shutdown_connections 2024-09-11T00:01:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560be57c7ce0 0x560be57d2f40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560be5845550 0x560be5847970 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560be57c52a0 0x560be57d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 --2- 172.21.15.33:0/1003665396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be57c2970 0x560be57d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f104fe00640 0 client.16017 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.788+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 >> 172.21.15.33:0/1003665396 conn(0x560be57bdac0 msgr2=0x560be57cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.789+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 shutdown_connections 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.789+0000 7f107802f740 1 -- 172.21.15.33:0/1003665396 wait complete. 2024-09-11T00:01:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.789+0000 7f107802f740 20 client.16017 trim_cache size 0 max 16384 2024-09-11T00:01:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:01:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:01:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:01:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 msgr2=0x7f10540b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 0x7f10540b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f107019ba60 tx=0x7f1068005f90 comp rx=0 tx=0).stop 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 msgr2=0x7f107019ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f106000d950 tx=0x7f106000de10 comp rx=0 tx=0).stop 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 shutdown_connections 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f10540b5360 0x7f10540b7820 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10701064c0 0x7f107019bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1070105b00 0x7f107019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 --2- 172.21.15.33:0/1172796484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10701049b0 0x7f107019ace0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 >> 172.21.15.33:0/1172796484 conn(0x7f1070100270 msgr2=0x7f1070108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 shutdown_connections 2024-09-11T00:01:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:00.790+0000 7f106f200640 1 -- 172.21.15.33:0/1172796484 wait complete. 2024-09-11T00:01:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:02 smithi033 ceph-mon[30593]: pgmap v564: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 609 op/s 2024-09-11T00:01:02.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:02 smithi189 ceph-mon[34000]: pgmap v564: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 609 op/s 2024-09-11T00:01:02.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:02 smithi052 ceph-mon[33526]: pgmap v564: 129 pgs: 129 active+clean; 946 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 MiB/s wr, 609 op/s 2024-09-11T00:01:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:04 smithi189 ceph-mon[34000]: pgmap v565: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2024-09-11T00:01:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:04 smithi052 ceph-mon[33526]: pgmap v565: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2024-09-11T00:01:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:04 smithi033 ceph-mon[30593]: pgmap v565: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.3 MiB/s wr, 528 op/s 2024-09-11T00:01:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:06 smithi189 ceph-mon[34000]: pgmap v566: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 306 op/s 2024-09-11T00:01:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:06 smithi052 ceph-mon[33526]: pgmap v566: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 306 op/s 2024-09-11T00:01:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:06 smithi033 ceph-mon[30593]: pgmap v566: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 306 op/s 2024-09-11T00:01:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:08 smithi189 ceph-mon[34000]: pgmap v567: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 255 op/s 2024-09-11T00:01:08.650 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:08 smithi033 ceph-mon[30593]: pgmap v567: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 255 op/s 2024-09-11T00:01:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:08 smithi052 ceph-mon[33526]: pgmap v567: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 255 op/s 2024-09-11T00:01:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:10 smithi189 ceph-mon[34000]: pgmap v568: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 659 KiB/s wr, 89 op/s 2024-09-11T00:01:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:10 smithi052 ceph-mon[33526]: pgmap v568: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 659 KiB/s wr, 89 op/s 2024-09-11T00:01:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:10 smithi033 ceph-mon[30593]: pgmap v568: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 659 KiB/s wr, 89 op/s 2024-09-11T00:01:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:01:11.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:11.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:11.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:01:11.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:11.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:11.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:01:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:01:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:01:11.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:01:12.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:12 smithi052 ceph-mon[33526]: pgmap v569: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 276 KiB/s wr, 43 op/s 2024-09-11T00:01:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:12 smithi033 ceph-mon[30593]: pgmap v569: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 276 KiB/s wr, 43 op/s 2024-09-11T00:01:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:12 smithi189 ceph-mon[34000]: pgmap v569: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 276 KiB/s wr, 43 op/s 2024-09-11T00:01:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 85.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.917+0000 7fb729200640 1 -- 172.21.15.33:0/3223567981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724079530 msgr2=0x7fb724079e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.917+0000 7fb729200640 1 --2- 172.21.15.33:0/3223567981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724079530 0x7fb724079e80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009ca0 tx=0x7fb71c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 -- 172.21.15.33:0/3223567981 shutdown_connections 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 --2- 172.21.15.33:0/3223567981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724079530 0x7fb724079e80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 --2- 172.21.15.33:0/3223567981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724078b70 0x7fb724078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 --2- 172.21.15.33:0/3223567981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724077a20 0x7fb724077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 -- 172.21.15.33:0/3223567981 >> 172.21.15.33:0/3223567981 conn(0x7fb724100470 msgr2=0x7fb724102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 -- 172.21.15.33:0/3223567981 shutdown_connections 2024-09-11T00:01:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.918+0000 7fb729200640 1 -- 172.21.15.33:0/3223567981 wait complete. 2024-09-11T00:01:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 Processor -- start 2024-09-11T00:01:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 -- start start 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724077a20 0x7fb72419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724079530 0x7fb7241a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb724114b30 con 0x7fb724078b70 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241149b0 con 0x7fb724079530 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb729200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb724114cb0 con 0x7fb724077a20 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.919+0000 7fb719400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55746/0 (socket says 172.21.15.33:55746) 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 -- 172.21.15.33:0/1362109760 learned_addr learned my addr 172.21.15.33:0/1362109760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb721e00640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724077a20 0x7fb72419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb722800640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724079530 0x7fb7241a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 -- 172.21.15.33:0/1362109760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724077a20 msgr2=0x7fb72419f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724077a20 0x7fb72419f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 -- 172.21.15.33:0/1362109760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724079530 msgr2=0x7fb7241a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724079530 0x7fb7241a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 -- 172.21.15.33:0/1362109760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7241a0d80 con 0x7fb724078b70 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.920+0000 7fb719400640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9f0 tx=0x7fb70c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.921+0000 7fb71b400640 1 -- 172.21.15.33:0/1362109760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00cd80 con 0x7fb724078b70 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.921+0000 7fb71b400640 1 -- 172.21.15.33:0/1362109760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb70c0054b0 con 0x7fb724078b70 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.921+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7241a1070 con 0x7fb724078b70 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.921+0000 7fb71b400640 1 -- 172.21.15.33:0/1362109760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c018430 con 0x7fb724078b70 2024-09-11T00:01:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.921+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7241a7740 con 0x7fb724078b70 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 Processor -- start 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 -- start start 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb71b400640 1 -- 172.21.15.33:0/1362109760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb70c004fe0 con 0x7fb724078b70 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 0x559dd48104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd4812fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559dd477e6b0 con 0x559dd4810b00 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559dd476dae0 con 0x559dd480e0c0 2024-09-11T00:01:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.924+0000 7fb72c06c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559dd47718f0 con 0x559dd480b790 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb719400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd4812fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb721e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 0x559dd48104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50204/0 (socket says 172.21.15.33:50204) 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 -- 172.21.15.33:0/2001171326 learned_addr learned my addr 172.21.15.33:0/2001171326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb721e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 0x559dd48104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37466/0 (socket says 172.21.15.33:37466) 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 -- 172.21.15.33:0/2001171326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 msgr2=0x559dd48104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 0x559dd48104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 -- 172.21.15.33:0/2001171326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 msgr2=0x559dd4812fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd4812fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 -- 172.21.15.33:0/2001171326 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd473a780 con 0x559dd480b790 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.925+0000 7fb722800640 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ade0 tx=0x7fb71c005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a46d28fd638a05fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb71b400640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 0x7fb7080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb713400640 1 -- 172.21.15.33:0/2001171326 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c031a80 con 0x559dd480b790 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb713400640 1 -- 172.21.15.33:0/2001171326 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb71c036030 con 0x559dd480b790 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb713400640 1 -- 172.21.15.33:0/2001171326 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004500 con 0x559dd480b790 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb71b400640 1 -- 172.21.15.33:0/1362109760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb70c0e64f0 con 0x7fb724078b70 2024-09-11T00:01:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.926+0000 7fb721e00640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 0x7fb7080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 -- 172.21.15.33:0/2001171326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 msgr2=0x559dd480db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ade0 tx=0x7fb71c005fa0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb721e00640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 0x7fb7080b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb714004610 tx=0x7fb71400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 -- 172.21.15.33:0/2001171326 shutdown_connections 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd4812fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480e0c0 0x559dd48104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 --2- 172.21.15.33:0/2001171326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd480db80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 -- 172.21.15.33:0/2001171326 >> 172.21.15.33:0/2001171326 conn(0x559dd48068e0 msgr2=0x559dd4807670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 -- 172.21.15.33:0/2001171326 shutdown_connections 2024-09-11T00:01:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.927+0000 7fb72c06c740 1 -- 172.21.15.33:0/2001171326 wait complete. 2024-09-11T00:01:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 -- start start 2024-09-11T00:01:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 Processor -- start 2024-09-11T00:01:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd4814ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4815f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559dd46a5ab0 con 0x559dd480e0c0 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559dd4714570 con 0x559dd4810b00 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559dd4813900 con 0x559dd480b790 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.928+0000 7fb72c06c740 10 client.0 _ll_register_callbacks cb 0x559dd4723100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55758/0 (socket says 172.21.15.33:55758) 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb721e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd4814ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 -- 172.21.15.33:0/607471390 learned_addr learned my addr 172.21.15.33:0/607471390 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb722800640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4815f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 -- 172.21.15.33:0/607471390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 msgr2=0x559dd4814ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd4814ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 -- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 msgr2=0x559dd4815f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4815f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 -- 172.21.15.33:0/607471390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd44cf790 con 0x559dd480e0c0 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb719400640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0ac840 tx=0x7fb70c005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c69c63c372d578 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.929+0000 7fb707e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0a8750 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb70c0e61a0 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb71c036030 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb70c0ac020 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb72c06c740 10 client.16029 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559dd4548620 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.930+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb71c036030 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb70c0adbe0 con 0x559dd480e0c0 2024-09-11T00:01:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 20 client.16029 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd48205e0 0x559dd48229d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 4 client.16029 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dd4780600 con 0x559dd48205e0 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.931+0000 7fb721e00640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd48205e0 0x559dd48229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.932+0000 7fb721e00640 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd48205e0 0x559dd48229d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd25e0878f15017 server_cookie=5e62c1cfd1bdf16 in_seq=0 out_seq=0 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.932+0000 7fb707e00640 10 client.16029 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.933+0000 7fb707e00640 1 -- 172.21.15.33:0/607471390 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559dd4780600 con 0x559dd48205e0 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.933+0000 7fb707e00640 10 client.16029 handle_command_reply: tid=0 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.933+0000 7fb72c06c740 1 client.16029 shutdown 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 msgr2=0x559dd4815380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0ac840 tx=0x7fb70c005b20 comp rx=0 tx=0).stop 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 shutdown_connections 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4815f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480e0c0 0x559dd4815380 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd48205e0 0x559dd48229d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 --2- 172.21.15.33:0/607471390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480b790 0x559dd4814ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb707e00640 0 client.16029 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 >> 172.21.15.33:0/607471390 conn(0x559dd48068e0 msgr2=0x559dd4805a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 shutdown_connections 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 1 -- 172.21.15.33:0/607471390 wait complete. 2024-09-11T00:01:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.934+0000 7fb72c06c740 20 client.16029 trim_cache size 0 max 16384 2024-09-11T00:01:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 Processor -- start 2024-09-11T00:01:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 -- start start 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd4810ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4811420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241b42e0 con 0x559dd480b790 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241b1b80 con 0x559dd4810b00 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb72c06c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241af9d0 con 0x559dd480e0c0 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb721e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb721e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55766/0 (socket says 172.21.15.33:55766) 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.951+0000 7fb721e00640 1 -- 172.21.15.33:0/3408460438 learned_addr learned my addr 172.21.15.33:0/3408460438 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb722800640 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4811420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 -- 172.21.15.33:0/3408460438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 msgr2=0x559dd4810ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd4810ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 -- 172.21.15.33:0/3408460438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 msgr2=0x559dd4811420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4811420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 -- 172.21.15.33:0/3408460438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd4810820 con 0x559dd480b790 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb722800640 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4811420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb721e00640 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb7140043f0 tx=0x7fb714019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1484343b951bf0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb712a00640 1 -- 172.21.15.33:0/3408460438 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71401ea70 con 0x559dd480b790 2024-09-11T00:01:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb712a00640 1 -- 172.21.15.33:0/3408460438 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb71401ec10 con 0x559dd480b790 2024-09-11T00:01:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.952+0000 7fb712a00640 1 -- 172.21.15.33:0/3408460438 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140316b0 con 0x559dd480b790 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 -- 172.21.15.33:0/3408460438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 msgr2=0x559dd4801960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb7140043f0 tx=0x7fb714019000 comp rx=0 tx=0).stop 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 -- 172.21.15.33:0/3408460438 shutdown_connections 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd4810b00 0x559dd4811420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd4810ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 --2- 172.21.15.33:0/3408460438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd480b790 0x559dd4801960 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 -- 172.21.15.33:0/3408460438 >> 172.21.15.33:0/3408460438 conn(0x559dd48068e0 msgr2=0x559dd480ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 -- 172.21.15.33:0/3408460438 shutdown_connections 2024-09-11T00:01:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.953+0000 7fb72c06c740 1 -- 172.21.15.33:0/3408460438 wait complete. 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 -- start start 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 Processor -- start 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480b790 0x559dd481bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd481c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241b0040 con 0x559dd4810b00 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241b14b0 con 0x559dd480b790 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7241b0710 con 0x559dd480e0c0 2024-09-11T00:01:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb72c06c740 10 client.0 _ll_register_callbacks cb 0x7fb70c0e9c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.954+0000 7fb722800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb721e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480b790 0x559dd481bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55770/0 (socket says 172.21.15.33:55770) 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 -- 172.21.15.33:0/380530054 learned_addr learned my addr 172.21.15.33:0/380530054 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb719400640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd481c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 -- 172.21.15.33:0/380530054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 msgr2=0x559dd481c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd481c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 -- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480b790 msgr2=0x559dd481bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480b790 0x559dd481bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 -- 172.21.15.33:0/380530054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd481adb0 con 0x559dd4810b00 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb719400640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd481c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb722800640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ade0 tx=0x7fb71c031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4447a7506a2cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb707e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.955+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c04a040 con 0x559dd4810b00 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb71401ec10 con 0x559dd4810b00 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb71c003b70 con 0x559dd4810b00 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb71c031e20 con 0x559dd4810b00 2024-09-11T00:01:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 10 client.16035 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559dd488dd80 con 0x559dd4810b00 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb71401ec10 con 0x559dd4810b00 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb71c04d030 con 0x559dd4810b00 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 10 client.16035 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 20 client.16035 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd488e550 0x559dd4890970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 4 client.16035 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:01:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.956+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559dd477c0b0 con 0x559dd488e550 2024-09-11T00:01:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.957+0000 7fb721e00640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd488e550 0x559dd4890970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.957+0000 7fb721e00640 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd488e550 0x559dd4890970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63dbff48717066c server_cookie=c34acf1bbb9e4942 in_seq=0 out_seq=0 2024-09-11T00:01:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.957+0000 7fb707e00640 10 client.16035 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.971+0000 7fb707e00640 1 -- 172.21.15.33:0/380530054 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559dd477c0b0 con 0x559dd488e550 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.971+0000 7fb707e00640 10 client.16035 handle_command_reply: tid=0 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.971+0000 7fb72c06c740 1 client.16035 shutdown 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 msgr2=0x559dd481a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ade0 tx=0x7fb71c031cb0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 shutdown_connections 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dd4810b00 0x559dd481a820 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dd488e550 0x559dd4890970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dd480e0c0 0x559dd481c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 --2- 172.21.15.33:0/380530054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dd480b790 0x559dd481bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 >> 172.21.15.33:0/380530054 conn(0x559dd48068e0 msgr2=0x559dd480a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb707e00640 0 client.16035 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 shutdown_connections 2024-09-11T00:01:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 1 -- 172.21.15.33:0/380530054 wait complete. 2024-09-11T00:01:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.972+0000 7fb72c06c740 20 client.16035 trim_cache size 0 max 16384 2024-09-11T00:01:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:01:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:01:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:01:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:01:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 msgr2=0x7fb7080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 0x7fb7080b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb714004610 tx=0x7fb71400b390 comp rx=0 tx=0).stop 2024-09-11T00:01:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 msgr2=0x7fb72419f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9f0 tx=0x7fb70c00edf0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 shutdown_connections 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb7080b52e0 0x7fb7080b77a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb724079530 0x7fb7241a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb724078b70 0x7fb72419f890 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 --2- 172.21.15.33:0/1362109760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb724077a20 0x7fb72419f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 >> 172.21.15.33:0/1362109760 conn(0x7fb724100470 msgr2=0x7fb724101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 shutdown_connections 2024-09-11T00:01:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:13.973+0000 7fb729200640 1 -- 172.21.15.33:0/1362109760 wait complete. 2024-09-11T00:01:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:14 smithi052 ceph-mon[33526]: pgmap v570: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 KiB/s wr, 36 op/s 2024-09-11T00:01:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:14 smithi033 ceph-mon[30593]: pgmap v570: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 KiB/s wr, 36 op/s 2024-09-11T00:01:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:14 smithi189 ceph-mon[34000]: pgmap v570: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 KiB/s wr, 36 op/s 2024-09-11T00:01:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:16 smithi052 ceph-mon[33526]: pgmap v571: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:01:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:16 smithi033 ceph-mon[30593]: pgmap v571: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:01:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:16 smithi189 ceph-mon[34000]: pgmap v571: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:01:18.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 90.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:18 smithi052 ceph-mon[33526]: pgmap v572: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 217 KiB/s wr, 36 op/s 2024-09-11T00:01:18.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:18 smithi033 ceph-mon[30593]: pgmap v572: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 217 KiB/s wr, 36 op/s 2024-09-11T00:01:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:18 smithi189 ceph-mon[34000]: pgmap v572: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 217 KiB/s wr, 36 op/s 2024-09-11T00:01:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:20 smithi052 ceph-mon[33526]: pgmap v573: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 215 KiB/s wr, 33 op/s 2024-09-11T00:01:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:20 smithi033 ceph-mon[30593]: pgmap v573: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 215 KiB/s wr, 33 op/s 2024-09-11T00:01:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:20 smithi189 ceph-mon[34000]: pgmap v573: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 215 KiB/s wr, 33 op/s 2024-09-11T00:01:21.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:21.475 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 -- 172.21.15.33:0/2399656482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f8108060 msgr2=0x7f51f810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 --2- 172.21.15.33:0/2399656482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f8108060 0x7f51f810e860 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009ca0 tx=0x7f51f002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 -- 172.21.15.33:0/2399656482 shutdown_connections 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 --2- 172.21.15.33:0/2399656482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f8108060 0x7f51f810e860 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 --2- 172.21.15.33:0/2399656482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f81076e0 0x7f51f8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 --2- 172.21.15.33:0/2399656482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8101cd0 0x7f51f81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 -- 172.21.15.33:0/2399656482 >> 172.21.15.33:0/2399656482 conn(0x7f51f80fd720 msgr2=0x7f51f80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 -- 172.21.15.33:0/2399656482 shutdown_connections 2024-09-11T00:01:22.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.055+0000 7f51fea00640 1 -- 172.21.15.33:0/2399656482 wait complete. 2024-09-11T00:01:22.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 Processor -- start 2024-09-11T00:01:22.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 -- start start 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 0x7f51f81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8108060 0x7f51f819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8111be0 con 0x7f51f81076e0 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8111a60 con 0x7f51f8108060 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.057+0000 7f51fea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8111d60 con 0x7f51f8101cd0 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35420/0 (socket says 172.21.15.33:35420) 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 -- 172.21.15.33:0/3614122060 learned_addr learned my addr 172.21.15.33:0/3614122060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51fca00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8108060 0x7f51f819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7e00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 0x7f51f81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 -- 172.21.15.33:0/3614122060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 msgr2=0x7f51f81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 0x7f51f81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 -- 172.21.15.33:0/3614122060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8108060 msgr2=0x7f51f819ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8108060 0x7f51f819ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 -- 172.21.15.33:0/3614122060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f819f260 con 0x7f51f81076e0 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7e00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 0x7f51f81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.058+0000 7f51f7400640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d770 tx=0x7f51e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.059+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4017070 con 0x7f51f81076e0 2024-09-11T00:01:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.059+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51e40054b0 con 0x7f51f81076e0 2024-09-11T00:01:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.059+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4004c60 con 0x7f51f81076e0 2024-09-11T00:01:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.059+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f819f550 con 0x7f51f81076e0 2024-09-11T00:01:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.059+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81a5c10 con 0x7f51f81076e0 2024-09-11T00:01:22.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.060+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f81020b0 con 0x7f51f81076e0 2024-09-11T00:01:22.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.063+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f51e4004e00 con 0x7f51f81076e0 2024-09-11T00:01:22.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.064+0000 7f51f4c00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 0x7f51dc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.065+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f51e40e5a40 con 0x7f51f81076e0 2024-09-11T00:01:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.065+0000 7f51f7e00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 0x7f51dc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.065+0000 7f51f7e00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 0x7f51dc0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f51e80058c0 tx=0x7f51e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:22.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.068+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51e40ac500 con 0x7f51f81076e0 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.303+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51f802e5c0 con 0x7f51f81076e0 2024-09-11T00:01:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.304+0000 7f51f4c00640 1 -- 172.21.15.33:0/3614122060 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11912 (secure 0 0 0) 0x7f51e40abe00 con 0x7f51f81076e0 2024-09-11T00:01:22.306 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:01:22.306 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-09-10T23:59:53:088652+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:59:52.844016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:01:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-09-11T00:01:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 msgr2=0x7f51dc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 0x7f51dc0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f51e80058c0 tx=0x7f51e8005850 comp rx=0 tx=0).stop 2024-09-11T00:01:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 msgr2=0x7f51f81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d770 tx=0x7f51e400dc30 comp rx=0 tx=0).stop 2024-09-11T00:01:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 shutdown_connections 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51dc0b52e0 0x7f51dc0b77a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f8108060 0x7f51f819ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51f81076e0 0x7f51f81996f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 --2- 172.21.15.33:0/3614122060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51f8101cd0 0x7f51f81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 >> 172.21.15.33:0/3614122060 conn(0x7f51f80fd720 msgr2=0x7f51f806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 shutdown_connections 2024-09-11T00:01:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:22.307+0000 7f51fea00640 1 -- 172.21.15.33:0/3614122060 wait complete. 2024-09-11T00:01:22.695 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:22 smithi033 ceph-mon[30593]: pgmap v574: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 210 KiB/s wr, 34 op/s 2024-09-11T00:01:22.695 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:22 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3614122060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:22 smithi052 ceph-mon[33526]: pgmap v574: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 210 KiB/s wr, 34 op/s 2024-09-11T00:01:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:22 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3614122060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:22 smithi189 ceph-mon[34000]: pgmap v574: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 210 KiB/s wr, 34 op/s 2024-09-11T00:01:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:22 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3614122060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:23.329 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 95.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:23.508 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id e4ad3766 --release --await' 2024-09-11T00:01:23.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id e4ad3766 --release --await 2024-09-11T00:01:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.504+0000 7f1d25a00640 1 -- 172.21.15.33:0/2947835400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20102c10 msgr2=0x7f1d20102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.504+0000 7f1d25a00640 1 --2- 172.21.15.33:0/2947835400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20102c10 0x7f1d20102ff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009900 tx=0x7f1d1002a410 comp rx=0 tx=0).stop 2024-09-11T00:01:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 -- 172.21.15.33:0/2947835400 shutdown_connections 2024-09-11T00:01:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 --2- 172.21.15.33:0/2947835400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20108fa0 0x7f1d2010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 --2- 172.21.15.33:0/2947835400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108620 0x7f1d20108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 --2- 172.21.15.33:0/2947835400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20102c10 0x7f1d20102ff0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 -- 172.21.15.33:0/2947835400 >> 172.21.15.33:0/2947835400 conn(0x7f1d200fe660 msgr2=0x7f1d20100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 -- 172.21.15.33:0/2947835400 shutdown_connections 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.505+0000 7f1d25a00640 1 -- 172.21.15.33:0/2947835400 wait complete. 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.506+0000 7f1d25a00640 1 Processor -- start 2024-09-11T00:01:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.506+0000 7f1d25a00640 1 -- start start 2024-09-11T00:01:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20102c10 0x7f1d200754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108fa0 0x7f1d20075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1d20112b60 con 0x7f1d20108620 2024-09-11T00:01:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201129e0 con 0x7f1d20108fa0 2024-09-11T00:01:24.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d20112ce0 con 0x7f1d20102c10 2024-09-11T00:01:24.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d17400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d17400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35438/0 (socket says 172.21.15.33:35438) 2024-09-11T00:01:24.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d17400640 1 -- 172.21.15.33:0/1848650177 learned_addr learned my addr 172.21.15.33:0/1848650177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20102c10 0x7f1d200754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.507+0000 7f1d25000640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108fa0 0x7f1d20075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 -- 172.21.15.33:0/1848650177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20102c10 msgr2=0x7f1d200754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20102c10 0x7f1d200754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 -- 172.21.15.33:0/1848650177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108fa0 msgr2=0x7f1d20075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108fa0 0x7f1d20075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 -- 172.21.15.33:0/1848650177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d201a7390 con 0x7f1d20108620 2024-09-11T00:01:24.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d17400640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800e9f0 tx=0x7f1d0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d1d600640 1 -- 172.21.15.33:0/1848650177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800cd80 con 0x7f1d20108620 2024-09-11T00:01:24.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.508+0000 7f1d1d600640 1 -- 172.21.15.33:0/1848650177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d080108c0 con 0x7f1d20108620 2024-09-11T00:01:24.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.509+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d201a7680 con 0x7f1d20108620 2024-09-11T00:01:24.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.509+0000 7f1d1d600640 1 -- 172.21.15.33:0/1848650177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d080187c0 con 0x7f1d20108620 2024-09-11T00:01:24.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.509+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d201a7c10 con 0x7f1d20108620 2024-09-11T00:01:24.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.512+0000 7f1d29a7d740 1 Processor -- start 2024-09-11T00:01:24.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.512+0000 7f1d29a7d740 1 -- start start 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ffaf0 0x55bad830b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad830ba80 0x55bad830de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bad8276290 con 0x55bad82ff1d0 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bad82656c0 con 0x55bad82ffaf0 2024-09-11T00:01:24.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bad82694d0 con 0x55bad830ba80 2024-09-11T00:01:24.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35442/0 (socket says 172.21.15.33:35442) 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 -- 172.21.15.33:0/3883055919 learned_addr learned my addr 172.21.15.33:0/3883055919 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ffaf0 0x55bad830b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 -- 172.21.15.33:0/3883055919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad830ba80 msgr2=0x55bad830de70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad830ba80 0x55bad830de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 -- 172.21.15.33:0/3883055919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ffaf0 msgr2=0x55bad830b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ffaf0 0x55bad830b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.513+0000 7f1d25000640 1 -- 172.21.15.33:0/3883055919 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad81f2460 con 0x55bad82ff1d0 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.514+0000 7f1d25000640 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d18010370 tx=0x7f1d18010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b9399af206b5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.514+0000 7f1d1d600640 1 -- 172.21.15.33:0/1848650177 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1d08010430 con 0x7f1d20108620 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.514+0000 7f1d15600640 1 -- 172.21.15.33:0/3883055919 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18016070 con 0x55bad82ff1d0 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.514+0000 7f1d15600640 1 -- 172.21.15.33:0/3883055919 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d18012ba0 con 0x55bad82ff1d0 2024-09-11T00:01:24.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.514+0000 7f1d15600640 1 -- 172.21.15.33:0/3883055919 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18011ad0 con 0x55bad82ff1d0 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3883055919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 msgr2=0x55bad82ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1d18010370 tx=0x7f1d18010830 comp rx=0 tx=0).stop 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3883055919 shutdown_connections 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad830ba80 0x55bad830de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ffaf0 0x55bad830b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3883055919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad82ff5b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3883055919 >> 172.21.15.33:0/3883055919 conn(0x55bad82fd000 msgr2=0x55bad82fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.515+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3883055919 shutdown_connections 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3883055919 wait complete. 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d1d600640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 0x7f1d040b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d29a7d740 1 -- start start 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d1d600640 1 -- 172.21.15.33:0/1848650177 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1d080e62b0 con 0x7f1d20108620 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d25000640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 0x7f1d040b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.516+0000 7f1d29a7d740 1 Processor -- start 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad8308ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8309530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bad80c6bb0 con 0x55bad82ff1d0 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bad82006c0 con 0x55bad830ba80 2024-09-11T00:01:24.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bad830e730 con 0x55bad82ffaf0 2024-09-11T00:01:24.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d29a7d740 10 client.0 _ll_register_callbacks cb 0x55bad821b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d25000640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 0x7f1d040b77e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009d90 tx=0x7f1d18000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d1fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d1fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35448/0 (socket says 172.21.15.33:35448) 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d1fe00640 1 -- 172.21.15.33:0/3631595379 learned_addr learned my addr 172.21.15.33:0/3631595379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d17400640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad8308ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.517+0000 7f1d25000640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8309530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 -- 172.21.15.33:0/3631595379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 msgr2=0x55bad8308ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad8308ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 -- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 msgr2=0x55bad8309530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8309530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 -- 172.21.15.33:0/3631595379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad7fc3b00 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009900 tx=0x7f1d100043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eda4ff802085d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d0e000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.518+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10035040 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1d10005460 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d18012ba0 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d1004d050 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d29a7d740 10 client.16053 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bad803a960 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d18012ba0 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d10003880 con 0x55bad82ff1d0 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d29a7d740 10 client.16053 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.519+0000 7f1d29a7d740 10 client.16053 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:24.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.520+0000 7f1d29a7d740 20 client.16053 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.520+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad831b6c0 0x55bad831dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.520+0000 7f1d29a7d740 4 client.16053 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.520+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bad82781e0 con 0x55bad831b6c0 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.520+0000 7f1d17400640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad831b6c0 0x55bad831dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.521+0000 7f1d17400640 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad831b6c0 0x55bad831dab0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b0a45ba12aface server_cookie=615f408ee39340d0 in_seq=0 out_seq=0 2024-09-11T00:01:24.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.521+0000 7f1d0e000640 10 client.16053 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.521+0000 7f1d0e000640 1 -- 172.21.15.33:0/3631595379 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1d080b5e50 con 0x55bad831b6c0 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.521+0000 7f1d0e000640 10 client.16053 handle_command_reply: tid=0 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 client.16053 shutdown 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 msgr2=0x55bad8308ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009900 tx=0x7f1d100043b0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 shutdown_connections 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8309530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad831b6c0 0x55bad831dab0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad8308ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/3631595379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ff1d0 0x55bad8308ab0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d0e000640 0 client.16053 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 >> 172.21.15.33:0/3631595379 conn(0x55bad82fd000 msgr2=0x55bad8302b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 shutdown_connections 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 1 -- 172.21.15.33:0/3631595379 wait complete. 2024-09-11T00:01:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.522+0000 7f1d29a7d740 20 client.16053 trim_cache size 0 max 16384 2024-09-11T00:01:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.541+0000 7f1d29a7d740 1 Processor -- start 2024-09-11T00:01:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.541+0000 7f1d29a7d740 1 -- start start 2024-09-11T00:01:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.541+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ff1d0 0x55bad8303240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.541+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.541+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8305ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201b43a0 con 0x55bad82ffaf0 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201b1c40 con 0x55bad830ba80 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201afa90 con 0x55bad82ff1d0 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35462/0 (socket says 172.21.15.33:35462) 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 -- 172.21.15.33:0/1831404765 learned_addr learned my addr 172.21.15.33:0/1831404765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ff1d0 0x55bad8303240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d25000640 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8305ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 -- 172.21.15.33:0/1831404765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ff1d0 msgr2=0x55bad8303240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ff1d0 0x55bad8303240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 -- 172.21.15.33:0/1831404765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 msgr2=0x55bad8305ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8305ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.542+0000 7f1d17400640 1 -- 172.21.15.33:0/1831404765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad82fda80 con 0x55bad82ffaf0 2024-09-11T00:01:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.543+0000 7f1d17400640 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800e9c0 tx=0x7f1d080e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a7cb5c0b913268 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.543+0000 7f1d14c00640 1 -- 172.21.15.33:0/1831404765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d080ac720 con 0x55bad82ffaf0 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.543+0000 7f1d14c00640 1 -- 172.21.15.33:0/1831404765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bad82781e0 con 0x55bad82ffaf0 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.543+0000 7f1d14c00640 1 -- 172.21.15.33:0/1831404765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d080a8070 con 0x55bad82ffaf0 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 -- 172.21.15.33:0/1831404765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 msgr2=0x55bad8307a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800e9c0 tx=0x7f1d080e5040 comp rx=0 tx=0).stop 2024-09-11T00:01:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 -- 172.21.15.33:0/1831404765 shutdown_connections 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad830ba80 0x55bad8305ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad82ffaf0 0x55bad8307a60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/1831404765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ff1d0 0x55bad8303240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 -- 172.21.15.33:0/1831404765 >> 172.21.15.33:0/1831404765 conn(0x55bad82fd000 msgr2=0x55bad8307350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 -- 172.21.15.33:0/1831404765 shutdown_connections 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.544+0000 7f1d29a7d740 1 -- 172.21.15.33:0/1831404765 wait complete. 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 -- start start 2024-09-11T00:01:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 Processor -- start 2024-09-11T00:01:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ff1d0 0x55bad83140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad830ba80 0x55bad8310ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201b0100 con 0x55bad830ba80 2024-09-11T00:01:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201b1570 con 0x55bad82ff1d0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d201b07d0 con 0x55bad82ffaf0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.545+0000 7f1d29a7d740 10 client.0 _ll_register_callbacks cb 0x7f1d10009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d25000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad830ba80 0x55bad8310ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:57918/0 (socket says 172.21.15.33:57918) 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 -- 172.21.15.33:0/2665079646 learned_addr learned my addr 172.21.15.33:0/2665079646 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ff1d0 0x55bad83140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 -- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ff1d0 msgr2=0x55bad83140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ff1d0 0x55bad83140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 -- 172.21.15.33:0/2665079646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad830ba80 msgr2=0x55bad8310ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad830ba80 0x55bad8310ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.546+0000 7f1d17400640 1 -- 172.21.15.33:0/2665079646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad8311270 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d17400640 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d080a8cf0 tx=0x7f1d080b5d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b86ea075edd7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d0e000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d080ab980 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bad82781e0 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1d080abb20 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d080a8070 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d29a7d740 10 client.25780 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.547+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bad83895c0 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bad82781e0 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d080c71f0 con 0x55bad82ffaf0 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 10 client.25780 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 10 client.25780 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 20 client.25780 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad8389d40 0x55bad838c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 4 client.25780 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e4ad3766", "release": true, "await": true}] 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.548+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e4ad3766", "release": true, "await": true}) -- 0x55bad8273c90 con 0x55bad8389d40 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.549+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad8389d40 0x55bad838c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.549+0000 7f1d0e000640 10 client.25780 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.549+0000 7f1d1fe00640 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad8389d40 0x55bad838c160 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc5f6e69e92f989 server_cookie=5a5950fed24549fc in_seq=0 out_seq=0 2024-09-11T00:01:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.603+0000 7f1d0e000640 1 -- 172.21.15.33:0/2665079646 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bad8273c90 con 0x55bad8389d40 2024-09-11T00:01:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.603+0000 7f1d0e000640 10 client.25780 handle_command_reply: tid=0 2024-09-11T00:01:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.603+0000 7f1d29a7d740 1 client.25780 shutdown 2024-09-11T00:01:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.603+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 msgr2=0x55bad83105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.603+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d080a8cf0 tx=0x7f1d080b5d40 comp rx=0 tx=0).stop 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 shutdown_connections 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bad830ba80 0x55bad8310ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bad8389d40 0x55bad838c160 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bad82ffaf0 0x55bad83105a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 --2- 172.21.15.33:0/2665079646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bad82ff1d0 0x55bad83140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 >> 172.21.15.33:0/2665079646 conn(0x55bad82fd000 msgr2=0x55bad82fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.604+0000 7f1d0e000640 0 client.25780 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.605+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 shutdown_connections 2024-09-11T00:01:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.606+0000 7f1d29a7d740 1 -- 172.21.15.33:0/2665079646 wait complete. 2024-09-11T00:01:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.606+0000 7f1d29a7d740 20 client.25780 trim_cache size 0 max 16384 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 16, 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "e4ad3766": { 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 16, 2024-09-11T00:01:24.609 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:01:24.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.608+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 msgr2=0x7f1d040b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.608+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 0x7f1d040b77e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009d90 tx=0x7f1d18000f40 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.608+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 msgr2=0x7f1d200759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.608+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800e9f0 tx=0x7f1d0800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 shutdown_connections 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1d040b5320 0x7f1d040b77e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d20108fa0 0x7f1d20075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d20108620 0x7f1d200759e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 --2- 172.21.15.33:0/1848650177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d20102c10 0x7f1d200754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 >> 172.21.15.33:0/1848650177 conn(0x7f1d200fe660 msgr2=0x7f1d200fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:24.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.609+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 shutdown_connections 2024-09-11T00:01:24.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:24.611+0000 7f1d25a00640 1 -- 172.21.15.33:0/1848650177 wait complete. 2024-09-11T00:01:24.636 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:24 smithi033 ceph-mon[30593]: pgmap v575: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-11T00:01:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:24 smithi052 ceph-mon[33526]: pgmap v575: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-11T00:01:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:24 smithi189 ceph-mon[34000]: pgmap v575: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-11T00:01:25.667 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e4ad3766', total seconds elapsed: 34.6 2024-09-11T00:01:25.667 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T00:01:25.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:26.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:26 smithi033 ceph-mon[30593]: pgmap v576: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 202 KiB/s wr, 32 op/s 2024-09-11T00:01:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:26 smithi052 ceph-mon[33526]: pgmap v576: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 202 KiB/s wr, 32 op/s 2024-09-11T00:01:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:26 smithi189 ceph-mon[34000]: pgmap v576: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 202 KiB/s wr, 32 op/s 2024-09-11T00:01:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 -- 172.21.15.33:0/4183009719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620105ce0 msgr2=0x7f9620106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 --2- 172.21.15.33:0/4183009719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620105ce0 0x7f9620106160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9610009930 tx=0x7f961002a440 comp rx=0 tx=0).stop 2024-09-11T00:01:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 -- 172.21.15.33:0/4183009719 shutdown_connections 2024-09-11T00:01:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 --2- 172.21.15.33:0/4183009719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96201066a0 0x7f962010d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 --2- 172.21.15.33:0/4183009719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620105ce0 0x7f9620106160 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9610009930 tx=0x7f961002a440 comp rx=0 tx=0).stop 2024-09-11T00:01:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 --2- 172.21.15.33:0/4183009719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9620104b90 0x7f9620104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.213+0000 7f9625600640 1 -- 172.21.15.33:0/4183009719 >> 172.21.15.33:0/4183009719 conn(0x7f9620100470 msgr2=0x7f9620102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.214+0000 7f9625600640 1 -- 172.21.15.33:0/4183009719 shutdown_connections 2024-09-11T00:01:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.214+0000 7f9625600640 1 -- 172.21.15.33:0/4183009719 wait complete. 2024-09-11T00:01:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 Processor -- start 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 -- start start 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96201066a0 0x7f96200725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f962007b5b0 0x7f9620073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96201106e0 con 0x7f96201066a0 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9620110560 con 0x7f962007b5b0 2024-09-11T00:01:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.217+0000 7f9625600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9620110860 con 0x7f9620104b90 2024-09-11T00:01:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.218+0000 7f961e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96201066a0 0x7f96200725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.219+0000 7f961f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f962007b5b0 0x7f9620073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.219+0000 7f961ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.219+0000 7f961ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:57946/0 (socket says 172.21.15.33:57946) 2024-09-11T00:01:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.219+0000 7f961ea00640 1 -- 172.21.15.33:0/436227883 learned_addr learned my addr 172.21.15.33:0/436227883 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 -- 172.21.15.33:0/436227883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f962007b5b0 msgr2=0x7f9620073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f962007b5b0 0x7f9620073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 -- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96201066a0 msgr2=0x7f96200725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96201066a0 0x7f96200725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 -- 172.21.15.33:0/436227883 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9620073a40 con 0x7f9620104b90 2024-09-11T00:01:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f961ea00640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ea60 tx=0x7f960c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f9617400640 1 -- 172.21.15.33:0/436227883 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c00cd20 con 0x7f9620104b90 2024-09-11T00:01:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f9617400640 1 -- 172.21.15.33:0/436227883 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f960c0035f0 con 0x7f9620104b90 2024-09-11T00:01:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.220+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9620073d30 con 0x7f9620104b90 2024-09-11T00:01:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.221+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96200743d0 con 0x7f9620104b90 2024-09-11T00:01:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.221+0000 7f9617400640 1 -- 172.21.15.33:0/436227883 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c010690 con 0x7f9620104b90 2024-09-11T00:01:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.226+0000 7f962867b740 1 Processor -- start 2024-09-11T00:01:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 -- start start 2024-09-11T00:01:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a5cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b2b79c86b0 con 0x55b2b7a5ab00 2024-09-11T00:01:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b2b79b7ae0 con 0x55b2b7a55790 2024-09-11T00:01:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.227+0000 7f962867b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2b79bb8f0 con 0x55b2b7a580c0 2024-09-11T00:01:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.228+0000 7f961f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.228+0000 7f961f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51666/0 (socket says 172.21.15.33:51666) 2024-09-11T00:01:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.228+0000 7f961f400640 1 -- 172.21.15.33:0/1002388053 learned_addr learned my addr 172.21.15.33:0/1002388053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.228+0000 7f961e000640 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a5cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.229+0000 7fe9ed200640 1 -- 172.21.15.33:0/4228399442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e811c0a0 msgr2=0x7fe9e811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.229+0000 7fe9ed200640 1 --2- 172.21.15.33:0/4228399442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e811c0a0 0x7fe9e811e490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009ca0 tx=0x7fe9e002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 -- 172.21.15.33:0/4228399442 shutdown_connections 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 --2- 172.21.15.33:0/4228399442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e811c0a0 0x7fe9e811e490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 --2- 172.21.15.33:0/4228399442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e810a530 0x7fe9e810a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 --2- 172.21.15.33:0/4228399442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a150 0x7fe9e81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 -- 172.21.15.33:0/4228399442 >> 172.21.15.33:0/4228399442 conn(0x7fe9e806cb30 msgr2=0x7fe9e806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f9617400640 1 -- 172.21.15.33:0/436227883 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f960c004020 con 0x7f9620104b90 2024-09-11T00:01:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f961f400640 1 -- 172.21.15.33:0/1002388053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a580c0 msgr2=0x55b2b7a5a4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f961f400640 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f961f400640 1 -- 172.21.15.33:0/1002388053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 msgr2=0x55b2b7a5cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f961f400640 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a5cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.229+0000 7f961f400640 1 -- 172.21.15.33:0/1002388053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b7984780 con 0x55b2b7a55790 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.230+0000 7f961e000640 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a5cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.230+0000 7f961f400640 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9618009fa0 tx=0x7f96180118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0b2ed65e351603 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 -- 172.21.15.33:0/4228399442 shutdown_connections 2024-09-11T00:01:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.231+0000 7f960b400640 1 -- 172.21.15.33:0/1002388053 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618004d20 con 0x55b2b7a55790 2024-09-11T00:01:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.231+0000 7f960b400640 1 -- 172.21.15.33:0/1002388053 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9618004050 con 0x55b2b7a55790 2024-09-11T00:01:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.231+0000 7f960b400640 1 -- 172.21.15.33:0/1002388053 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618005280 con 0x55b2b7a55790 2024-09-11T00:01:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.230+0000 7fe9ed200640 1 -- 172.21.15.33:0/4228399442 wait complete. 2024-09-11T00:01:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.231+0000 7f9617400640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 0x7f96040b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f9617400640 1 -- 172.21.15.33:0/436227883 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f960c0e6230 con 0x7f9620104b90 2024-09-11T00:01:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 -- 172.21.15.33:0/1002388053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 msgr2=0x55b2b7a57b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9618009fa0 tx=0x7f96180118d0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.232+0000 7fe9ed200640 1 Processor -- start 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f961ea00640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 0x7f96040b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 -- 172.21.15.33:0/1002388053 shutdown_connections 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a5cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 --2- 172.21.15.33:0/1002388053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a57b80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 -- 172.21.15.33:0/1002388053 >> 172.21.15.33:0/1002388053 conn(0x55b2b7a508e0 msgr2=0x55b2b7a51670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 -- 172.21.15.33:0/1002388053 shutdown_connections 2024-09-11T00:01:27.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.232+0000 7fe9ed200640 1 -- start start 2024-09-11T00:01:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.232+0000 7f962867b740 1 -- 172.21.15.33:0/1002388053 wait complete. 2024-09-11T00:01:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.233+0000 7f962867b740 1 -- start start 2024-09-11T00:01:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.233+0000 7f962867b740 1 Processor -- start 2024-09-11T00:01:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.234+0000 7f962867b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a5ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.233+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a530 0x7fe9e81a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e811c0a0 0x7fe9e81ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9ed200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8121950 con 0x7fe9e810a530 2024-09-11T00:01:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9ed200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e81217d0 con 0x7fe9e811c0a0 2024-09-11T00:01:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9ed200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8121ad0 con 0x7fe9e810a150 2024-09-11T00:01:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.234+0000 7f961ea00640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 0x7f96040b78e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f960c0cdfd0 tx=0x7f960c0057e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.234+0000 7f962867b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.235+0000 7f961f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a5ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.235+0000 7f961f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a5ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51678/0 (socket says 172.21.15.33:51678) 2024-09-11T00:01:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.235+0000 7f961f400640 1 -- 172.21.15.33:0/2905613550 learned_addr learned my addr 172.21.15.33:0/2905613550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.234+0000 7fe9e7400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.235+0000 7fe9e7400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:57976/0 (socket says 172.21.15.33:57976) 2024-09-11T00:01:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.235+0000 7fe9e7400640 1 -- 172.21.15.33:0/923525715 learned_addr learned my addr 172.21.15.33:0/923525715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.235+0000 7fe9e7e00640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e811c0a0 0x7fe9e81ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.235+0000 7fe9e6a00640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a530 0x7fe9e81a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.235+0000 7f961e000640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.236+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.236+0000 7fe9e7400640 1 -- 172.21.15.33:0/923525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e811c0a0 msgr2=0x7fe9e81ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.236+0000 7fe9e7400640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e811c0a0 0x7fe9e81ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.236+0000 7fe9e7400640 1 -- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a530 msgr2=0x7fe9e81a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.236+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b2b78efab0 con 0x55b2b7a580c0 2024-09-11T00:01:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.236+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b2b795e570 con 0x55b2b7a55790 2024-09-11T00:01:27.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.236+0000 7fe9e7400640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a530 0x7fe9e81a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.236+0000 7fe9e7400640 1 -- 172.21.15.33:0/923525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e81ade10 con 0x7fe9e810a150 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.236+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2b7a5dae0 con 0x55b2b7a5ab00 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.236+0000 7f962867b740 10 client.0 _ll_register_callbacks cb 0x55b2b796d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961f400640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961e000640 1 -- 172.21.15.33:0/2905613550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 msgr2=0x55b2b7a601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961e000640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961e000640 1 -- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 msgr2=0x55b2b7a5ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961e000640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a5ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.237+0000 7f961e000640 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b7719790 con 0x55b2b7a580c0 2024-09-11T00:01:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.238+0000 7f961e000640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5f5e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9610008000 tx=0x7f96100044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920818185aade1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.238+0000 7f95ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.237+0000 7fe9e7400640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800d950 tx=0x7fe9d800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.238+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610035040 con 0x55b2b7a580c0 2024-09-11T00:01:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.238+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8017070 con 0x7fe9e810a150 2024-09-11T00:01:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.238+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9d8009c30 con 0x7fe9e810a150 2024-09-11T00:01:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.238+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800f620 con 0x7fe9e810a150 2024-09-11T00:01:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.238+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e81ae100 con 0x7fe9e810a150 2024-09-11T00:01:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.238+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9618004050 con 0x55b2b7a580c0 2024-09-11T00:01:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.238+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e81b47c0 con 0x7fe9e810a150 2024-09-11T00:01:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.239+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9610003a00 con 0x55b2b7a580c0 2024-09-11T00:01:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.240+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f961004b050 con 0x55b2b7a580c0 2024-09-11T00:01:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.240+0000 7f962867b740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.240+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b2b7792620 con 0x55b2b7a580c0 2024-09-11T00:01:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.240+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e810a970 con 0x7fe9e810a150 2024-09-11T00:01:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9618004050 con 0x55b2b7a580c0 2024-09-11T00:01:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9610044070 con 0x55b2b7a580c0 2024-09-11T00:01:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f962867b740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f962867b740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f962867b740 20 client.16077 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.242+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7a6a850 0x55b2b7a6ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.243+0000 7f962867b740 4 client.16077 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.243+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b79ca600 con 0x55b2b7a6a850 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.243+0000 7f961f400640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7a6a850 0x55b2b7a6ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.244+0000 7f961f400640 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7a6a850 0x55b2b7a6ccc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71888035ab39274 server_cookie=a41df84846b95258 in_seq=0 out_seq=0 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.244+0000 7f95ffe00640 10 client.16077 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.246+0000 7f95ffe00640 1 -- 172.21.15.33:0/2905613550 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2b79ca600 con 0x55b2b7a6a850 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.246+0000 7f95ffe00640 10 client.16077 handle_command_reply: tid=0 2024-09-11T00:01:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.246+0000 7f962867b740 1 client.16077 shutdown 2024-09-11T00:01:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.244+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe9d8005030 con 0x7fe9e810a150 2024-09-11T00:01:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 msgr2=0x55b2b7a5f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5f5e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9610008000 tx=0x7f96100044d0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 shutdown_connections 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7a6a850 0x55b2b7a6ccc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f95ffe00640 0 client.16077 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5f5e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 --2- 172.21.15.33:0/2905613550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a55790 0x55b2b7a5ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.247+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 >> 172.21.15.33:0/2905613550 conn(0x55b2b7a508e0 msgr2=0x55b2b7a4fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.248+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 shutdown_connections 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.248+0000 7f962867b740 1 -- 172.21.15.33:0/2905613550 wait complete. 2024-09-11T00:01:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.248+0000 7f962867b740 20 client.16077 trim_cache size 0 max 16384 2024-09-11T00:01:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.248+0000 7fe9dfe00640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 0x7fe9cc0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.248+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe9d80e5b40 con 0x7fe9e810a150 2024-09-11T00:01:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.248+0000 7fe9e6a00640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 0x7fe9cc0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.249+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe9d81162e0 con 0x7fe9e810a150 2024-09-11T00:01:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.250+0000 7fe9e6a00640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 0x7fe9cc0b79a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40095f0 tx=0x7fe9d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.285+0000 7f962867b740 1 Processor -- start 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.285+0000 7f962867b740 1 -- start start 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a52710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9600012500 con 0x55b2b7a580c0 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f960000fda0 con 0x55b2b7a5ab00 2024-09-11T00:01:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f962867b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f960000dbf0 con 0x55b2b7a55790 2024-09-11T00:01:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f961f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f961f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:57986/0 (socket says 172.21.15.33:57986) 2024-09-11T00:01:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.286+0000 7f961f400640 1 -- 172.21.15.33:0/2765796716 learned_addr learned my addr 172.21.15.33:0/2765796716 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a52710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 -- 172.21.15.33:0/2765796716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a5ab00 msgr2=0x55b2b7a52710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a52710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 -- 172.21.15.33:0/2765796716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 msgr2=0x55b2b7a5b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.287+0000 7f961f400640 1 -- 172.21.15.33:0/2765796716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b7a57ef0 con 0x55b2b7a55790 2024-09-11T00:01:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.288+0000 7f961f400640 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a68bd47a3228914a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.288+0000 7f960aa00640 1 -- 172.21.15.33:0/2765796716 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618037070 con 0x55b2b7a55790 2024-09-11T00:01:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.288+0000 7f960aa00640 1 -- 172.21.15.33:0/2765796716 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f961801e040 con 0x55b2b7a55790 2024-09-11T00:01:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.288+0000 7f960aa00640 1 -- 172.21.15.33:0/2765796716 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961801d030 con 0x55b2b7a55790 2024-09-11T00:01:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.289+0000 7f962867b740 1 -- 172.21.15.33:0/2765796716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 msgr2=0x55b2b7a5aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.289+0000 7f962867b740 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618009820 comp rx=0 tx=0).stop 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.289+0000 7f962867b740 1 -- 172.21.15.33:0/2765796716 shutdown_connections 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.289+0000 7f962867b740 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a52710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.289+0000 7f962867b740 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a580c0 0x55b2b7a5b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.290+0000 7f962867b740 1 --2- 172.21.15.33:0/2765796716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a55790 0x55b2b7a5aee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.290+0000 7f962867b740 1 -- 172.21.15.33:0/2765796716 >> 172.21.15.33:0/2765796716 conn(0x55b2b7a508e0 msgr2=0x55b2b7a5ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.290+0000 7f962867b740 1 -- 172.21.15.33:0/2765796716 shutdown_connections 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.290+0000 7f962867b740 1 -- 172.21.15.33:0/2765796716 wait complete. 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.290+0000 7f962867b740 1 -- start start 2024-09-11T00:01:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 Processor -- start 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 0x55b2b7a65f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a66450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f960000e260 con 0x55b2b7a55790 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f960000f6d0 con 0x55b2b7a580c0 2024-09-11T00:01:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f960000e930 con 0x55b2b7a5ab00 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.291+0000 7f962867b740 10 client.0 _ll_register_callbacks cb 0x7f9610009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.292+0000 7f961f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.292+0000 7f961f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35548/0 (socket says 172.21.15.33:35548) 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.292+0000 7f961f400640 1 -- 172.21.15.33:0/1103839461 learned_addr learned my addr 172.21.15.33:0/1103839461 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.292+0000 7f961e000640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 0x55b2b7a65f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.292+0000 7f961f400640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a66450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 -- 172.21.15.33:0/1103839461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 msgr2=0x55b2b7a66450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a66450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 -- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 msgr2=0x55b2b7a65f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 0x55b2b7a65f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 -- 172.21.15.33:0/1103839461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b7a64610 con 0x55b2b7a55790 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961e000640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 0x55b2b7a65f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f961f400640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9618005c40 tx=0x7f9618009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179cd02391d6aea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f95ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.293+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618037050 con 0x55b2b7a55790 2024-09-11T00:01:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.294+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f961800fb10 con 0x55b2b7a55790 2024-09-11T00:01:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.294+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f961801e040 con 0x55b2b7a55790 2024-09-11T00:01:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.295+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f961801d070 con 0x55b2b7a55790 2024-09-11T00:01:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.295+0000 7f962867b740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.295+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b2b7ad7b80 con 0x55b2b7a55790 2024-09-11T00:01:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.295+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f961801e040 con 0x55b2b7a55790 2024-09-11T00:01:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.295+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9618047480 con 0x55b2b7a55790 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 20 client.16080 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7ad81b0 0x55b2b7ada5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 4 client.16080 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:01:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.296+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2b79c60b0 con 0x55b2b7ad81b0 2024-09-11T00:01:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.297+0000 7f961e000640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7ad81b0 0x55b2b7ada5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.299+0000 7f961e000640 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7ad81b0 0x55b2b7ada5d0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236ade95eccb7f57 server_cookie=fa908315e0ddf983 in_seq=0 out_seq=0 2024-09-11T00:01:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.299+0000 7f95ffe00640 10 client.16080 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.321+0000 7f95ffe00640 1 -- 172.21.15.33:0/1103839461 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2b79c60b0 con 0x55b2b7ad81b0 2024-09-11T00:01:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.321+0000 7f95ffe00640 10 client.16080 handle_command_reply: tid=0 2024-09-11T00:01:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.321+0000 7f962867b740 1 client.16080 shutdown 2024-09-11T00:01:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 msgr2=0x55b2b7a659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9618005c40 tx=0x7f9618009b10 comp rx=0 tx=0).stop 2024-09-11T00:01:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 shutdown_connections 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b2b7ad81b0 0x55b2b7ada5d0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2b7a5ab00 0x55b2b7a66450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b2b7a580c0 0x55b2b7a65f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 --2- 172.21.15.33:0/1103839461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2b7a55790 0x55b2b7a659d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 >> 172.21.15.33:0/1103839461 conn(0x55b2b7a508e0 msgr2=0x55b2b7a54880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.322+0000 7f95ffe00640 0 client.16080 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.323+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 shutdown_connections 2024-09-11T00:01:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:01:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:01:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:01:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.323+0000 7f962867b740 1 -- 172.21.15.33:0/1103839461 wait complete. 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.324+0000 7f962867b740 20 client.16080 trim_cache size 0 max 16384 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 msgr2=0x7f96040b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 0x7f96040b78e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f960c0cdfd0 tx=0x7f960c0057e0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 msgr2=0x7f9620071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ea60 tx=0x7f960c00ee60 comp rx=0 tx=0).stop 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 shutdown_connections 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96040b5420 0x7f96040b78e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f962007b5b0 0x7f9620073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96201066a0 0x7f96200725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 --2- 172.21.15.33:0/436227883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9620104b90 0x7f9620071f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.325+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 >> 172.21.15.33:0/436227883 conn(0x7f9620100470 msgr2=0x7f9620109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.326+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 shutdown_connections 2024-09-11T00:01:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:27.327+0000 7f9625600640 1 -- 172.21.15.33:0/436227883 wait complete. 2024-09-11T00:01:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.673+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e81b4ac0 con 0x7fe9e810a150 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.675+0000 7fe9dfe00640 1 -- 172.21.15.33:0/923525715 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11912 (secure 0 0 0) 0x7fe9d80ac760 con 0x7fe9e810a150 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:01:27.676 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-09-10T23:59:53:088652+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-10T23:59:52.844016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:01:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-09-11T00:01:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.679+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 msgr2=0x7fe9cc0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.679+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 0x7fe9cc0b79a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40095f0 tx=0x7fe9d4005f90 comp rx=0 tx=0).stop 2024-09-11T00:01:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.679+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 msgr2=0x7fe9e81a7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.679+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800d950 tx=0x7fe9d800de10 comp rx=0 tx=0).stop 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 shutdown_connections 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe9cc0b54e0 0x7fe9cc0b79a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e811c0a0 0x7fe9e81ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9e810a530 0x7fe9e81a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 --2- 172.21.15.33:0/923525715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe9e810a150 0x7fe9e81a7d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.680+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 >> 172.21.15.33:0/923525715 conn(0x7fe9e806cb30 msgr2=0x7fe9e811c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.681+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 shutdown_connections 2024-09-11T00:01:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:27.681+0000 7fe9ed200640 1 -- 172.21.15.33:0/923525715 wait complete. 2024-09-11T00:01:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 100.0 s, 442.8 tps, lat 1465.716 ms stddev 5961.154 2024-09-11T00:01:28.686 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:28 smithi033 ceph-mon[30593]: pgmap v577: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 581 KiB/s wr, 73 op/s 2024-09-11T00:01:28.686 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:28 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/923525715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:28.690 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T00:01:28.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T00:01:28.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:28 smithi052 ceph-mon[33526]: pgmap v577: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 581 KiB/s wr, 73 op/s 2024-09-11T00:01:28.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:28 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/923525715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:28 smithi189 ceph-mon[34000]: pgmap v577: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 581 KiB/s wr, 73 op/s 2024-09-11T00:01:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:28 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/923525715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:29.447 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 -- 172.21.15.33:0/1501674905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 msgr2=0x7fdd28115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 --2- 172.21.15.33:0/1501674905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd28115f60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009ca0 tx=0x7fdd2002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 -- 172.21.15.33:0/1501674905 shutdown_connections 2024-09-11T00:01:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 --2- 172.21.15.33:0/1501674905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd28115f60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 --2- 172.21.15.33:0/1501674905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd2810ede0 0x7fdd2810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 --2- 172.21.15.33:0/1501674905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd281093d0 0x7fdd281097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.260+0000 7fdd2e200640 1 -- 172.21.15.33:0/1501674905 >> 172.21.15.33:0/1501674905 conn(0x7fdd28078a40 msgr2=0x7fdd2807ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.261+0000 7fdd2e200640 1 -- 172.21.15.33:0/1501674905 shutdown_connections 2024-09-11T00:01:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.261+0000 7fdd2e200640 1 -- 172.21.15.33:0/1501674905 wait complete. 2024-09-11T00:01:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.262+0000 7fdd2e200640 1 Processor -- start 2024-09-11T00:01:30.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 -- start start 2024-09-11T00:01:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd2810ede0 0x7fdd2819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd281a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28119240 con 0x7fdd2810ede0 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281190c0 con 0x7fdd2810f760 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.263+0000 7fdd2e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281193c0 con 0x7fdd281093d0 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.264+0000 7fdd27400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.264+0000 7fdd27400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58028/0 (socket says 172.21.15.33:58028) 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.264+0000 7fdd27400640 1 -- 172.21.15.33:0/4077343460 learned_addr learned my addr 172.21.15.33:0/4077343460 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.264+0000 7fdd27e00640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd281a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 -- 172.21.15.33:0/4077343460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 msgr2=0x7fdd281a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd281a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 -- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd2810ede0 msgr2=0x7fdd2819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd2810ede0 0x7fdd2819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 -- 172.21.15.33:0/4077343460 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd281a5820 con 0x7fdd281093d0 2024-09-11T00:01:30.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd27400640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400d950 tx=0x7fdd1400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd1fe00640 1 -- 172.21.15.33:0/4077343460 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14017070 con 0x7fdd281093d0 2024-09-11T00:01:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd1fe00640 1 -- 172.21.15.33:0/4077343460 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd14009c30 con 0x7fdd281093d0 2024-09-11T00:01:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.265+0000 7fdd1fe00640 1 -- 172.21.15.33:0/4077343460 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400f3c0 con 0x7fdd281093d0 2024-09-11T00:01:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.266+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd281a5b10 con 0x7fdd281093d0 2024-09-11T00:01:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.266+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd281ac1d0 con 0x7fdd281093d0 2024-09-11T00:01:30.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.270+0000 7fdd30bf9740 1 Processor -- start 2024-09-11T00:01:30.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 -- start start 2024-09-11T00:01:30.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa8ec66ca0 con 0x55fa8ecf1180 2024-09-11T00:01:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fa8ec560d0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.271+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa8ec59ee0 con 0x55fa8ecfda30 2024-09-11T00:01:30.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.272+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.272+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58040/0 (socket says 172.21.15.33:58040) 2024-09-11T00:01:30.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.272+0000 7fdd26a00640 1 -- 172.21.15.33:0/3501959145 learned_addr learned my addr 172.21.15.33:0/3501959145 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:30.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.273+0000 7fdd27e00640 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.273+0000 7fdd26a00640 1 -- 172.21.15.33:0/3501959145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1aa0 msgr2=0x55fa8ecfd4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:01:30.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.274+0000 7fdd26a00640 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfd4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.274+0000 7fdd26a00640 1 -- 172.21.15.33:0/3501959145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 msgr2=0x55fa8ecf1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.274+0000 7fdd26a00640 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.274+0000 7fdd26a00640 1 -- 172.21.15.33:0/3501959145 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8ec08400 con 0x55fa8ecfda30 2024-09-11T00:01:30.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.274+0000 7fdd1fe00640 1 -- 172.21.15.33:0/4077343460 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdd1400f560 con 0x7fdd281093d0 2024-09-11T00:01:30.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.275+0000 7fdd26a00640 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800bae0 tx=0x7fdd1800d2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3b2e9a8ff6948f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.275+0000 7fdd13e00640 1 -- 172.21.15.33:0/3501959145 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18016070 con 0x55fa8ecfda30 2024-09-11T00:01:30.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.275+0000 7fdd13e00640 1 -- 172.21.15.33:0/3501959145 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd180054b0 con 0x55fa8ecfda30 2024-09-11T00:01:30.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.275+0000 7fdd13e00640 1 -- 172.21.15.33:0/3501959145 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18004e20 con 0x55fa8ecfda30 2024-09-11T00:01:30.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.276+0000 7fdd30bf9740 1 -- 172.21.15.33:0/3501959145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 msgr2=0x55fa8ecffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.276+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800bae0 tx=0x7fdd1800d2e0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.277+0000 7fdd1fe00640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 0x7fdd0c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.277+0000 7fdd1fe00640 1 -- 172.21.15.33:0/4077343460 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdd140e5b70 con 0x7fdd281093d0 2024-09-11T00:01:30.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd30bf9740 1 -- 172.21.15.33:0/3501959145 shutdown_connections 2024-09-11T00:01:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ecffe20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/3501959145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd30bf9740 1 -- 172.21.15.33:0/3501959145 >> 172.21.15.33:0/3501959145 conn(0x55fa8eceefb0 msgr2=0x55fa8ecf0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.278+0000 7fdd27e00640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 0x7fdd0c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.279+0000 7fdd30bf9740 1 -- 172.21.15.33:0/3501959145 shutdown_connections 2024-09-11T00:01:30.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.279+0000 7fdd30bf9740 1 -- 172.21.15.33:0/3501959145 wait complete. 2024-09-11T00:01:30.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.280+0000 7fdd30bf9740 1 -- start start 2024-09-11T00:01:30.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.280+0000 7fdd30bf9740 1 Processor -- start 2024-09-11T00:01:30.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.280+0000 7fdd27e00640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 0x7fdd0c0b77e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006010 tx=0x7fdd20005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.283+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.283+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.284+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ecfaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.284+0000 7fdd27400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.284+0000 7fdd27400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35594/0 (socket says 172.21.15.33:35594) 2024-09-11T00:01:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.284+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.284+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58056/0 (socket says 172.21.15.33:58056) 2024-09-11T00:01:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa8eab77a0 con 0x55fa8ecf1180 2024-09-11T00:01:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fa8ebfba10 con 0x55fa8ecfda30 2024-09-11T00:01:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd27400640 1 -- 172.21.15.33:0/9243246 learned_addr learned my addr 172.21.15.33:0/9243246 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa8ed116c0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd27e00640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ecfaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.285+0000 7fdd30bf9740 10 client.0 _ll_register_callbacks cb 0x55fa8ec0bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.286+0000 7fdd27400640 1 -- 172.21.15.33:0/9243246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 msgr2=0x55fa8ecfa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.286+0000 7fdd27400640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.286+0000 7fdd27400640 1 -- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 msgr2=0x55fa8ecfaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.286+0000 7fdd27400640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ecfaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.286+0000 7fdd27400640 1 -- 172.21.15.33:0/9243246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8e9c3b90 con 0x55fa8ecf1180 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.287+0000 7fdd27400640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdd140a8500 tx=0x7fdd140ab6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefb1e6a1529c951 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.287+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14020070 con 0x55fa8ecf1180 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd180054b0 con 0x55fa8ecf1180 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdd140971b0 con 0x55fa8ecf1180 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd14020070 con 0x55fa8ecf1180 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd30bf9740 10 client.16089 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.288+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa8ed1d120 con 0x55fa8ecf1180 2024-09-11T00:01:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.289+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd180054b0 con 0x55fa8ecf1180 2024-09-11T00:01:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.289+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd140930b0 con 0x55fa8ecf1180 2024-09-11T00:01:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.289+0000 7fdd30bf9740 10 client.16089 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.289+0000 7fdd30bf9740 10 client.16089 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.290+0000 7fdd30bf9740 20 client.16089 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.290+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed1e530 0x55fa8ed20940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.290+0000 7fdd30bf9740 4 client.16089 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.290+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa8ec68bf0 con 0x55fa8ed1e530 2024-09-11T00:01:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.290+0000 7fdd26a00640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed1e530 0x55fa8ed20940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.291+0000 7fdd26a00640 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed1e530 0x55fa8ed20940 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97b4c74b5c7cadd server_cookie=42920b997a2831c1 in_seq=0 out_seq=0 2024-09-11T00:01:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.291+0000 7fdd10c00640 10 client.16089 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.292+0000 7fdd10c00640 1 -- 172.21.15.33:0/9243246 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa8ec68bf0 con 0x55fa8ed1e530 2024-09-11T00:01:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.292+0000 7fdd10c00640 10 client.16089 handle_command_reply: tid=0 2024-09-11T00:01:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.292+0000 7fdd30bf9740 1 client.16089 shutdown 2024-09-11T00:01:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 msgr2=0x55fa8ecfd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdd140a8500 tx=0x7fdd140ab6a0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 shutdown_connections 2024-09-11T00:01:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ecfaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed1e530 0x55fa8ed20940 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecfa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/9243246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1180 0x55fa8ecfd3e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 >> 172.21.15.33:0/9243246 conn(0x55fa8eceefb0 msgr2=0x55fa8ecf4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.294+0000 7fdd10c00640 0 client.16089 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.295+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 shutdown_connections 2024-09-11T00:01:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.295+0000 7fdd30bf9740 1 -- 172.21.15.33:0/9243246 wait complete. 2024-09-11T00:01:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.295+0000 7fdd30bf9740 20 client.16089 trim_cache size 0 max 16384 2024-09-11T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 Processor -- start 2024-09-11T00:01:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 -- start start 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecf5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281b0190 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281ada30 con 0x55fa8ecfda30 2024-09-11T00:01:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.332+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28074740 con 0x55fa8ecf1180 2024-09-11T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.333+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.333+0000 7fdd27400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.333+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51748/0 (socket says 172.21.15.33:51748) 2024-09-11T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.334+0000 7fdd27e00640 1 -- 172.21.15.33:0/2809915166 learned_addr learned my addr 172.21.15.33:0/2809915166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.334+0000 7fdd27400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58072/0 (socket says 172.21.15.33:58072) 2024-09-11T00:01:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.334+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecf5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.335+0000 7fdd26a00640 1 -- 172.21.15.33:0/2809915166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 msgr2=0x55fa8ecf0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.335+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.335+0000 7fdd26a00640 1 -- 172.21.15.33:0/2809915166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 msgr2=0x55fa8ed1a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.335+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.335+0000 7fdd26a00640 1 -- 172.21.15.33:0/2809915166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa8ecf8d30 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.336+0000 7fdd27e00640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.336+0000 7fdd27400640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.337+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecf5a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdd18004a80 tx=0x7fdd18005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef365a1df5d97d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.339+0000 7fdd13400640 1 -- 172.21.15.33:0/2809915166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18016040 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.340+0000 7fdd13400640 1 -- 172.21.15.33:0/2809915166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd180057f0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.340+0000 7fdd13400640 1 -- 172.21.15.33:0/2809915166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18003850 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.342+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2809915166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 msgr2=0x55fa8ecf5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.342+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecf5a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdd18004a80 tx=0x7fdd18005e70 comp rx=0 tx=0).stop 2024-09-11T00:01:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.342+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2809915166 shutdown_connections 2024-09-11T00:01:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.343+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecfda30 0x55fa8ed1a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.343+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ecf5a40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.343+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2809915166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecf1180 0x55fa8ecf0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.343+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2809915166 >> 172.21.15.33:0/2809915166 conn(0x55fa8eceefb0 msgr2=0x55fa8ecfc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.344+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2809915166 shutdown_connections 2024-09-11T00:01:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.344+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2809915166 wait complete. 2024-09-11T00:01:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.344+0000 7fdd30bf9740 1 -- start start 2024-09-11T00:01:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.345+0000 7fdd30bf9740 1 Processor -- start 2024-09-11T00:01:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.346+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 0x55fa8ed16960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.347+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ed16ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.347+0000 7fdd30bf9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ed11910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.347+0000 7fdd27400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 0x55fa8ed16960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd27400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 0x55fa8ed16960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51762/0 (socket says 172.21.15.33:51762) 2024-09-11T00:01:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28074db0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281ad360 con 0x55fa8ecf1180 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd30bf9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281ac5e0 con 0x55fa8ecfda30 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd30bf9740 10 client.0 _ll_register_callbacks cb 0x7fdd1400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd26a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ed16ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.348+0000 7fdd27e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ed11910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.349+0000 7fdd27400640 1 -- 172.21.15.33:0/2200536192 learned_addr learned my addr 172.21.15.33:0/2200536192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:30.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.350+0000 7fdd26a00640 1 -- 172.21.15.33:0/2200536192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 msgr2=0x55fa8ed11910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.350+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ed11910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.350+0000 7fdd26a00640 1 -- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 msgr2=0x55fa8ed16960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:30.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.350+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 0x55fa8ed16960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.350+0000 7fdd26a00640 1 -- 172.21.15.33:0/2200536192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa8ed11e50 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.351+0000 7fdd26a00640 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ed16ea0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800ba30 tx=0x7fdd18004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef94569ba9366355 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:30.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.351+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:30.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.353+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18031020 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.353+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdd1800dab0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.353+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd180057f0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.354+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd18016070 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.354+0000 7fdd30bf9740 10 client.16095 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:30.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.354+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa8ed8bb00 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.355+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd180057f0 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.355+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd18010460 con 0x55fa8ecf1aa0 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 10 client.16095 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 20 client.16095 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed8c040 0x55fa8ed8e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 4 client.16095 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T00:01:30.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.356+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55fa8ec646a0 con 0x55fa8ed8c040 2024-09-11T00:01:30.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.357+0000 7fdd27400640 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed8c040 0x55fa8ed8e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:30.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.359+0000 7fdd27400640 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed8c040 0x55fa8ed8e430 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73965290d5b5cfb9 server_cookie=5eb0fef7f1a4036a in_seq=0 out_seq=0 2024-09-11T00:01:30.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.359+0000 7fdd10c00640 10 client.16095 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:30.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.693+0000 7fdd10c00640 1 -- 172.21.15.33:0/2200536192 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fa8ec646a0 con 0x55fa8ed8c040 2024-09-11T00:01:30.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.693+0000 7fdd10c00640 10 client.16095 handle_command_reply: tid=0 2024-09-11T00:01:30.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.693+0000 7fdd30bf9740 1 client.16095 shutdown 2024-09-11T00:01:30.695 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:30 smithi033 ceph-mon[30593]: pgmap v578: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 783 KiB/s wr, 94 op/s 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 msgr2=0x55fa8ed16ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ed16ea0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800ba30 tx=0x7fdd18004940 comp rx=0 tx=0).stop 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 shutdown_connections 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fa8ed8c040 0x55fa8ed8e430 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa8ecfda30 0x55fa8ed11910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8ecf1aa0 0x55fa8ed16ea0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 --2- 172.21.15.33:0/2200536192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa8ecf1180 0x55fa8ed16960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd10c00640 0 client.16095 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 >> 172.21.15.33:0/2200536192 conn(0x55fa8eceefb0 msgr2=0x55fa8ed198e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 shutdown_connections 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.694+0000 7fdd30bf9740 1 -- 172.21.15.33:0/2200536192 wait complete. 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.695+0000 7fdd30bf9740 20 client.16095 trim_cache size 0 max 16384 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 18, 2024-09-11T00:01:30.697 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "80e3e40e": { 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 18, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:01:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 msgr2=0x7fdd0c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 0x7fdd0c0b77e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006010 tx=0x7fdd20005fa0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 msgr2=0x7fdd2819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400d950 tx=0x7fdd1400de10 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 shutdown_connections 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdd0c0b5320 0x7fdd0c0b77e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd2810f760 0x7fdd281a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd2810ede0 0x7fdd2819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 --2- 172.21.15.33:0/4077343460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd281093d0 0x7fdd2819f770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 >> 172.21.15.33:0/4077343460 conn(0x7fdd28078a40 msgr2=0x7fdd2807ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 shutdown_connections 2024-09-11T00:01:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:30.696+0000 7fdd2e200640 1 -- 172.21.15.33:0/4077343460 wait complete. 2024-09-11T00:01:30.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:30 smithi052 ceph-mon[33526]: pgmap v578: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 783 KiB/s wr, 94 op/s 2024-09-11T00:01:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:30 smithi189 ceph-mon[34000]: pgmap v578: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 783 KiB/s wr, 94 op/s 2024-09-11T00:01:31.870 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '80e3e40e', quiesce took 6.2 seconds. Will release after: 23.8 2024-09-11T00:01:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:32 smithi052 ceph-mon[33526]: pgmap v579: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-09-11T00:01:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:32 smithi033 ceph-mon[30593]: pgmap v579: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-09-11T00:01:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:32 smithi189 ceph-mon[34000]: pgmap v579: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 170 op/s 2024-09-11T00:01:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 105.0 s, 194.5 tps, lat 149.914 ms stddev 56.161 2024-09-11T00:01:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:34 smithi052 ceph-mon[33526]: pgmap v580: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-11T00:01:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:34 smithi033 ceph-mon[30593]: pgmap v580: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-11T00:01:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:34 smithi189 ceph-mon[34000]: pgmap v580: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-11T00:01:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:36 smithi052 ceph-mon[33526]: pgmap v581: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 358 op/s 2024-09-11T00:01:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:36 smithi033 ceph-mon[30593]: pgmap v581: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 358 op/s 2024-09-11T00:01:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:36 smithi189 ceph-mon[34000]: pgmap v581: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 358 op/s 2024-09-11T00:01:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 110.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:38 smithi052 ceph-mon[33526]: pgmap v582: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2024-09-11T00:01:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:38 smithi033 ceph-mon[30593]: pgmap v582: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2024-09-11T00:01:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:38 smithi189 ceph-mon[34000]: pgmap v582: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.9 MiB/s wr, 360 op/s 2024-09-11T00:01:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.477+0000 7fa35e400640 1 -- 172.21.15.33:0/1976626779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 msgr2=0x7fa35810ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.477+0000 7fa35e400640 1 --2- 172.21.15.33:0/1976626779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35810ab40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa350009ca0 tx=0x7fa35002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 -- 172.21.15.33:0/1976626779 shutdown_connections 2024-09-11T00:01:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 --2- 172.21.15.33:0/1976626779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35810ab40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 --2- 172.21.15.33:0/1976626779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa358105ad0 0x7fa358107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 --2- 172.21.15.33:0/1976626779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35806bf90 0x7fa358105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 -- 172.21.15.33:0/1976626779 >> 172.21.15.33:0/1976626779 conn(0x7fa3580fd130 msgr2=0x7fa3580ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 -- 172.21.15.33:0/1976626779 shutdown_connections 2024-09-11T00:01:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.478+0000 7fa35e400640 1 -- 172.21.15.33:0/1976626779 wait complete. 2024-09-11T00:01:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 Processor -- start 2024-09-11T00:01:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 -- start start 2024-09-11T00:01:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 0x7fa35819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa358105ad0 0x7fa35819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa35810e530 con 0x7fa358108680 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa35810e3b0 con 0x7fa358105ad0 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa35e400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa35810e6b0 con 0x7fa35806bf90 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51268/0 (socket says 172.21.15.33:51268) 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa357e00640 1 -- 172.21.15.33:0/4019114236 learned_addr learned my addr 172.21.15.33:0/4019114236 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.479+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 0x7fa35819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa34ea00640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa358105ad0 0x7fa35819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 -- 172.21.15.33:0/4019114236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa358105ad0 msgr2=0x7fa35819b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa358105ad0 0x7fa35819b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 -- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 msgr2=0x7fa35819c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 -- 172.21.15.33:0/4019114236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35819c9d0 con 0x7fa35806bf90 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357e00640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.480+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 0x7fa35819af00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d6d0 tx=0x7fa34800dad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.481+0000 7fa354c00640 1 -- 172.21.15.33:0/4019114236 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348017070 con 0x7fa35806bf90 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.481+0000 7fa354c00640 1 -- 172.21.15.33:0/4019114236 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3480047a0 con 0x7fa35806bf90 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.481+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35819ccc0 con 0x7fa35806bf90 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.481+0000 7fa354c00640 1 -- 172.21.15.33:0/4019114236 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348009a40 con 0x7fa35806bf90 2024-09-11T00:01:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.481+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3581a3390 con 0x7fa35806bf90 2024-09-11T00:01:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 Processor -- start 2024-09-11T00:01:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 -- start start 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d896fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d8026b0 con 0x55bf2d88f790 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d7f1ae0 con 0x55bf2d894b00 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.484+0000 7fa3613bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d7f58f0 con 0x55bf2d8920c0 2024-09-11T00:01:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa354c00640 1 -- 172.21.15.33:0/4019114236 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa348009be0 con 0x7fa35806bf90 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51270/0 (socket says 172.21.15.33:51270) 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 -- 172.21.15.33:0/511673766 learned_addr learned my addr 172.21.15.33:0/511673766 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa34ea00640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d896fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357400640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 -- 172.21.15.33:0/511673766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 msgr2=0x55bf2d8944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8944b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 -- 172.21.15.33:0/511673766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 msgr2=0x55bf2d896fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d896fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357e00640 1 -- 172.21.15.33:0/511673766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2d7be780 con 0x55bf2d88f790 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa34ea00640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d896fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.485+0000 7fa357400640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.486+0000 7fa357e00640 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa35002aeb0 tx=0x7fa350009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bff817b974768d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.486+0000 7fa34cc00640 1 -- 172.21.15.33:0/511673766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350003970 con 0x55bf2d88f790 2024-09-11T00:01:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.486+0000 7fa34cc00640 1 -- 172.21.15.33:0/511673766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa350036030 con 0x55bf2d88f790 2024-09-11T00:01:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.486+0000 7fa34cc00640 1 -- 172.21.15.33:0/511673766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350030820 con 0x55bf2d88f790 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa354c00640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 -- 172.21.15.33:0/511673766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 msgr2=0x55bf2d891b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa35002aeb0 tx=0x7fa350009a20 comp rx=0 tx=0).stop 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa354c00640 1 -- 172.21.15.33:0/4019114236 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa3480e5790 con 0x7fa35806bf90 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 -- 172.21.15.33:0/511673766 shutdown_connections 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d896fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 --2- 172.21.15.33:0/511673766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d891b80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 -- 172.21.15.33:0/511673766 >> 172.21.15.33:0/511673766 conn(0x55bf2d88a8e0 msgr2=0x55bf2d88b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 -- 172.21.15.33:0/511673766 shutdown_connections 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.487+0000 7fa3613bb740 1 -- 172.21.15.33:0/511673766 wait complete. 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa357400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 0x7fa33c0b7820 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3480e5a30 tx=0x7fa3480046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 -- start start 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 Processor -- start 2024-09-11T00:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d899ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d729ab0 con 0x55bf2d88f790 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d798570 con 0x55bf2d894b00 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.488+0000 7fa3613bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bf2d897900 con 0x55bf2d8920c0 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa3613bb740 10 client.0 _ll_register_callbacks cb 0x55bf2d7a7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51274/0 (socket says 172.21.15.33:51274) 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 -- 172.21.15.33:0/2231556407 learned_addr learned my addr 172.21.15.33:0/2231556407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa34ea00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d899ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 -- 172.21.15.33:0/2231556407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 msgr2=0x55bf2d8992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 -- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 msgr2=0x55bf2d899ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d899ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.489+0000 7fa357e00640 1 -- 172.21.15.33:0/2231556407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2d553790 con 0x55bf2d88f790 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa357e00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa350009620 tx=0x7fa350005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea13a771b87d72e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa345600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350045850 con 0x55bf2d88f790 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa350036030 con 0x55bf2d88f790 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa3500459f0 con 0x55bf2d88f790 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa350060050 con 0x55bf2d88f790 2024-09-11T00:01:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa3613bb740 10 client.16107 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf2d5cc620 con 0x55bf2d88f790 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.490+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa350036030 con 0x55bf2d88f790 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa35005b030 con 0x55bf2d88f790 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 10 client.16107 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 20 client.16107 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d8a4120 0x55bf2d8a6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 4 client.16107 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf2d804600 con 0x55bf2d8a4120 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.491+0000 7fa34ea00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d8a4120 0x55bf2d8a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.492+0000 7fa34ea00640 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d8a4120 0x55bf2d8a6510 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=824586c63c129867 server_cookie=7b9aba0d67f0776f in_seq=0 out_seq=0 2024-09-11T00:01:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.492+0000 7fa345600640 10 client.16107 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa345600640 1 -- 172.21.15.33:0/2231556407 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf2d804600 con 0x55bf2d8a4120 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa345600640 10 client.16107 handle_command_reply: tid=0 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 client.16107 shutdown 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 msgr2=0x55bf2d898c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa350009620 tx=0x7fa350005fd0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 shutdown_connections 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d894b00 0x55bf2d899ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d8a4120 0x55bf2d8a6510 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d8992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 --2- 172.21.15.33:0/2231556407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d898c50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa345600640 0 client.16107 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 >> 172.21.15.33:0/2231556407 conn(0x55bf2d88a8e0 msgr2=0x55bf2d889a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 shutdown_connections 2024-09-11T00:01:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 1 -- 172.21.15.33:0/2231556407 wait complete. 2024-09-11T00:01:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.493+0000 7fa3613bb740 20 client.16107 trim_cache size 0 max 16384 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 Processor -- start 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 -- start start 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 0x55bf2d88dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d894b00 0x55bf2d8aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581aff70 con 0x55bf2d88f790 2024-09-11T00:01:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581ad810 con 0x55bf2d8920c0 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa3613bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581ab660 con 0x55bf2d894b00 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51282/0 (socket says 172.21.15.33:51282) 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.509+0000 7fa357e00640 1 -- 172.21.15.33:0/803145504 learned_addr learned my addr 172.21.15.33:0/803145504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa34ea00640 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 0x55bf2d88dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 -- 172.21.15.33:0/803145504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d894b00 msgr2=0x55bf2d8aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d894b00 0x55bf2d8aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 -- 172.21.15.33:0/803145504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 msgr2=0x55bf2d88dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 0x55bf2d88dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 -- 172.21.15.33:0/803145504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2d898750 con 0x55bf2d88f790 2024-09-11T00:01:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa34ea00640 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 0x55bf2d88dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa357e00640 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa350031840 tx=0x7fa350009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc57a0136841a23b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa347e00640 1 -- 172.21.15.33:0/803145504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004100 con 0x55bf2d88f790 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa347e00640 1 -- 172.21.15.33:0/803145504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa350036040 con 0x55bf2d88f790 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.510+0000 7fa347e00640 1 -- 172.21.15.33:0/803145504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350045650 con 0x55bf2d88f790 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- 172.21.15.33:0/803145504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 msgr2=0x55bf2d88d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa350031840 tx=0x7fa350009a20 comp rx=0 tx=0).stop 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- 172.21.15.33:0/803145504 shutdown_connections 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d894b00 0x55bf2d8aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d8920c0 0x55bf2d88dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 --2- 172.21.15.33:0/803145504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d88f790 0x55bf2d88d720 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- 172.21.15.33:0/803145504 >> 172.21.15.33:0/803145504 conn(0x55bf2d88a8e0 msgr2=0x55bf2d88ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- 172.21.15.33:0/803145504 shutdown_connections 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- 172.21.15.33:0/803145504 wait complete. 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.511+0000 7fa3613bb740 1 -- start start 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 Processor -- start 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d88f790 0x55bf2d8a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d89f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581abcd0 con 0x55bf2d894b00 2024-09-11T00:01:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581ad140 con 0x55bf2d88f790 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581ac3a0 con 0x55bf2d8920c0 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa3613bb740 10 client.0 _ll_register_callbacks cb 0x7fa350030a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa357e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51284/0 (socket says 172.21.15.33:51284) 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa357e00640 1 -- 172.21.15.33:0/3883083591 learned_addr learned my addr 172.21.15.33:0/3883083591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.512+0000 7fa357e00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d88f790 0x55bf2d8a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa34ea00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d89f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 -- 172.21.15.33:0/3883083591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 msgr2=0x55bf2d89f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d89f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 -- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d88f790 msgr2=0x55bf2d8a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d88f790 0x55bf2d8a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 -- 172.21.15.33:0/3883083591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2d8a6b70 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa357e00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa350009960 tx=0x7fa350004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0e387f6305f1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa345600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004100 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa3500042a0 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.513+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa350036040 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa350004b40 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 10 client.16113 fetch_fsmap learned FSMap version 28 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf2d9111b0 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa350036040 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa35005b070 con 0x55bf2d894b00 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 10 client.16113 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T00:01:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 20 client.16113 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d911b30 0x55bf2d913f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 4 client.16113 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.514+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf2d8000b0 con 0x55bf2d911b30 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.515+0000 7fa34ea00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d911b30 0x55bf2d913f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.515+0000 7fa34ea00640 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d911b30 0x55bf2d913f50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a185cc4a2a1071 server_cookie=19ffe13b7438ea05 in_seq=0 out_seq=0 2024-09-11T00:01:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.515+0000 7fa345600640 10 client.16113 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa345600640 1 -- 172.21.15.33:0/3883083591 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf2d8000b0 con 0x55bf2d911b30 2024-09-11T00:01:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa345600640 10 client.16113 handle_command_reply: tid=0 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 client.16113 shutdown 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 msgr2=0x55bf2d89ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa350009960 tx=0x7fa350004850 comp rx=0 tx=0).stop 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 shutdown_connections 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bf2d894b00 0x55bf2d89ffb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55bf2d911b30 0x55bf2d913f50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bf2d8920c0 0x55bf2d89f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 --2- 172.21.15.33:0/3883083591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf2d88f790 0x55bf2d8a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa345600640 0 client.16113 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 >> 172.21.15.33:0/3883083591 conn(0x55bf2d88a8e0 msgr2=0x55bf2d88efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 shutdown_connections 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 1 -- 172.21.15.33:0/3883083591 wait complete. 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.536+0000 7fa3613bb740 20 client.16113 trim_cache size 0 max 16384 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:01:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 msgr2=0x7fa33c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 0x7fa33c0b7820 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3480e5a30 tx=0x7fa3480046c0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 msgr2=0x7fa35819af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 0x7fa35819af00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d6d0 tx=0x7fa34800dad0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 shutdown_connections 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa33c0b5360 0x7fa33c0b7820 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa358108680 0x7fa35819c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa358105ad0 0x7fa35819b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 --2- 172.21.15.33:0/4019114236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa35806bf90 0x7fa35819af00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 >> 172.21.15.33:0/4019114236 conn(0x7fa3580fd130 msgr2=0x7fa3580ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 shutdown_connections 2024-09-11T00:01:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:40.537+0000 7fa35e400640 1 -- 172.21.15.33:0/4019114236 wait complete. 2024-09-11T00:01:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:40 smithi052 ceph-mon[33526]: pgmap v583: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 318 op/s 2024-09-11T00:01:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:40 smithi033 ceph-mon[30593]: pgmap v583: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 318 op/s 2024-09-11T00:01:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:40 smithi189 ceph-mon[34000]: pgmap v583: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 318 op/s 2024-09-11T00:01:42.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:42 smithi052 ceph-mon[33526]: pgmap v584: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-09-11T00:01:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:42 smithi033 ceph-mon[30593]: pgmap v584: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-09-11T00:01:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:42 smithi189 ceph-mon[34000]: pgmap v584: 129 pgs: 129 active+clean; 946 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-09-11T00:01:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 115.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:44 smithi052 ceph-mon[33526]: pgmap v585: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-11T00:01:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:44 smithi033 ceph-mon[30593]: pgmap v585: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-11T00:01:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:44 smithi189 ceph-mon[34000]: pgmap v585: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-11T00:01:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:46 smithi189 ceph-mon[34000]: pgmap v586: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 374 KiB/s wr, 49 op/s 2024-09-11T00:01:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:46 smithi052 ceph-mon[33526]: pgmap v586: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 374 KiB/s wr, 49 op/s 2024-09-11T00:01:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:46 smithi033 ceph-mon[30593]: pgmap v586: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 374 KiB/s wr, 49 op/s 2024-09-11T00:01:48.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 120.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:48 smithi033 ceph-mon[30593]: pgmap v587: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 245 KiB/s wr, 35 op/s 2024-09-11T00:01:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:48 smithi189 ceph-mon[34000]: pgmap v587: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 245 KiB/s wr, 35 op/s 2024-09-11T00:01:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:48 smithi052 ceph-mon[33526]: pgmap v587: 129 pgs: 129 active+clean; 946 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 245 KiB/s wr, 35 op/s 2024-09-11T00:01:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:50 smithi033 ceph-mon[30593]: pgmap v588: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 415 KiB/s wr, 32 op/s 2024-09-11T00:01:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:50 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:50 smithi189 ceph-mon[34000]: pgmap v588: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 415 KiB/s wr, 32 op/s 2024-09-11T00:01:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:50 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:50 smithi052 ceph-mon[33526]: pgmap v588: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 415 KiB/s wr, 32 op/s 2024-09-11T00:01:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:50 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:52.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:52 smithi033 ceph-mon[30593]: pgmap v589: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 434 KiB/s wr, 35 op/s 2024-09-11T00:01:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:52 smithi189 ceph-mon[34000]: pgmap v589: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 434 KiB/s wr, 35 op/s 2024-09-11T00:01:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:52 smithi052 ceph-mon[33526]: pgmap v589: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 434 KiB/s wr, 35 op/s 2024-09-11T00:01:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 125.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 -- 172.21.15.33:0/3603191485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d741066a0 msgr2=0x7f9d7410d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 --2- 172.21.15.33:0/3603191485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d741066a0 0x7f9d7410d020 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009cd0 tx=0x7f9d6c02a8e0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 -- 172.21.15.33:0/3603191485 shutdown_connections 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 --2- 172.21.15.33:0/3603191485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d741066a0 0x7f9d7410d020 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 --2- 172.21.15.33:0/3603191485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d74105ce0 0x7f9d74106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 --2- 172.21.15.33:0/3603191485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 0x7f9d74104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 -- 172.21.15.33:0/3603191485 >> 172.21.15.33:0/3603191485 conn(0x7f9d74100470 msgr2=0x7f9d74102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 -- 172.21.15.33:0/3603191485 shutdown_connections 2024-09-11T00:01:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.668+0000 7f9d79200640 1 -- 172.21.15.33:0/3603191485 wait complete. 2024-09-11T00:01:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.669+0000 7f9d79200640 1 Processor -- start 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.669+0000 7f9d79200640 1 -- start start 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 0x7f9d7419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d741066a0 0x7f9d7419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741106b0 con 0x7f9d74105ce0 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74110530 con 0x7f9d74104b90 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d79200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74110830 con 0x7f9d741066a0 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50836/0 (socket says 172.21.15.33:50836) 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 -- 172.21.15.33:0/1330893119 learned_addr learned my addr 172.21.15.33:0/1330893119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71e00640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 0x7f9d7419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 -- 172.21.15.33:0/1330893119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d741066a0 msgr2=0x7f9d7419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d741066a0 0x7f9d7419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 -- 172.21.15.33:0/1330893119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 msgr2=0x7f9d7419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 0x7f9d7419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.670+0000 7f9d71400640 1 -- 172.21.15.33:0/1330893119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7419c9a0 con 0x7f9d74105ce0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d71400640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000e9f0 tx=0x7f9d6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d6aa00640 1 -- 172.21.15.33:0/1330893119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000cd80 con 0x7f9d74105ce0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d6aa00640 1 -- 172.21.15.33:0/1330893119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d600054b0 con 0x7f9d74105ce0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7419cc90 con 0x7f9d74105ce0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d6aa00640 1 -- 172.21.15.33:0/1330893119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60010430 con 0x7f9d74105ce0 2024-09-11T00:01:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.671+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a3360 con 0x7f9d74105ce0 2024-09-11T00:01:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.674+0000 7f9d7c1c3740 1 Processor -- start 2024-09-11T00:01:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 -- start start 2024-09-11T00:01:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d24b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d29fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562a45c956b0 con 0x562a45d250c0 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562a45c84ae0 con 0x562a45d22790 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562a45c888f0 con 0x562a45d27b00 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d71e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d71e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50838/0 (socket says 172.21.15.33:50838) 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d71e00640 1 -- 172.21.15.33:0/77181296 learned_addr learned my addr 172.21.15.33:0/77181296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d6aa00640 1 -- 172.21.15.33:0/1330893119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9d60005020 con 0x7f9d74105ce0 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.675+0000 7f9d72800640 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d24b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 -- 172.21.15.33:0/77181296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 msgr2=0x562a45d29fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d29fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 -- 172.21.15.33:0/77181296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 msgr2=0x562a45d24b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d24b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 -- 172.21.15.33:0/77181296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a45c51780 con 0x562a45d250c0 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d72800640 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d24b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d71e00640 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009c80 tx=0x7f9d640117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee4663dee5b0f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d5f400640 1 -- 172.21.15.33:0/77181296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64012450 con 0x562a45d250c0 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d5f400640 1 -- 172.21.15.33:0/77181296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d64012a80 con 0x562a45d250c0 2024-09-11T00:01:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.676+0000 7f9d5f400640 1 -- 172.21.15.33:0/77181296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400fa60 con 0x562a45d250c0 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/77181296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 msgr2=0x562a45d274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009c80 tx=0x7f9d640117b0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/77181296 shutdown_connections 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d29fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d274b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/77181296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d24b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/77181296 >> 172.21.15.33:0/77181296 conn(0x562a45d1d8e0 msgr2=0x562a45d1e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.677+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/77181296 shutdown_connections 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/77181296 wait complete. 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d6aa00640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 0x7f9d580b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d6aa00640 1 -- 172.21.15.33:0/1330893119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9d600e6510 con 0x7f9d74105ce0 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d71e00640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 0x7f9d580b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d7c1c3740 1 -- start start 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.678+0000 7f9d7c1c3740 1 Processor -- start 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d2beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562a45bbcab0 con 0x562a45d250c0 2024-09-11T00:01:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562a45c2b570 con 0x562a45d22790 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562a45d2aae0 con 0x562a45d27b00 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71e00640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 0x7f9d580b76b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9d6401c040 tx=0x7f9d6400f440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d7c1c3740 10 client.0 _ll_register_callbacks cb 0x562a45c3a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50846/0 (socket says 172.21.15.33:50846) 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 -- 172.21.15.33:0/2643686235 learned_addr learned my addr 172.21.15.33:0/2643686235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d72800640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71e00640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d2beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 -- 172.21.15.33:0/2643686235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 msgr2=0x562a45d2d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d2d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.679+0000 7f9d71400640 1 -- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 msgr2=0x562a45d2beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d71400640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d2beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d71400640 1 -- 172.21.15.33:0/2643686235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a459e6790 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d71e00640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d71400640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ac860 tx=0x7f9d600a87f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f0ed7f615a3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d53e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600b1020 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9d600b59d0 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d64012a80 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d600ac040 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d7c1c3740 10 client.16125 fetch_fsmap learned FSMap version 30 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.680+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562a45a5f620 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d64012a80 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9d600a8220 con 0x562a45d250c0 2024-09-11T00:01:53.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 10 client.16125 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 20 client.16125 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45d377b0 0x562a45d39ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 4 client.16125 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.681+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a45c97600 con 0x562a45d377b0 2024-09-11T00:01:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.682+0000 7f9d71e00640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45d377b0 0x562a45d39ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.682+0000 7f9d71e00640 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45d377b0 0x562a45d39ba0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d547cf0165b30632 server_cookie=b8484d54c47ba3ca in_seq=0 out_seq=0 2024-09-11T00:01:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.682+0000 7f9d53e00640 10 client.16125 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d53e00640 1 -- 172.21.15.33:0/2643686235 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a45c97600 con 0x562a45d377b0 2024-09-11T00:01:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d53e00640 10 client.16125 handle_command_reply: tid=0 2024-09-11T00:01:53.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 client.16125 shutdown 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 msgr2=0x562a45d2c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ac860 tx=0x7f9d600a87f0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 shutdown_connections 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45d377b0 0x562a45d39ba0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d250c0 0x562a45d2c550 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/2643686235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 >> 172.21.15.33:0/2643686235 conn(0x562a45d1d8e0 msgr2=0x562a45d1ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.683+0000 7f9d53e00640 0 client.16125 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.684+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 shutdown_connections 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.684+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/2643686235 wait complete. 2024-09-11T00:01:53.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.684+0000 7f9d7c1c3740 20 client.16125 trim_cache size 0 max 16384 2024-09-11T00:01:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.699+0000 7f9d7c1c3740 1 Processor -- start 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.699+0000 7f9d7c1c3740 1 -- start start 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d284d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741b0050 con 0x562a45d1ea90 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ad920 con 0x562a45d22790 2024-09-11T00:01:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ab770 con 0x562a45d27b00 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50862/0 (socket says 172.21.15.33:50862) 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 -- 172.21.15.33:0/1720724578 learned_addr learned my addr 172.21.15.33:0/1720724578 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d71400640 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d71e00640 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 -- 172.21.15.33:0/1720724578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 msgr2=0x562a45d284d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d284d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 -- 172.21.15.33:0/1720724578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 msgr2=0x562a45d27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d27f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.700+0000 7f9d72800640 1 -- 172.21.15.33:0/1720724578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a45d2d490 con 0x562a45d1ea90 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d72800640 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c035000 tx=0x7f9d6c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dafb69edf5442d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d5ea00640 1 -- 172.21.15.33:0/1720724578 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c049070 con 0x562a45d1ea90 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d5ea00640 1 -- 172.21.15.33:0/1720724578 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d6c036040 con 0x562a45d1ea90 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d5ea00640 1 -- 172.21.15.33:0/1720724578 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0042a0 con 0x562a45d1ea90 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/1720724578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 msgr2=0x562a45d1f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.701+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c035000 tx=0x7f9d6c005f60 comp rx=0 tx=0).stop 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/1720724578 shutdown_connections 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d1f710 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d27b00 0x562a45d284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/1720724578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d22790 0x562a45d27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/1720724578 >> 172.21.15.33:0/1720724578 conn(0x562a45d1d8e0 msgr2=0x562a45d1e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/1720724578 shutdown_connections 2024-09-11T00:01:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/1720724578 wait complete. 2024-09-11T00:01:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 -- start start 2024-09-11T00:01:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.702+0000 7f9d7c1c3740 1 Processor -- start 2024-09-11T00:01:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 0x562a45d321c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d27b00 0x562a45d327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741abde0 con 0x562a45d1ea90 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ad250 con 0x562a45d27b00 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ac4b0 con 0x562a45d22790 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d7c1c3740 10 client.0 _ll_register_callbacks cb 0x7f9d6000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50872/0 (socket says 172.21.15.33:50872) 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 -- 172.21.15.33:0/3987756969 learned_addr learned my addr 172.21.15.33:0/3987756969 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d72800640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d27b00 0x562a45d327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71400640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 0x562a45d321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 -- 172.21.15.33:0/3987756969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 msgr2=0x562a45d321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 0x562a45d321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 -- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d27b00 msgr2=0x562a45d327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d27b00 0x562a45d327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71e00640 1 -- 172.21.15.33:0/3987756969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a45da4620 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.703+0000 7f9d71400640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 0x562a45d321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d71e00640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009530 tx=0x7f9d640117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f6740762d34f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d53e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6403c070 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9d64004310 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d6c036040 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d64045050 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d7c1c3740 10 client.16131 fetch_fsmap learned FSMap version 30 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562a45da57c0 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.704+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d6c036040 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9d6403f020 con 0x562a45d1ea90 2024-09-11T00:01:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 10 client.16131 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 20 client.16131 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45da5ec0 0x562a45da82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 4 client.16131 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a45c930b0 con 0x562a45da5ec0 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.705+0000 7f9d71400640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45da5ec0 0x562a45da82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.706+0000 7f9d71400640 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45da5ec0 0x562a45da82e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec8cc73e6aaa5858 server_cookie=ff1f06a51f62742b in_seq=0 out_seq=0 2024-09-11T00:01:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.706+0000 7f9d53e00640 10 client.16131 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.717+0000 7f9d53e00640 1 -- 172.21.15.33:0/3987756969 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a45c930b0 con 0x562a45da5ec0 2024-09-11T00:01:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.717+0000 7f9d53e00640 10 client.16131 handle_command_reply: tid=0 2024-09-11T00:01:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.717+0000 7f9d7c1c3740 1 client.16131 shutdown 2024-09-11T00:01:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 msgr2=0x562a45d33990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009530 tx=0x7f9d640117b0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 shutdown_connections 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a45d27b00 0x562a45d327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562a45da5ec0 0x562a45da82e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a45d22790 0x562a45d321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 --2- 172.21.15.33:0/3987756969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562a45d1ea90 0x562a45d33990 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d53e00640 0 client.16131 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 >> 172.21.15.33:0/3987756969 conn(0x562a45d1d8e0 msgr2=0x562a45d21b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 shutdown_connections 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 1 -- 172.21.15.33:0/3987756969 wait complete. 2024-09-11T00:01:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.718+0000 7f9d7c1c3740 20 client.16131 trim_cache size 0 max 16384 2024-09-11T00:01:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:01:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:01:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:01:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 msgr2=0x7f9d580b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 0x7f9d580b76b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9d6401c040 tx=0x7f9d6400f440 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 msgr2=0x7f9d7419b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000e9f0 tx=0x7f9d6000edf0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 shutdown_connections 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f9d580b51f0 0x7f9d580b76b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d741066a0 0x7f9d7419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74105ce0 0x7f9d7419b4b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 --2- 172.21.15.33:0/1330893119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d74104b90 0x7f9d7419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 >> 172.21.15.33:0/1330893119 conn(0x7f9d74100470 msgr2=0x7f9d741090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 shutdown_connections 2024-09-11T00:01:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:01:53.719+0000 7f9d79200640 1 -- 172.21.15.33:0/1330893119 wait complete. 2024-09-11T00:01:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:54 smithi033 ceph-mon[30593]: pgmap v590: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 452 KiB/s wr, 38 op/s 2024-09-11T00:01:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:54 smithi033 ceph-mon[30593]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:54 smithi189 ceph-mon[34000]: pgmap v590: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 452 KiB/s wr, 38 op/s 2024-09-11T00:01:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:54 smithi189 ceph-mon[34000]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:54 smithi052 ceph-mon[33526]: pgmap v590: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 452 KiB/s wr, 38 op/s 2024-09-11T00:01:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:54 smithi052 ceph-mon[33526]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T00:01:55.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:01:56.070 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:56.615 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:56 smithi033 ceph-mon[30593]: pgmap v591: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 323 KiB/s wr, 27 op/s 2024-09-11T00:01:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 -- 172.21.15.33:0/2544603409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010077ff0 msgr2=0x7f2010113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 --2- 172.21.15.33:0/2544603409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010077ff0 0x7f2010113450 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009900 tx=0x7f1ffc02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 -- 172.21.15.33:0/2544603409 shutdown_connections 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 --2- 172.21.15.33:0/2544603409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010113990 0x7f2010115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 --2- 172.21.15.33:0/2544603409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010077ff0 0x7f2010113450 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 --2- 172.21.15.33:0/2544603409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 0x7f2010077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 -- 172.21.15.33:0/2544603409 >> 172.21.15.33:0/2544603409 conn(0x7f2010100a50 msgr2=0x7f2010102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 -- 172.21.15.33:0/2544603409 shutdown_connections 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.735+0000 7f2015c00640 1 -- 172.21.15.33:0/2544603409 wait complete. 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.736+0000 7f2015c00640 1 Processor -- start 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.736+0000 7f2015c00640 1 -- start start 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.736+0000 7f2015c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 0x7f201019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.736+0000 7f2015c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010077ff0 0x7f201019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.736+0000 7f2015c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f2015c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2010119230 con 0x7f2010113990 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f2015c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20101190b0 con 0x7f20100776d0 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f2015c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20101193b0 con 0x7f2010077ff0 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50876/0 (socket says 172.21.15.33:50876) 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 -- 172.21.15.33:0/3015853822 learned_addr learned my addr 172.21.15.33:0/3015853822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200ea00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 0x7f201019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200e000640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010077ff0 0x7f201019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 -- 172.21.15.33:0/3015853822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010077ff0 msgr2=0x7f201019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010077ff0 0x7f201019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 -- 172.21.15.33:0/3015853822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 msgr2=0x7f201019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 0x7f201019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.737+0000 7f200f400640 1 -- 172.21.15.33:0/3015853822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20101a5850 con 0x7f2010113990 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f200f400640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f200800e9d0 tx=0x7f200800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200800cd80 con 0x7f2010113990 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20101a5b40 con 0x7f2010113990 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2008005020 con 0x7f2010113990 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20101ac3d0 con 0x7f2010113990 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.738+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200801f060 con 0x7f2010113990 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.739+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2010077ab0 con 0x7f2010113990 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.742+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f200800f040 con 0x7f2010113990 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.743+0000 7f2007400640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 0x7f1ff40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.743+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f20080e6120 con 0x7f2010113990 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.744+0000 7f200ea00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 0x7f1ff40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.744+0000 7f200ea00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 0x7f1ff40b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2000005d00 tx=0x7f200000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:56.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.749+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2008016030 con 0x7f2010113990 2024-09-11T00:01:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:56 smithi189 ceph-mon[34000]: pgmap v591: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 323 KiB/s wr, 27 op/s 2024-09-11T00:01:56.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:56 smithi052 ceph-mon[33526]: pgmap v591: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 323 KiB/s wr, 27 op/s 2024-09-11T00:01:56.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.987+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f201010eb20 con 0x7f2010113990 2024-09-11T00:01:56.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.988+0000 7f2007400640 1 -- 172.21.15.33:0/3015853822 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f20080ac590 con 0x7f2010113990 2024-09-11T00:01:56.991 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:01:56.991 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:01:56.991 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.990+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 msgr2=0x7f1ff40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.990+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 0x7f1ff40b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2000005d00 tx=0x7f200000b410 comp rx=0 tx=0).stop 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 msgr2=0x7f20101a5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f200800e9d0 tx=0x7f200800ee90 comp rx=0 tx=0).stop 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 shutdown_connections 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b52e0 0x7f1ff40b77a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2010113990 0x7f20101a5080 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2010077ff0 0x7f201019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 --2- 172.21.15.33:0/3015853822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20100776d0 0x7f201019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 >> 172.21.15.33:0/3015853822 conn(0x7f2010100a50 msgr2=0x7f2010102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:56.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 shutdown_connections 2024-09-11T00:01:56.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:56.991+0000 7f2015c00640 1 -- 172.21.15.33:0/3015853822 wait complete. 2024-09-11T00:01:57.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:57 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3015853822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:57.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:57 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3015853822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:57.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:57 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3015853822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:01:57.977 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id 80e3e40e --release --await' 2024-09-11T00:01:57.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id 80e3e40e --release --await 2024-09-11T00:01:58.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 130.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:01:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:01:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:01:58 smithi033 ceph-mon[30593]: pgmap v592: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 365 KiB/s wr, 34 op/s 2024-09-11T00:01:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:01:58 smithi189 ceph-mon[34000]: pgmap v592: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 365 KiB/s wr, 34 op/s 2024-09-11T00:01:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:01:58 smithi052 ceph-mon[33526]: pgmap v592: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 365 KiB/s wr, 34 op/s 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 -- 172.21.15.33:0/3721207493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8581137e0 msgr2=0x7fc858115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 --2- 172.21.15.33:0/3721207493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8581137e0 0x7fc858115bd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc850009ca0 tx=0x7fc85002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 -- 172.21.15.33:0/3721207493 shutdown_connections 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 --2- 172.21.15.33:0/3721207493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8581137e0 0x7fc858115bd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 --2- 172.21.15.33:0/3721207493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 0x7fc8581132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 --2- 172.21.15.33:0/3721207493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8580776d0 0x7fc858077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 -- 172.21.15.33:0/3721207493 >> 172.21.15.33:0/3721207493 conn(0x7fc858100840 msgr2=0x7fc858102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.373+0000 7fc85ec00640 1 -- 172.21.15.33:0/3721207493 shutdown_connections 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.374+0000 7fc85ec00640 1 -- 172.21.15.33:0/3721207493 wait complete. 2024-09-11T00:01:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 Processor -- start 2024-09-11T00:01:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 -- start start 2024-09-11T00:01:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 0x7fc85819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8581137e0 0x7fc8581a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581190b0 con 0x7fc8580776d0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc858118f30 con 0x7fc858077ff0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.375+0000 7fc85ec00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc858119230 con 0x7fc8581137e0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50898/0 (socket says 172.21.15.33:50898) 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 -- 172.21.15.33:0/2917996996 learned_addr learned my addr 172.21.15.33:0/2917996996 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85ce00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 0x7fc85819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85e200640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8581137e0 0x7fc8581a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 -- 172.21.15.33:0/2917996996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8581137e0 msgr2=0x7fc8581a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8581137e0 0x7fc8581a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 -- 172.21.15.33:0/2917996996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 msgr2=0x7fc85819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 0x7fc85819f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 -- 172.21.15.33:0/2917996996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581a5550 con 0x7fc8580776d0 2024-09-11T00:01:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.376+0000 7fc85d800640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00d950 tx=0x7fc84c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.377+0000 7fc856000640 1 -- 172.21.15.33:0/2917996996 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c017030 con 0x7fc8580776d0 2024-09-11T00:01:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.377+0000 7fc856000640 1 -- 172.21.15.33:0/2917996996 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc84c004020 con 0x7fc8580776d0 2024-09-11T00:01:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.377+0000 7fc856000640 1 -- 172.21.15.33:0/2917996996 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0055d0 con 0x7fc8580776d0 2024-09-11T00:01:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.377+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581a5840 con 0x7fc8580776d0 2024-09-11T00:01:59.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.377+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581abf00 con 0x7fc8580776d0 2024-09-11T00:01:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 Processor -- start 2024-09-11T00:01:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 -- start start 2024-09-11T00:01:59.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc856000640 1 -- 172.21.15.33:0/2917996996 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc84c009a30 con 0x7fc8580776d0 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6924540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 0x55d5f6926e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d5f688f290 con 0x55d5f69181d0 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5f687e6c0 con 0x55d5f6924a80 2024-09-11T00:01:59.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.380+0000 7fc862c6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5f68824d0 con 0x55d5f6918af0 2024-09-11T00:01:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50914/0 (socket says 172.21.15.33:50914) 2024-09-11T00:01:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85e200640 1 -- 172.21.15.33:0/151849221 learned_addr learned my addr 172.21.15.33:0/151849221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 0x55d5f6926e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85d800640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6924540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 -- 172.21.15.33:0/151849221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 msgr2=0x55d5f6924540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6924540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 -- 172.21.15.33:0/151849221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 msgr2=0x55d5f69185b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.381+0000 7fc85ce00640 1 -- 172.21.15.33:0/151849221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f680b460 con 0x55d5f6924a80 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc85d800640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6924540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc85e200640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc85ce00640 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 0x55d5f6926e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc84400bb40 tx=0x7fc8440103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a25b7101b9621cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc856000640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 0x7fc8400b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc84aa00640 1 -- 172.21.15.33:0/151849221 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844004030 con 0x55d5f6924a80 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc84aa00640 1 -- 172.21.15.33:0/151849221 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8440035f0 con 0x55d5f6924a80 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc84aa00640 1 -- 172.21.15.33:0/151849221 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440116a0 con 0x55d5f6924a80 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc856000640 1 -- 172.21.15.33:0/2917996996 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc84c0e5950 con 0x7fc8580776d0 2024-09-11T00:01:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.382+0000 7fc85e200640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 0x7fc8400b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 -- 172.21.15.33:0/151849221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 msgr2=0x55d5f6926e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 0x55d5f6926e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc84400bb40 tx=0x7fc8440103d0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc85e200640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 0x7fc8400b78d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc850006010 tx=0x7fc850004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 -- 172.21.15.33:0/151849221 shutdown_connections 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f6924a80 0x55d5f6926e70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6924540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 --2- 172.21.15.33:0/151849221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f69181d0 0x55d5f69185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 -- 172.21.15.33:0/151849221 >> 172.21.15.33:0/151849221 conn(0x55d5f6916000 msgr2=0x55d5f69171a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 -- 172.21.15.33:0/151849221 shutdown_connections 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.383+0000 7fc862c6b740 1 -- 172.21.15.33:0/151849221 wait complete. 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 -- start start 2024-09-11T00:01:59.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 Processor -- start 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f6924510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6924a80 0x55d5f6922110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d5f66dfbb0 con 0x55d5f6918af0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5f68196c0 con 0x55d5f69181d0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5f6927730 con 0x55d5f6924a80 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.384+0000 7fc862c6b740 10 client.0 _ll_register_callbacks cb 0x55d5f6834490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50922/0 (socket says 172.21.15.33:50922) 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85ce00640 1 -- 172.21.15.33:0/53983172 learned_addr learned my addr 172.21.15.33:0/53983172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f6924510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85e200640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6924a80 0x55d5f6922110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 -- 172.21.15.33:0/53983172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6924a80 msgr2=0x55d5f6922110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6924a80 0x55d5f6922110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 -- 172.21.15.33:0/53983172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 msgr2=0x55d5f6921980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85d800640 1 -- 172.21.15.33:0/53983172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f65dcb00 con 0x55d5f69181d0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.385+0000 7fc85ce00640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc85d800640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f6924510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55d5f691b350 tx=0x7fc84c0abba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f57a3bda82159ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc83f400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0ac410 con 0x55d5f69181d0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8440035f0 con 0x55d5f69181d0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc84c093070 con 0x55d5f69181d0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc84c0abd10 con 0x55d5f69181d0 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc862c6b740 10 client.35918 fetch_fsmap learned FSMap version 30 2024-09-11T00:01:59.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.386+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d5f6653960 con 0x55d5f69181d0 2024-09-11T00:01:59.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8440035f0 con 0x55d5f69181d0 2024-09-11T00:01:59.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc84c0a7f80 con 0x55d5f69181d0 2024-09-11T00:01:59.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 10 client.35918 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:01:59.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 10 client.35918 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 20 client.35918 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f6934520 0x55d5f69369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 4 client.35918 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5f68911e0 con 0x55d5f6934520 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.387+0000 7fc85ce00640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f6934520 0x55d5f69369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.388+0000 7fc85ce00640 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f6934520 0x55d5f69369b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448dff6d7ac22b12 server_cookie=7ec9e6cef77a6f22 in_seq=0 out_seq=0 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.388+0000 7fc83f400640 10 client.35918 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc83f400640 1 -- 172.21.15.33:0/53983172 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5f68911e0 con 0x55d5f6934520 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc83f400640 10 client.35918 handle_command_reply: tid=0 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 client.35918 shutdown 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 msgr2=0x55d5f6924510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f6924510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55d5f691b350 tx=0x7fc84c0abba0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 shutdown_connections 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f6934520 0x55d5f69369b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6924a80 0x55d5f6922110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6918af0 0x55d5f6921980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc83f400640 0 client.35918 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 --2- 172.21.15.33:0/53983172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f6924510 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 >> 172.21.15.33:0/53983172 conn(0x55d5f6916000 msgr2=0x55d5f691bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 shutdown_connections 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.389+0000 7fc862c6b740 1 -- 172.21.15.33:0/53983172 wait complete. 2024-09-11T00:01:59.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.390+0000 7fc862c6b740 20 client.35918 trim_cache size 0 max 16384 2024-09-11T00:01:59.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.407+0000 7fc862c6b740 1 Processor -- start 2024-09-11T00:01:59.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 -- start start 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f691eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f691f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b8670 con 0x55d5f6924a80 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b5f40 con 0x55d5f69181d0 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc862c6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b3d90 con 0x55d5f6918af0 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50930/0 (socket says 172.21.15.33:50930) 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc85e200640 1 -- 172.21.15.33:0/1204650821 learned_addr learned my addr 172.21.15.33:0/1204650821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.408+0000 7fc85ce00640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f691f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85d800640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f691eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 -- 172.21.15.33:0/1204650821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 msgr2=0x55d5f691f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f691f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 -- 172.21.15.33:0/1204650821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 msgr2=0x55d5f691eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f691eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 -- 172.21.15.33:0/1204650821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f6924880 con 0x55d5f6924a80 2024-09-11T00:01:59.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85ce00640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f691f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc85e200640 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc85806bf20 tx=0x7fc850041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c02e65a14cb865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc84a000640 1 -- 172.21.15.33:0/1204650821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850031a40 con 0x55d5f6924a80 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc84a000640 1 -- 172.21.15.33:0/1204650821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc850036050 con 0x55d5f6924a80 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.409+0000 7fc84a000640 1 -- 172.21.15.33:0/1204650821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850030e90 con 0x55d5f6924a80 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 -- 172.21.15.33:0/1204650821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 msgr2=0x55d5f693c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc85806bf20 tx=0x7fc850041000 comp rx=0 tx=0).stop 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 -- 172.21.15.33:0/1204650821 shutdown_connections 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f693c280 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f691f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 --2- 172.21.15.33:0/1204650821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f691eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 -- 172.21.15.33:0/1204650821 >> 172.21.15.33:0/1204650821 conn(0x55d5f6916000 msgr2=0x55d5f6922f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 -- 172.21.15.33:0/1204650821 shutdown_connections 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.410+0000 7fc862c6b740 1 -- 172.21.15.33:0/1204650821 wait complete. 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 -- start start 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 Processor -- start 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f69279b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6927ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b4400 con 0x55d5f6924a80 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b5870 con 0x55d5f69181d0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8581b4ad0 con 0x55d5f6918af0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.411+0000 7fc862c6b740 10 client.0 _ll_register_callbacks cb 0x7fc84c0a7bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50942/0 (socket says 172.21.15.33:50942) 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 -- 172.21.15.33:0/2101551085 learned_addr learned my addr 172.21.15.33:0/2101551085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85ce00640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6927ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85d800640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f69279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 -- 172.21.15.33:0/2101551085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 msgr2=0x55d5f6927ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6927ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 -- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 msgr2=0x55d5f69279b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:01:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f69279b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 -- 172.21.15.33:0/2101551085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f69a1500 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc85e200640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc850055040 tx=0x7fc8500315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581bbde0aa306704 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.412+0000 7fc83f400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850030910 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc850030ab0 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc850036050 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc850030cb0 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc862c6b740 10 client.16155 fetch_fsmap learned FSMap version 30 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d5f69a2840 con 0x55d5f6924a80 2024-09-11T00:01:59.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.413+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc850036050 con 0x55d5f6924a80 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc85005d420 con 0x55d5f6924a80 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 10 client.16155 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 10 client.16155 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 20 client.16155 populate_metadata read hostname 'smithi033' 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f69a2f80 0x55d5f69a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 4 client.16155 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "80e3e40e", "release": true, "await": true}] 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "80e3e40e", "release": true, "await": true}) -- 0x55d5f688cc90 con 0x55d5f69a2f80 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.414+0000 7fc85d800640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f69a2f80 0x55d5f69a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.415+0000 7fc85d800640 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f69a2f80 0x55d5f69a53a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e404858839c908a server_cookie=ce2cfa8c1d397471 in_seq=0 out_seq=0 2024-09-11T00:01:59.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.415+0000 7fc83f400640 10 client.16155 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:59.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.467+0000 7fc83f400640 1 -- 172.21.15.33:0/2101551085 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d5f688cc90 con 0x55d5f69a2f80 2024-09-11T00:01:59.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.467+0000 7fc83f400640 10 client.16155 handle_command_reply: tid=0 2024-09-11T00:01:59.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.467+0000 7fc862c6b740 1 client.16155 shutdown 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 msgr2=0x55d5f6928430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc850055040 tx=0x7fc8500315d0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 shutdown_connections 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5f6924a80 0x55d5f6928430 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d5f69a2f80 0x55d5f69a53a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5f6918af0 0x55d5f6927ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc83f400640 0 client.16155 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 --2- 172.21.15.33:0/2101551085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5f69181d0 0x55d5f69279b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 >> 172.21.15.33:0/2101551085 conn(0x55d5f6916000 msgr2=0x55d5f69148a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.468+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 shutdown_connections 2024-09-11T00:01:59.475 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:01:59.475 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:01:59.475 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:01:59.475 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 20, 2024-09-11T00:01:59.475 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "80e3e40e": { 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 20, 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:01:59.476 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:01:59.477 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.469+0000 7fc862c6b740 1 -- 172.21.15.33:0/2101551085 wait complete. 2024-09-11T00:01:59.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.469+0000 7fc862c6b740 20 client.16155 trim_cache size 0 max 16384 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.470+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 msgr2=0x7fc8400b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.470+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 0x7fc8400b78d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc850006010 tx=0x7fc850004a80 comp rx=0 tx=0).stop 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.470+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 msgr2=0x7fc85819f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.470+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00d950 tx=0x7fc84c00de10 comp rx=0 tx=0).stop 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 shutdown_connections 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8400b5410 0x7fc8400b78d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8581137e0 0x7fc8581a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc858077ff0 0x7fc85819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 --2- 172.21.15.33:0/2917996996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8580776d0 0x7fc85819f4a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:59.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 >> 172.21.15.33:0/2917996996 conn(0x7fc858100840 msgr2=0x7fc858102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:59.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 shutdown_connections 2024-09-11T00:01:59.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:01:59.471+0000 7fc85ec00640 1 -- 172.21.15.33:0/2917996996 wait complete. 2024-09-11T00:02:00.568 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '80e3e40e', total seconds elapsed: 34.9 2024-09-11T00:02:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:00 smithi033 ceph-mon[30593]: pgmap v593: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 365 KiB/s wr, 32 op/s 2024-09-11T00:02:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:00 smithi189 ceph-mon[34000]: pgmap v593: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 365 KiB/s wr, 32 op/s 2024-09-11T00:02:00.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:00 smithi052 ceph-mon[33526]: pgmap v593: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 365 KiB/s wr, 32 op/s 2024-09-11T00:02:02.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:02 smithi033 ceph-mon[30593]: pgmap v594: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 221 KiB/s wr, 35 op/s 2024-09-11T00:02:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:02 smithi189 ceph-mon[34000]: pgmap v594: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 221 KiB/s wr, 35 op/s 2024-09-11T00:02:02.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:02 smithi052 ceph-mon[33526]: pgmap v594: 129 pgs: 129 active+clean; 948 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 221 KiB/s wr, 35 op/s 2024-09-11T00:02:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 135.0 s, 511.7 tps, lat 683.436 ms stddev 4149.882 2024-09-11T00:02:04.781 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:04 smithi033 ceph-mon[30593]: pgmap v595: 129 pgs: 129 active+clean; 948 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 127 op/s 2024-09-11T00:02:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:04 smithi189 ceph-mon[34000]: pgmap v595: 129 pgs: 129 active+clean; 948 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 127 op/s 2024-09-11T00:02:04.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:04 smithi052 ceph-mon[33526]: pgmap v595: 129 pgs: 129 active+clean; 948 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.0 MiB/s wr, 127 op/s 2024-09-11T00:02:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:06 smithi033 ceph-mon[30593]: pgmap v596: 129 pgs: 129 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2024-09-11T00:02:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:06 smithi189 ceph-mon[34000]: pgmap v596: 129 pgs: 129 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2024-09-11T00:02:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 -- 172.21.15.33:0/3799972323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 msgr2=0x7fc8e8075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 --2- 172.21.15.33:0/3799972323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e8075f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009900 tx=0x7fc8dc02a420 comp rx=0 tx=0).stop 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 -- 172.21.15.33:0/3799972323 shutdown_connections 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 --2- 172.21.15.33:0/3799972323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e810a900 0x7fc8e810cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 --2- 172.21.15.33:0/3799972323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e8075f40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 --2- 172.21.15.33:0/3799972323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e8075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.927+0000 7fc8f0400640 1 -- 172.21.15.33:0/3799972323 >> 172.21.15.33:0/3799972323 conn(0x7fc8e80fe240 msgr2=0x7fc8e8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.928+0000 7fc8f0400640 1 -- 172.21.15.33:0/3799972323 shutdown_connections 2024-09-11T00:02:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.928+0000 7fc8f0400640 1 -- 172.21.15.33:0/3799972323 wait complete. 2024-09-11T00:02:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.930+0000 7fc8f0400640 1 Processor -- start 2024-09-11T00:02:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.930+0000 7fc8f0400640 1 -- start start 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e810a900 0x7fc8e81a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81107e0 con 0x7fc8e810a900 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8110660 con 0x7fc8e8075ac0 2024-09-11T00:02:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.931+0000 7fc8f0400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8110960 con 0x7fc8e8076f30 2024-09-11T00:02:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.932+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.932+0000 7fc8ed000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.932+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e819f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47970/0 (socket says 172.21.15.33:47970) 2024-09-11T00:02:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.932+0000 7fc8eda00640 1 -- 172.21.15.33:0/779404965 learned_addr learned my addr 172.21.15.33:0/779404965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 -- 172.21.15.33:0/779404965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 msgr2=0x7fc8e819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 -- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e810a900 msgr2=0x7fc8e81a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e810a900 0x7fc8e81a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 -- 172.21.15.33:0/779404965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e81a0f40 con 0x7fc8e8076f30 2024-09-11T00:02:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.933+0000 7fc8ed000640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e819fa50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc02a940 tx=0x7fc8dc003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.934+0000 7fc8e6000640 1 -- 172.21.15.33:0/779404965 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc03f070 con 0x7fc8e8076f30 2024-09-11T00:02:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.934+0000 7fc8e6000640 1 -- 172.21.15.33:0/779404965 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8dc031da0 con 0x7fc8e8076f30 2024-09-11T00:02:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.934+0000 7fc8e6000640 1 -- 172.21.15.33:0/779404965 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc035030 con 0x7fc8e8076f30 2024-09-11T00:02:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.934+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e81a11d0 con 0x7fc8e8076f30 2024-09-11T00:02:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.935+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e81a77a0 con 0x7fc8e8076f30 2024-09-11T00:02:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.941+0000 7fc8f345d740 1 Processor -- start 2024-09-11T00:02:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 -- start start 2024-09-11T00:02:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e519b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e51c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e51efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56154e48a6b0 con 0x56154e51cb00 2024-09-11T00:02:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56154e479ae0 con 0x56154e51a0c0 2024-09-11T00:02:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.943+0000 7fc8f345d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56154e47d8f0 con 0x56154e517790 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e51c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e51c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47982/0 (socket says 172.21.15.33:47982) 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8eda00640 1 -- 172.21.15.33:0/2573781669 learned_addr learned my addr 172.21.15.33:0/2573781669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e519b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 -- 172.21.15.33:0/2573781669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 msgr2=0x56154e51c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e51c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 -- 172.21.15.33:0/2573781669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 msgr2=0x56154e51efc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e51efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.944+0000 7fc8ee400640 1 -- 172.21.15.33:0/2573781669 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154e446780 con 0x56154e517790 2024-09-11T00:02:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.945+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e519b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009c90 tx=0x7fc8e000b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d7c72cdd4cf595 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.945+0000 7fc8e6000640 1 -- 172.21.15.33:0/779404965 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc8dc03b580 con 0x7fc8e8076f30 2024-09-11T00:02:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.945+0000 7fc8daa00640 1 -- 172.21.15.33:0/2573781669 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0018070 con 0x56154e517790 2024-09-11T00:02:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.947+0000 7fc8daa00640 1 -- 172.21.15.33:0/2573781669 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8e0009e40 con 0x56154e517790 2024-09-11T00:02:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.947+0000 7fc8e6000640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 0x7fc8d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 -- 172.21.15.33:0/2573781669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 msgr2=0x56154e519b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8daa00640 1 -- 172.21.15.33:0/2573781669 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0013850 con 0x56154e517790 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e519b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009c90 tx=0x7fc8e000b7e0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8e6000640 1 -- 172.21.15.33:0/779404965 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc8dc106b50 con 0x7fc8e8076f30 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 -- 172.21.15.33:0/2573781669 shutdown_connections 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e51efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e51c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2573781669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e519b80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8f345d740 1 -- 172.21.15.33:0/2573781669 >> 172.21.15.33:0/2573781669 conn(0x56154e5128e0 msgr2=0x56154e513670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.948+0000 7fc8eda00640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 0x7fc8d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.949+0000 7fc8f345d740 1 -- 172.21.15.33:0/2573781669 shutdown_connections 2024-09-11T00:02:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.949+0000 7fc8f345d740 1 -- 172.21.15.33:0/2573781669 wait complete. 2024-09-11T00:02:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.951+0000 7fc8f345d740 1 -- start start 2024-09-11T00:02:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.952+0000 7fc8eda00640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 0x7fc8d00b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4006a50 tx=0x7fc8d4009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.952+0000 7fc8f345d740 1 Processor -- start 2024-09-11T00:02:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e520f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51a0c0 0x56154e521620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56154e3b1ab0 con 0x56154e51a0c0 2024-09-11T00:02:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56154e420570 con 0x56154e51cb00 2024-09-11T00:02:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56154e51fb30 con 0x56154e517790 2024-09-11T00:02:06.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:06 smithi052 ceph-mon[33526]: pgmap v596: 129 pgs: 129 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2024-09-11T00:02:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.953+0000 7fc8f345d740 10 client.0 _ll_register_callbacks cb 0x56154e42f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47996/0 (socket says 172.21.15.33:47996) 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 -- 172.21.15.33:0/2142328400 learned_addr learned my addr 172.21.15.33:0/2142328400 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 -- 172.21.15.33:0/2142328400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 msgr2=0x56154e520f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e520f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 -- 172.21.15.33:0/2142328400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51a0c0 msgr2=0x56154e521620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51a0c0 0x56154e521620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 -- 172.21.15.33:0/2142328400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154e1db790 con 0x56154e51cb00 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8ee400640 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011e20 tx=0x7fc8e0009890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596f45fdcafc97c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.954+0000 7fc8cf400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0020070 con 0x56154e51cb00 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc8e0013610 con 0x56154e51cb00 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56154e48c600 con 0x56154e51cb00 2024-09-11T00:02:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8e002c050 con 0x56154e51cb00 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8f345d740 10 client.35936 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.955+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56154e254620 con 0x56154e51cb00 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56154e48c600 con 0x56154e51cb00 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc8e001b050 con 0x56154e51cb00 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 10 client.35936 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 10 client.35936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 20 client.35936 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e52c640 0x56154e52ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 4 client.35936 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.956+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56154e4880b0 con 0x56154e52c640 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.957+0000 7fc8eda00640 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e52c640 0x56154e52ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.958+0000 7fc8eda00640 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e52c640 0x56154e52ea50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99bb55354cff6cf server_cookie=d5ea678848c032df in_seq=0 out_seq=0 2024-09-11T00:02:06.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.958+0000 7fc8cf400640 10 client.35936 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.959+0000 7fc8cf400640 1 -- 172.21.15.33:0/2142328400 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56154e4880b0 con 0x56154e52c640 2024-09-11T00:02:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.959+0000 7fc8cf400640 10 client.35936 handle_command_reply: tid=0 2024-09-11T00:02:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.959+0000 7fc8f345d740 1 client.35936 shutdown 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.960+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 msgr2=0x56154e5221f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.960+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011e20 tx=0x7fc8e0009890 comp rx=0 tx=0).stop 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 shutdown_connections 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51cb00 0x56154e5221f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51a0c0 0x56154e521620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e52c640 0x56154e52ea50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 --2- 172.21.15.33:0/2142328400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e520f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 >> 172.21.15.33:0/2142328400 conn(0x56154e5128e0 msgr2=0x56154e51a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8cf400640 0 client.35936 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 shutdown_connections 2024-09-11T00:02:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 1 -- 172.21.15.33:0/2142328400 wait complete. 2024-09-11T00:02:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:06.961+0000 7fc8f345d740 20 client.35936 trim_cache size 0 max 16384 2024-09-11T00:02:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.003+0000 7fc8f345d740 1 Processor -- start 2024-09-11T00:02:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.003+0000 7fc8f345d740 1 -- start start 2024-09-11T00:02:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.004+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.005+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e50d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.005+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e520160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.005+0000 7fc8f345d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81bcd30 con 0x56154e51cb00 2024-09-11T00:02:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.005+0000 7fc8f345d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81ba600 con 0x56154e51a0c0 2024-09-11T00:02:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.005+0000 7fc8f345d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e819e070 con 0x56154e517790 2024-09-11T00:02:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.006+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.006+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35498/0 (socket says 172.21.15.33:35498) 2024-09-11T00:02:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.006+0000 7fc8eda00640 1 -- 172.21.15.33:0/802121225 learned_addr learned my addr 172.21.15.33:0/802121225 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.006+0000 7fc8ed000640 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e50d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.006+0000 7fc8ee400640 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e520160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.007+0000 7fc8eda00640 1 -- 172.21.15.33:0/802121225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 msgr2=0x56154e50d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.007+0000 7fc8eda00640 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e50d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.007+0000 7fc8eda00640 1 -- 172.21.15.33:0/802121225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 msgr2=0x56154e520160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.007+0000 7fc8eda00640 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e520160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.007+0000 7fc8eda00640 1 -- 172.21.15.33:0/802121225 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154e50e270 con 0x56154e517790 2024-09-11T00:02:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.008+0000 7fc8eda00640 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40069e0 tx=0x7fc8d4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd0e51d19a373f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.009+0000 7fc8da000640 1 -- 172.21.15.33:0/802121225 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d402d030 con 0x56154e517790 2024-09-11T00:02:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.009+0000 7fc8da000640 1 -- 172.21.15.33:0/802121225 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d401b040 con 0x56154e517790 2024-09-11T00:02:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.009+0000 7fc8da000640 1 -- 172.21.15.33:0/802121225 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40229d0 con 0x56154e517790 2024-09-11T00:02:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 -- 172.21.15.33:0/802121225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 msgr2=0x56154e51c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40069e0 tx=0x7fc8d4014000 comp rx=0 tx=0).stop 2024-09-11T00:02:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 -- 172.21.15.33:0/802121225 shutdown_connections 2024-09-11T00:02:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e520160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e51a0c0 0x56154e50d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 --2- 172.21.15.33:0/802121225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e517790 0x56154e51c490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.010+0000 7fc8f345d740 1 -- 172.21.15.33:0/802121225 >> 172.21.15.33:0/802121225 conn(0x56154e5128e0 msgr2=0x56154e516c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.011+0000 7fc8f345d740 1 -- 172.21.15.33:0/802121225 shutdown_connections 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.011+0000 7fc8f345d740 1 -- 172.21.15.33:0/802121225 wait complete. 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.011+0000 7fc8f345d740 1 -- start start 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.011+0000 7fc8f345d740 1 Processor -- start 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.012+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 0x56154e524170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.012+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e51a0c0 0x56154e524810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.012+0000 7fc8f345d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8eda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 0x56154e524170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8ed000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e51a0c0 0x56154e524810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8ee400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8ee400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60862/0 (socket says 172.21.15.33:60862) 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8ee400640 1 -- 172.21.15.33:0/261923886 learned_addr learned my addr 172.21.15.33:0/261923886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81b8af0 con 0x56154e51cb00 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81b9f30 con 0x56154e517790 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e81b9190 con 0x56154e51a0c0 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.013+0000 7fc8f345d740 10 client.0 _ll_register_callbacks cb 0x7fc8e0016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.014+0000 7fc8ee400640 1 -- 172.21.15.33:0/261923886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e51a0c0 msgr2=0x56154e524810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8ee400640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e51a0c0 0x56154e524810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8ee400640 1 -- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 msgr2=0x56154e524170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8ee400640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 0x56154e524170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8ee400640 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154e528c90 con 0x56154e51cb00 2024-09-11T00:02:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8eda00640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 0x56154e524170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8ee400640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011df0 tx=0x7fc8e00129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40943f1487230244 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.015+0000 7fc8cf400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:02:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.016+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e000f070 con 0x56154e51cb00 2024-09-11T00:02:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.016+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc8e0025640 con 0x56154e51cb00 2024-09-11T00:02:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.016+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8d401b040 con 0x56154e51cb00 2024-09-11T00:02:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.017+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc8e0035050 con 0x56154e51cb00 2024-09-11T00:02:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.017+0000 7fc8f345d740 10 client.16161 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.017+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56154e5260a0 con 0x56154e51cb00 2024-09-11T00:02:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.017+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8d401b040 con 0x56154e51cb00 2024-09-11T00:02:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc8e001b040 con 0x56154e51cb00 2024-09-11T00:02:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 10 client.16161 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 20 client.16161 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e599be0 0x56154e59c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 4 client.16161 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56154e4854e0 con 0x56154e599be0 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.018+0000 7fc8eda00640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e599be0 0x56154e59c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.019+0000 7fc8eda00640 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e599be0 0x56154e59c000 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd15a4e17ba480f3 server_cookie=90e1c9a56b75d74 in_seq=0 out_seq=0 2024-09-11T00:02:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:07.019+0000 7fc8cf400640 10 client.16161 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.216+0000 7fc8cf400640 1 -- 172.21.15.33:0/261923886 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56154e4854e0 con 0x56154e599be0 2024-09-11T00:02:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.216+0000 7fc8cf400640 10 client.16161 handle_command_reply: tid=0 2024-09-11T00:02:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.216+0000 7fc8f345d740 1 client.16161 shutdown 2024-09-11T00:02:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.217+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 msgr2=0x56154e528460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.217+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011df0 tx=0x7fc8e00129f0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 shutdown_connections 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154e51cb00 0x56154e528460 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56154e599be0 0x56154e59c000 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56154e51a0c0 0x56154e524810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 --2- 172.21.15.33:0/261923886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56154e517790 0x56154e524170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 >> 172.21.15.33:0/261923886 conn(0x56154e5128e0 msgr2=0x56154e51b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8cf400640 0 client.16161 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 shutdown_connections 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 1 -- 172.21.15.33:0/261923886 wait complete. 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.218+0000 7fc8f345d740 20 client.16161 trim_cache size 0 max 16384 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:02:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.219+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 msgr2=0x7fc8d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.219+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 0x7fc8d00b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4006a50 tx=0x7fc8d4009190 comp rx=0 tx=0).stop 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.219+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 msgr2=0x7fc8e819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.219+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e819fa50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc02a940 tx=0x7fc8dc003d50 comp rx=0 tx=0).stop 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 shutdown_connections 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc8d00b5360 0x7fc8d00b7820 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e810a900 0x7fc8e81a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8e8076f30 0x7fc8e819fa50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 --2- 172.21.15.33:0/779404965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8e8075ac0 0x7fc8e819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.220+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 >> 172.21.15.33:0/779404965 conn(0x7fc8e80fe240 msgr2=0x7fc8e81024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.221+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 shutdown_connections 2024-09-11T00:02:08.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:08.221+0000 7fc8f0400640 1 -- 172.21.15.33:0/779404965 wait complete. 2024-09-11T00:02:08.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 140.0 s, 563.0 tps, lat 706.374 ms stddev 4790.355 2024-09-11T00:02:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:08 smithi033 ceph-mon[30593]: pgmap v597: 129 pgs: 129 active+clean; 949 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 305 op/s 2024-09-11T00:02:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:08 smithi189 ceph-mon[34000]: pgmap v597: 129 pgs: 129 active+clean; 949 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 305 op/s 2024-09-11T00:02:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:08 smithi052 ceph-mon[33526]: pgmap v597: 129 pgs: 129 active+clean; 949 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 MiB/s wr, 305 op/s 2024-09-11T00:02:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:10 smithi033 ceph-mon[30593]: pgmap v598: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-11T00:02:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:10 smithi189 ceph-mon[34000]: pgmap v598: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-11T00:02:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:10 smithi052 ceph-mon[33526]: pgmap v598: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-09-11T00:02:11.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:11 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:11.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:11 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:12.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:11 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:02:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: pgmap v599: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 569 op/s 2024-09-11T00:02:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:12.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:12.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:12 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:02:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: pgmap v599: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 569 op/s 2024-09-11T00:02:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:12.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:12 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:02:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: pgmap v599: 129 pgs: 129 active+clean; 950 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 569 op/s 2024-09-11T00:02:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:02:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:12 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:02:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 145.0 s, 687.2 tps, lat 180.223 ms stddev 959.727 2024-09-11T00:02:13.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:13 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:02:13.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:13 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:02:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:13 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:02:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:13 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:02:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:13 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:02:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:13 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:02:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:14 smithi189 ceph-mon[34000]: pgmap v600: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 795 op/s 2024-09-11T00:02:14.856 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:14 smithi052 ceph-mon[33526]: pgmap v600: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 795 op/s 2024-09-11T00:02:15.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:14 smithi033 ceph-mon[30593]: pgmap v600: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 795 op/s 2024-09-11T00:02:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:16 smithi189 ceph-mon[34000]: pgmap v601: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-11T00:02:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:16 smithi052 ceph-mon[33526]: pgmap v601: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-11T00:02:17.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:16 smithi033 ceph-mon[30593]: pgmap v601: 129 pgs: 129 active+clean; 954 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 757 op/s 2024-09-11T00:02:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 150.0 s, 741.9 tps, lat 135.049 ms stddev 36.565 2024-09-11T00:02:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:18 smithi189 ceph-mon[34000]: pgmap v602: 129 pgs: 129 active+clean; 954 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 865 op/s 2024-09-11T00:02:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:18 smithi052 ceph-mon[33526]: pgmap v602: 129 pgs: 129 active+clean; 954 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 865 op/s 2024-09-11T00:02:19.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:18 smithi033 ceph-mon[30593]: pgmap v602: 129 pgs: 129 active+clean; 954 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 865 op/s 2024-09-11T00:02:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:20 smithi189 ceph-mon[34000]: pgmap v603: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 841 op/s 2024-09-11T00:02:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:20 smithi052 ceph-mon[33526]: pgmap v603: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 841 op/s 2024-09-11T00:02:21.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:20 smithi033 ceph-mon[30593]: pgmap v603: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 841 op/s 2024-09-11T00:02:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.421+0000 7f0654e00640 1 -- 172.21.15.33:0/240902247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650105ac0 msgr2=0x7f0650107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.421+0000 7f0654e00640 1 --2- 172.21.15.33:0/240902247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650105ac0 0x7f0650107f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0640009860 tx=0x7f064002a340 comp rx=0 tx=0).stop 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 -- 172.21.15.33:0/240902247 shutdown_connections 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 --2- 172.21.15.33:0/240902247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650108670 0x7f065010ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 --2- 172.21.15.33:0/240902247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650105ac0 0x7f0650107f30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 --2- 172.21.15.33:0/240902247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f0650105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 -- 172.21.15.33:0/240902247 >> 172.21.15.33:0/240902247 conn(0x7f06500fd140 msgr2=0x7f06500ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.422+0000 7f0654e00640 1 -- 172.21.15.33:0/240902247 shutdown_connections 2024-09-11T00:02:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.424+0000 7f0654e00640 1 -- 172.21.15.33:0/240902247 wait complete. 2024-09-11T00:02:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.426+0000 7f0654e00640 1 Processor -- start 2024-09-11T00:02:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f0654e00640 1 -- start start 2024-09-11T00:02:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f0654e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f065019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f0654e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f0654e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650108670 0x7f06501a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f065019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.427+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f065019f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42498/0 (socket says 172.21.15.33:42498) 2024-09-11T00:02:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f0645400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f0645400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52674/0 (socket says 172.21.15.33:52674) 2024-09-11T00:02:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f0654e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06501029d0 con 0x7f0650108670 2024-09-11T00:02:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f0654e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0650102850 con 0x7f065006b470 2024-09-11T00:02:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f0654e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0650102b50 con 0x7f0650105ac0 2024-09-11T00:02:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.428+0000 7f064de00640 1 -- 172.21.15.33:0/2590589323 learned_addr learned my addr 172.21.15.33:0/2590589323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.429+0000 7f064e800640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650108670 0x7f06501a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.430+0000 7f0645400640 1 -- 172.21.15.33:0/2590589323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 msgr2=0x7f065019f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.430+0000 7f0645400640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f065019f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.430+0000 7f0645400640 1 -- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650108670 msgr2=0x7f06501a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.430+0000 7f0645400640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650108670 0x7f06501a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.430+0000 7f0645400640 1 -- 172.21.15.33:0/2590589323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06501a0e00 con 0x7f0650105ac0 2024-09-11T00:02:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.431+0000 7f0645400640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0640009780 tx=0x7f06400306e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.431+0000 7f0647400640 1 -- 172.21.15.33:0/2590589323 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640037040 con 0x7f0650105ac0 2024-09-11T00:02:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.431+0000 7f0647400640 1 -- 172.21.15.33:0/2590589323 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0640032df0 con 0x7f0650105ac0 2024-09-11T00:02:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.431+0000 7f0647400640 1 -- 172.21.15.33:0/2590589323 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640003850 con 0x7f0650105ac0 2024-09-11T00:02:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.431+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06501a1090 con 0x7f0650105ac0 2024-09-11T00:02:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.432+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06501a75e0 con 0x7f0650105ac0 2024-09-11T00:02:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.438+0000 7f0657c2b740 1 Processor -- start 2024-09-11T00:02:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.438+0000 7f0647400640 1 -- 172.21.15.33:0/2590589323 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0640030ab0 con 0x7f0650105ac0 2024-09-11T00:02:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.439+0000 7f0657c2b740 1 -- start start 2024-09-11T00:02:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.439+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.440+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.440+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.440+0000 7f0657c2b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555e41c316b0 con 0x555e41cc3b00 2024-09-11T00:02:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.440+0000 7f0657c2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555e41c20ae0 con 0x555e41cbe790 2024-09-11T00:02:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.440+0000 7f0657c2b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e41c248f0 con 0x555e41cc10c0 2024-09-11T00:02:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52676/0 (socket says 172.21.15.33:52676) 2024-09-11T00:02:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 -- 172.21.15.33:0/437732904 learned_addr learned my addr 172.21.15.33:0/437732904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064e800640 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 -- 172.21.15.33:0/437732904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 msgr2=0x555e41cc0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 -- 172.21.15.33:0/437732904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 msgr2=0x555e41cc5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.441+0000 7f064de00640 1 -- 172.21.15.33:0/437732904 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e41bed780 con 0x555e41cc10c0 2024-09-11T00:02:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f0647400640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 0x7f06340b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f0647400640 1 -- 172.21.15.33:0/2590589323 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f06401054f0 con 0x7f0650105ac0 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f064de00640 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f063800b7e0 tx=0x7f063800bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb310a42b470d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f063f400640 1 -- 172.21.15.33:0/437732904 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638003dd0 con 0x555e41cc10c0 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f063f400640 1 -- 172.21.15.33:0/437732904 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0638015070 con 0x555e41cc10c0 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.442+0000 7f063f400640 1 -- 172.21.15.33:0/437732904 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06380196c0 con 0x555e41cc10c0 2024-09-11T00:02:21.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.443+0000 7f064e800640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 0x7f06340b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 -- 172.21.15.33:0/437732904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 msgr2=0x555e41cc34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f063800b7e0 tx=0x7f063800bca0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f064e800640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 0x7f06340b7860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f06501a0040 tx=0x7f0648009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 -- 172.21.15.33:0/437732904 shutdown_connections 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc10c0 0x555e41cc34b0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f063800b7e0 tx=0x7f063800bca0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 --2- 172.21.15.33:0/437732904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 -- 172.21.15.33:0/437732904 >> 172.21.15.33:0/437732904 conn(0x555e41cb98e0 msgr2=0x555e41cba670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.444+0000 7f0657c2b740 1 -- 172.21.15.33:0/437732904 shutdown_connections 2024-09-11T00:02:21.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.445+0000 7f0657c2b740 1 -- 172.21.15.33:0/437732904 wait complete. 2024-09-11T00:02:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.447+0000 7f0657c2b740 1 -- start start 2024-09-11T00:02:21.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.447+0000 7f0657c2b740 1 Processor -- start 2024-09-11T00:02:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.450+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41cc98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0645400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0645400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52686/0 (socket says 172.21.15.33:52686) 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0645400640 1 -- 172.21.15.33:0/2495031650 learned_addr learned my addr 172.21.15.33:0/2495031650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555e41b58ab0 con 0x555e41cc9470 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555e41bc7570 con 0x555e41cbe790 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e41cc6ae0 con 0x555e41cc3b00 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42518/0 (socket says 172.21.15.33:42518) 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f0657c2b740 10 client.0 _ll_register_callbacks cb 0x555e41bd6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.451+0000 7f064e800640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41cc98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f0645400640 1 -- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 msgr2=0x555e41cc8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f0645400640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f0645400640 1 -- 172.21.15.33:0/2495031650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 msgr2=0x555e41cc98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f0645400640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41cc98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f0645400640 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e41982790 con 0x555e41cc3b00 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f064de00640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.452+0000 7f064e800640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41cc98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.453+0000 7f0645400640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06400c7f70 tx=0x7f06400c80b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e7c1345addc4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.453+0000 7f0633e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:02:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.453+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400cb110 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.453+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f06400d4a10 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.453+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0638015070 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.454+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f06400c7110 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.454+0000 7f0657c2b740 10 client.25885 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.454+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555e419fb620 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.454+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0638015070 con 0x555e41cc3b00 2024-09-11T00:02:21.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f06400ee050 con 0x555e41cc3b00 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 10 client.25885 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 10 client.25885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 20 client.25885 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41cd3e10 0x555e41cd6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 4 client.25885 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.455+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e41c33600 con 0x555e41cd3e10 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.456+0000 7f064de00640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41cd3e10 0x555e41cd6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.456+0000 7f064de00640 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41cd3e10 0x555e41cd6200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6bf51d13a4bdfa server_cookie=117720d1023ac2fb in_seq=0 out_seq=0 2024-09-11T00:02:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.456+0000 7f0633e00640 10 client.25885 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.458+0000 7f0633e00640 1 -- 172.21.15.33:0/2495031650 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555e41c33600 con 0x555e41cd3e10 2024-09-11T00:02:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.458+0000 7f0633e00640 10 client.25885 handle_command_reply: tid=0 2024-09-11T00:02:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.458+0000 7f0657c2b740 1 client.25885 shutdown 2024-09-11T00:02:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.458+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 msgr2=0x555e41cc8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.458+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06400c7f70 tx=0x7f06400c80b0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 shutdown_connections 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41cc98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41cd3e10 0x555e41cd6200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc3b00 0x555e41cc8930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2495031650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cc8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 >> 172.21.15.33:0/2495031650 conn(0x555e41cb98e0 msgr2=0x555e41cb8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0633e00640 0 client.25885 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 shutdown_connections 2024-09-11T00:02:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.459+0000 7f0657c2b740 1 -- 172.21.15.33:0/2495031650 wait complete. 2024-09-11T00:02:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.460+0000 7f0657c2b740 20 client.25885 trim_cache size 0 max 16384 2024-09-11T00:02:21.486 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.485+0000 7f0657c2b740 1 Processor -- start 2024-09-11T00:02:21.487 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.485+0000 7f0657c2b740 1 -- start start 2024-09-11T00:02:21.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cb9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 0x555e41cc44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06501b4540 con 0x555e41cc3b00 2024-09-11T00:02:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06501b1e10 con 0x555e41cbe790 2024-09-11T00:02:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.486+0000 7f0657c2b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06501afc60 con 0x555e41cc9470 2024-09-11T00:02:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.488+0000 7f064e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 0x555e41cc44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.488+0000 7f064e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 0x555e41cc44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52690/0 (socket says 172.21.15.33:52690) 2024-09-11T00:02:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.488+0000 7f064e800640 1 -- 172.21.15.33:0/3260394317 learned_addr learned my addr 172.21.15.33:0/3260394317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.488+0000 7f0645400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.488+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cb9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f064de00640 1 -- 172.21.15.33:0/3260394317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 msgr2=0x555e41cc44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f064de00640 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 0x555e41cc44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f064de00640 1 -- 172.21.15.33:0/3260394317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 msgr2=0x555e41cc3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f064de00640 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f064de00640 1 -- 172.21.15.33:0/3260394317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e41cbe5c0 con 0x555e41cbe790 2024-09-11T00:02:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.490+0000 7f0645400640 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.491+0000 7f064de00640 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cb9250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0638009000 tx=0x7f0638012dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55bb3177126d8fef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.491+0000 7f063ea00640 1 -- 172.21.15.33:0/3260394317 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638003d50 con 0x555e41cbe790 2024-09-11T00:02:21.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.492+0000 7f063ea00640 1 -- 172.21.15.33:0/3260394317 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0638015030 con 0x555e41cbe790 2024-09-11T00:02:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.492+0000 7f063ea00640 1 -- 172.21.15.33:0/3260394317 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638003d50 con 0x555e41cbe790 2024-09-11T00:02:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 -- 172.21.15.33:0/3260394317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 msgr2=0x555e41cb9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cb9250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0638009000 tx=0x7f0638012dd0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 -- 172.21.15.33:0/3260394317 shutdown_connections 2024-09-11T00:02:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41cc9470 0x555e41cc44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc3b00 0x555e41cc3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 --2- 172.21.15.33:0/3260394317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cbe790 0x555e41cb9250 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0638009000 tx=0x7f0638012dd0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.493+0000 7f0657c2b740 1 -- 172.21.15.33:0/3260394317 >> 172.21.15.33:0/3260394317 conn(0x555e41cb98e0 msgr2=0x555e41cba330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.494+0000 7f0657c2b740 1 -- 172.21.15.33:0/3260394317 shutdown_connections 2024-09-11T00:02:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.494+0000 7f0657c2b740 1 -- 172.21.15.33:0/3260394317 wait complete. 2024-09-11T00:02:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.494+0000 7f0657c2b740 1 -- start start 2024-09-11T00:02:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.494+0000 7f0657c2b740 1 Processor -- start 2024-09-11T00:02:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 0x555e41ccf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41ccf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 0x555e41cce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06501b02d0 con 0x555e41cc9470 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06501b1740 con 0x555e41cc3b00 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06501b09a0 con 0x555e41ccdd20 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.495+0000 7f0657c2b740 10 client.0 _ll_register_callbacks cb 0x7f06400097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 0x555e41ccf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 0x555e41ccf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42546/0 (socket says 172.21.15.33:42546) 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064de00640 1 -- 172.21.15.33:0/2770157584 learned_addr learned my addr 172.21.15.33:0/2770157584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064e800640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 0x555e41cce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064e800640 1 -- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 msgr2=0x555e41ccf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064e800640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 0x555e41ccf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.496+0000 7f064e800640 1 -- 172.21.15.33:0/2770157584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 msgr2=0x555e41ccf900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:02:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.497+0000 7f064e800640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41ccf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.497+0000 7f064e800640 1 -- 172.21.15.33:0/2770157584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e41cc9c60 con 0x555e41ccdd20 2024-09-11T00:02:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.498+0000 7f064e800640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 0x555e41cce1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0648009810 tx=0x7f0648004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9663c91088c0035 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.498+0000 7f0633e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:02:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.499+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064801f9a0 con 0x555e41ccdd20 2024-09-11T00:02:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.500+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0648018070 con 0x555e41ccdd20 2024-09-11T00:02:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.500+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0638015030 con 0x555e41ccdd20 2024-09-11T00:02:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.500+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f064801f9a0 con 0x555e41ccdd20 2024-09-11T00:02:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.501+0000 7f0657c2b740 10 client.25891 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.501+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555e41d40dc0 con 0x555e41ccdd20 2024-09-11T00:02:21.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.502+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0638015030 con 0x555e41ccdd20 2024-09-11T00:02:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.502+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f064801ebe0 con 0x555e41ccdd20 2024-09-11T00:02:21.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 10 client.25891 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 10 client.25891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 20 client.25891 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41d41820 0x555e41d43c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 4 client.25891 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555e41c2f0b0 con 0x555e41d41820 2024-09-11T00:02:21.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.503+0000 7f064de00640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41d41820 0x555e41d43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.505+0000 7f064de00640 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41d41820 0x555e41d43c40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99fb3aa511a3cc2f server_cookie=be5bfef11a1016c3 in_seq=0 out_seq=0 2024-09-11T00:02:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.505+0000 7f0633e00640 10 client.25891 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.534+0000 7f0633e00640 1 -- 172.21.15.33:0/2770157584 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555e41c2f0b0 con 0x555e41d41820 2024-09-11T00:02:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.534+0000 7f0633e00640 10 client.25891 handle_command_reply: tid=0 2024-09-11T00:02:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.534+0000 7f0657c2b740 1 client.25891 shutdown 2024-09-11T00:02:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.535+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 msgr2=0x555e41cce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.535+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 0x555e41cce1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0648009810 tx=0x7f0648004a40 comp rx=0 tx=0).stop 2024-09-11T00:02:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.536+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 shutdown_connections 2024-09-11T00:02:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x555e41d41820 0x555e41d43c40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e41ccdd20 0x555e41cce1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555e41cc9470 0x555e41ccf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0657c2b740 1 --2- 172.21.15.33:0/2770157584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555e41cc3b00 0x555e41ccf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 >> 172.21.15.33:0/2770157584 conn(0x555e41cb98e0 msgr2=0x555e41cc3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.537+0000 7f0633e00640 0 client.25891 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.538+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 shutdown_connections 2024-09-11T00:02:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.538+0000 7f0657c2b740 1 -- 172.21.15.33:0/2770157584 wait complete. 2024-09-11T00:02:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.538+0000 7f0657c2b740 20 client.25891 trim_cache size 0 max 16384 2024-09-11T00:02:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:02:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:02:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:02:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:02:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 msgr2=0x7f06340b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 0x7f06340b7860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f06501a0040 tx=0x7f0648009500 comp rx=0 tx=0).stop 2024-09-11T00:02:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 msgr2=0x7f065019f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0640009780 tx=0x7f06400306e0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 shutdown_connections 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06340b53a0 0x7f06340b7860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0650108670 0x7f06501a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0650105ac0 0x7f065019f910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.539+0000 7f0654e00640 1 --2- 172.21.15.33:0/2590589323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065006b470 0x7f065019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.540+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 >> 172.21.15.33:0/2590589323 conn(0x7f06500fd140 msgr2=0x7f06501093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.540+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 shutdown_connections 2024-09-11T00:02:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:21.540+0000 7f0654e00640 1 -- 172.21.15.33:0/2590589323 wait complete. 2024-09-11T00:02:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:22 smithi189 ceph-mon[34000]: pgmap v604: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-11T00:02:22.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:22 smithi052 ceph-mon[33526]: pgmap v604: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-11T00:02:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:22 smithi033 ceph-mon[30593]: pgmap v604: 129 pgs: 129 active+clean; 954 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 751 op/s 2024-09-11T00:02:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 155.0 s, 677.9 tps, lat 147.037 ms stddev 38.567 2024-09-11T00:02:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:24 smithi189 ceph-mon[34000]: pgmap v605: 129 pgs: 129 active+clean; 954 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 898 op/s 2024-09-11T00:02:24.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:24 smithi052 ceph-mon[33526]: pgmap v605: 129 pgs: 129 active+clean; 954 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 898 op/s 2024-09-11T00:02:25.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:24 smithi033 ceph-mon[30593]: pgmap v605: 129 pgs: 129 active+clean; 954 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 898 op/s 2024-09-11T00:02:26.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:26 smithi052 ceph-mon[33526]: pgmap v606: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-09-11T00:02:27.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:26 smithi033 ceph-mon[30593]: pgmap v606: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-09-11T00:02:27.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:26 smithi189 ceph-mon[34000]: pgmap v606: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 733 op/s 2024-09-11T00:02:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 160.0 s, 559.4 tps, lat 156.234 ms stddev 60.640 2024-09-11T00:02:28.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:28 smithi033 ceph-mon[30593]: pgmap v607: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 879 op/s 2024-09-11T00:02:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:28 smithi052 ceph-mon[33526]: pgmap v607: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 879 op/s 2024-09-11T00:02:29.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:28 smithi189 ceph-mon[34000]: pgmap v607: 129 pgs: 129 active+clean; 955 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 879 op/s 2024-09-11T00:02:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:30 smithi052 ceph-mon[33526]: pgmap v608: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 810 op/s 2024-09-11T00:02:31.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:30 smithi033 ceph-mon[30593]: pgmap v608: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 810 op/s 2024-09-11T00:02:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:30 smithi189 ceph-mon[34000]: pgmap v608: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 810 op/s 2024-09-11T00:02:32.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:32 smithi052 ceph-mon[33526]: pgmap v609: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 787 op/s 2024-09-11T00:02:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:32 smithi033 ceph-mon[30593]: pgmap v609: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 787 op/s 2024-09-11T00:02:33.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:32 smithi189 ceph-mon[34000]: pgmap v609: 129 pgs: 129 active+clean; 955 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 787 op/s 2024-09-11T00:02:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 165.0 s, 546.0 tps, lat 207.065 ms stddev 313.298 2024-09-11T00:02:33.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:33 smithi052 ceph-mon[33526]: pgmap v610: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-11T00:02:34.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:33 smithi033 ceph-mon[30593]: pgmap v610: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-11T00:02:34.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:33 smithi189 ceph-mon[34000]: pgmap v610: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-11T00:02:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 -- 172.21.15.33:0/2030977214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58104ba0 msgr2=0x7f3e58104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 --2- 172.21.15.33:0/2030977214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58104ba0 0x7f3e58104fa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e4802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 -- 172.21.15.33:0/2030977214 shutdown_connections 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 --2- 172.21.15.33:0/2030977214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e581066b0 0x7f3e5810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 --2- 172.21.15.33:0/2030977214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e58105cf0 0x7f3e58106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 --2- 172.21.15.33:0/2030977214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58104ba0 0x7f3e58104fa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.698+0000 7f3e5d200640 1 -- 172.21.15.33:0/2030977214 >> 172.21.15.33:0/2030977214 conn(0x7f3e58100460 msgr2=0x7f3e58102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.699+0000 7f3e5d200640 1 -- 172.21.15.33:0/2030977214 shutdown_connections 2024-09-11T00:02:34.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.699+0000 7f3e5d200640 1 -- 172.21.15.33:0/2030977214 wait complete. 2024-09-11T00:02:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 Processor -- start 2024-09-11T00:02:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 -- start start 2024-09-11T00:02:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e58104ba0 0x7f3e58074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5806d2d0 con 0x7f3e58104ba0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5806d150 con 0x7f3e58105cf0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.700+0000 7f3e5d200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5806d450 con 0x7f3e581066b0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e55400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e56800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e56800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37246/0 (socket says 172.21.15.33:37246) 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e56800640 1 -- 172.21.15.33:0/4055361770 learned_addr learned my addr 172.21.15.33:0/4055361770 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e55e00640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e58104ba0 0x7f3e58074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.701+0000 7f3e55400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35022/0 (socket says 172.21.15.33:35022) 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 -- 172.21.15.33:0/4055361770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 msgr2=0x7f3e58072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 -- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e58104ba0 msgr2=0x7f3e58074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e58104ba0 0x7f3e58074040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 -- 172.21.15.33:0/4055361770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e58073150 con 0x7f3e58105cf0 2024-09-11T00:02:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e56800640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.702+0000 7f3e55400640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e9f0 tx=0x7f3e4400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.703+0000 7f3e4ea00640 1 -- 172.21.15.33:0/4055361770 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ccc0 con 0x7f3e58105cf0 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.703+0000 7f3e4ea00640 1 -- 172.21.15.33:0/4055361770 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e440108c0 con 0x7f3e58105cf0 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.703+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e580733e0 con 0x7f3e58105cf0 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.703+0000 7f3e4ea00640 1 -- 172.21.15.33:0/4055361770 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440187e0 con 0x7f3e58105cf0 2024-09-11T00:02:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.703+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e580738d0 con 0x7f3e58105cf0 2024-09-11T00:02:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.707+0000 7f3e601c6740 1 Processor -- start 2024-09-11T00:02:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 -- start start 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a227790 0x55641a229b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a22efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55641a19a6b0 con 0x55641a227790 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55641a189ae0 con 0x55641a22cb00 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.708+0000 7f3e601c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55641a18d8f0 con 0x55641a22a0c0 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e56800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a227790 0x55641a229b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37256/0 (socket says 172.21.15.33:37256) 2024-09-11T00:02:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 -- 172.21.15.33:0/1457901630 learned_addr learned my addr 172.21.15.33:0/1457901630 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 -- 172.21.15.33:0/1457901630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 msgr2=0x55641a22efc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a22efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 -- 172.21.15.33:0/1457901630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a227790 msgr2=0x55641a229b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a227790 0x55641a229b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.709+0000 7f3e55e00640 1 -- 172.21.15.33:0/1457901630 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55641a156780 con 0x55641a22a0c0 2024-09-11T00:02:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.710+0000 7f3e55e00640 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e480040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a104036f9b5990 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.710+0000 7f3e43400640 1 -- 172.21.15.33:0/1457901630 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48040070 con 0x55641a22a0c0 2024-09-11T00:02:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.710+0000 7f3e43400640 1 -- 172.21.15.33:0/1457901630 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e480044c0 con 0x55641a22a0c0 2024-09-11T00:02:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.710+0000 7f3e43400640 1 -- 172.21.15.33:0/1457901630 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48035040 con 0x55641a22a0c0 2024-09-11T00:02:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.711+0000 7f3e4ea00640 1 -- 172.21.15.33:0/4055361770 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3e44010430 con 0x7f3e58105cf0 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.711+0000 7f3e601c6740 1 -- 172.21.15.33:0/1457901630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 msgr2=0x55641a22c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.711+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009900 tx=0x7f3e480040d0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.712+0000 7f3e601c6740 1 -- 172.21.15.33:0/1457901630 shutdown_connections 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.712+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a22efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.712+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22a0c0 0x55641a22c4b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.712+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1457901630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a227790 0x55641a229b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.712+0000 7f3e601c6740 1 -- 172.21.15.33:0/1457901630 >> 172.21.15.33:0/1457901630 conn(0x55641a2228e0 msgr2=0x55641a223670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.713+0000 7f3e4ea00640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 0x7f3e3c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.714+0000 7f3e4ea00640 1 -- 172.21.15.33:0/4055361770 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3e440e6350 con 0x7f3e58105cf0 2024-09-11T00:02:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.714+0000 7f3e601c6740 1 -- 172.21.15.33:0/1457901630 shutdown_connections 2024-09-11T00:02:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.716+0000 7f3e55e00640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 0x7f3e3c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.717+0000 7f3e601c6740 1 -- 172.21.15.33:0/1457901630 wait complete. 2024-09-11T00:02:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.717+0000 7f3e601c6740 1 -- start start 2024-09-11T00:02:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.718+0000 7f3e601c6740 1 Processor -- start 2024-09-11T00:02:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.718+0000 7f3e55e00640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 0x7f3e3c0b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802a9e0 tx=0x7f3e4802a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.718+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a227790 0x55641a239770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.718+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.718+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22cb00 0x55641a23a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e601c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55641a0c1ab0 con 0x55641a22a0c0 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a227790 0x55641a239770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55680/0 (socket says 172.21.15.33:55680) 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e55400640 1 -- 172.21.15.33:0/1136822765 learned_addr learned my addr 172.21.15.33:0/1136822765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55641a130570 con 0x55641a227790 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55641a238290 con 0x55641a22cb00 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e56800640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22cb00 0x55641a23a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.719+0000 7f3e601c6740 10 client.0 _ll_register_callbacks cb 0x55641a13f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 -- 172.21.15.33:0/1136822765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22cb00 msgr2=0x55641a23a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22cb00 0x55641a23a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 -- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a227790 msgr2=0x55641a239770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a227790 0x55641a239770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556419eeb790 con 0x55641a22a0c0 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55641a19c600 con 0x55641a22a0c0 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.720+0000 7f3e55400640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e440a8d90 tx=0x7f3e440ac200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9296ba4900e79602 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e37e00640 10 client.16185 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:02:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e37e00640 1 -- 172.21.15.33:0/1136822765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440abc20 con 0x55641a22a0c0 2024-09-11T00:02:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e37e00640 1 -- 172.21.15.33:0/1136822765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3e440a8110 con 0x55641a22a0c0 2024-09-11T00:02:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e37e00640 1 -- 172.21.15.33:0/1136822765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e440a8310 con 0x55641a22a0c0 2024-09-11T00:02:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e601c6740 10 client.16185 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:34.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.721+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556419f64620 con 0x55641a22a0c0 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e37e00640 1 -- 172.21.15.33:0/1136822765 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3e440ab490 con 0x55641a22a0c0 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 10 client.16185 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 20 client.16185 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a244ea0 0x55641a247290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 4 client.16185 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.722+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55641a1980b0 con 0x55641a244ea0 2024-09-11T00:02:34.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.723+0000 7f3e55e00640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a244ea0 0x55641a247290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.724+0000 7f3e55e00640 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a244ea0 0x55641a247290 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85e655b3927278a server_cookie=8c9cb7e2d768ac65 in_seq=0 out_seq=0 2024-09-11T00:02:34.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.724+0000 7f3e37e00640 10 client.16185 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:34.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.725+0000 7f3e37e00640 1 -- 172.21.15.33:0/1136822765 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55641a1980b0 con 0x55641a244ea0 2024-09-11T00:02:34.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.725+0000 7f3e37e00640 10 client.16185 handle_command_reply: tid=0 2024-09-11T00:02:34.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.726+0000 7f3e601c6740 1 client.16185 shutdown 2024-09-11T00:02:34.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 msgr2=0x55641a239e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e440a8d90 tx=0x7f3e440ac200 comp rx=0 tx=0).stop 2024-09-11T00:02:34.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 shutdown_connections 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a244ea0 0x55641a247290 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a22cb00 0x55641a23a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a239e10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 --2- 172.21.15.33:0/1136822765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a227790 0x55641a239770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.727+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 >> 172.21.15.33:0/1136822765 conn(0x55641a2228e0 msgr2=0x55641a221a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.728+0000 7f3e37e00640 0 client.16185 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.728+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 shutdown_connections 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.728+0000 7f3e601c6740 1 -- 172.21.15.33:0/1136822765 wait complete. 2024-09-11T00:02:34.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.728+0000 7f3e601c6740 20 client.16185 trim_cache size 0 max 16384 2024-09-11T00:02:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.757+0000 7f3e601c6740 1 Processor -- start 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 -- start start 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 0x55641a22d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22cb00 0x55641a224710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581b45e0 con 0x55641a22cb00 2024-09-11T00:02:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581b1eb0 con 0x55641a22a0c0 2024-09-11T00:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.758+0000 7f3e601c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581afd20 con 0x55641a227790 2024-09-11T00:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.759+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.759+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37278/0 (socket says 172.21.15.33:37278) 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.759+0000 7f3e55e00640 1 -- 172.21.15.33:0/627910716 learned_addr learned my addr 172.21.15.33:0/627910716 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.759+0000 7f3e55400640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 0x55641a22d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e56800640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22cb00 0x55641a224710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55e00640 1 -- 172.21.15.33:0/627910716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 msgr2=0x55641a22d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55e00640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 0x55641a22d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55e00640 1 -- 172.21.15.33:0/627910716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22cb00 msgr2=0x55641a224710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55e00640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22cb00 0x55641a224710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55e00640 1 -- 172.21.15.33:0/627910716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55641a229ef0 con 0x55641a227790 2024-09-11T00:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.760+0000 7f3e55400640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 0x55641a22d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.761+0000 7f3e55e00640 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000c00 tx=0x7f3e48045000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac3e507fad3a96b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.761+0000 7f3e42a00640 1 -- 172.21.15.33:0/627910716 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48040040 con 0x55641a227790 2024-09-11T00:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.761+0000 7f3e42a00640 1 -- 172.21.15.33:0/627910716 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e48031900 con 0x55641a227790 2024-09-11T00:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.761+0000 7f3e42a00640 1 -- 172.21.15.33:0/627910716 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4804d740 con 0x55641a227790 2024-09-11T00:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.763+0000 7f3e601c6740 1 -- 172.21.15.33:0/627910716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 msgr2=0x55641a22cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.763+0000 7f3e601c6740 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000c00 tx=0x7f3e48045000 comp rx=0 tx=0).stop 2024-09-11T00:02:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.765+0000 7f3e601c6740 1 -- 172.21.15.33:0/627910716 shutdown_connections 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.765+0000 7f3e601c6740 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22cb00 0x55641a224710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.765+0000 7f3e601c6740 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22a0c0 0x55641a22d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.765+0000 7f3e601c6740 1 --2- 172.21.15.33:0/627910716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a22cf70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.765+0000 7f3e601c6740 1 -- 172.21.15.33:0/627910716 >> 172.21.15.33:0/627910716 conn(0x55641a2228e0 msgr2=0x55641a239770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.766+0000 7f3e601c6740 1 -- 172.21.15.33:0/627910716 shutdown_connections 2024-09-11T00:02:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.766+0000 7f3e601c6740 1 -- 172.21.15.33:0/627910716 wait complete. 2024-09-11T00:02:34.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.766+0000 7f3e601c6740 1 -- start start 2024-09-11T00:02:34.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.767+0000 7f3e601c6740 1 Processor -- start 2024-09-11T00:02:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.769+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.769+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a23d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.769+0000 7f3e601c6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e56800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e56800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35048/0 (socket says 172.21.15.33:35048) 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e601c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581b0370 con 0x55641a22a0c0 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e601c6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581b17e0 con 0x55641a22cb00 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e601c6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e581b0a40 con 0x55641a227790 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e601c6740 10 client.0 _ll_register_callbacks cb 0x7f3e44005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e55e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37280/0 (socket says 172.21.15.33:37280) 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.770+0000 7f3e55e00640 1 -- 172.21.15.33:0/2809367611 learned_addr learned my addr 172.21.15.33:0/2809367611 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.771+0000 7f3e55e00640 1 -- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 msgr2=0x55641a23dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.771+0000 7f3e55e00640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.771+0000 7f3e55e00640 1 -- 172.21.15.33:0/2809367611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 msgr2=0x55641a23d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.771+0000 7f3e55e00640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a23d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.771+0000 7f3e55e00640 1 -- 172.21.15.33:0/2809367611 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55641a23ad50 con 0x55641a227790 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.772+0000 7f3e55e00640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e48003fe0 tx=0x7f3e480047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2374aba6f3ca2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.772+0000 7f3e37e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.772+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48040040 con 0x55641a227790 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.772+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3e48031cb0 con 0x55641a227790 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.773+0000 7f3e56800640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-11T00:02:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.773+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e48031900 con 0x55641a227790 2024-09-11T00:02:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.773+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e4804d4c0 con 0x55641a227790 2024-09-11T00:02:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.773+0000 7f3e601c6740 10 client.25909 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.773+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55641a233840 con 0x55641a227790 2024-09-11T00:02:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.774+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e48031900 con 0x55641a227790 2024-09-11T00:02:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.775+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3e48062570 con 0x55641a227790 2024-09-11T00:02:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 10 client.25909 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 20 client.25909 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a233ba0 0x55641a235f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 4 client.25909 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:02:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55641a1954e0 con 0x55641a233ba0 2024-09-11T00:02:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.776+0000 7f3e55400640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a233ba0 0x55641a235f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.777+0000 7f3e55400640 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a233ba0 0x55641a235f90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f874cd2696c1d19e server_cookie=4c6b903da1e87f43 in_seq=0 out_seq=0 2024-09-11T00:02:34.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.777+0000 7f3e37e00640 10 client.25909 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.812+0000 7f3e37e00640 1 -- 172.21.15.33:0/2809367611 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55641a1954e0 con 0x55641a233ba0 2024-09-11T00:02:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.812+0000 7f3e37e00640 10 client.25909 handle_command_reply: tid=0 2024-09-11T00:02:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.812+0000 7f3e601c6740 1 client.25909 shutdown 2024-09-11T00:02:34.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.813+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 msgr2=0x55641a241750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.813+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e48003fe0 tx=0x7f3e480047e0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 shutdown_connections 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55641a22cb00 0x55641a23dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55641a22a0c0 0x55641a23d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55641a233ba0 0x55641a235f90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 --2- 172.21.15.33:0/2809367611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55641a227790 0x55641a241750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e37e00640 0 client.25909 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 >> 172.21.15.33:0/2809367611 conn(0x55641a2228e0 msgr2=0x55641a239710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 shutdown_connections 2024-09-11T00:02:34.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 1 -- 172.21.15.33:0/2809367611 wait complete. 2024-09-11T00:02:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.814+0000 7f3e601c6740 20 client.25909 trim_cache size 0 max 16384 2024-09-11T00:02:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:02:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:02:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:02:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 msgr2=0x7f3e3c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 0x7f3e3c0b7820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e4802a9e0 tx=0x7f3e4802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 msgr2=0x7f3e58074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e9f0 tx=0x7f3e4400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 shutdown_connections 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3e3c0b5360 0x7f3e3c0b7820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e581066b0 0x7f3e58072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.815+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e58105cf0 0x7f3e58074620 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e9f0 tx=0x7f3e4400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.816+0000 7f3e5d200640 1 --2- 172.21.15.33:0/4055361770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e58104ba0 0x7f3e58074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:34.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.816+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 >> 172.21.15.33:0/4055361770 conn(0x7f3e58100460 msgr2=0x7f3e58107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:34.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.816+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 shutdown_connections 2024-09-11T00:02:34.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:34.816+0000 7f3e5d200640 1 -- 172.21.15.33:0/4055361770 wait complete. 2024-09-11T00:02:36.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:36 smithi033 ceph-mon[30593]: pgmap v611: 129 pgs: 129 active+clean; 980 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-11T00:02:36.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:36 smithi189 ceph-mon[34000]: pgmap v611: 129 pgs: 129 active+clean; 980 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-11T00:02:36.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:36 smithi052 ceph-mon[33526]: pgmap v611: 129 pgs: 129 active+clean; 980 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 11 MiB/s wr, 784 op/s 2024-09-11T00:02:38.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:38 smithi033 ceph-mon[30593]: pgmap v612: 129 pgs: 129 active+clean; 1000 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 15 MiB/s wr, 895 op/s 2024-09-11T00:02:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 170.0 s, 528.2 tps, lat 190.151 ms stddev 294.391 2024-09-11T00:02:38.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:38 smithi189 ceph-mon[34000]: pgmap v612: 129 pgs: 129 active+clean; 1000 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 15 MiB/s wr, 895 op/s 2024-09-11T00:02:38.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:38 smithi052 ceph-mon[33526]: pgmap v612: 129 pgs: 129 active+clean; 1000 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 15 MiB/s wr, 895 op/s 2024-09-11T00:02:40.270 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:40 smithi033 ceph-mon[30593]: pgmap v613: 129 pgs: 129 active+clean; 1004 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 788 op/s 2024-09-11T00:02:40.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:40 smithi189 ceph-mon[34000]: pgmap v613: 129 pgs: 129 active+clean; 1004 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 788 op/s 2024-09-11T00:02:40.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:40 smithi052 ceph-mon[33526]: pgmap v613: 129 pgs: 129 active+clean; 1004 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 788 op/s 2024-09-11T00:02:42.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:42 smithi033 ceph-mon[30593]: pgmap v614: 129 pgs: 129 active+clean; 1008 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 15 MiB/s wr, 792 op/s 2024-09-11T00:02:42.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:42 smithi189 ceph-mon[34000]: pgmap v614: 129 pgs: 129 active+clean; 1008 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 15 MiB/s wr, 792 op/s 2024-09-11T00:02:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:42 smithi052 ceph-mon[33526]: pgmap v614: 129 pgs: 129 active+clean; 1008 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 15 MiB/s wr, 792 op/s 2024-09-11T00:02:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 175.0 s, 630.4 tps, lat 135.292 ms stddev 187.186 2024-09-11T00:02:44.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:44 smithi189 ceph-mon[34000]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 19 MiB/s wr, 868 op/s 2024-09-11T00:02:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:44 smithi052 ceph-mon[33526]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 19 MiB/s wr, 868 op/s 2024-09-11T00:02:44.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:44 smithi033 ceph-mon[30593]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 19 MiB/s wr, 868 op/s 2024-09-11T00:02:46.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:46 smithi189 ceph-mon[34000]: pgmap v616: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 14 MiB/s wr, 677 op/s 2024-09-11T00:02:46.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:46 smithi052 ceph-mon[33526]: pgmap v616: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 14 MiB/s wr, 677 op/s 2024-09-11T00:02:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:46 smithi033 ceph-mon[30593]: pgmap v616: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 14 MiB/s wr, 677 op/s 2024-09-11T00:02:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.979+0000 7f39e4a00640 1 -- 172.21.15.33:0/1587323896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e0102790 msgr2=0x7f39e0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.979+0000 7f39e4a00640 1 --2- 172.21.15.33:0/1587323896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e0102790 0x7f39e0102b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009900 tx=0x7f39d002a400 comp rx=0 tx=0).stop 2024-09-11T00:02:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.979+0000 7f39e4a00640 1 -- 172.21.15.33:0/1587323896 shutdown_connections 2024-09-11T00:02:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.979+0000 7f39e4a00640 1 --2- 172.21.15.33:0/1587323896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e01042a0 0x7f39e010ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.980+0000 7f39e4a00640 1 --2- 172.21.15.33:0/1587323896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01038e0 0x7f39e0103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.980+0000 7f39e4a00640 1 --2- 172.21.15.33:0/1587323896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e0102790 0x7f39e0102b90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.980+0000 7f39e4a00640 1 -- 172.21.15.33:0/1587323896 >> 172.21.15.33:0/1587323896 conn(0x7f39e00fe030 msgr2=0x7f39e0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.980+0000 7f39e4a00640 1 -- 172.21.15.33:0/1587323896 shutdown_connections 2024-09-11T00:02:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.980+0000 7f39e4a00640 1 -- 172.21.15.33:0/1587323896 wait complete. 2024-09-11T00:02:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.981+0000 7f39e4a00640 1 Processor -- start 2024-09-11T00:02:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.981+0000 7f39e4a00640 1 -- start start 2024-09-11T00:02:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 0x7f39e0105010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 0x7f39e0105660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 0x7f39e0106290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010e2e0 con 0x7f39e0102790 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010e160 con 0x7f39e01038e0 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 0x7f39e0105010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 0x7f39e0105010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37484/0 (socket says 172.21.15.33:37484) 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 0x7f39e0105660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39df400640 1 -- 172.21.15.33:0/2762696713 learned_addr learned my addr 172.21.15.33:0/2762696713 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010e460 con 0x7f39e01042a0 2024-09-11T00:02:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.982+0000 7f39dfe00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 0x7f39e0106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dea00640 1 -- 172.21.15.33:0/2762696713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 msgr2=0x7f39e0106290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dea00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 0x7f39e0106290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dea00640 1 -- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 msgr2=0x7f39e0105010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dea00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 0x7f39e0105010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dea00640 1 -- 172.21.15.33:0/2762696713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e0106b50 con 0x7f39e01038e0 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.983+0000 7f39dfe00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 0x7f39e0106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39dea00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 0x7f39e0105660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d6d0 tx=0x7f39cc00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39d7e00640 1 -- 172.21.15.33:0/2762696713 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc017070 con 0x7f39e01038e0 2024-09-11T00:02:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e0106e40 con 0x7f39e01038e0 2024-09-11T00:02:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e01074e0 con 0x7f39e01038e0 2024-09-11T00:02:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39d7e00640 1 -- 172.21.15.33:0/2762696713 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39cc009820 con 0x7f39e01038e0 2024-09-11T00:02:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.984+0000 7f39d7e00640 1 -- 172.21.15.33:0/2762696713 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc004bc0 con 0x7f39e01038e0 2024-09-11T00:02:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.989+0000 7f39e8de4740 1 Processor -- start 2024-09-11T00:02:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 -- start start 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf919970 0x55a7cf91bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf9211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf88c6b0 con 0x55a7cf91c2a0 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf87bae0 con 0x55a7cf91ece0 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.990+0000 7f39e8de4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf87f8f0 con 0x55a7cf919970 2024-09-11T00:02:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.991+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.991+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37490/0 (socket says 172.21.15.33:37490) 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.991+0000 7f39df400640 1 -- 172.21.15.33:0/2420287566 learned_addr learned my addr 172.21.15.33:0/2420287566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.991+0000 7f39dfe00640 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf919970 0x55a7cf91bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39df400640 1 -- 172.21.15.33:0/2420287566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf919970 msgr2=0x55a7cf91bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39df400640 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf919970 0x55a7cf91bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39df400640 1 -- 172.21.15.33:0/2420287566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 msgr2=0x55a7cf9211a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39df400640 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf9211a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39df400640 1 -- 172.21.15.33:0/2420287566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7cf848780 con 0x55a7cf91c2a0 2024-09-11T00:02:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.992+0000 7f39d7e00640 1 -- 172.21.15.33:0/2762696713 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f39cc005220 con 0x7f39e01038e0 2024-09-11T00:02:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.993+0000 7f39df400640 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009850 tx=0x7f39d0004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00f5bb8c062f043 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.994+0000 7f39cbe00640 1 -- 172.21.15.33:0/2420287566 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0035030 con 0x55a7cf91c2a0 2024-09-11T00:02:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.994+0000 7f39cbe00640 1 -- 172.21.15.33:0/2420287566 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d0040070 con 0x55a7cf91c2a0 2024-09-11T00:02:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.994+0000 7f39cbe00640 1 -- 172.21.15.33:0/2420287566 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0031aa0 con 0x55a7cf91c2a0 2024-09-11T00:02:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.995+0000 7f39d7e00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 0x7f39c40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.996+0000 7f39d7e00640 1 -- 172.21.15.33:0/2762696713 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f39cc0e5750 con 0x7f39e01038e0 2024-09-11T00:02:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.996+0000 7f39e8de4740 1 -- 172.21.15.33:0/2420287566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 msgr2=0x55a7cf91e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.996+0000 7f39e8de4740 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009850 tx=0x7f39d0004350 comp rx=0 tx=0).stop 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39dfe00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 0x7f39c40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 -- 172.21.15.33:0/2420287566 shutdown_connections 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf9211a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf91e690 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 --2- 172.21.15.33:0/2420287566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf919970 0x55a7cf91bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 -- 172.21.15.33:0/2420287566 >> 172.21.15.33:0/2420287566 conn(0x55a7cf914ac0 msgr2=0x55a7cf915850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.997+0000 7f39e8de4740 1 -- 172.21.15.33:0/2420287566 shutdown_connections 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.998+0000 7f39dfe00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 0x7f39c40b7860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39e0105d90 tx=0x7f39d8009790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.998+0000 7f39e8de4740 1 -- 172.21.15.33:0/2420287566 wait complete. 2024-09-11T00:02:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.999+0000 7f39e8de4740 1 -- start start 2024-09-11T00:02:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:47.999+0000 7f39e8de4740 1 Processor -- start 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf9230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf924340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf7b3ab0 con 0x55a7cf919970 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf822570 con 0x55a7cf91ece0 2024-09-11T00:02:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7cf921c60 con 0x55a7cf91c2a0 2024-09-11T00:02:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39e8de4740 10 client.0 _ll_register_callbacks cb 0x55a7cf831100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.000+0000 7f39dea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf9230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47464/0 (socket says 172.21.15.33:47464) 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dea00640 1 -- 172.21.15.33:0/3962637300 learned_addr learned my addr 172.21.15.33:0/3962637300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf924340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dfe00640 1 -- 172.21.15.33:0/3962637300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 msgr2=0x55a7cf923770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dfe00640 1 -- 172.21.15.33:0/3962637300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 msgr2=0x55a7cf9230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.001+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf9230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.002+0000 7f39dfe00640 1 -- 172.21.15.33:0/3962637300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7cf5dd790 con 0x55a7cf91ece0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.002+0000 7f39dea00640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.002+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf924340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005fd0 tx=0x7f39d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d233c4574096951 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.002+0000 7f39c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d800ece0 con 0x55a7cf91ece0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f39d801f420 con 0x55a7cf91ece0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d0040070 con 0x55a7cf91ece0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f39d8030050 con 0x55a7cf91ece0 2024-09-11T00:02:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39e8de4740 10 client.35978 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.003+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a7cf656620 con 0x55a7cf91ece0 2024-09-11T00:02:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d0040070 con 0x55a7cf91ece0 2024-09-11T00:02:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f39d800f040 con 0x55a7cf91ece0 2024-09-11T00:02:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 10 client.35978 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 10 client.35978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 20 client.35978 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf92eab0 0x55a7cf930ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 4 client.35978 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.004+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7cf88e600 con 0x55a7cf92eab0 2024-09-11T00:02:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.005+0000 7f39df400640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf92eab0 0x55a7cf930ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.006+0000 7f39df400640 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf92eab0 0x55a7cf930ec0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1919675e413d9837 server_cookie=f33ac4f661cade62 in_seq=0 out_seq=0 2024-09-11T00:02:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.006+0000 7f39c8c00640 10 client.35978 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.007+0000 7f39c8c00640 1 -- 172.21.15.33:0/3962637300 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7cf88e600 con 0x55a7cf92eab0 2024-09-11T00:02:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.007+0000 7f39c8c00640 10 client.35978 handle_command_reply: tid=0 2024-09-11T00:02:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.007+0000 7f39e8de4740 1 client.35978 shutdown 2024-09-11T00:02:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.007+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 msgr2=0x55a7cf924340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.007+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf924340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005fd0 tx=0x7f39d8004a40 comp rx=0 tx=0).stop 2024-09-11T00:02:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 shutdown_connections 2024-09-11T00:02:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91ece0 0x55a7cf924340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf92eab0 0x55a7cf930ec0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91c2a0 0x55a7cf923770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3962637300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf9230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 >> 172.21.15.33:0/3962637300 conn(0x55a7cf914ac0 msgr2=0x55a7cf913bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39c8c00640 0 client.35978 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 shutdown_connections 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 1 -- 172.21.15.33:0/3962637300 wait complete. 2024-09-11T00:02:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.008+0000 7f39e8de4740 20 client.35978 trim_cache size 0 max 16384 2024-09-11T00:02:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.035+0000 7f39e8de4740 1 Processor -- start 2024-09-11T00:02:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 -- start start 2024-09-11T00:02:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 0x55a7cf922090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf9225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0012490 con 0x55a7cf919970 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000fd60 con 0x55a7cf91c2a0 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39e8de4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000dbb0 con 0x55a7cf91ece0 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37506/0 (socket says 172.21.15.33:37506) 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39df400640 1 -- 172.21.15.33:0/3166414632 learned_addr learned my addr 172.21.15.33:0/3166414632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.036+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf9225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39dea00640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 0x55a7cf922090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 -- 172.21.15.33:0/3166414632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 msgr2=0x55a7cf9225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf9225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 -- 172.21.15.33:0/3166414632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 msgr2=0x55a7cf922090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 0x55a7cf922090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 -- 172.21.15.33:0/3166414632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7cf91c0d0 con 0x55a7cf919970 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39dea00640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 0x55a7cf922090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.037+0000 7f39df400640 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f39d0005c40 tx=0x7f39d0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b935b0e80327448 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.039+0000 7f39cb400640 1 -- 172.21.15.33:0/3166414632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0035040 con 0x55a7cf919970 2024-09-11T00:02:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.039+0000 7f39cb400640 1 -- 172.21.15.33:0/3166414632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d0040070 con 0x55a7cf919970 2024-09-11T00:02:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.039+0000 7f39cb400640 1 -- 172.21.15.33:0/3166414632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0003ba0 con 0x55a7cf919970 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 -- 172.21.15.33:0/3166414632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 msgr2=0x55a7cf924320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f39d0005c40 tx=0x7f39d0009880 comp rx=0 tx=0).stop 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 -- 172.21.15.33:0/3166414632 shutdown_connections 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf9225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf91c2a0 0x55a7cf922090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3166414632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf919970 0x55a7cf924320 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 -- 172.21.15.33:0/3166414632 >> 172.21.15.33:0/3166414632 conn(0x55a7cf914ac0 msgr2=0x55a7cf915320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 -- 172.21.15.33:0/3166414632 shutdown_connections 2024-09-11T00:02:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.040+0000 7f39e8de4740 1 -- 172.21.15.33:0/3166414632 wait complete. 2024-09-11T00:02:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.041+0000 7f39e8de4740 1 -- start start 2024-09-11T00:02:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.041+0000 7f39e8de4740 1 Processor -- start 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 0x55a7cf92aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf926800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf926d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000e220 con 0x55a7cf91c2a0 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000f690 con 0x55a7cf919970 2024-09-11T00:02:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39c000e8f0 con 0x55a7cf91ece0 2024-09-11T00:02:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39e8de4740 10 client.0 _ll_register_callbacks cb 0x7f39d8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:02:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.042+0000 7f39dea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf926800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39dea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf926800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37518/0 (socket says 172.21.15.33:37518) 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39dea00640 1 -- 172.21.15.33:0/3515329932 learned_addr learned my addr 172.21.15.33:0/3515329932 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 0x55a7cf92aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf926d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 -- 172.21.15.33:0/3515329932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 msgr2=0x55a7cf926d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf926d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 -- 172.21.15.33:0/3515329932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 msgr2=0x55a7cf926800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf926800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39df400640 1 -- 172.21.15.33:0/3515329932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7cf927a50 con 0x55a7cf919970 2024-09-11T00:02:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.043+0000 7f39dfe00640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf926d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.044+0000 7f39df400640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 0x55a7cf92aad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39d00092a0 tx=0x7f39d002ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9f9df673fb38f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.044+0000 7f39c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:02:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.044+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0035040 con 0x55a7cf919970 2024-09-11T00:02:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.045+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f39d0003d30 con 0x55a7cf919970 2024-09-11T00:02:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.045+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d0040070 con 0x55a7cf919970 2024-09-11T00:02:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.045+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f39d006d050 con 0x55a7cf919970 2024-09-11T00:02:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.045+0000 7f39e8de4740 10 client.35984 fetch_fsmap learned FSMap version 30 2024-09-11T00:02:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.045+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a7cf9acbf0 con 0x55a7cf919970 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d0031a20 con 0x55a7cf919970 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f39d0068030 con 0x55a7cf919970 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 10 client.35984 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 10 client.35984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 20 client.35984 populate_metadata read hostname 'smithi033' 2024-09-11T00:02:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf9ad120 0x55a7cf9af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 4 client.35984 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:02:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.046+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f39d0040070 con 0x55a7cf9ad120 2024-09-11T00:02:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.047+0000 7f39dea00640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf9ad120 0x55a7cf9af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.048+0000 7f39c8c00640 10 client.35984 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.048+0000 7f39dea00640 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf9ad120 0x55a7cf9af540 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb81b297921ead5 server_cookie=711763d028d8065f in_seq=0 out_seq=0 2024-09-11T00:02:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.113+0000 7f39c8c00640 1 -- 172.21.15.33:0/3515329932 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f39d0040070 con 0x55a7cf9ad120 2024-09-11T00:02:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.113+0000 7f39c8c00640 10 client.35984 handle_command_reply: tid=0 2024-09-11T00:02:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.113+0000 7f39e8de4740 1 client.35984 shutdown 2024-09-11T00:02:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 msgr2=0x55a7cf92aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 0x55a7cf92aad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39d00092a0 tx=0x7f39d002ab90 comp rx=0 tx=0).stop 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 shutdown_connections 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7cf9ad120 0x55a7cf9af540 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7cf91ece0 0x55a7cf926d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7cf91c2a0 0x55a7cf926800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39c8c00640 0 client.35984 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 --2- 172.21.15.33:0/3515329932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7cf919970 0x55a7cf92aad0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 >> 172.21.15.33:0/3515329932 conn(0x55a7cf914ac0 msgr2=0x55a7cf915320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 shutdown_connections 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.114+0000 7f39e8de4740 1 -- 172.21.15.33:0/3515329932 wait complete. 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.115+0000 7f39e8de4740 20 client.35984 trim_cache size 0 max 16384 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:02:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 msgr2=0x7f39c40b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 0x7f39c40b7860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39e0105d90 tx=0x7f39d8009790 comp rx=0 tx=0).stop 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 msgr2=0x7f39e0105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 0x7f39e0105660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d6d0 tx=0x7f39cc00db90 comp rx=0 tx=0).stop 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 shutdown_connections 2024-09-11T00:02:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f39c40b53a0 0x7f39c40b7860 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f39e01042a0 0x7f39e0106290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e01038e0 0x7f39e0105660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 --2- 172.21.15.33:0/2762696713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39e0102790 0x7f39e0105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 >> 172.21.15.33:0/2762696713 conn(0x7f39e00fe030 msgr2=0x7f39e0075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.116+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 shutdown_connections 2024-09-11T00:02:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:02:48.117+0000 7f39e4a00640 1 -- 172.21.15.33:0/2762696713 wait complete. 2024-09-11T00:02:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 180.0 s, 677.4 tps, lat 168.780 ms stddev 260.995 2024-09-11T00:02:48.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:48 smithi189 ceph-mon[34000]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-11T00:02:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:48 smithi052 ceph-mon[33526]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-11T00:02:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:48 smithi033 ceph-mon[30593]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-11T00:02:50.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:50 smithi189 ceph-mon[34000]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 670 op/s 2024-09-11T00:02:50.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:50 smithi052 ceph-mon[33526]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 670 op/s 2024-09-11T00:02:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:50 smithi033 ceph-mon[30593]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 670 op/s 2024-09-11T00:02:52.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:52 smithi189 ceph-mon[34000]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-11T00:02:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:52 smithi052 ceph-mon[33526]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-11T00:02:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:52 smithi033 ceph-mon[30593]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-11T00:02:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 185.0 s, 541.8 tps, lat 151.164 ms stddev 206.317 2024-09-11T00:02:54.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:54 smithi189 ceph-mon[34000]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 778 op/s 2024-09-11T00:02:54.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:54 smithi052 ceph-mon[33526]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 778 op/s 2024-09-11T00:02:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:54 smithi033 ceph-mon[30593]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 778 op/s 2024-09-11T00:02:56.329 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:56 smithi033 ceph-mon[30593]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-09-11T00:02:56.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:56 smithi189 ceph-mon[34000]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-09-11T00:02:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:56 smithi052 ceph-mon[33526]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 15 MiB/s wr, 659 op/s 2024-09-11T00:02:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 190.0 s, 739.4 tps, lat 159.170 ms stddev 247.504 2024-09-11T00:02:58.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:02:58 smithi189 ceph-mon[34000]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 772 op/s 2024-09-11T00:02:58.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:02:58 smithi052 ceph-mon[33526]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 772 op/s 2024-09-11T00:02:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:02:58 smithi033 ceph-mon[30593]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 772 op/s 2024-09-11T00:03:00.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:00 smithi189 ceph-mon[34000]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 724 op/s 2024-09-11T00:03:00.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:00 smithi052 ceph-mon[33526]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 724 op/s 2024-09-11T00:03:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:00 smithi033 ceph-mon[30593]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 724 op/s 2024-09-11T00:03:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 -- 172.21.15.33:0/1563903993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d006bf50 msgr2=0x7f51d0103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 --2- 172.21.15.33:0/1563903993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d006bf50 0x7f51d0103350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009ca0 tx=0x7f51c802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 -- 172.21.15.33:0/1563903993 shutdown_connections 2024-09-11T00:03:01.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 --2- 172.21.15.33:0/1563903993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d0106490 0x7f51d0106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 --2- 172.21.15.33:0/1563903993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d01038e0 0x7f51d0105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 --2- 172.21.15.33:0/1563903993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d006bf50 0x7f51d0103350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 -- 172.21.15.33:0/1563903993 >> 172.21.15.33:0/1563903993 conn(0x7f51d00fd150 msgr2=0x7f51d00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 -- 172.21.15.33:0/1563903993 shutdown_connections 2024-09-11T00:03:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.309+0000 7f51d8400640 1 -- 172.21.15.33:0/1563903993 wait complete. 2024-09-11T00:03:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 Processor -- start 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 -- start start 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 0x7f51d019f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d01038e0 0x7f51d019f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.311+0000 7f51d8400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0114b10 con 0x7f51d006bf50 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0114990 con 0x7f51d0106490 2024-09-11T00:03:01.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d8400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0114c90 con 0x7f51d01038e0 2024-09-11T00:03:01.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54502/0 (socket says 172.21.15.33:54502) 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d6400640 1 -- 172.21.15.33:0/2151034184 learned_addr learned my addr 172.21.15.33:0/2151034184 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d5a00640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 0x7f51d019f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.312+0000 7f51d5000640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d01038e0 0x7f51d019f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.313+0000 7f51d6400640 1 -- 172.21.15.33:0/2151034184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d01038e0 msgr2=0x7f51d019f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.313+0000 7f51d6400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d01038e0 0x7f51d019f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.313+0000 7f51d6400640 1 -- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 msgr2=0x7f51d019f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.314+0000 7f51d6400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 0x7f51d019f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.314+0000 7f51d6400640 1 -- 172.21.15.33:0/2151034184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d01a0e40 con 0x7f51d0106490 2024-09-11T00:03:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.314+0000 7f51d5a00640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 0x7f51d019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:01.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.315+0000 7f51d6400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00d950 tx=0x7f51bc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.315+0000 7f51ce000640 1 -- 172.21.15.33:0/2151034184 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc017030 con 0x7f51d0106490 2024-09-11T00:03:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.315+0000 7f51ce000640 1 -- 172.21.15.33:0/2151034184 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51bc004020 con 0x7f51d0106490 2024-09-11T00:03:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.315+0000 7f51ce000640 1 -- 172.21.15.33:0/2151034184 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc003ab0 con 0x7f51d0106490 2024-09-11T00:03:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.316+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d01a1130 con 0x7f51d0106490 2024-09-11T00:03:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.316+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d0107b40 con 0x7f51d0106490 2024-09-11T00:03:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.320+0000 7f51db253740 1 Processor -- start 2024-09-11T00:03:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.321+0000 7f51ce000640 1 -- 172.21.15.33:0/2151034184 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f51bc024060 con 0x7f51d0106490 2024-09-11T00:03:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.321+0000 7f51db253740 1 -- start start 2024-09-11T00:03:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.322+0000 7f51db253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d0790 0x55662f8d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.322+0000 7f51db253740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51db253740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 0x55662f8d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51db253740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55662f8436b0 con 0x55662f8d5b00 2024-09-11T00:03:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51db253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55662f832ae0 con 0x55662f8d0790 2024-09-11T00:03:01.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51db253740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55662f8368f0 con 0x55662f8d30c0 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58834/0 (socket says 172.21.15.33:58834) 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5a00640 1 -- 172.21.15.33:0/22635443 learned_addr learned my addr 172.21.15.33:0/22635443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5000640 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 0x55662f8d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51ce000640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 0x7f51b40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5a00640 1 -- 172.21.15.33:0/22635443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d0790 msgr2=0x55662f8d2b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.323+0000 7f51d5a00640 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d0790 0x55662f8d2b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d5a00640 1 -- 172.21.15.33:0/22635443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 msgr2=0x55662f8d7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51ce000640 1 -- 172.21.15.33:0/2151034184 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f51bc0e59e0 con 0x7f51d0106490 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d5a00640 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 0x55662f8d7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d5a00640 1 -- 172.21.15.33:0/22635443 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662f7ff780 con 0x55662f8d30c0 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d5000640 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 0x55662f8d7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d6400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 0x7f51b40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.324+0000 7f51d5a00640 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51c80319e0 tx=0x7f51c8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7731ba32e6a9ae40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.325+0000 7f51c6a00640 1 -- 172.21.15.33:0/22635443 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8031c80 con 0x55662f8d30c0 2024-09-11T00:03:01.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.325+0000 7f51c6a00640 1 -- 172.21.15.33:0/22635443 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51c8036040 con 0x55662f8d30c0 2024-09-11T00:03:01.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.325+0000 7f51c6a00640 1 -- 172.21.15.33:0/22635443 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c80044b0 con 0x55662f8d30c0 2024-09-11T00:03:01.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 -- 172.21.15.33:0/22635443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 msgr2=0x55662f8d54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51d6400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 0x7f51b40b7820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0af590 tx=0x7f51bc00df40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51c80319e0 tx=0x7f51c8005f90 comp rx=0 tx=0).stop 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 -- 172.21.15.33:0/22635443 shutdown_connections 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d5b00 0x55662f8d7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8d54b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 --2- 172.21.15.33:0/22635443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d0790 0x55662f8d2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 -- 172.21.15.33:0/22635443 >> 172.21.15.33:0/22635443 conn(0x55662f8cb8e0 msgr2=0x55662f8cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.326+0000 7f51db253740 1 -- 172.21.15.33:0/22635443 shutdown_connections 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.327+0000 7f51db253740 1 -- 172.21.15.33:0/22635443 wait complete. 2024-09-11T00:03:01.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.327+0000 7f51db253740 1 -- start start 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.327+0000 7f51db253740 1 Processor -- start 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8d9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8db130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55662f76aab0 con 0x55662f8d0790 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55662f7d9570 con 0x55662f8d5b00 2024-09-11T00:03:01.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55662f8d8a80 con 0x55662f8d30c0 2024-09-11T00:03:01.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51db253740 10 client.0 _ll_register_callbacks cb 0x55662f7e8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:01.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:58836/0 (socket says 172.21.15.33:58836) 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51d5a00640 1 -- 172.21.15.33:0/2959604251 learned_addr learned my addr 172.21.15.33:0/2959604251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.328+0000 7f51d5000640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8d9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 -- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 msgr2=0x55662f8db130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8db130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 -- 172.21.15.33:0/2959604251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 msgr2=0x55662f8d9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8d9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 -- 172.21.15.33:0/2959604251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662f594790 con 0x55662f8d30c0 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5000640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8d9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51d5a00640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51c8006010 tx=0x7f51c802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c54b90feb66958 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.329+0000 7f51bb400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c804a040 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f51c8031dc0 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c8036040 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51c805c050 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51db253740 10 client.25936 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.330+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55662f60d620 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51c8036040 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f51c804d070 con 0x55662f8d30c0 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 10 client.25936 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 20 client.25936 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f8e5360 0x55662f8e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 4 client.25936 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.331+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55662f845600 con 0x55662f8e5360 2024-09-11T00:03:01.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.332+0000 7f51d5000640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f8e5360 0x55662f8e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.333+0000 7f51d5000640 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f8e5360 0x55662f8e7750 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc81a08852a10f82 server_cookie=f4d25e6d6b25216a in_seq=0 out_seq=0 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.333+0000 7f51bb400640 10 client.25936 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.333+0000 7f51bb400640 1 -- 172.21.15.33:0/2959604251 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55662f845600 con 0x55662f8e5360 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.333+0000 7f51bb400640 10 client.25936 handle_command_reply: tid=0 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 client.25936 shutdown 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 msgr2=0x55662f8da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51c8006010 tx=0x7f51c802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 shutdown_connections 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8db130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f8e5360 0x55662f8e7750 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d30c0 0x55662f8da560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 --2- 172.21.15.33:0/2959604251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8d9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 >> 172.21.15.33:0/2959604251 conn(0x55662f8cb8e0 msgr2=0x55662f8caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51bb400640 0 client.25936 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 shutdown_connections 2024-09-11T00:03:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 1 -- 172.21.15.33:0/2959604251 wait complete. 2024-09-11T00:03:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.334+0000 7f51db253740 20 client.25936 trim_cache size 0 max 16384 2024-09-11T00:03:01.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 Processor -- start 2024-09-11T00:03:01.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 -- start start 2024-09-11T00:03:01.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d5b00 0x55662f8d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01bcd10 con 0x55662f8d0790 2024-09-11T00:03:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01ba5e0 con 0x55662f8d30c0 2024-09-11T00:03:01.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.359+0000 7f51db253740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51d010ff70 con 0x55662f8d5b00 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54508/0 (socket says 172.21.15.33:54508) 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 -- 172.21.15.33:0/719377918 learned_addr learned my addr 172.21.15.33:0/719377918 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5000640 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d5b00 0x55662f8d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 -- 172.21.15.33:0/719377918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d5b00 msgr2=0x55662f8d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d5b00 0x55662f8d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 -- 172.21.15.33:0/719377918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 msgr2=0x55662f8da4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.360+0000 7f51d5a00640 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8da4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.361+0000 7f51d5a00640 1 -- 172.21.15.33:0/719377918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662f8ccb40 con 0x55662f8d30c0 2024-09-11T00:03:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.361+0000 7f51d5000640 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8da4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:01.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.361+0000 7f51d5a00640 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51c802ade0 tx=0x7f51c8005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace3143e2d025273 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.361+0000 7f51c6000640 1 -- 172.21.15.33:0/719377918 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8031dc0 con 0x55662f8d30c0 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.361+0000 7f51c6000640 1 -- 172.21.15.33:0/719377918 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51c8036040 con 0x55662f8d30c0 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.362+0000 7f51c6000640 1 -- 172.21.15.33:0/719377918 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c80586b0 con 0x55662f8d30c0 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.362+0000 7f51db253740 1 -- 172.21.15.33:0/719377918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 msgr2=0x55662f8cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.362+0000 7f51db253740 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f51c802ade0 tx=0x7f51c8005ef0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 -- 172.21.15.33:0/719377918 shutdown_connections 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8d5b00 0x55662f8d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d30c0 0x55662f8cfcb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 --2- 172.21.15.33:0/719377918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8da4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 -- 172.21.15.33:0/719377918 >> 172.21.15.33:0/719377918 conn(0x55662f8cb8e0 msgr2=0x55662f8d9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 -- 172.21.15.33:0/719377918 shutdown_connections 2024-09-11T00:03:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 -- 172.21.15.33:0/719377918 wait complete. 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 -- start start 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.363+0000 7f51db253740 1 Processor -- start 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8e0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8e0e90 0x55662f8df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01b8aa0 con 0x55662f8d0790 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01b9f10 con 0x55662f8d5b00 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51d01b9170 con 0x55662f8e0e90 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51db253740 10 client.0 _ll_register_callbacks cb 0x7f51c8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51d5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8e1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34072/0 (socket says 172.21.15.33:34072) 2024-09-11T00:03:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51d5000640 1 -- 172.21.15.33:0/523054493 learned_addr learned my addr 172.21.15.33:0/523054493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.364+0000 7f51d5000640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8e0e90 0x55662f8df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 -- 172.21.15.33:0/523054493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8e0e90 msgr2=0x55662f8df370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8e0e90 0x55662f8df370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 -- 172.21.15.33:0/523054493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 msgr2=0x55662f8e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 -- 172.21.15.33:0/523054493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662f8d2ef0 con 0x55662f8d5b00 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51d5a00640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8e0840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51c804f000 tx=0x7f51c8031df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880ef61ffc47dc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.365+0000 7f51bb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:03:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8031690 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51c8036040 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f51c8030610 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51c8073050 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51db253740 10 client.35996 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55662f952660 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.366+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51c8036040 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f51c804d040 con 0x55662f8d5b00 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 10 client.35996 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 10 client.35996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 20 client.35996 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f952ec0 0x55662f9552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 4 client.35996 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:03:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55662f8daba0 con 0x55662f952ec0 2024-09-11T00:03:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.367+0000 7f51d5000640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f952ec0 0x55662f9552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.368+0000 7f51d5000640 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f952ec0 0x55662f9552b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad18bce3b20e89b server_cookie=faf969a7ad2d5623 in_seq=0 out_seq=0 2024-09-11T00:03:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.368+0000 7f51bb400640 10 client.35996 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51bb400640 1 -- 172.21.15.33:0/523054493 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55662f8daba0 con 0x55662f952ec0 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51bb400640 10 client.35996 handle_command_reply: tid=0 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 client.35996 shutdown 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 msgr2=0x55662f8e0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8e0840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f51c804f000 tx=0x7f51c8031df0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 shutdown_connections 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55662f952ec0 0x55662f9552b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55662f8e0e90 0x55662f8df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55662f8d5b00 0x55662f8e0840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 --2- 172.21.15.33:0/523054493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55662f8d0790 0x55662f8e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 >> 172.21.15.33:0/523054493 conn(0x55662f8cb8e0 msgr2=0x55662f8cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51bb400640 0 client.35996 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 shutdown_connections 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.498+0000 7f51db253740 1 -- 172.21.15.33:0/523054493 wait complete. 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.499+0000 7f51db253740 20 client.35996 trim_cache size 0 max 16384 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:03:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 msgr2=0x7f51b40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 0x7f51b40b7820 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0af590 tx=0x7f51bc00df40 comp rx=0 tx=0).stop 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 msgr2=0x7f51d01a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00d950 tx=0x7f51bc00de10 comp rx=0 tx=0).stop 2024-09-11T00:03:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 shutdown_connections 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f51b40b5360 0x7f51b40b7820 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d0106490 0x7f51d01a0580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51d01038e0 0x7f51d019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 --2- 172.21.15.33:0/2151034184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51d006bf50 0x7f51d019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 >> 172.21.15.33:0/2151034184 conn(0x7f51d00fd150 msgr2=0x7f51d01046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 shutdown_connections 2024-09-11T00:03:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:01.500+0000 7f51d8400640 1 -- 172.21.15.33:0/2151034184 wait complete. 2024-09-11T00:03:02.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:02 smithi189 ceph-mon[34000]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 736 op/s 2024-09-11T00:03:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:02 smithi052 ceph-mon[33526]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 736 op/s 2024-09-11T00:03:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:02 smithi033 ceph-mon[30593]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 736 op/s 2024-09-11T00:03:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 195.0 s, 640.2 tps, lat 156.237 ms stddev 199.771 2024-09-11T00:03:04.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:04 smithi052 ceph-mon[33526]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-11T00:03:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:04 smithi033 ceph-mon[30593]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-11T00:03:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:04 smithi189 ceph-mon[34000]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-11T00:03:06.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:06 smithi189 ceph-mon[34000]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 667 op/s 2024-09-11T00:03:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:06 smithi052 ceph-mon[33526]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 667 op/s 2024-09-11T00:03:06.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:06 smithi033 ceph-mon[30593]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 13 MiB/s wr, 667 op/s 2024-09-11T00:03:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 200.0 s, 538.6 tps, lat 160.144 ms stddev 212.595 2024-09-11T00:03:08.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:08 smithi052 ceph-mon[33526]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-11T00:03:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:08 smithi033 ceph-mon[30593]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-11T00:03:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:08 smithi189 ceph-mon[34000]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-11T00:03:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:10 smithi052 ceph-mon[33526]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 699 op/s 2024-09-11T00:03:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:10 smithi033 ceph-mon[30593]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 699 op/s 2024-09-11T00:03:10.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:10 smithi189 ceph-mon[34000]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 699 op/s 2024-09-11T00:03:12.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:12 smithi052 ceph-mon[33526]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 678 op/s 2024-09-11T00:03:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:12 smithi033 ceph-mon[30593]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 678 op/s 2024-09-11T00:03:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:12 smithi189 ceph-mon[34000]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 678 op/s 2024-09-11T00:03:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 205.0 s, 553.0 tps, lat 177.958 ms stddev 212.974 2024-09-11T00:03:13.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:13.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:13.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 737 op/s 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:14.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:03:14.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 737 op/s 2024-09-11T00:03:14.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:14.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:14.529 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:03:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 737 op/s 2024-09-11T00:03:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:03:14.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:03:14.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:03:14.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.693+0000 7f3fb6800640 1 -- 172.21.15.33:0/3271886067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb0075b20 msgr2=0x7f3fb0075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.693+0000 7f3fb6800640 1 --2- 172.21.15.33:0/3271886067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb0075b20 0x7f3fb0075fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009900 tx=0x7f3fa402a400 comp rx=0 tx=0).stop 2024-09-11T00:03:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 -- 172.21.15.33:0/3271886067 shutdown_connections 2024-09-11T00:03:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 --2- 172.21.15.33:0/3271886067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb01062a0 0x7f3fb0110f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 --2- 172.21.15.33:0/3271886067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb0075b20 0x7f3fb0075fa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 --2- 172.21.15.33:0/3271886067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 0x7f3fb00755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 -- 172.21.15.33:0/3271886067 >> 172.21.15.33:0/3271886067 conn(0x7f3fb00fe030 msgr2=0x7f3fb0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 -- 172.21.15.33:0/3271886067 shutdown_connections 2024-09-11T00:03:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.694+0000 7f3fb6800640 1 -- 172.21.15.33:0/3271886067 wait complete. 2024-09-11T00:03:14.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 Processor -- start 2024-09-11T00:03:14.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 -- start start 2024-09-11T00:03:14.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 0x7f3fb019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb01a0350 0x7f3fb01a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01148f0 con 0x7f3fb0075b20 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb0114770 con 0x7f3fb0076f90 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.696+0000 7f3fb6800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb0114a70 con 0x7f3fb01a0350 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.697+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.697+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46814/0 (socket says 172.21.15.33:46814) 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.697+0000 7f3fb5400640 1 -- 172.21.15.33:0/2759348677 learned_addr learned my addr 172.21.15.33:0/2759348677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.697+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb01a0350 0x7f3fb01a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.697+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 0x7f3fb019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 -- 172.21.15.33:0/2759348677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb01a0350 msgr2=0x7f3fb01a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb01a0350 0x7f3fb01a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 -- 172.21.15.33:0/2759348677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 msgr2=0x7f3fb019f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 0x7f3fb019f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 -- 172.21.15.33:0/2759348677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb01a1000 con 0x7f3fb0075b20 2024-09-11T00:03:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.698+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000e9f0 tx=0x7f3fa000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.699+0000 7f3fae000640 1 -- 172.21.15.33:0/2759348677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000cd80 con 0x7f3fb0075b20 2024-09-11T00:03:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.699+0000 7f3fae000640 1 -- 172.21.15.33:0/2759348677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa00108c0 con 0x7f3fb0075b20 2024-09-11T00:03:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.699+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb01a73f0 con 0x7f3fb0075b20 2024-09-11T00:03:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.699+0000 7f3fae000640 1 -- 172.21.15.33:0/2759348677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00187c0 con 0x7f3fb0075b20 2024-09-11T00:03:14.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.699+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb01a7930 con 0x7f3fb0075b20 2024-09-11T00:03:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.709+0000 7f3fbae1b740 1 Processor -- start 2024-09-11T00:03:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.709+0000 7f3fae000640 1 -- 172.21.15.33:0/2759348677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3fa0010430 con 0x7f3fb0075b20 2024-09-11T00:03:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.709+0000 7f3fbae1b740 1 -- start start 2024-09-11T00:03:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.710+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.710+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069c82a0 0x556a069ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069cace0 0x556a069cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a069386b0 con 0x556a069cace0 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fb5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fb5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58214/0 (socket says 172.21.15.33:58214) 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fb5e00640 1 -- 172.21.15.33:0/191904867 learned_addr learned my addr 172.21.15.33:0/191904867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a06927ae0 con 0x556a069c5970 2024-09-11T00:03:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a0692b8f0 con 0x556a069c82a0 2024-09-11T00:03:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.711+0000 7f3fb5400640 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069c82a0 0x556a069ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069cace0 0x556a069cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb5e00640 1 -- 172.21.15.33:0/191904867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069c82a0 msgr2=0x556a069ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069c82a0 0x556a069ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fae000640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 0x7f3f980b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb5e00640 1 -- 172.21.15.33:0/191904867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069cace0 msgr2=0x556a069cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069cace0 0x556a069cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.712+0000 7f3fb5e00640 1 -- 172.21.15.33:0/191904867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a068f4780 con 0x556a069c5970 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.713+0000 7f3fae000640 1 -- 172.21.15.33:0/2759348677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3fa00e62a0 con 0x7f3fb0075b20 2024-09-11T00:03:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.713+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 0x7f3f980b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.714+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80039f0 tx=0x7f3fa8003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8276c12a7d737c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.714+0000 7f3f9e600640 1 -- 172.21.15.33:0/191904867 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8011c30 con 0x556a069c5970 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.714+0000 7f3f9e600640 1 -- 172.21.15.33:0/191904867 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa8018040 con 0x556a069c5970 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.714+0000 7f3f9e600640 1 -- 172.21.15.33:0/191904867 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8010440 con 0x556a069c5970 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.715+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 msgr2=0x556a069c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.715+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 0x7f3f980b7860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8021000 tx=0x7f3fa8022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.715+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80039f0 tx=0x7f3fa8003eb0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 shutdown_connections 2024-09-11T00:03:14.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069cace0 0x556a069cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069c82a0 0x556a069ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/191904867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069c7d60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 >> 172.21.15.33:0/191904867 conn(0x556a069c0ac0 msgr2=0x556a069c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 shutdown_connections 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.716+0000 7f3fbae1b740 1 -- 172.21.15.33:0/191904867 wait complete. 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.717+0000 7f3fbae1b740 1 -- start start 2024-09-11T00:03:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.717+0000 7f3fbae1b740 1 Processor -- start 2024-09-11T00:03:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a0685fab0 con 0x556a069c5970 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a068ce570 con 0x556a069c82a0 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a069cdcc0 con 0x556a069cace0 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.718+0000 7f3fbae1b740 10 client.0 _ll_register_callbacks cb 0x556a068dd100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.719+0000 7f3fb5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.719+0000 7f3fb5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47902/0 (socket says 172.21.15.33:47902) 2024-09-11T00:03:14.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.719+0000 7f3fb5400640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.719+0000 7f3fb5e00640 1 -- 172.21.15.33:0/224894535 learned_addr learned my addr 172.21.15.33:0/224894535 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.719+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.720+0000 7f3fb5e00640 1 -- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 msgr2=0x556a069cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.720+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.720+0000 7f3fb5e00640 1 -- 172.21.15.33:0/224894535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 msgr2=0x556a069cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.720+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.720+0000 7f3fb5e00640 1 -- 172.21.15.33:0/224894535 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a06689790 con 0x556a069cace0 2024-09-11T00:03:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.721+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8004780 tx=0x7f3fa801da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca73c79bc4afcd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.721+0000 7f3f92a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:03:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.723+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8011c30 con 0x556a069cace0 2024-09-11T00:03:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.723+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3fa8023040 con 0x556a069cace0 2024-09-11T00:03:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.723+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa8018040 con 0x556a069cace0 2024-09-11T00:03:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.724+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3fa8011dd0 con 0x556a069cace0 2024-09-11T00:03:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.724+0000 7f3fbae1b740 10 client.25954 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.724+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556a06702620 con 0x556a069cace0 2024-09-11T00:03:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.724+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa8018040 con 0x556a069cace0 2024-09-11T00:03:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3fa8010cd0 con 0x556a069cace0 2024-09-11T00:03:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 10 client.25954 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:14.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 20 client.25954 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a069da720 0x556a069dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 4 client.25954 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.725+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a0693a600 con 0x556a069da720 2024-09-11T00:03:14.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.726+0000 7f3fb5400640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a069da720 0x556a069dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.727+0000 7f3fb5400640 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a069da720 0x556a069dcb10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8027493925d7701 server_cookie=6914d8cf8afa8e83 in_seq=0 out_seq=0 2024-09-11T00:03:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.727+0000 7f3f92a00640 10 client.25954 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.728+0000 7f3f92a00640 1 -- 172.21.15.33:0/224894535 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a0693a600 con 0x556a069da720 2024-09-11T00:03:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.728+0000 7f3f92a00640 10 client.25954 handle_command_reply: tid=0 2024-09-11T00:03:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.728+0000 7f3fbae1b740 1 client.25954 shutdown 2024-09-11T00:03:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 msgr2=0x556a069d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8004780 tx=0x7f3fa801da10 comp rx=0 tx=0).stop 2024-09-11T00:03:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 shutdown_connections 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a069da720 0x556a069dcb10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d0370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/224894535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 >> 172.21.15.33:0/224894535 conn(0x556a069c0ac0 msgr2=0x556a069bfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3f92a00640 0 client.25954 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.729+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 shutdown_connections 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.730+0000 7f3fbae1b740 1 -- 172.21.15.33:0/224894535 wait complete. 2024-09-11T00:03:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.730+0000 7f3fbae1b740 20 client.25954 trim_cache size 0 max 16384 2024-09-11T00:03:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.757+0000 7f3fbae1b740 1 Processor -- start 2024-09-11T00:03:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.757+0000 7f3fbae1b740 1 -- start start 2024-09-11T00:03:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.757+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01b43d0 con 0x556a069c5970 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fb4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fb4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58238/0 (socket says 172.21.15.33:58238) 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fb4a00640 1 -- 172.21.15.33:0/2816985755 learned_addr learned my addr 172.21.15.33:0/2816985755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.758+0000 7f3fb5e00640 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.759+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01b1ca0 con 0x556a069c82a0 2024-09-11T00:03:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.759+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01afaf0 con 0x556a069cace0 2024-09-11T00:03:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.760+0000 7f3fb5400640 1 -- 172.21.15.33:0/2816985755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 msgr2=0x556a069c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.760+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.760+0000 7f3fb5400640 1 -- 172.21.15.33:0/2816985755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 msgr2=0x556a069c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.760+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.760+0000 7f3fb5400640 1 -- 172.21.15.33:0/2816985755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a069cec00 con 0x556a069c5970 2024-09-11T00:03:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.761+0000 7f3fb5400640 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069d0350 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00e3a50 tx=0x7f3fa00e9d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5cda2baa7db0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.762+0000 7f3f9dc00640 1 -- 172.21.15.33:0/2816985755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00a8560 con 0x556a069c5970 2024-09-11T00:03:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.762+0000 7f3f9dc00640 1 -- 172.21.15.33:0/2816985755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa00ac1d0 con 0x556a069c5970 2024-09-11T00:03:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.762+0000 7f3f9dc00640 1 -- 172.21.15.33:0/2816985755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00abe30 con 0x556a069c5970 2024-09-11T00:03:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 msgr2=0x556a069d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069d0350 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00e3a50 tx=0x7f3fa00e9d80 comp rx=0 tx=0).stop 2024-09-11T00:03:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 shutdown_connections 2024-09-11T00:03:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c82a0 0x556a069c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/2816985755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c5970 0x556a069d0350 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.763+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 >> 172.21.15.33:0/2816985755 conn(0x556a069c0ac0 msgr2=0x556a069ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.764+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 shutdown_connections 2024-09-11T00:03:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.765+0000 7f3fbae1b740 1 -- 172.21.15.33:0/2816985755 wait complete. 2024-09-11T00:03:14.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.765+0000 7f3fbae1b740 1 -- start start 2024-09-11T00:03:14.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.766+0000 7f3fbae1b740 1 Processor -- start 2024-09-11T00:03:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01b0160 con 0x556a069c82a0 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01b15d0 con 0x556a069c5970 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb01b0830 con 0x556a069cace0 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.767+0000 7f3fbae1b740 10 client.0 _ll_register_callbacks cb 0x7f3fa801df50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.768+0000 7f3fb5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.768+0000 7f3fb4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.768+0000 7f3fb4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46848/0 (socket says 172.21.15.33:46848) 2024-09-11T00:03:14.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.768+0000 7f3fb4a00640 1 -- 172.21.15.33:0/3728797581 learned_addr learned my addr 172.21.15.33:0/3728797581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 -- 172.21.15.33:0/3728797581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 msgr2=0x556a069d5de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d5de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 -- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 msgr2=0x556a069d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 -- 172.21.15.33:0/3728797581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a069ce090 con 0x556a069c82a0 2024-09-11T00:03:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3fb4a00640 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006010 tx=0x7f3fa4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a978bf37c6dd4e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.769+0000 7f3f92a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:03:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.770+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4035070 con 0x556a069c82a0 2024-09-11T00:03:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.770+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3fa4003aa0 con 0x556a069c82a0 2024-09-11T00:03:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.770+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fa00ac1d0 con 0x556a069c82a0 2024-09-11T00:03:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.771+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3fa404e050 con 0x556a069c82a0 2024-09-11T00:03:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.771+0000 7f3fbae1b740 10 client.16239 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.771+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556a06a475d0 con 0x556a069c82a0 2024-09-11T00:03:14.772 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.771+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3fa00ac1d0 con 0x556a069c82a0 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.771+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3fa4045460 con 0x556a069c82a0 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 10 client.16239 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 20 client.16239 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a06a47e40 0x556a06a4a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 4 client.16239 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:03:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a069360b0 con 0x556a06a47e40 2024-09-11T00:03:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.772+0000 7f3fb5400640 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a06a47e40 0x556a06a4a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.773+0000 7f3fb5400640 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a06a47e40 0x556a06a4a260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5f60466fd60c29c server_cookie=61dd4e51090dc30b in_seq=0 out_seq=0 2024-09-11T00:03:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.774+0000 7f3f92a00640 10 client.16239 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.807+0000 7f3f92a00640 1 -- 172.21.15.33:0/3728797581 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556a069360b0 con 0x556a06a47e40 2024-09-11T00:03:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.807+0000 7f3f92a00640 10 client.16239 handle_command_reply: tid=0 2024-09-11T00:03:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.807+0000 7f3fbae1b740 1 client.16239 shutdown 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 msgr2=0x556a069d58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006010 tx=0x7f3fa4003820 comp rx=0 tx=0).stop 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 shutdown_connections 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556a06a47e40 0x556a06a4a260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a069cace0 0x556a069d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a069c82a0 0x556a069d58a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 --2- 172.21.15.33:0/3728797581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a069c5970 0x556a069d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 >> 172.21.15.33:0/3728797581 conn(0x556a069c0ac0 msgr2=0x556a069cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.808+0000 7f3f92a00640 0 client.16239 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.809+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 shutdown_connections 2024-09-11T00:03:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.809+0000 7f3fbae1b740 1 -- 172.21.15.33:0/3728797581 wait complete. 2024-09-11T00:03:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.809+0000 7f3fbae1b740 20 client.16239 trim_cache size 0 max 16384 2024-09-11T00:03:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:03:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:03:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:03:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:03:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 msgr2=0x7f3f980b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 0x7f3f980b7860 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8021000 tx=0x7f3fa8022000 comp rx=0 tx=0).stop 2024-09-11T00:03:14.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 msgr2=0x7f3fb019f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000e9f0 tx=0x7f3fa000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 shutdown_connections 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3f980b53a0 0x7f3f980b7860 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb01a0350 0x7f3fb01a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.811+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fb0076f90 0x7f3fb019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.812+0000 7f3fb6800640 1 --2- 172.21.15.33:0/2759348677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fb0075b20 0x7f3fb019f0d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.812+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 >> 172.21.15.33:0/2759348677 conn(0x7f3fb00fe030 msgr2=0x7f3fb0100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.812+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 shutdown_connections 2024-09-11T00:03:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:14.812+0000 7f3fb6800640 1 -- 172.21.15.33:0/2759348677 wait complete. 2024-09-11T00:03:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:16 smithi052 ceph-mon[33526]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 638 op/s 2024-09-11T00:03:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:16 smithi033 ceph-mon[30593]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 638 op/s 2024-09-11T00:03:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:16 smithi189 ceph-mon[34000]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 638 op/s 2024-09-11T00:03:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 210.0 s, 551.6 tps, lat 173.387 ms stddev 226.173 2024-09-11T00:03:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:18 smithi052 ceph-mon[33526]: pgmap v632: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-09-11T00:03:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:18 smithi033 ceph-mon[30593]: pgmap v632: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-09-11T00:03:18.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:18 smithi189 ceph-mon[34000]: pgmap v632: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-09-11T00:03:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:20 smithi052 ceph-mon[33526]: pgmap v633: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-11T00:03:20.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:20 smithi033 ceph-mon[30593]: pgmap v633: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-11T00:03:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:20 smithi189 ceph-mon[34000]: pgmap v633: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 681 op/s 2024-09-11T00:03:22.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:22 smithi052 ceph-mon[33526]: pgmap v634: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-09-11T00:03:22.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:22 smithi033 ceph-mon[30593]: pgmap v634: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-09-11T00:03:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:22 smithi189 ceph-mon[34000]: pgmap v634: 129 pgs: 129 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 12 MiB/s wr, 679 op/s 2024-09-11T00:03:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 215.0 s, 618.6 tps, lat 162.943 ms stddev 201.949 2024-09-11T00:03:24.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:24 smithi052 ceph-mon[33526]: pgmap v635: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-09-11T00:03:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:24 smithi033 ceph-mon[30593]: pgmap v635: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-09-11T00:03:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:24 smithi189 ceph-mon[34000]: pgmap v635: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-09-11T00:03:26.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:26 smithi052 ceph-mon[33526]: pgmap v636: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 675 op/s 2024-09-11T00:03:26.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:26 smithi033 ceph-mon[30593]: pgmap v636: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 675 op/s 2024-09-11T00:03:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:26 smithi189 ceph-mon[34000]: pgmap v636: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 675 op/s 2024-09-11T00:03:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 -- 172.21.15.33:0/4190990154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 msgr2=0x7f340c10cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 --2- 172.21.15.33:0/4190990154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c10cd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3404009900 tx=0x7f340402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 -- 172.21.15.33:0/4190990154 shutdown_connections 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 --2- 172.21.15.33:0/4190990154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c10cd50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 --2- 172.21.15.33:0/4190990154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c10a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 --2- 172.21.15.33:0/4190990154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 -- 172.21.15.33:0/4190990154 >> 172.21.15.33:0/4190990154 conn(0x7f340c0fd140 msgr2=0x7f340c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.026+0000 7f3413600640 1 -- 172.21.15.33:0/4190990154 shutdown_connections 2024-09-11T00:03:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.027+0000 7f3413600640 1 -- 172.21.15.33:0/4190990154 wait complete. 2024-09-11T00:03:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.028+0000 7f3413600640 1 Processor -- start 2024-09-11T00:03:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.029+0000 7f3413600640 1 -- start start 2024-09-11T00:03:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f340c104080 con 0x7f340c107e70 2024-09-11T00:03:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f340c103f00 con 0x7f340c10a8b0 2024-09-11T00:03:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.030+0000 7f3413600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f340c104200 con 0x7f340c06b360 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:55114/0 (socket says 172.21.15.33:55114) 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 -- 172.21.15.33:0/634156418 learned_addr learned my addr 172.21.15.33:0/634156418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3410c00640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 -- 172.21.15.33:0/634156418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 msgr2=0x7f340c19f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c19f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 -- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 msgr2=0x7f340c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f340be00640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c19f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3411600640 1 -- 172.21.15.33:0/634156418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c1a0da0 con 0x7f340c10a8b0 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.031+0000 7f3410c00640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.032+0000 7f340be00640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.032+0000 7f3411600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3404005ab0 tx=0x7f3404003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.032+0000 7f3409600640 1 -- 172.21.15.33:0/634156418 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340403f070 con 0x7f340c10a8b0 2024-09-11T00:03:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.032+0000 7f3409600640 1 -- 172.21.15.33:0/634156418 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3404003e40 con 0x7f340c10a8b0 2024-09-11T00:03:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.032+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c1a1030 con 0x7f340c10a8b0 2024-09-11T00:03:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.033+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c1a7760 con 0x7f340c10a8b0 2024-09-11T00:03:28.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.034+0000 7f3409600640 1 -- 172.21.15.33:0/634156418 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404035030 con 0x7f340c10a8b0 2024-09-11T00:03:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.039+0000 7f3409600640 1 -- 172.21.15.33:0/634156418 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f340403bca0 con 0x7f340c10a8b0 2024-09-11T00:03:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 Processor -- start 2024-09-11T00:03:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 -- start start 2024-09-11T00:03:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153ab6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b153a116b0 con 0x55b153ab4b10 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b153a00ae0 con 0x55b153ab20d0 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.040+0000 7f34165ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b153a048f0 con 0x55b153aaf7a0 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.041+0000 7f340be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.041+0000 7f340be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34840/0 (socket says 172.21.15.33:34840) 2024-09-11T00:03:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.042+0000 7f3410c00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.042+0000 7f3409600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 0x7f33f00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.042+0000 7f3409600640 1 -- 172.21.15.33:0/634156418 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3404106c70 con 0x7f340c10a8b0 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.041+0000 7f340be00640 1 -- 172.21.15.33:0/2218143136 learned_addr learned my addr 172.21.15.33:0/2218143136 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f340be00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153ab6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f3410c00640 1 -- 172.21.15.33:0/2218143136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 msgr2=0x55b153ab1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f3410c00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f3410c00640 1 -- 172.21.15.33:0/2218143136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 msgr2=0x55b153ab6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f3410c00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153ab6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.043+0000 7f3410c00640 1 -- 172.21.15.33:0/2218143136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1539cd780 con 0x55b153ab20d0 2024-09-11T00:03:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.044+0000 7f340be00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153ab6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.044+0000 7f3410c00640 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab44c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009e60 tx=0x7f33fc00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f28d79850217fa61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.044+0000 7f3411600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 0x7f33f00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.045+0000 7f3411600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 0x7f33f00b7820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34040ccd30 tx=0x7f34040045e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.046+0000 7f3401c00640 1 -- 172.21.15.33:0/2218143136 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc003b70 con 0x55b153ab20d0 2024-09-11T00:03:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.046+0000 7f3401c00640 1 -- 172.21.15.33:0/2218143136 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc003d10 con 0x55b153ab20d0 2024-09-11T00:03:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.046+0000 7f3401c00640 1 -- 172.21.15.33:0/2218143136 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0117c0 con 0x55b153ab20d0 2024-09-11T00:03:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.047+0000 7f34165ea740 1 -- 172.21.15.33:0/2218143136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 msgr2=0x55b153ab44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.047+0000 7f34165ea740 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab44c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009e60 tx=0x7f33fc00f730 comp rx=0 tx=0).stop 2024-09-11T00:03:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.049+0000 7f34165ea740 1 -- 172.21.15.33:0/2218143136 shutdown_connections 2024-09-11T00:03:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.049+0000 7f34165ea740 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153ab6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.049+0000 7f34165ea740 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab44c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.049+0000 7f34165ea740 1 --2- 172.21.15.33:0/2218143136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.049+0000 7f34165ea740 1 -- 172.21.15.33:0/2218143136 >> 172.21.15.33:0/2218143136 conn(0x55b153a998e0 msgr2=0x55b153a9a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.050+0000 7f34165ea740 1 -- 172.21.15.33:0/2218143136 shutdown_connections 2024-09-11T00:03:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.050+0000 7f34165ea740 1 -- 172.21.15.33:0/2218143136 wait complete. 2024-09-11T00:03:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.050+0000 7f34165ea740 1 -- start start 2024-09-11T00:03:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.052+0000 7f34165ea740 1 Processor -- start 2024-09-11T00:03:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.053+0000 7f34165ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.054+0000 7f34165ea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f340be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f34165ea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153aba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f34165ea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b153938ab0 con 0x55b153ab4b10 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f34165ea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1539a7570 con 0x55b153ab20d0 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f34165ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b153ab7af0 con 0x55b153aaf7a0 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f3410c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f3410c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:55122/0 (socket says 172.21.15.33:55122) 2024-09-11T00:03:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.056+0000 7f3410c00640 1 -- 172.21.15.33:0/3094031662 learned_addr learned my addr 172.21.15.33:0/3094031662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.057+0000 7f34165ea740 10 client.0 _ll_register_callbacks cb 0x55b1539b6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.058+0000 7f3410c00640 1 -- 172.21.15.33:0/3094031662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 msgr2=0x55b153ab8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.058+0000 7f3410c00640 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.058+0000 7f3410c00640 1 -- 172.21.15.33:0/3094031662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 msgr2=0x55b153aba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.058+0000 7f3410c00640 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153aba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.058+0000 7f3410c00640 1 -- 172.21.15.33:0/3094031662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b153762790 con 0x55b153ab20d0 2024-09-11T00:03:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.059+0000 7f3410c00640 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000f80 tx=0x7f33fc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac61d4fae446bf91 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.059+0000 7f33fa000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:03:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.060+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004c40 con 0x55b153ab20d0 2024-09-11T00:03:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.061+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f33fc004de0 con 0x55b153ab20d0 2024-09-11T00:03:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.061+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33fc003d10 con 0x55b153ab20d0 2024-09-11T00:03:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.061+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f33fc003ec0 con 0x55b153ab20d0 2024-09-11T00:03:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.062+0000 7f34165ea740 10 client.36026 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.062+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1537db620 con 0x55b153ab20d0 2024-09-11T00:03:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.063+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc003d10 con 0x55b153ab20d0 2024-09-11T00:03:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.063+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f33fc0055e0 con 0x55b153ab20d0 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 10 client.36026 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 10 client.36026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 20 client.36026 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153ac45d0 0x55b153ac69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 4 client.36026 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.064+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b153a13600 con 0x55b153ac45d0 2024-09-11T00:03:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.065+0000 7f340be00640 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153ac45d0 0x55b153ac69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.066+0000 7f340be00640 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153ac45d0 0x55b153ac69e0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ecfafa1aeea12ae server_cookie=3cda68125a644e91 in_seq=0 out_seq=0 2024-09-11T00:03:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.066+0000 7f33fa000640 10 client.36026 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.068+0000 7f33fa000640 1 -- 172.21.15.33:0/3094031662 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b153a13600 con 0x55b153ac45d0 2024-09-11T00:03:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.068+0000 7f33fa000640 10 client.36026 handle_command_reply: tid=0 2024-09-11T00:03:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.068+0000 7f34165ea740 1 client.36026 shutdown 2024-09-11T00:03:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 msgr2=0x55b153ab9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000f80 tx=0x7f33fc009bd0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 shutdown_connections 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab4b10 0x55b153aba260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ab9690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153ac45d0 0x55b153ac69e0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 --2- 172.21.15.33:0/3094031662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153ab8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 >> 172.21.15.33:0/3094031662 conn(0x55b153a998e0 msgr2=0x55b153a98a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.069+0000 7f33fa000640 0 client.36026 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.070+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 shutdown_connections 2024-09-11T00:03:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.070+0000 7f34165ea740 1 -- 172.21.15.33:0/3094031662 wait complete. 2024-09-11T00:03:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.070+0000 7f34165ea740 20 client.36026 trim_cache size 0 max 16384 2024-09-11T00:03:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 Processor -- start 2024-09-11T00:03:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 -- start start 2024-09-11T00:03:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 0x55b153ac65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ac12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153ab4b10 0x55b153ab4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1abd40 con 0x55b153aaf7a0 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1a9610 con 0x55b153ab20d0 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.114+0000 7f34165ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f340c117ec0 con 0x55b153ab4b10 2024-09-11T00:03:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.115+0000 7f340be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 0x55b153ac65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.115+0000 7f3410c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ac12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.115+0000 7f340be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 0x55b153ac65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57368/0 (socket says 172.21.15.33:57368) 2024-09-11T00:03:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.115+0000 7f340be00640 1 -- 172.21.15.33:0/1674780149 learned_addr learned my addr 172.21.15.33:0/1674780149 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.116+0000 7f340be00640 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153ab4b10 0x55b153ab4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.117+0000 7f3410c00640 1 -- 172.21.15.33:0/1674780149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153ab4b10 msgr2=0x55b153ab4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.117+0000 7f3410c00640 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153ab4b10 0x55b153ab4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.117+0000 7f3410c00640 1 -- 172.21.15.33:0/1674780149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 msgr2=0x55b153ac65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.117+0000 7f3410c00640 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 0x55b153ac65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.117+0000 7f3410c00640 1 -- 172.21.15.33:0/1674780149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b153ab1f00 con 0x55b153ab20d0 2024-09-11T00:03:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.118+0000 7f3410c00640 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ac12e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33fc02c740 tx=0x7f33fc00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43882f07b56fba89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.122 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.120+0000 7f3401200640 1 -- 172.21.15.33:0/1674780149 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc005b50 con 0x55b153ab20d0 2024-09-11T00:03:28.122 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.120+0000 7f3401200640 1 -- 172.21.15.33:0/1674780149 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc005900 con 0x55b153ab20d0 2024-09-11T00:03:28.122 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.120+0000 7f3401200640 1 -- 172.21.15.33:0/1674780149 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00ddd0 con 0x55b153ab20d0 2024-09-11T00:03:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.122+0000 7f34165ea740 1 -- 172.21.15.33:0/1674780149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 msgr2=0x55b153ac12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.122+0000 7f34165ea740 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ac12e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33fc02c740 tx=0x7f33fc00f730 comp rx=0 tx=0).stop 2024-09-11T00:03:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.124+0000 7f34165ea740 1 -- 172.21.15.33:0/1674780149 shutdown_connections 2024-09-11T00:03:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.124+0000 7f34165ea740 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153ab4b10 0x55b153ab4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.124+0000 7f34165ea740 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab20d0 0x55b153ac12e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.124+0000 7f34165ea740 1 --2- 172.21.15.33:0/1674780149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153aaf7a0 0x55b153ac65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.124+0000 7f34165ea740 1 -- 172.21.15.33:0/1674780149 >> 172.21.15.33:0/1674780149 conn(0x55b153a998e0 msgr2=0x55b153a9a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.125+0000 7f34165ea740 1 -- 172.21.15.33:0/1674780149 shutdown_connections 2024-09-11T00:03:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.125+0000 7f34165ea740 1 -- 172.21.15.33:0/1674780149 wait complete. 2024-09-11T00:03:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.126+0000 7f34165ea740 1 -- start start 2024-09-11T00:03:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.126+0000 7f34165ea740 1 Processor -- start 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab20d0 0x55b153abebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab4b10 0x55b153abf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1a7ad0 con 0x55b153ab20d0 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1a8f40 con 0x55b153ab4b10 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1a81a0 con 0x55b153aaf7a0 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f34165ea740 10 client.0 _ll_register_callbacks cb 0x7f33fc009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f340be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f340be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34868/0 (socket says 172.21.15.33:34868) 2024-09-11T00:03:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.128+0000 7f340be00640 1 -- 172.21.15.33:0/1196918967 learned_addr learned my addr 172.21.15.33:0/1196918967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f3410c00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab20d0 0x55b153abebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f340be00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab4b10 0x55b153abf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f340be00640 1 -- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab4b10 msgr2=0x55b153abf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f340be00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab4b10 0x55b153abf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f340be00640 1 -- 172.21.15.33:0/1196918967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab20d0 msgr2=0x55b153abebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.130+0000 7f340be00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab20d0 0x55b153abebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.131+0000 7f340be00640 1 -- 172.21.15.33:0/1196918967 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b153abff90 con 0x55b153aaf7a0 2024-09-11T00:03:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.131+0000 7f340be00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33f40058c0 tx=0x7f33f400bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8e26f2690818d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.131+0000 7f33fa000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:03:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.132+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4014ea0 con 0x55b153aaf7a0 2024-09-11T00:03:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.132+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f33f4014110 con 0x55b153aaf7a0 2024-09-11T00:03:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.132+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33fc005900 con 0x55b153aaf7a0 2024-09-11T00:03:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.133+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f33f4011e80 con 0x55b153aaf7a0 2024-09-11T00:03:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.133+0000 7f34165ea740 10 client.25972 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.134+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b153ac13a0 con 0x55b153aaf7a0 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc005900 con 0x55b153aaf7a0 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f33f400f040 con 0x55b153aaf7a0 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 10 client.25972 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 10 client.25972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 20 client.25972 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153b42a60 0x55b153b44e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 4 client.25972 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:03:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b153a0f0b0 con 0x55b153b42a60 2024-09-11T00:03:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.135+0000 7f3410c00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153b42a60 0x55b153b44e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.137+0000 7f3410c00640 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153b42a60 0x55b153b44e80 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0dbcc34f90a96dd server_cookie=36faf3024ee541eb in_seq=0 out_seq=0 2024-09-11T00:03:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.137+0000 7f33fa000640 10 client.25972 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.198+0000 7f33fa000640 1 -- 172.21.15.33:0/1196918967 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b153a0f0b0 con 0x55b153b42a60 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.198+0000 7f33fa000640 10 client.25972 handle_command_reply: tid=0 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 client.25972 shutdown 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 msgr2=0x55b153abe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33f40058c0 tx=0x7f33f400bc20 comp rx=0 tx=0).stop 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 shutdown_connections 2024-09-11T00:03:28.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b153ab4b10 0x55b153abf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b153ab20d0 0x55b153abebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b153b42a60 0x55b153b44e80 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 --2- 172.21.15.33:0/1196918967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b153aaf7a0 0x55b153abe540 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 >> 172.21.15.33:0/1196918967 conn(0x55b153a998e0 msgr2=0x55b153ab8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f33fa000640 0 client.25972 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 shutdown_connections 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.199+0000 7f34165ea740 1 -- 172.21.15.33:0/1196918967 wait complete. 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f34165ea740 20 client.25972 trim_cache size 0 max 16384 2024-09-11T00:03:28.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 msgr2=0x7f33f00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 0x7f33f00b7820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34040ccd30 tx=0x7f34040045e0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 msgr2=0x7f340c1a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3404005ab0 tx=0x7f3404003cd0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 shutdown_connections 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33f00b5360 0x7f33f00b7820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f340c10a8b0 0x7f340c1a04e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f340c107e70 0x7f340c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 --2- 172.21.15.33:0/634156418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f340c06b360 0x7f340c19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.200+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 >> 172.21.15.33:0/634156418 conn(0x7f340c0fd140 msgr2=0x7f340c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.201+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 shutdown_connections 2024-09-11T00:03:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:28.201+0000 7f3413600640 1 -- 172.21.15.33:0/634156418 wait complete. 2024-09-11T00:03:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 220.0 s, 634.4 tps, lat 160.047 ms stddev 253.170 2024-09-11T00:03:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:28 smithi052 ceph-mon[33526]: pgmap v637: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 781 op/s 2024-09-11T00:03:28.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:28 smithi033 ceph-mon[30593]: pgmap v637: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 781 op/s 2024-09-11T00:03:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:28 smithi189 ceph-mon[34000]: pgmap v637: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 781 op/s 2024-09-11T00:03:30.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:30 smithi052 ceph-mon[33526]: pgmap v638: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-09-11T00:03:30.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:30 smithi033 ceph-mon[30593]: pgmap v638: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-09-11T00:03:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:30 smithi189 ceph-mon[34000]: pgmap v638: 129 pgs: 129 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-09-11T00:03:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:32 smithi052 ceph-mon[33526]: pgmap v639: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-11T00:03:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:32 smithi033 ceph-mon[30593]: pgmap v639: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-11T00:03:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:32 smithi189 ceph-mon[34000]: pgmap v639: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-11T00:03:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 225.0 s, 670.4 tps, lat 174.538 ms stddev 203.070 2024-09-11T00:03:34.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:34 smithi033 ceph-mon[30593]: pgmap v640: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 812 op/s 2024-09-11T00:03:34.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:34 smithi189 ceph-mon[34000]: pgmap v640: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 812 op/s 2024-09-11T00:03:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:34 smithi052 ceph-mon[33526]: pgmap v640: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 812 op/s 2024-09-11T00:03:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:36 smithi033 ceph-mon[30593]: pgmap v641: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-09-11T00:03:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:36 smithi189 ceph-mon[34000]: pgmap v641: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-09-11T00:03:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:36 smithi052 ceph-mon[33526]: pgmap v641: 129 pgs: 129 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 697 op/s 2024-09-11T00:03:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 230.0 s, 590.8 tps, lat 169.725 ms stddev 201.697 2024-09-11T00:03:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:38 smithi033 ceph-mon[30593]: pgmap v642: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 12 MiB/s wr, 762 op/s 2024-09-11T00:03:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:38 smithi189 ceph-mon[34000]: pgmap v642: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 12 MiB/s wr, 762 op/s 2024-09-11T00:03:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:38 smithi052 ceph-mon[33526]: pgmap v642: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 12 MiB/s wr, 762 op/s 2024-09-11T00:03:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:40 smithi033 ceph-mon[30593]: pgmap v643: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-09-11T00:03:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:40 smithi189 ceph-mon[34000]: pgmap v643: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-09-11T00:03:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:40 smithi052 ceph-mon[33526]: pgmap v643: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-09-11T00:03:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.374+0000 7f36cc000640 1 -- 172.21.15.33:0/966399546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c406b300 msgr2=0x7f36c4107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.374+0000 7f36cc000640 1 --2- 172.21.15.33:0/966399546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c406b300 0x7f36c4107990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009900 tx=0x7f36b802a410 comp rx=0 tx=0).stop 2024-09-11T00:03:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 -- 172.21.15.33:0/966399546 shutdown_connections 2024-09-11T00:03:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 --2- 172.21.15.33:0/966399546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c410a890 0x7f36c410cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 --2- 172.21.15.33:0/966399546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c4107ed0 0x7f36c410a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 --2- 172.21.15.33:0/966399546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c406b300 0x7f36c4107990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 -- 172.21.15.33:0/966399546 >> 172.21.15.33:0/966399546 conn(0x7f36c40fd140 msgr2=0x7f36c40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 -- 172.21.15.33:0/966399546 shutdown_connections 2024-09-11T00:03:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.375+0000 7f36cc000640 1 -- 172.21.15.33:0/966399546 wait complete. 2024-09-11T00:03:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.376+0000 7f36cc000640 1 Processor -- start 2024-09-11T00:03:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 -- start start 2024-09-11T00:03:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 0x7f36c419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 0x7f36c419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 0x7f36c419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4110710 con 0x7f36c406b300 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4110590 con 0x7f36c410a890 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36cc000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4110890 con 0x7f36c4107ed0 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36c8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 0x7f36c419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36c8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 0x7f36c419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33518/0 (socket says 172.21.15.33:33518) 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36c9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 0x7f36c419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36c8c00640 1 -- 172.21.15.33:0/629771220 learned_addr learned my addr 172.21.15.33:0/629771220 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.377+0000 7f36ca000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 0x7f36c419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 -- 172.21.15.33:0/629771220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 msgr2=0x7f36c419b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 0x7f36c419b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 -- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 msgr2=0x7f36c419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 0x7f36c419ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 -- 172.21.15.33:0/629771220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c419c9d0 con 0x7f36c410a890 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36c9600640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 0x7f36c419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.378+0000 7f36ca000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 0x7f36c419c110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009fd0 tx=0x7f36bc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.379+0000 7f36c2000640 1 -- 172.21.15.33:0/629771220 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00ce20 con 0x7f36c410a890 2024-09-11T00:03:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.379+0000 7f36c2000640 1 -- 172.21.15.33:0/629771220 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36bc005020 con 0x7f36c410a890 2024-09-11T00:03:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.379+0000 7f36c2000640 1 -- 172.21.15.33:0/629771220 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc010690 con 0x7f36c410a890 2024-09-11T00:03:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.379+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c419ccc0 con 0x7f36c410a890 2024-09-11T00:03:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.379+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c41a3390 con 0x7f36c410a890 2024-09-11T00:03:41.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.383+0000 7f36ceec9740 1 Processor -- start 2024-09-11T00:03:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.383+0000 7f36c2000640 1 -- 172.21.15.33:0/629771220 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f36bc004a40 con 0x7f36c410a890 2024-09-11T00:03:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 -- start start 2024-09-11T00:03:41.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7187390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a718c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c1a70ef6b0 con 0x55c1a7184fa0 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1a70deae0 con 0x55c1a718a310 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.384+0000 7f36ceec9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c1a70e28f0 con 0x55c1a71878d0 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.385+0000 7f36c9600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.385+0000 7f36c9600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33528/0 (socket says 172.21.15.33:33528) 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.385+0000 7f36c9600640 1 -- 172.21.15.33:0/4214827762 learned_addr learned my addr 172.21.15.33:0/4214827762 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 -- 172.21.15.33:0/4214827762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 msgr2=0x55c1a718c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a718c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 -- 172.21.15.33:0/4214827762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 msgr2=0x55c1a7187390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7187390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 -- 172.21.15.33:0/4214827762 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a70ab780 con 0x55c1a71878d0 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c2000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 0x7f36ac0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c2000640 1 -- 172.21.15.33:0/629771220 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f36bc0e6690 con 0x7f36c410a890 2024-09-11T00:03:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c9600640 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36b802aa00 tx=0x7f36b8004140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a012f6ca79c765c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.386+0000 7f36c8c00640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 0x7f36ac0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.387+0000 7f36b6600640 1 -- 172.21.15.33:0/4214827762 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8035030 con 0x55c1a71878d0 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.387+0000 7f36b6600640 1 -- 172.21.15.33:0/4214827762 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b8003a80 con 0x55c1a71878d0 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.387+0000 7f36b6600640 1 -- 172.21.15.33:0/4214827762 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8031a60 con 0x55c1a71878d0 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.388+0000 7f36ceec9740 1 -- 172.21.15.33:0/4214827762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 msgr2=0x55c1a7189cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.388+0000 7f36ceec9740 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36b802aa00 tx=0x7f36b8004140 comp rx=0 tx=0).stop 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36c8c00640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 0x7f36ac0b78f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f36b00058c0 tx=0x7f36b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 -- 172.21.15.33:0/4214827762 shutdown_connections 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a718c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7189cc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 --2- 172.21.15.33:0/4214827762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7187390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 -- 172.21.15.33:0/4214827762 >> 172.21.15.33:0/4214827762 conn(0x55c1a71778e0 msgr2=0x55c1a7178670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 -- 172.21.15.33:0/4214827762 shutdown_connections 2024-09-11T00:03:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.389+0000 7f36ceec9740 1 -- 172.21.15.33:0/4214827762 wait complete. 2024-09-11T00:03:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.390+0000 7f36ceec9740 1 -- start start 2024-09-11T00:03:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.390+0000 7f36ceec9740 1 Processor -- start 2024-09-11T00:03:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.391+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 0x55c1a718e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.391+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.391+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 0x55c1a718f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36c8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36c8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33530/0 (socket says 172.21.15.33:33530) 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36ceec9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c1a7016ab0 con 0x55c1a718a310 2024-09-11T00:03:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36ceec9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1a7085570 con 0x55c1a7184fa0 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36ceec9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c1a718d290 con 0x55c1a71878d0 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36ceec9740 10 client.0 _ll_register_callbacks cb 0x55c1a7094100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 0x55c1a718e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 0x55c1a718e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42872/0 (socket says 172.21.15.33:42872) 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36c9600640 1 -- 172.21.15.33:0/2175176896 learned_addr learned my addr 172.21.15.33:0/2175176896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.392+0000 7f36ca000640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 0x55c1a718f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 -- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 msgr2=0x55c1a718e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 0x55c1a718e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 -- 172.21.15.33:0/2175176896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 msgr2=0x55c1a718f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 0x55c1a718f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 -- 172.21.15.33:0/2175176896 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a6e40790 con 0x55c1a71878d0 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36ca000640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 0x55c1a718f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.393+0000 7f36c8c00640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009fb0 tx=0x7f36b0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c595c64841c583f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b001e830 con 0x55c1a71878d0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f36b001e9d0 con 0x55c1a71878d0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b8003a80 con 0x55c1a71878d0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f36b002f050 con 0x55c1a71878d0 2024-09-11T00:03:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36ceec9740 10 client.25984 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.394+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1a6eb9620 con 0x55c1a71878d0 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.395+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36b8003a80 con 0x55c1a71878d0 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.395+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f36b001dbe0 con 0x55c1a71878d0 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.395+0000 7f36ceec9740 10 client.25984 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.395+0000 7f36ceec9740 10 client.25984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.396+0000 7f36ceec9740 20 client.25984 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.396+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a7199f80 0x55c1a719c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.396+0000 7f36ceec9740 4 client.25984 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.396+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1a70f1600 con 0x55c1a7199f80 2024-09-11T00:03:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.396+0000 7f36c9600640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a7199f80 0x55c1a719c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.397+0000 7f36aaa00640 10 client.25984 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.397+0000 7f36c9600640 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a7199f80 0x55c1a719c370 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8dcf565e174dbe3 server_cookie=2709f33f605a388d in_seq=0 out_seq=0 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.398+0000 7f36aaa00640 1 -- 172.21.15.33:0/2175176896 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1a70f1600 con 0x55c1a7199f80 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.398+0000 7f36aaa00640 10 client.25984 handle_command_reply: tid=0 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.399+0000 7f36ceec9740 1 client.25984 shutdown 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.399+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 msgr2=0x55c1a718ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.399+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009fb0 tx=0x7f36b0004730 comp rx=0 tx=0).stop 2024-09-11T00:03:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 shutdown_connections 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a718a310 0x55c1a718f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a7199f80 0x55c1a719c370 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a718ece0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 --2- 172.21.15.33:0/2175176896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a7184fa0 0x55c1a718e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 >> 172.21.15.33:0/2175176896 conn(0x55c1a71778e0 msgr2=0x55c1a7176a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36aaa00640 0 client.25984 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 shutdown_connections 2024-09-11T00:03:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 1 -- 172.21.15.33:0/2175176896 wait complete. 2024-09-11T00:03:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.400+0000 7f36ceec9740 20 client.25984 trim_cache size 0 max 16384 2024-09-11T00:03:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.426+0000 7f36ceec9740 1 Processor -- start 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 -- start start 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7178260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 0x55c1a71787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41abb80 con 0x55c1a7184fa0 2024-09-11T00:03:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41a9450 con 0x55c1a71878d0 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ceec9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41a72a0 con 0x55c1a718a310 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33532/0 (socket says 172.21.15.33:33532) 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36ca000640 1 -- 172.21.15.33:0/3816548872 learned_addr learned my addr 172.21.15.33:0/3816548872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36c9600640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7178260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.427+0000 7f36c8c00640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 0x55c1a71787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 -- 172.21.15.33:0/3816548872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 msgr2=0x55c1a71787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 0x55c1a71787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 -- 172.21.15.33:0/3816548872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 msgr2=0x55c1a7178260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7178260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 -- 172.21.15.33:0/3816548872 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a7187700 con 0x55c1a718a310 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36c8c00640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 0x55c1a71787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36c9600640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7178260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.428+0000 7f36ca000640 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0a8fd0 tx=0x7f36bc0a81c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9caf0eb0df575b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.429+0000 7f36b5c00640 1 -- 172.21.15.33:0/3816548872 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0d3030 con 0x55c1a718a310 2024-09-11T00:03:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.429+0000 7f36b5c00640 1 -- 172.21.15.33:0/3816548872 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36bc0aca50 con 0x55c1a718a310 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.429+0000 7f36b5c00640 1 -- 172.21.15.33:0/3816548872 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0e6340 con 0x55c1a718a310 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.429+0000 7f36ceec9740 1 -- 172.21.15.33:0/3816548872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 msgr2=0x55c1a7179710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.429+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0a8fd0 tx=0x7f36bc0a81c0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 -- 172.21.15.33:0/3816548872 shutdown_connections 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a718a310 0x55c1a7179710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a71878d0 0x55c1a71787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3816548872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a7178260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 -- 172.21.15.33:0/3816548872 >> 172.21.15.33:0/3816548872 conn(0x55c1a71778e0 msgr2=0x55c1a717bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 -- 172.21.15.33:0/3816548872 shutdown_connections 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.430+0000 7f36ceec9740 1 -- 172.21.15.33:0/3816548872 wait complete. 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.431+0000 7f36ceec9740 1 -- start start 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.431+0000 7f36ceec9740 1 Processor -- start 2024-09-11T00:03:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a71960e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7194de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41a7910 con 0x55c1a7184fa0 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41a8d80 con 0x55c1a718a310 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36c41a7fe0 con 0x55c1a71878d0 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ceec9740 10 client.0 _ll_register_callbacks cb 0x7f36b0009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:41.438 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36c9600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a71960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ca000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ca000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:42888/0 (socket says 172.21.15.33:42888) 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36ca000640 1 -- 172.21.15.33:0/3979076087 learned_addr learned my addr 172.21.15.33:0/3979076087 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.432+0000 7f36c8c00640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36ca000640 1 -- 172.21.15.33:0/3979076087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 msgr2=0x55c1a7194de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36ca000640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7194de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36ca000640 1 -- 172.21.15.33:0/3979076087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 msgr2=0x55c1a71960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36ca000640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a71960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36ca000640 1 -- 172.21.15.33:0/3979076087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a7195b50 con 0x55c1a718a310 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36c9600640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a71960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.433+0000 7f36c8c00640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7194de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.434+0000 7f36ca000640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0a9020 tx=0x7f36bc005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca16d0401754d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:41.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.434+0000 7f36aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:03:41.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.435+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0b5fe0 con 0x55c1a718a310 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.435+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f36bc0051d0 con 0x55c1a718a310 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.435+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36bc0aca50 con 0x55c1a718a310 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.435+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f36bc0e6340 con 0x55c1a718a310 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.435+0000 7f36ceec9740 10 client.36047 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1a7206e90 con 0x55c1a718a310 2024-09-11T00:03:41.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36bc0aca50 con 0x55c1a718a310 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f36bc0a8510 con 0x55c1a718a310 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 10 client.36047 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 10 client.36047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 20 client.36047 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a72077e0 0x55c1a7209c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 4 client.36047 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:03:41.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.436+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1a70ed0b0 con 0x55c1a72077e0 2024-09-11T00:03:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.437+0000 7f36c9600640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a72077e0 0x55c1a7209c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.438+0000 7f36aaa00640 10 client.36047 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:41.438+0000 7f36c9600640 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a72077e0 0x55c1a7209c00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8535f7711f3aadd9 server_cookie=871dac9d3dea9285 in_seq=0 out_seq=0 2024-09-11T00:03:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:42 smithi033 ceph-mon[30593]: pgmap v644: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 717 op/s 2024-09-11T00:03:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:42 smithi189 ceph-mon[34000]: pgmap v644: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 717 op/s 2024-09-11T00:03:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:42 smithi052 ceph-mon[33526]: pgmap v644: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 717 op/s 2024-09-11T00:03:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 235.0 s, 611.0 tps, lat 163.581 ms stddev 199.116 2024-09-11T00:03:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.267+0000 7f36aaa00640 1 -- 172.21.15.33:0/3979076087 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1a70ed0b0 con 0x55c1a72077e0 2024-09-11T00:03:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.267+0000 7f36aaa00640 10 client.36047 handle_command_reply: tid=0 2024-09-11T00:03:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.267+0000 7f36ceec9740 1 client.36047 shutdown 2024-09-11T00:03:44.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.268+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 msgr2=0x55c1a7195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.268+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0a9020 tx=0x7f36bc005df0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 shutdown_connections 2024-09-11T00:03:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a718a310 0x55c1a7195320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55c1a72077e0 0x55c1a7209c00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1a71878d0 0x55c1a7194de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 --2- 172.21.15.33:0/3979076087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c1a7184fa0 0x55c1a71960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 >> 172.21.15.33:0/3979076087 conn(0x55c1a71778e0 msgr2=0x55c1a7178240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.269+0000 7f36aaa00640 0 client.36047 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.270+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 shutdown_connections 2024-09-11T00:03:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.270+0000 7f36ceec9740 1 -- 172.21.15.33:0/3979076087 wait complete. 2024-09-11T00:03:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.270+0000 7f36ceec9740 20 client.36047 trim_cache size 0 max 16384 2024-09-11T00:03:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:03:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:03:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:03:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:03:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.272+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 msgr2=0x7f36ac0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.272+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 0x7f36ac0b78f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f36b00058c0 tx=0x7f36b0005f90 comp rx=0 tx=0).stop 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.272+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 msgr2=0x7f36c419c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.272+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 0x7f36c419c110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009fd0 tx=0x7f36bc00ef10 comp rx=0 tx=0).stop 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 shutdown_connections 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f36ac0b5430 0x7f36ac0b78f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36c410a890 0x7f36c419c110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36c4107ed0 0x7f36c419b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 --2- 172.21.15.33:0/629771220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36c406b300 0x7f36c419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 >> 172.21.15.33:0/629771220 conn(0x7f36c40fd140 msgr2=0x7f36c4108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.273+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 shutdown_connections 2024-09-11T00:03:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:44.274+0000 7f36cc000640 1 -- 172.21.15.33:0/629771220 wait complete. 2024-09-11T00:03:44.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:44 smithi033 ceph-mon[30593]: pgmap v645: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-09-11T00:03:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:44 smithi189 ceph-mon[34000]: pgmap v645: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-09-11T00:03:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:44 smithi052 ceph-mon[33526]: pgmap v645: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-09-11T00:03:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:46 smithi189 ceph-mon[34000]: pgmap v646: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 658 op/s 2024-09-11T00:03:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:46 smithi052 ceph-mon[33526]: pgmap v646: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 658 op/s 2024-09-11T00:03:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:46 smithi033 ceph-mon[30593]: pgmap v646: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 658 op/s 2024-09-11T00:03:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 240.0 s, 674.0 tps, lat 147.992 ms stddev 194.273 2024-09-11T00:03:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:48 smithi189 ceph-mon[34000]: pgmap v647: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-11T00:03:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:48 smithi052 ceph-mon[33526]: pgmap v647: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-11T00:03:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:48 smithi033 ceph-mon[30593]: pgmap v647: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-11T00:03:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:50 smithi189 ceph-mon[34000]: pgmap v648: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 766 op/s 2024-09-11T00:03:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:50 smithi052 ceph-mon[33526]: pgmap v648: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 766 op/s 2024-09-11T00:03:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:50 smithi033 ceph-mon[30593]: pgmap v648: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 766 op/s 2024-09-11T00:03:51.998 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.8 2024-09-11T00:03:51.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:03:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:52 smithi033 ceph-mon[30593]: pgmap v649: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 763 op/s 2024-09-11T00:03:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:52 smithi189 ceph-mon[34000]: pgmap v649: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 763 op/s 2024-09-11T00:03:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:52 smithi052 ceph-mon[33526]: pgmap v649: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 763 op/s 2024-09-11T00:03:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 245.0 s, 542.8 tps, lat 185.237 ms stddev 228.288 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 -- 172.21.15.33:0/3785654601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 msgr2=0x7fac081013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 --2- 172.21.15.33:0/3785654601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081013b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009900 tx=0x7fabfc02a400 comp rx=0 tx=0).stop 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 -- 172.21.15.33:0/3785654601 shutdown_connections 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 --2- 172.21.15.33:0/3785654601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac08069d30 0x7fac08107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 --2- 172.21.15.33:0/3785654601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac081069e0 0x7fac08106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 --2- 172.21.15.33:0/3785654601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081013b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.396+0000 7fac10200640 1 -- 172.21.15.33:0/3785654601 >> 172.21.15.33:0/3785654601 conn(0x7fac080fca20 msgr2=0x7fac080fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.397+0000 7fac10200640 1 -- 172.21.15.33:0/3785654601 shutdown_connections 2024-09-11T00:03:53.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.397+0000 7fac10200640 1 -- 172.21.15.33:0/3785654601 wait complete. 2024-09-11T00:03:53.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.399+0000 7fac10200640 1 Processor -- start 2024-09-11T00:03:53.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.399+0000 7fac10200640 1 -- start start 2024-09-11T00:03:53.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.399+0000 7fac10200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac08069d30 0x7fac08115e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac10200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac10200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 0x7fac08114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac10200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac08110150 con 0x7fac08069d30 2024-09-11T00:03:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac10200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac0810ffd0 con 0x7fac08100fd0 2024-09-11T00:03:53.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac10200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac081102d0 con 0x7fac081069e0 2024-09-11T00:03:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac0d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac08069d30 0x7fac08115e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60586/0 (socket says 172.21.15.33:60586) 2024-09-11T00:03:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac0ce00640 1 -- 172.21.15.33:0/2616660938 learned_addr learned my addr 172.21.15.33:0/2616660938 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:53.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.400+0000 7fac0e200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 0x7fac08114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 -- 172.21.15.33:0/2616660938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 msgr2=0x7fac081138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 -- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac08069d30 msgr2=0x7fac08115e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac08069d30 0x7fac08115e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 -- 172.21.15.33:0/2616660938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac081ab9d0 con 0x7fac081069e0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0ce00640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.401+0000 7fac0e200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 0x7fac08114020 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac00009fd0 tx=0x7fac0000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.402+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0000ce20 con 0x7fac081069e0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.402+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac00005020 con 0x7fac081069e0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.402+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00010690 con 0x7fac081069e0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.402+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac081abcc0 con 0x7fac081069e0 2024-09-11T00:03:53.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.402+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac081ac1b0 con 0x7fac081069e0 2024-09-11T00:03:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.404+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac081013b0 con 0x7fac081069e0 2024-09-11T00:03:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.408+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fac00004a40 con 0x7fac081069e0 2024-09-11T00:03:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.410+0000 7fac06000640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 0x7fabf00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.411+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fac000e66a0 con 0x7fac081069e0 2024-09-11T00:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.411+0000 7fac0d800640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 0x7fabf00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.412+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fac000ad1e0 con 0x7fac081069e0 2024-09-11T00:03:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.414+0000 7fac0d800640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 0x7fabf00b7970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fabfc006010 tx=0x7fabfc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:53.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.844+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac081133b0 con 0x7fac081069e0 2024-09-11T00:03:53.848 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:03:53.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.845+0000 7fac06000640 1 -- 172.21.15.33:0/2616660938 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fac000acae0 con 0x7fac081069e0 2024-09-11T00:03:53.849 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:03:53.849 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:03:53.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 msgr2=0x7fabf00b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 0x7fabf00b7970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fabfc006010 tx=0x7fabfc005e80 comp rx=0 tx=0).stop 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 msgr2=0x7fac08114020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 0x7fac08114020 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac00009fd0 tx=0x7fac0000ef10 comp rx=0 tx=0).stop 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 shutdown_connections 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fabf00b54b0 0x7fabf00b7970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac081069e0 0x7fac08114020 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac08100fd0 0x7fac081138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 --2- 172.21.15.33:0/2616660938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac08069d30 0x7fac08115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.849+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 >> 172.21.15.33:0/2616660938 conn(0x7fac080fca20 msgr2=0x7fac080ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.850+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 shutdown_connections 2024-09-11T00:03:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:53.850+0000 7fac10200640 1 -- 172.21.15.33:0/2616660938 wait complete. 2024-09-11T00:03:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:54 smithi033 ceph-mon[30593]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-11T00:03:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:54 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2616660938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:54 smithi189 ceph-mon[34000]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-11T00:03:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:54 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2616660938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:54 smithi052 ceph-mon[33526]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-11T00:03:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:54 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2616660938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:03:54.816 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 146.8 --await-for 45.0' 2024-09-11T00:03:54.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 146.8 --await-for 45.0 2024-09-11T00:03:55.536 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:03:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.345+0000 7f484a600640 1 -- 172.21.15.33:0/1870927727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844100c70 msgr2=0x7f4844101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.345+0000 7f484a600640 1 --2- 172.21.15.33:0/1870927727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844100c70 0x7f4844101050 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4838009900 tx=0x7f483802a490 comp rx=0 tx=0).stop 2024-09-11T00:03:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 -- 172.21.15.33:0/1870927727 shutdown_connections 2024-09-11T00:03:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 --2- 172.21.15.33:0/1870927727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f484410f170 0x7f4844111630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 --2- 172.21.15.33:0/1870927727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4844101590 0x7f484410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 --2- 172.21.15.33:0/1870927727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844100c70 0x7f4844101050 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 -- 172.21.15.33:0/1870927727 >> 172.21.15.33:0/1870927727 conn(0x7f48440fc8c0 msgr2=0x7f48440fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 -- 172.21.15.33:0/1870927727 shutdown_connections 2024-09-11T00:03:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.347+0000 7f484a600640 1 -- 172.21.15.33:0/1870927727 wait complete. 2024-09-11T00:03:56.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.350+0000 7f484a600640 1 Processor -- start 2024-09-11T00:03:56.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.350+0000 7f484a600640 1 -- start start 2024-09-11T00:03:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.350+0000 7f484a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 0x7f484419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.351+0000 7f484a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484410f170 0x7f484419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.352+0000 7f4849200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 0x7f484419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.352+0000 7f4849200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 0x7f484419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39356/0 (socket says 172.21.15.33:39356) 2024-09-11T00:03:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.352+0000 7f4849200640 1 -- 172.21.15.33:0/971189876 learned_addr learned my addr 172.21.15.33:0/971189876 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.352+0000 7f4843e00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484410f170 0x7f484419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.353+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 0x7f48441a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.353+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4844114c90 con 0x7f4844101590 2024-09-11T00:03:56.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.353+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4844114b10 con 0x7f48441a0c70 2024-09-11T00:03:56.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.353+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4844114e10 con 0x7f484410f170 2024-09-11T00:03:56.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 0x7f48441a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 -- 172.21.15.33:0/971189876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484410f170 msgr2=0x7f484419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484410f170 0x7f484419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 -- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 msgr2=0x7f484419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 0x7f484419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.354+0000 7f4849c00640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48441a1800 con 0x7f48441a0c70 2024-09-11T00:03:56.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.355+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 0x7f48441a1120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f483c009fd0 tx=0x7f483c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.414+0000 7f4841600640 1 -- 172.21.15.33:0/971189876 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c00ce20 con 0x7f48441a0c70 2024-09-11T00:03:56.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.414+0000 7f4841600640 1 -- 172.21.15.33:0/971189876 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f483c005020 con 0x7f48441a0c70 2024-09-11T00:03:56.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.414+0000 7f4841600640 1 -- 172.21.15.33:0/971189876 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c010690 con 0x7f48441a0c70 2024-09-11T00:03:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.414+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48441a7df0 con 0x7f48441a0c70 2024-09-11T00:03:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.414+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441a8190 con 0x7f48441a0c70 2024-09-11T00:03:56.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.425+0000 7f4841600640 1 -- 172.21.15.33:0/971189876 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f483c010830 con 0x7f48441a0c70 2024-09-11T00:03:56.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.425+0000 7f484e85c740 1 Processor -- start 2024-09-11T00:03:56.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 -- start start 2024-09-11T00:03:56.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 0x563f607e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607fc3b0 0x563f607fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f6075cca0 con 0x563f607fc3b0 2024-09-11T00:03:56.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563f6074c0d0 con 0x563f607e7c10 2024-09-11T00:03:56.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.426+0000 7f484e85c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563f6074fee0 con 0x563f607e72f0 2024-09-11T00:03:56.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.428+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.428+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60604/0 (socket says 172.21.15.33:60604) 2024-09-11T00:03:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.428+0000 7f4849200640 1 -- 172.21.15.33:0/2262816017 learned_addr learned my addr 172.21.15.33:0/2262816017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.428+0000 7f4841600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 0x7f482c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.429+0000 7f4841600640 1 -- 172.21.15.33:0/971189876 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f483c0e65a0 con 0x7f48441a0c70 2024-09-11T00:03:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.429+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 0x7f482c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.429+0000 7f4843e00640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 0x563f607e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.429+0000 7f4843e00640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607fc3b0 0x563f607fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.431+0000 7f4843e00640 1 -- 172.21.15.33:0/2262816017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 msgr2=0x563f607fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.432+0000 7f4843e00640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.432+0000 7f4843e00640 1 -- 172.21.15.33:0/2262816017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607fc3b0 msgr2=0x563f607fe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.432+0000 7f4843e00640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607fc3b0 0x563f607fe7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.432+0000 7f4843e00640 1 -- 172.21.15.33:0/2262816017 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f606fe400 con 0x563f607e72f0 2024-09-11T00:03:56.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.432+0000 7f4849c00640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 0x7f482c0b79a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f483c004fd0 tx=0x7f483c005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.433+0000 7f4849200640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:56.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.433+0000 7f4843e00640 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 0x563f607e76d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4844111970 tx=0x7f4830005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d080c1322817d4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.433+0000 7f4836000640 1 -- 172.21.15.33:0/2262816017 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830004230 con 0x563f607e72f0 2024-09-11T00:03:56.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.433+0000 7f4836000640 1 -- 172.21.15.33:0/2262816017 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48300043d0 con 0x563f607e72f0 2024-09-11T00:03:56.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.433+0000 7f4836000640 1 -- 172.21.15.33:0/2262816017 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830004e40 con 0x563f607e72f0 2024-09-11T00:03:56.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.435+0000 7f484e85c740 1 -- 172.21.15.33:0/2262816017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 msgr2=0x563f607e76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.435+0000 7f484e85c740 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 0x563f607e76d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4844111970 tx=0x7f4830005c90 comp rx=0 tx=0).stop 2024-09-11T00:03:56.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.436+0000 7f484e85c740 1 -- 172.21.15.33:0/2262816017 shutdown_connections 2024-09-11T00:03:56.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.436+0000 7f484e85c740 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607fc3b0 0x563f607fe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.436+0000 7f484e85c740 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.436+0000 7f484e85c740 1 --2- 172.21.15.33:0/2262816017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e72f0 0x563f607e76d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.436+0000 7f484e85c740 1 -- 172.21.15.33:0/2262816017 >> 172.21.15.33:0/2262816017 conn(0x563f607e5120 msgr2=0x563f607e62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.439+0000 7f484e85c740 1 -- 172.21.15.33:0/2262816017 shutdown_connections 2024-09-11T00:03:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.439+0000 7f484e85c740 1 -- 172.21.15.33:0/2262816017 wait complete. 2024-09-11T00:03:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.439+0000 7f484e85c740 1 -- start start 2024-09-11T00:03:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.440+0000 7f484e85c740 1 Processor -- start 2024-09-11T00:03:56.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f607fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f605ad7a0 con 0x563f607e72f0 2024-09-11T00:03:56.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563f606f1a10 con 0x563f607e7c10 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563f607ed970 con 0x563f607fc3b0 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f484e85c740 10 client.0 _ll_register_callbacks cb 0x563f60701be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60616/0 (socket says 172.21.15.33:60616) 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.441+0000 7f4849200640 1 -- 172.21.15.33:0/3330309991 learned_addr learned my addr 172.21.15.33:0/3330309991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4843e00640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4849200640 1 -- 172.21.15.33:0/3330309991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 msgr2=0x563f607fb9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:03:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4849200640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f607fb9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4849200640 1 -- 172.21.15.33:0/3330309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 msgr2=0x563f607f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4849200640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4849200640 1 -- 172.21.15.33:0/3330309991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f604b9b90 con 0x563f607e7c10 2024-09-11T00:03:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.442+0000 7f4843e00640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.443+0000 7f482aa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:03:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.444+0000 7f4849200640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4838009230 tx=0x7f48380316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b90e117bb45dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.444+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035070 con 0x563f607e7c10 2024-09-11T00:03:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.445+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4838004240 con 0x563f607e7c10 2024-09-11T00:03:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.445+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48300043d0 con 0x563f607e7c10 2024-09-11T00:03:56.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.447+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4838005d50 con 0x563f607e7c10 2024-09-11T00:03:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.447+0000 7f484e85c740 10 client.36065 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.447+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f60813350 con 0x563f607e7c10 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.448+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48300043d0 con 0x563f607e7c10 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.448+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f48380046c0 con 0x563f607e7c10 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.448+0000 7f484e85c740 10 client.36065 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.448+0000 7f484e85c740 10 client.36065 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.448+0000 7f484e85c740 20 client.36065 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.449+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f608146f0 0x563f60816b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.449+0000 7f484e85c740 4 client.36065 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.449+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f6075ebf0 con 0x563f608146f0 2024-09-11T00:03:56.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.450+0000 7f4843e00640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f608146f0 0x563f60816b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.453+0000 7f4843e00640 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f608146f0 0x563f60816b20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad17e2b741f183c server_cookie=74f6ce641af69520 in_seq=0 out_seq=0 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.454+0000 7f482aa00640 10 client.36065 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.454+0000 7f482aa00640 1 -- 172.21.15.33:0/3330309991 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f6075ebf0 con 0x563f608146f0 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.454+0000 7f482aa00640 10 client.36065 handle_command_reply: tid=0 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.454+0000 7f484e85c740 1 client.36065 shutdown 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 msgr2=0x563f607f1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4838009230 tx=0x7f48380316b0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 shutdown_connections 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f608146f0 0x563f60816b20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f607fb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f607f1730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 --2- 172.21.15.33:0/3330309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 >> 172.21.15.33:0/3330309991 conn(0x563f607e5120 msgr2=0x563f607eac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f482aa00640 0 client.36065 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.455+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 shutdown_connections 2024-09-11T00:03:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.456+0000 7f484e85c740 1 -- 172.21.15.33:0/3330309991 wait complete. 2024-09-11T00:03:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.456+0000 7f484e85c740 20 client.36065 trim_cache size 0 max 16384 2024-09-11T00:03:56.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.491+0000 7f484e85c740 1 Processor -- start 2024-09-11T00:03:56.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.491+0000 7f484e85c740 1 -- start start 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607fc3b0 0x563f607efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f48441b0460 con 0x563f607e72f0 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f48441add30 con 0x563f607fc3b0 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.492+0000 7f484e85c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48441abb80 con 0x563f607e7c10 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.493+0000 7f4843e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.493+0000 7f4849200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.493+0000 7f4849200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:56128/0 (socket says 172.21.15.33:56128) 2024-09-11T00:03:56.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.493+0000 7f4849200640 1 -- 172.21.15.33:0/1437113362 learned_addr learned my addr 172.21.15.33:0/1437113362 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.493+0000 7f4843e00640 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607fc3b0 0x563f607efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4849200640 1 -- 172.21.15.33:0/1437113362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607fc3b0 msgr2=0x563f607efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4849200640 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607fc3b0 0x563f607efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4849200640 1 -- 172.21.15.33:0/1437113362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 msgr2=0x563f607f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4849200640 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4849200640 1 -- 172.21.15.33:0/1437113362 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f608171a0 con 0x563f607e7c10 2024-09-11T00:03:56.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.494+0000 7f4843e00640 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.495+0000 7f4849200640 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f483802a9b0 tx=0x7f483802a490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226c0890bb9d11e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.496+0000 7f4835600640 1 -- 172.21.15.33:0/1437113362 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035040 con 0x563f607e7c10 2024-09-11T00:03:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.496+0000 7f4835600640 1 -- 172.21.15.33:0/1437113362 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4838052070 con 0x563f607e7c10 2024-09-11T00:03:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.496+0000 7f4835600640 1 -- 172.21.15.33:0/1437113362 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838004ff0 con 0x563f607e7c10 2024-09-11T00:03:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.497+0000 7f484e85c740 1 -- 172.21.15.33:0/1437113362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 msgr2=0x563f607ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.497+0000 7f484e85c740 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f483802a9b0 tx=0x7f483802a490 comp rx=0 tx=0).stop 2024-09-11T00:03:56.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 -- 172.21.15.33:0/1437113362 shutdown_connections 2024-09-11T00:03:56.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607fc3b0 0x563f607efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607e7c10 0x563f607ef850 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 --2- 172.21.15.33:0/1437113362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f607f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 -- 172.21.15.33:0/1437113362 >> 172.21.15.33:0/1437113362 conn(0x563f607e5120 msgr2=0x563f607fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 -- 172.21.15.33:0/1437113362 shutdown_connections 2024-09-11T00:03:56.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.498+0000 7f484e85c740 1 -- 172.21.15.33:0/1437113362 wait complete. 2024-09-11T00:03:56.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.499+0000 7f484e85c740 1 -- start start 2024-09-11T00:03:56.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.499+0000 7f484e85c740 1 Processor -- start 2024-09-11T00:03:56.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f6087cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f48441ac1f0 con 0x563f607e72f0 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f48441ad660 con 0x563f607e7c10 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48441ac8c0 con 0x563f607fc3b0 2024-09-11T00:03:56.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.500+0000 7f484e85c740 10 client.0 _ll_register_callbacks cb 0x7f483c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4849200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60632/0 (socket says 172.21.15.33:60632) 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4843e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4843e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:56138/0 (socket says 172.21.15.33:56138) 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4843e00640 1 -- 172.21.15.33:0/2891206443 learned_addr learned my addr 172.21.15.33:0/2891206443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.502+0000 7f4843e00640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f6087cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.503+0000 7f4843e00640 1 -- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 msgr2=0x563f6087b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.503+0000 7f4843e00640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.503+0000 7f4843e00640 1 -- 172.21.15.33:0/2891206443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 msgr2=0x563f6087cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.503+0000 7f4843e00640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f6087cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.503+0000 7f4843e00640 1 -- 172.21.15.33:0/2891206443 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f6087c260 con 0x563f607fc3b0 2024-09-11T00:03:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.504+0000 7f4849200640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.504+0000 7f4843e00640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4830012550 tx=0x7f4830004a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24034da119ae7bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.505+0000 7f482aa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:03:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.505+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830029650 con 0x563f607fc3b0 2024-09-11T00:03:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.506+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f48300297f0 con 0x563f607fc3b0 2024-09-11T00:03:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.506+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4838052070 con 0x563f607fc3b0 2024-09-11T00:03:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.507+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f48300299f0 con 0x563f607fc3b0 2024-09-11T00:03:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.507+0000 7f484e85c740 10 client.26011 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.507+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563f60828290 con 0x563f607fc3b0 2024-09-11T00:03:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4838052070 con 0x563f607fc3b0 2024-09-11T00:03:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4830025040 con 0x563f607fc3b0 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f484e85c740 10 client.26011 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f484e85c740 10 client.26011 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f484e85c740 20 client.26011 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.508+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f60828840 0x563f60828c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.509+0000 7f484e85c740 4 client.26011 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.8, "await_for": 45.0}] 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.509+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.8, "await_for": 45.0}) -- 0x563f6075a6a0 con 0x563f60828840 2024-09-11T00:03:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.509+0000 7f4849200640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f60828840 0x563f60828c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.510+0000 7f4849200640 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f60828840 0x563f60828c50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a5126f7827b3d8 server_cookie=b88447c906fcef8 in_seq=0 out_seq=0 2024-09-11T00:03:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.510+0000 7f482aa00640 10 client.26011 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:56 smithi189 ceph-mon[34000]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 717 op/s 2024-09-11T00:03:56.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:56 smithi052 ceph-mon[33526]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 717 op/s 2024-09-11T00:03:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:56 smithi033 ceph-mon[30593]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 717 op/s 2024-09-11T00:03:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f482aa00640 1 -- 172.21.15.33:0/2891206443 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563f6075a6a0 con 0x563f60828840 2024-09-11T00:03:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f482aa00640 10 client.26011 handle_command_reply: tid=0 2024-09-11T00:03:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f484e85c740 1 client.26011 shutdown 2024-09-11T00:03:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 msgr2=0x563f6087bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4830012550 tx=0x7f4830004a20 comp rx=0 tx=0).stop 2024-09-11T00:03:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.793+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 shutdown_connections 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563f60828840 0x563f60828c50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563f607fc3b0 0x563f6087bb20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f607e7c10 0x563f6087b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 --2- 172.21.15.33:0/2891206443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f607e72f0 0x563f6087cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 >> 172.21.15.33:0/2891206443 conn(0x563f607e5120 msgr2=0x563f607ef790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f482aa00640 0 client.26011 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 shutdown_connections 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 1 -- 172.21.15.33:0/2891206443 wait complete. 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.794+0000 7f484e85c740 20 client.26011 trim_cache size 0 max 16384 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 22, 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "ae422884": { 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 22, 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:03:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 146.8, 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:03:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:03:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:03:56.800 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:03:56.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 msgr2=0x7f482c0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 0x7f482c0b79a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f483c004fd0 tx=0x7f483c005f70 comp rx=0 tx=0).stop 2024-09-11T00:03:56.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 msgr2=0x7f48441a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 0x7f48441a1120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f483c009fd0 tx=0x7f483c00ef10 comp rx=0 tx=0).stop 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 shutdown_connections 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f482c0b54e0 0x7f482c0b79a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48441a0c70 0x7f48441a1120 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f484410f170 0x7f484419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 --2- 172.21.15.33:0/971189876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4844101590 0x7f484419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 >> 172.21.15.33:0/971189876 conn(0x7f48440fc8c0 msgr2=0x7f48440fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.795+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 shutdown_connections 2024-09-11T00:03:56.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:03:56.796+0000 7f484a600640 1 -- 172.21.15.33:0/971189876 wait complete. 2024-09-11T00:03:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 -- 172.21.15.33:0/1204688585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 msgr2=0x7f993410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 --2- 172.21.15.33:0/1204688585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993410ce60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f992c009c10 tx=0x7f992c02a6f0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 -- 172.21.15.33:0/1204688585 shutdown_connections 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 --2- 172.21.15.33:0/1204688585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993410ce60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 --2- 172.21.15.33:0/1204688585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f9934105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 --2- 172.21.15.33:0/1204688585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 0x7f9934104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 -- 172.21.15.33:0/1204688585 >> 172.21.15.33:0/1204688585 conn(0x7f9934100270 msgr2=0x7f99341026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 -- 172.21.15.33:0/1204688585 shutdown_connections 2024-09-11T00:03:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.406+0000 7f9933e00640 1 -- 172.21.15.33:0/1204688585 wait complete. 2024-09-11T00:03:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.407+0000 7f9933e00640 1 Processor -- start 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.407+0000 7f9933e00640 1 -- start start 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.407+0000 7f9933e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 0x7f993419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.407+0000 7f9933e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.407+0000 7f9933e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9933e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f99341104f0 con 0x7f9934105b20 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9933e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9934110370 con 0x7f99341049d0 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9933e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9934110670 con 0x7f99341064e0 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39410/0 (socket says 172.21.15.33:39410) 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 -- 172.21.15.33:0/96105972 learned_addr learned my addr 172.21.15.33:0/96105972 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932a00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 0x7f993419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9933400640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 -- 172.21.15.33:0/96105972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 msgr2=0x7f993419bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993419bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 -- 172.21.15.33:0/96105972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 msgr2=0x7f993419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 0x7f993419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.408+0000 7f9932000640 1 -- 172.21.15.33:0/96105972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993419c810 con 0x7f9934105b20 2024-09-11T00:03:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f9932000640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9c0 tx=0x7f992000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f992b400640 1 -- 172.21.15.33:0/96105972 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992000cde0 con 0x7f9934105b20 2024-09-11T00:03:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993419cb00 con 0x7f9934105b20 2024-09-11T00:03:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f992b400640 1 -- 172.21.15.33:0/96105972 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99200035f0 con 0x7f9934105b20 2024-09-11T00:03:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f992b400640 1 -- 172.21.15.33:0/96105972 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920010690 con 0x7f9934105b20 2024-09-11T00:03:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.409+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341a31d0 con 0x7f9934105b20 2024-09-11T00:03:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 Processor -- start 2024-09-11T00:03:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 -- start start 2024-09-11T00:03:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5afed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5a6f6b0 con 0x55a1c5b01ce0 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5a5eae0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.413+0000 7f993c619740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5a628f0 con 0x55a1c5afc970 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60644/0 (socket says 172.21.15.33:60644) 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 -- 172.21.15.33:0/2884101605 learned_addr learned my addr 172.21.15.33:0/2884101605 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9933400640 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5afed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f992b400640 1 -- 172.21.15.33:0/96105972 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9920004000 con 0x7f9934105b20 2024-09-11T00:03:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 -- 172.21.15.33:0/2884101605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 msgr2=0x55a1c5afed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5afed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.414+0000 7f9932a00640 1 -- 172.21.15.33:0/2884101605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 msgr2=0x55a1c5b041a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:03:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f9932a00640 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f9932a00640 1 -- 172.21.15.33:0/2884101605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c5a2b780 con 0x55a1c5aff2a0 2024-09-11T00:03:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f9932a00640 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d20 tx=0x7f9924011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74599cf37d39b87a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f991fe00640 1 -- 172.21.15.33:0/2884101605 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992401e070 con 0x55a1c5aff2a0 2024-09-11T00:03:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f991fe00640 1 -- 172.21.15.33:0/2884101605 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924019ac0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.415+0000 7f991fe00640 1 -- 172.21.15.33:0/2884101605 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992400ea00 con 0x55a1c5aff2a0 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.416+0000 7f992b400640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 0x7f99180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.416+0000 7f993c619740 1 -- 172.21.15.33:0/2884101605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 msgr2=0x55a1c5b01690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.416+0000 7f993c619740 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9924009d20 tx=0x7f9924011810 comp rx=0 tx=0).stop 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.416+0000 7f992b400640 1 -- 172.21.15.33:0/96105972 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f99200e6350 con 0x7f9934105b20 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 -- 172.21.15.33:0/2884101605 shutdown_connections 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b01690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 --2- 172.21.15.33:0/2884101605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5afed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 -- 172.21.15.33:0/2884101605 >> 172.21.15.33:0/2884101605 conn(0x55a1c5af7ac0 msgr2=0x55a1c5af8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f9933400640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 0x7f99180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 -- 172.21.15.33:0/2884101605 shutdown_connections 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 -- 172.21.15.33:0/2884101605 wait complete. 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 -- start start 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f993c619740 1 Processor -- start 2024-09-11T00:03:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.417+0000 7f9933400640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 0x7f99180b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f992c006010 tx=0x7f992c004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 0x55a1c5b06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b07370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5996ab0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5a05570 con 0x55a1c5afc970 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1c5b04cc0 con 0x55a1c5b01ce0 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f993c619740 10 client.0 _ll_register_callbacks cb 0x55a1c5a14100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9932000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9932a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 0x55a1c5b06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9932000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39438/0 (socket says 172.21.15.33:39438) 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9932a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 0x55a1c5b06100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60650/0 (socket says 172.21.15.33:60650) 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9932000640 1 -- 172.21.15.33:0/2625130159 learned_addr learned my addr 172.21.15.33:0/2625130159 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.418+0000 7f9933400640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b07370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 -- 172.21.15.33:0/2625130159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 msgr2=0x55a1c5b07370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b07370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 -- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 msgr2=0x55a1c5b06100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 0x55a1c5b06100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 -- 172.21.15.33:0/2625130159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c57c0790 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f9932000640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f99200ac6a0 tx=0x7f99200ac2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68e9092d9341e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f991cc00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99200b11f0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9924019ac0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9920009400 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f99200b5ca0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.419+0000 7f993c619740 10 client.16290 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1c5839620 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924019ac0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f99200b5810 con 0x55a1c5aff2a0 2024-09-11T00:03:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 10 client.16290 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 20 client.16290 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b119e0 0x55a1c5b13dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 4 client.16290 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.420+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1c5a71600 con 0x55a1c5b119e0 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.421+0000 7f9932a00640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b119e0 0x55a1c5b13dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.421+0000 7f9932a00640 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b119e0 0x55a1c5b13dd0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c074a1ad5261f6 server_cookie=7297c9b3cc1927d2 in_seq=0 out_seq=0 2024-09-11T00:03:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.421+0000 7f991cc00640 10 client.16290 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.422+0000 7f991cc00640 1 -- 172.21.15.33:0/2625130159 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1c5a71600 con 0x55a1c5b119e0 2024-09-11T00:03:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.422+0000 7f991cc00640 10 client.16290 handle_command_reply: tid=0 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.422+0000 7f993c619740 1 client.16290 shutdown 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.422+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 msgr2=0x55a1c5b067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.422+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f99200ac6a0 tx=0x7f99200ac2e0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 shutdown_connections 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b119e0 0x55a1c5b13dd0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b07370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b067a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f991cc00640 0 client.16290 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 --2- 172.21.15.33:0/2625130159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5afc970 0x55a1c5b06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 >> 172.21.15.33:0/2625130159 conn(0x55a1c5af7ac0 msgr2=0x55a1c5af6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 shutdown_connections 2024-09-11T00:03:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 1 -- 172.21.15.33:0/2625130159 wait complete. 2024-09-11T00:03:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.423+0000 7f993c619740 20 client.16290 trim_cache size 0 max 16384 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.438+0000 7f993c619740 1 Processor -- start 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.438+0000 7f993c619740 1 -- start start 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5af73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5af8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f99341afe00 con 0x55a1c5b01ce0 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ad6d0 con 0x55a1c5aff2a0 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f993c619740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ab520 con 0x55a1c5afc970 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9933400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5af8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:56192/0 (socket says 172.21.15.33:56192) 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 -- 172.21.15.33:0/2279472025 learned_addr learned my addr 172.21.15.33:0/2279472025 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932000640 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5af73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 -- 172.21.15.33:0/2279472025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 msgr2=0x55a1c5af73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5af73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 -- 172.21.15.33:0/2279472025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 msgr2=0x55a1c5af8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5af8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.439+0000 7f9932a00640 1 -- 172.21.15.33:0/2279472025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c5af78f0 con 0x55a1c5afc970 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.440+0000 7f9932a00640 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9924005890 tx=0x7f9924009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d632d420ed41a0be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.440+0000 7f991f400640 1 -- 172.21.15.33:0/2279472025 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992401e040 con 0x55a1c5afc970 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.440+0000 7f991f400640 1 -- 172.21.15.33:0/2279472025 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924019a60 con 0x55a1c5afc970 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.440+0000 7f991f400640 1 -- 172.21.15.33:0/2279472025 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99240035f0 con 0x55a1c5afc970 2024-09-11T00:03:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- 172.21.15.33:0/2279472025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 msgr2=0x55a1c5b057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9924005890 tx=0x7f9924009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- 172.21.15.33:0/2279472025 shutdown_connections 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5b01ce0 0x55a1c5af8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5af73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 --2- 172.21.15.33:0/2279472025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5afc970 0x55a1c5b057a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- 172.21.15.33:0/2279472025 >> 172.21.15.33:0/2279472025 conn(0x55a1c5af7ac0 msgr2=0x55a1c5b05090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- 172.21.15.33:0/2279472025 shutdown_connections 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- 172.21.15.33:0/2279472025 wait complete. 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 -- start start 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.441+0000 7f993c619740 1 Processor -- start 2024-09-11T00:03:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b0d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f99341abb90 con 0x55a1c5afc970 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ad000 con 0x55a1c5aff2a0 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99341ac260 con 0x55a1c5b01ce0 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f993c619740 10 client.0 _ll_register_callbacks cb 0x7f99200046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f9932a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f9932a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39448/0 (socket says 172.21.15.33:39448) 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f9932a00640 1 -- 172.21.15.33:0/126340350 learned_addr learned my addr 172.21.15.33:0/126340350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f9933400640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.442+0000 7f9932000640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b0d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 -- 172.21.15.33:0/126340350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 msgr2=0x55a1c5b0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 -- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 msgr2=0x55a1c5b0d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:03:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b0d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 -- 172.21.15.33:0/126340350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c5b0bfb0 con 0x55a1c5afc970 2024-09-11T00:03:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f9932a00640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f992400e3e0 tx=0x7f9924009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932820f8927b13d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f991cc00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924034020 con 0x55a1c5afc970 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f99240195d0 con 0x55a1c5afc970 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9924019a60 con 0x55a1c5afc970 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.443+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f992403f050 con 0x55a1c5afc970 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 10 client.16296 fetch_fsmap learned FSMap version 30 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1c5b7ef10 con 0x55a1c5afc970 2024-09-11T00:03:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9924019a60 con 0x55a1c5afc970 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9920004320 con 0x55a1c5afc970 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 10 client.16296 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 20 client.16296 populate_metadata read hostname 'smithi033' 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b7f700 0x55a1c5b81b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 4 client.16296 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.444+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1c5a6d0b0 con 0x55a1c5b7f700 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.445+0000 7f9932000640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b7f700 0x55a1c5b81b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.445+0000 7f991cc00640 10 client.16296 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.445+0000 7f9932000640 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b7f700 0x55a1c5b81b20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8b2d43b664f19b server_cookie=963c60b7d2f482d6 in_seq=0 out_seq=0 2024-09-11T00:03:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.465+0000 7f991cc00640 1 -- 172.21.15.33:0/126340350 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1c5a6d0b0 con 0x55a1c5b7f700 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.465+0000 7f991cc00640 10 client.16296 handle_command_reply: tid=0 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 client.16296 shutdown 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 msgr2=0x55a1c5b0cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f992400e3e0 tx=0x7f9924009f50 comp rx=0 tx=0).stop 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 shutdown_connections 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a1c5b7f700 0x55a1c5b81b20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1c5b01ce0 0x55a1c5b0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a1c5aff2a0 0x55a1c5b0d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 --2- 172.21.15.33:0/126340350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1c5afc970 0x55a1c5b0cf50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f991cc00640 0 client.16296 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 >> 172.21.15.33:0/126340350 conn(0x55a1c5af7ac0 msgr2=0x55a1c5af8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 shutdown_connections 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 1 -- 172.21.15.33:0/126340350 wait complete. 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.466+0000 7f993c619740 20 client.16296 trim_cache size 0 max 16384 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:03:57.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:03:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 msgr2=0x7f99180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 0x7f99180b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f992c006010 tx=0x7f992c004a60 comp rx=0 tx=0).stop 2024-09-11T00:03:57.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 msgr2=0x7f993419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9c0 tx=0x7f992000ee80 comp rx=0 tx=0).stop 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 shutdown_connections 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f99180b52e0 0x7f99180b77a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99341064e0 0x7f993419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9934105b20 0x7f993419b320 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 --2- 172.21.15.33:0/96105972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99341049d0 0x7f993419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 >> 172.21.15.33:0/96105972 conn(0x7f9934100270 msgr2=0x7f9934108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 shutdown_connections 2024-09-11T00:03:57.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:03:57.467+0000 7f9933e00640 1 -- 172.21.15.33:0/96105972 wait complete. 2024-09-11T00:03:58.025 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ae422884', quiesce took 6.0 seconds. Will release after: 20.8 2024-09-11T00:03:58.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 250.0 s, 456.7 tps, lat 144.940 ms stddev 49.244 2024-09-11T00:03:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:03:58 smithi189 ceph-mon[34000]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 813 op/s 2024-09-11T00:03:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:03:58 smithi052 ceph-mon[33526]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 813 op/s 2024-09-11T00:03:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:03:58 smithi033 ceph-mon[30593]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 813 op/s 2024-09-11T00:04:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:00 smithi189 ceph-mon[34000]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 639 op/s 2024-09-11T00:04:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:00 smithi052 ceph-mon[33526]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 639 op/s 2024-09-11T00:04:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:00 smithi033 ceph-mon[30593]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.7 MiB/s wr, 639 op/s 2024-09-11T00:04:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:02 smithi189 ceph-mon[34000]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 572 op/s 2024-09-11T00:04:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:02 smithi052 ceph-mon[33526]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 572 op/s 2024-09-11T00:04:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:02 smithi033 ceph-mon[30593]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 572 op/s 2024-09-11T00:04:03.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:04:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:04 smithi189 ceph-mon[34000]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2024-09-11T00:04:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:04 smithi052 ceph-mon[33526]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2024-09-11T00:04:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:04 smithi033 ceph-mon[30593]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2024-09-11T00:04:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:06 smithi189 ceph-mon[34000]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-11T00:04:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:06 smithi052 ceph-mon[33526]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-11T00:04:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:06 smithi033 ceph-mon[30593]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-11T00:04:08.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:04:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:08 smithi189 ceph-mon[34000]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 246 op/s 2024-09-11T00:04:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:08 smithi052 ceph-mon[33526]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 246 op/s 2024-09-11T00:04:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:08 smithi033 ceph-mon[30593]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.0 MiB/s wr, 246 op/s 2024-09-11T00:04:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:10 smithi189 ceph-mon[34000]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 834 KiB/s wr, 98 op/s 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.594+0000 7f3b4d400640 1 -- 172.21.15.33:0/1511186346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b481066a0 msgr2=0x7f3b4810d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.594+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1511186346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b481066a0 0x7f3b4810d020 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009cd0 tx=0x7f3b4002a8e0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 -- 172.21.15.33:0/1511186346 shutdown_connections 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1511186346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b481066a0 0x7f3b4810d020 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1511186346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48105ce0 0x7f3b48106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1511186346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b48104b90 0x7f3b48104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 -- 172.21.15.33:0/1511186346 >> 172.21.15.33:0/1511186346 conn(0x7f3b48100470 msgr2=0x7f3b48102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 -- 172.21.15.33:0/1511186346 shutdown_connections 2024-09-11T00:04:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.595+0000 7f3b4d400640 1 -- 172.21.15.33:0/1511186346 wait complete. 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 Processor -- start 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 -- start start 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 0x7f3b4819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b481066a0 0x7f3b4819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48110690 con 0x7f3b48105ce0 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48110510 con 0x7f3b481066a0 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b4d400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48110810 con 0x7f3b48104b90 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42374/0 (socket says 172.21.15.33:42374) 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b3fe00640 1 -- 172.21.15.33:0/1286877420 learned_addr learned my addr 172.21.15.33:0/1286877420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.596+0000 7f3b47200640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b481066a0 0x7f3b4819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b46800640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 0x7f3b4819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 -- 172.21.15.33:0/1286877420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 msgr2=0x7f3b4819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 0x7f3b4819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 -- 172.21.15.33:0/1286877420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b481066a0 msgr2=0x7f3b4819c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b481066a0 0x7f3b4819c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 -- 172.21.15.33:0/1286877420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4819c980 con 0x7f3b48105ce0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b46800640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 0x7f3b4819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000d950 tx=0x7f3b3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3f400640 1 -- 172.21.15.33:0/1286877420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30017070 con 0x7f3b48105ce0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3f400640 1 -- 172.21.15.33:0/1286877420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b30009c30 con 0x7f3b48105ce0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4819cc70 con 0x7f3b48105ce0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.597+0000 7f3b3f400640 1 -- 172.21.15.33:0/1286877420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000f620 con 0x7f3b48105ce0 2024-09-11T00:04:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.598+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b481a3340 con 0x7f3b48105ce0 2024-09-11T00:04:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 Processor -- start 2024-09-11T00:04:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 -- start start 2024-09-11T00:04:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b3f400640 1 -- 172.21.15.33:0/1286877420 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3b30010460 con 0x7f3b48105ce0 2024-09-11T00:04:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 0x55764312ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x55764312ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55764309b6b0 con 0x55764312b0c0 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55764308aae0 con 0x55764312db00 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b50458740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55764308e8f0 con 0x557643128790 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.601+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42384/0 (socket says 172.21.15.33:42384) 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 -- 172.21.15.33:0/3166450088 learned_addr learned my addr 172.21.15.33:0/3166450088 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x55764312ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b47200640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 0x55764312ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 -- 172.21.15.33:0/3166450088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 msgr2=0x55764312ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 0x55764312ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 -- 172.21.15.33:0/3166450088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 msgr2=0x55764312ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x55764312ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 -- 172.21.15.33:0/3166450088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557643057780 con 0x55764312b0c0 2024-09-11T00:04:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x55764312ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b47200640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 0x55764312ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.602+0000 7f3b46800640 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800bd40 tx=0x7f3b3800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d7fd03d4e89ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b37400640 1 -- 172.21.15.33:0/3166450088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38015070 con 0x55764312b0c0 2024-09-11T00:04:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b37400640 1 -- 172.21.15.33:0/3166450088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b3800be30 con 0x55764312b0c0 2024-09-11T00:04:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b37400640 1 -- 172.21.15.33:0/3166450088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38011900 con 0x55764312b0c0 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b3f400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 0x7f3b2c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b3f400640 1 -- 172.21.15.33:0/1286877420 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b300e5b90 con 0x7f3b48105ce0 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b47200640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 0x7f3b2c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b50458740 1 -- 172.21.15.33:0/3166450088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 msgr2=0x55764312d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.603+0000 7f3b50458740 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800bd40 tx=0x7f3b3800f730 comp rx=0 tx=0).stop 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 -- 172.21.15.33:0/3166450088 shutdown_connections 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x55764312ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312d4b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 --2- 172.21.15.33:0/3166450088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557643128790 0x55764312ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 -- 172.21.15.33:0/3166450088 >> 172.21.15.33:0/3166450088 conn(0x5576431238e0 msgr2=0x557643124670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 -- 172.21.15.33:0/3166450088 shutdown_connections 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 -- 172.21.15.33:0/3166450088 wait complete. 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b47200640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 0x7f3b2c0b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b40004af0 tx=0x7f3b40004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 -- start start 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.604+0000 7f3b50458740 1 Processor -- start 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 0x5576431325a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x557643133170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557642fc2ab0 con 0x557643128790 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557643031570 con 0x55764312b0c0 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557643130ae0 con 0x55764312db00 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b50458740 10 client.0 _ll_register_callbacks cb 0x557643040100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42386/0 (socket says 172.21.15.33:42386) 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 -- 172.21.15.33:0/1268468549 learned_addr learned my addr 172.21.15.33:0/1268468549 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b47200640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x557643133170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 -- 172.21.15.33:0/1268468549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 msgr2=0x557643133170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x557643133170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b46800640 1 -- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 msgr2=0x5576431325a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.605+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 0x5576431325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b46800640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 0x5576431325a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b46800640 1 -- 172.21.15.33:0/1268468549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557642dec790 con 0x557643128790 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b47200640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x557643133170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 0x5576431325a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b46800640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800bab0 tx=0x7f3b38005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3fefc9f831022d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b2be00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38027020 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b38004020 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3800be30 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.606+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b3802f050 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 10 client.16308 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557642e65620 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b3800be30 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3b38022070 con 0x557643128790 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 10 client.16308 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 20 client.16308 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55764313d460 0x55764313f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 4 client.16308 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.607+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55764309d600 con 0x55764313d460 2024-09-11T00:04:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.608+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55764313d460 0x55764313f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.608+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55764313d460 0x55764313f850 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff0b690e90575c server_cookie=11b956ae76eeadc6 in_seq=0 out_seq=0 2024-09-11T00:04:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.608+0000 7f3b2be00640 10 client.16308 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b2be00640 1 -- 172.21.15.33:0/1268468549 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55764309d600 con 0x55764313d460 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b2be00640 10 client.16308 handle_command_reply: tid=0 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 client.16308 shutdown 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 msgr2=0x557643131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800bab0 tx=0x7f3b38005040 comp rx=0 tx=0).stop 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 shutdown_connections 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55764313d460 0x55764313f850 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x557643133170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312b0c0 0x5576431325a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 --2- 172.21.15.33:0/1268468549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643131f00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b2be00640 0 client.16308 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.609+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 >> 172.21.15.33:0/1268468549 conn(0x5576431238e0 msgr2=0x557643122a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.610+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 shutdown_connections 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.610+0000 7f3b50458740 1 -- 172.21.15.33:0/1268468549 wait complete. 2024-09-11T00:04:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.610+0000 7f3b50458740 20 client.16308 trim_cache size 0 max 16384 2024-09-11T00:04:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.625+0000 7f3b50458740 1 Processor -- start 2024-09-11T00:04:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.625+0000 7f3b50458740 1 -- start start 2024-09-11T00:04:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.625+0000 7f3b50458740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557643128790 0x55764312dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.625+0000 7f3b50458740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.625+0000 7f3b50458740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x5576431255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b50458740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481b00c0 con 0x55764312b0c0 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b50458740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481ad990 con 0x557643128790 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b50458740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481ab7e0 con 0x55764312db00 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42392/0 (socket says 172.21.15.33:42392) 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 -- 172.21.15.33:0/2994870664 learned_addr learned my addr 172.21.15.33:0/2994870664 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b46800640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557643128790 0x55764312dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b47200640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x5576431255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 -- 172.21.15.33:0/2994870664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 msgr2=0x5576431255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x5576431255e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 -- 172.21.15.33:0/2994870664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557643128790 msgr2=0x55764312dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557643128790 0x55764312dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b3fe00640 1 -- 172.21.15.33:0/2994870664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764312aef0 con 0x55764312b0c0 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.626+0000 7f3b47200640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x5576431255e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3b300abc50 tx=0x7f3b300a8660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0824bc4b2733d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b36a00640 1 -- 172.21.15.33:0/2994870664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b300eb070 con 0x55764312b0c0 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b36a00640 1 -- 172.21.15.33:0/2994870664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b300ac650 con 0x55764312b0c0 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b36a00640 1 -- 172.21.15.33:0/2994870664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30020040 con 0x55764312b0c0 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 -- 172.21.15.33:0/2994870664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 msgr2=0x55764312e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3b300abc50 tx=0x7f3b300a8660 comp rx=0 tx=0).stop 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 -- 172.21.15.33:0/2994870664 shutdown_connections 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312db00 0x5576431255e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55764312b0c0 0x55764312e420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 --2- 172.21.15.33:0/2994870664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557643128790 0x55764312dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.627+0000 7f3b50458740 1 -- 172.21.15.33:0/2994870664 >> 172.21.15.33:0/2994870664 conn(0x5576431238e0 msgr2=0x557643127c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 -- 172.21.15.33:0/2994870664 shutdown_connections 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 -- 172.21.15.33:0/2994870664 wait complete. 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 -- start start 2024-09-11T00:04:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 Processor -- start 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.628+0000 7f3b50458740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312b0c0 0x557643138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b50458740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x557643139020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b50458740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481abe50 con 0x557643128790 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b50458740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481ad2c0 con 0x55764312db00 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b50458740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b481ac520 con 0x55764312b0c0 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b50458740 10 client.0 _ll_register_callbacks cb 0x7f3b3800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42408/0 (socket says 172.21.15.33:42408) 2024-09-11T00:04:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 -- 172.21.15.33:0/1535313043 learned_addr learned my addr 172.21.15.33:0/1535313043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312b0c0 0x557643138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b47200640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x557643139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 -- 172.21.15.33:0/1535313043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312b0c0 msgr2=0x557643138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312b0c0 0x557643138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 -- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 msgr2=0x557643139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x557643139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b46800640 1 -- 172.21.15.33:0/1535313043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557643137460 con 0x557643128790 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.629+0000 7f3b47200640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x557643139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b46800640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b38005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888422a713efd0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b2be00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38037070 con 0x557643128790 2024-09-11T00:04:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b380117a0 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b300ac650 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b38027040 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b50458740 10 client.16314 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5576431aa4e0 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.630+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b300ac650 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3b38022070 con 0x557643128790 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 10 client.16314 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 20 client.16314 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5576431aaec0 0x5576431ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 4 client.16314 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576430990b0 con 0x5576431aaec0 2024-09-11T00:04:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.631+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5576431aaec0 0x5576431ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.632+0000 7f3b3fe00640 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5576431aaec0 0x5576431ad2e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edba9b8eb58ea8ad server_cookie=70d57e3fdd52fa7c in_seq=0 out_seq=0 2024-09-11T00:04:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.632+0000 7f3b2be00640 10 client.16314 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.647+0000 7f3b2be00640 1 -- 172.21.15.33:0/1535313043 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576430990b0 con 0x5576431aaec0 2024-09-11T00:04:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b2be00640 10 client.16314 handle_command_reply: tid=0 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 client.16314 shutdown 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 msgr2=0x557643139bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000c00 tx=0x7f3b38005a70 comp rx=0 tx=0).stop 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 shutdown_connections 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55764312db00 0x557643139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5576431aaec0 0x5576431ad2e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55764312b0c0 0x557643138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 --2- 172.21.15.33:0/1535313043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557643128790 0x557643139bf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b2be00640 0 client.16314 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 >> 172.21.15.33:0/1535313043 conn(0x5576431238e0 msgr2=0x557643127c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 shutdown_connections 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 1 -- 172.21.15.33:0/1535313043 wait complete. 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.648+0000 7f3b50458740 20 client.16314 trim_cache size 0 max 16384 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:04:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 msgr2=0x7f3b2c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 0x7f3b2c0b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b40004af0 tx=0x7f3b40004a40 comp rx=0 tx=0).stop 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 msgr2=0x7f3b4819b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000d950 tx=0x7f3b3000de10 comp rx=0 tx=0).stop 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 shutdown_connections 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b2c0b5360 0x7f3b2c0b7820 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b481066a0 0x7f3b4819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b48105ce0 0x7f3b4819b490 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 --2- 172.21.15.33:0/1286877420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b48104b90 0x7f3b4819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 >> 172.21.15.33:0/1286877420 conn(0x7f3b48100470 msgr2=0x7f3b481090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 shutdown_connections 2024-09-11T00:04:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:10.649+0000 7f3b4d400640 1 -- 172.21.15.33:0/1286877420 wait complete. 2024-09-11T00:04:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:10 smithi052 ceph-mon[33526]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 834 KiB/s wr, 98 op/s 2024-09-11T00:04:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:10 smithi033 ceph-mon[30593]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 834 KiB/s wr, 98 op/s 2024-09-11T00:04:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:12 smithi052 ceph-mon[33526]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 533 KiB/s wr, 61 op/s 2024-09-11T00:04:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:12 smithi033 ceph-mon[30593]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 533 KiB/s wr, 61 op/s 2024-09-11T00:04:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:12 smithi189 ceph-mon[34000]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 533 KiB/s wr, 61 op/s 2024-09-11T00:04:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:04:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:14 smithi052 ceph-mon[33526]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 215 KiB/s wr, 39 op/s 2024-09-11T00:04:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:14 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:14 smithi033 ceph-mon[30593]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 215 KiB/s wr, 39 op/s 2024-09-11T00:04:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:14 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:14 smithi189 ceph-mon[34000]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 215 KiB/s wr, 39 op/s 2024-09-11T00:04:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:14 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:04:15.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:15.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:04:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:04:15.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:04:15.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:04:15.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:04:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:16 smithi052 ceph-mon[33526]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:04:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:16 smithi033 ceph-mon[30593]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:04:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:16 smithi189 ceph-mon[34000]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-11T00:04:18.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:04:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:18 smithi052 ceph-mon[33526]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 201 KiB/s wr, 34 op/s 2024-09-11T00:04:18.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:18 smithi033 ceph-mon[30593]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 201 KiB/s wr, 34 op/s 2024-09-11T00:04:18.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:04:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:18 smithi189 ceph-mon[34000]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 201 KiB/s wr, 34 op/s 2024-09-11T00:04:19.220 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 -- 172.21.15.33:0/1548946730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec640776d0 msgr2=0x7fec64077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 --2- 172.21.15.33:0/1548946730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec640776d0 0x7fec64077ab0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec54009900 tx=0x7fec5402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 -- 172.21.15.33:0/1548946730 shutdown_connections 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 --2- 172.21.15.33:0/1548946730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec641137e0 0x7fec64115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 --2- 172.21.15.33:0/1548946730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 0x7fec641132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 --2- 172.21.15.33:0/1548946730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec640776d0 0x7fec64077ab0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 -- 172.21.15.33:0/1548946730 >> 172.21.15.33:0/1548946730 conn(0x7fec64100840 msgr2=0x7fec64102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 -- 172.21.15.33:0/1548946730 shutdown_connections 2024-09-11T00:04:19.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.845+0000 7fec6a600640 1 -- 172.21.15.33:0/1548946730 wait complete. 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.846+0000 7fec6a600640 1 Processor -- start 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.846+0000 7fec6a600640 1 -- start start 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec640776d0 0x7fec6419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 0x7fec6419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fec641190f0 con 0x7fec641137e0 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec64118f70 con 0x7fec640776d0 2024-09-11T00:04:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec6a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec64119270 con 0x7fec64077ff0 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec69c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec69c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49368/0 (socket says 172.21.15.33:49368) 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec69c00640 1 -- 172.21.15.33:0/2639231246 learned_addr learned my addr 172.21.15.33:0/2639231246 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec5be00640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 0x7fec6419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.847+0000 7fec69200640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec640776d0 0x7fec6419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 -- 172.21.15.33:0/2639231246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 msgr2=0x7fec6419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 0x7fec6419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 -- 172.21.15.33:0/2639231246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec640776d0 msgr2=0x7fec6419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec640776d0 0x7fec6419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 -- 172.21.15.33:0/2639231246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec641a5610 con 0x7fec641137e0 2024-09-11T00:04:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec69c00640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00eb40 tx=0x7fec5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c004b20 con 0x7fec641137e0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec5c004cc0 con 0x7fec641137e0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c010690 con 0x7fec641137e0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec641a5900 con 0x7fec641137e0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.848+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec641abfc0 con 0x7fec641137e0 2024-09-11T00:04:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.849+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec64077ab0 con 0x7fec641137e0 2024-09-11T00:04:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.852+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fec5c005540 con 0x7fec641137e0 2024-09-11T00:04:19.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.853+0000 7fec62000640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 0x7fec480b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.853+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fec5c0e6820 con 0x7fec641137e0 2024-09-11T00:04:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.853+0000 7fec69200640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 0x7fec480b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.854+0000 7fec69200640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 0x7fec480b7850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec54006010 tx=0x7fec54005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:19.857+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec5c0ad2e0 con 0x7fec641137e0 2024-09-11T00:04:20.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.090+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec641ac350 con 0x7fec641137e0 2024-09-11T00:04:20.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.090+0000 7fec62000640 1 -- 172.21.15.33:0/2639231246 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fec5c0acbe0 con 0x7fec641137e0 2024-09-11T00:04:20.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:04:20.093 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:04:20.093 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:04:20.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 msgr2=0x7fec480b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:20.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 0x7fec480b7850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec54006010 tx=0x7fec54005a20 comp rx=0 tx=0).stop 2024-09-11T00:04:20.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 msgr2=0x7fec641a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:20.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00eb40 tx=0x7fec5c00c2d0 comp rx=0 tx=0).stop 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 shutdown_connections 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fec480b5390 0x7fec480b7850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec641137e0 0x7fec641a4e40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec64077ff0 0x7fec6419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 --2- 172.21.15.33:0/2639231246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec640776d0 0x7fec6419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:20.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 >> 172.21.15.33:0/2639231246 conn(0x7fec64100840 msgr2=0x7fec64102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:20.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 shutdown_connections 2024-09-11T00:04:20.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:20.093+0000 7fec6a600640 1 -- 172.21.15.33:0/2639231246 wait complete. 2024-09-11T00:04:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:20 smithi052 ceph-mon[33526]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 190 KiB/s wr, 30 op/s 2024-09-11T00:04:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:20 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2639231246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:20 smithi033 ceph-mon[30593]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 190 KiB/s wr, 30 op/s 2024-09-11T00:04:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:20 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2639231246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:20 smithi189 ceph-mon[34000]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 190 KiB/s wr, 30 op/s 2024-09-11T00:04:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:20 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2639231246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:04:20.988 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id ae422884 --release --await' 2024-09-11T00:04:20.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id ae422884 --release --await 2024-09-11T00:04:21.367 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:04:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 -- 172.21.15.33:0/292471097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 msgr2=0x7fb868105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 --2- 172.21.15.33:0/292471097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb868105380 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009900 tx=0x7fb85c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 -- 172.21.15.33:0/292471097 shutdown_connections 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 --2- 172.21.15.33:0/292471097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810b330 0x7fb868111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 --2- 172.21.15.33:0/292471097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810a9b0 0x7fb86810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 --2- 172.21.15.33:0/292471097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb868105380 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 -- 172.21.15.33:0/292471097 >> 172.21.15.33:0/292471097 conn(0x7fb868100a50 msgr2=0x7fb868102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 -- 172.21.15.33:0/292471097 shutdown_connections 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.957+0000 7fb870200640 1 -- 172.21.15.33:0/292471097 wait complete. 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 Processor -- start 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 -- start start 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810a9b0 0x7fb86819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 0x7fb8681a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb868114e10 con 0x7fb868104fa0 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb868114c90 con 0x7fb86810b330 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.958+0000 7fb870200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb868114f90 con 0x7fb86810a9b0 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43774/0 (socket says 172.21.15.33:43774) 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 -- 172.21.15.33:0/2512043205 learned_addr learned my addr 172.21.15.33:0/2512043205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86ce00640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810a9b0 0x7fb86819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86e200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 0x7fb8681a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 -- 172.21.15.33:0/2512043205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810a9b0 msgr2=0x7fb86819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810a9b0 0x7fb86819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 -- 172.21.15.33:0/2512043205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 msgr2=0x7fb8681a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 0x7fb8681a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 -- 172.21.15.33:0/2512043205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8681a1510 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86e200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 0x7fb8681a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.959+0000 7fb86d800640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009230 tx=0x7fb85c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.960+0000 7fb866000640 1 -- 172.21.15.33:0/2512043205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c03f030 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.960+0000 7fb866000640 1 -- 172.21.15.33:0/2512043205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb85c003a80 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.960+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8681a17a0 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.960+0000 7fb866000640 1 -- 172.21.15.33:0/2512043205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c035070 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.960+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8681a7ec0 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.963+0000 7fb872c9c740 1 Processor -- start 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.963+0000 7fb872c9c740 1 -- start start 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.963+0000 7fb866000640 1 -- 172.21.15.33:0/2512043205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb85c0035f0 con 0x7fb868104fa0 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.963+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41694910 0x556f416a0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f416a08a0 0x556f416a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb872c9c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f4160b290 con 0x556f41693ff0 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb872c9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556f415fa6c0 con 0x556f416a08a0 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb872c9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f415fe4d0 con 0x556f41694910 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43778/0 (socket says 172.21.15.33:43778) 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 -- 172.21.15.33:0/2179548132 learned_addr learned my addr 172.21.15.33:0/2179548132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86d800640 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41694910 0x556f416a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86ce00640 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f416a08a0 0x556f416a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 -- 172.21.15.33:0/2179548132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41694910 msgr2=0x556f416a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41694910 0x556f416a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 -- 172.21.15.33:0/2179548132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f416a08a0 msgr2=0x556f416a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f416a08a0 0x556f416a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.964+0000 7fb86e200640 1 -- 172.21.15.33:0/2179548132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f41587460 con 0x556f41693ff0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb86e200640 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb860009f60 tx=0x7fb860009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39587ce0dbd953 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb85aa00640 1 -- 172.21.15.33:0/2179548132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860016070 con 0x556f41693ff0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb85aa00640 1 -- 172.21.15.33:0/2179548132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86001baf0 con 0x556f41693ff0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb85aa00640 1 -- 172.21.15.33:0/2179548132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860012b30 con 0x556f41693ff0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb866000640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 0x7fb8500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb866000640 1 -- 172.21.15.33:0/2512043205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb85c1067f0 con 0x7fb868104fa0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.965+0000 7fb86d800640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 0x7fb8500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 -- 172.21.15.33:0/2179548132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 msgr2=0x556f416943d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb860009f60 tx=0x7fb860009f90 comp rx=0 tx=0).stop 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 -- 172.21.15.33:0/2179548132 shutdown_connections 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f416a08a0 0x556f416a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41694910 0x556f416a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2179548132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41693ff0 0x556f416943d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 -- 172.21.15.33:0/2179548132 >> 172.21.15.33:0/2179548132 conn(0x556f41691e20 msgr2=0x556f41692fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 -- 172.21.15.33:0/2179548132 shutdown_connections 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb86d800640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 0x7fb8500b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0c9180 tx=0x7fb85c02a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.966+0000 7fb872c9c740 1 -- 172.21.15.33:0/2179548132 wait complete. 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 -- start start 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 Processor -- start 2024-09-11T00:04:21.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41693ff0 0x556f4169d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f416a08a0 0x556f4169e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f4145bbb0 con 0x556f41694910 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556f415956c0 con 0x556f41693ff0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.967+0000 7fb872c9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f416a3550 con 0x556f416a08a0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb872c9c740 10 client.0 _ll_register_callbacks cb 0x556f415b0490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43780/0 (socket says 172.21.15.33:43780) 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 -- 172.21.15.33:0/2117012747 learned_addr learned my addr 172.21.15.33:0/2117012747 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86e200640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41693ff0 0x556f4169d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86e200640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f416a08a0 0x556f4169e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 -- 172.21.15.33:0/2117012747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f416a08a0 msgr2=0x556f4169e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f416a08a0 0x556f4169e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 -- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41693ff0 msgr2=0x556f4169d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41693ff0 0x556f4169d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.968+0000 7fb86ce00640 1 -- 172.21.15.33:0/2117012747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f41358b00 con 0x556f41694910 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb86ce00640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b9f0 tx=0x7fb85400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2725fb41c0b8a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb84f400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85401b440 con 0x556f41694910 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb85401b5e0 con 0x556f41694910 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb86001baf0 con 0x556f41694910 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb854024050 con 0x556f41694910 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb872c9c740 10 client.16332 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:21.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f413cf960 con 0x556f41694910 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.969+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86001baf0 con 0x556f41694910 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb854019020 con 0x556f41694910 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 10 client.16332 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 10 client.16332 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 20 client.16332 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f416b04b0 0x556f416b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 4 client.16332 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f4160d1e0 con 0x556f416b04b0 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.970+0000 7fb86e200640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f416b04b0 0x556f416b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.971+0000 7fb86e200640 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f416b04b0 0x556f416b28a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e921d045b167448 server_cookie=9c983ca4ab0c62de in_seq=0 out_seq=0 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.971+0000 7fb84f400640 10 client.16332 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb84f400640 1 -- 172.21.15.33:0/2117012747 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f4160d1e0 con 0x556f416b04b0 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb84f400640 10 client.16332 handle_command_reply: tid=0 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 client.16332 shutdown 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 msgr2=0x556f4169ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b9f0 tx=0x7fb85400beb0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 shutdown_connections 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f416b04b0 0x556f416b28a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f416a08a0 0x556f4169e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f41694910 0x556f4169ddd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 --2- 172.21.15.33:0/2117012747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41693ff0 0x556f4169d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb84f400640 0 client.16332 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 >> 172.21.15.33:0/2117012747 conn(0x556f41691e20 msgr2=0x556f416979c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 shutdown_connections 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 1 -- 172.21.15.33:0/2117012747 wait complete. 2024-09-11T00:04:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.972+0000 7fb872c9c740 20 client.16332 trim_cache size 0 max 16384 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 Processor -- start 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 -- start start 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416b8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b4590 con 0x556f416a08a0 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b1e60 con 0x556f41694910 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb872c9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681afcb0 con 0x556f41693ff0 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43786/0 (socket says 172.21.15.33:43786) 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb86ce00640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.991+0000 7fb86e200640 1 -- 172.21.15.33:0/497945934 learned_addr learned my addr 172.21.15.33:0/497945934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:21.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86e200640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:21.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 -- 172.21.15.33:0/497945934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 msgr2=0x556f416978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 -- 172.21.15.33:0/497945934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 msgr2=0x556f416b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 -- 172.21.15.33:0/497945934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f416928a0 con 0x556f41694910 2024-09-11T00:04:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86e200640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.992+0000 7fb86ce00640 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416b8160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b9f0 tx=0x7fb8540040f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4400b08202bb284 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb85a000640 1 -- 172.21.15.33:0/497945934 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85402e020 con 0x556f41694910 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb85a000640 1 -- 172.21.15.33:0/497945934 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8540043c0 con 0x556f41694910 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb85a000640 1 -- 172.21.15.33:0/497945934 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854011680 con 0x556f41694910 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 -- 172.21.15.33:0/497945934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 msgr2=0x556f416b8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416b8160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb85400b9f0 tx=0x7fb8540040f0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 -- 172.21.15.33:0/497945934 shutdown_connections 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416b8160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 --2- 172.21.15.33:0/497945934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.993+0000 7fb872c9c740 1 -- 172.21.15.33:0/497945934 >> 172.21.15.33:0/497945934 conn(0x556f41691e20 msgr2=0x556f416971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.994+0000 7fb872c9c740 1 -- 172.21.15.33:0/497945934 shutdown_connections 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.994+0000 7fb872c9c740 1 -- 172.21.15.33:0/497945934 wait complete. 2024-09-11T00:04:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.994+0000 7fb872c9c740 1 -- start start 2024-09-11T00:04:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.994+0000 7fb872c9c740 1 Processor -- start 2024-09-11T00:04:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b0320 con 0x556f416a08a0 2024-09-11T00:04:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b1790 con 0x556f41694910 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8681b09f0 con 0x556f41693ff0 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb872c9c740 10 client.0 _ll_register_callbacks cb 0x7fb854004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb86e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43794/0 (socket says 172.21.15.33:43794) 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.995+0000 7fb86e200640 1 -- 172.21.15.33:0/729550732 learned_addr learned my addr 172.21.15.33:0/729550732 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86ce00640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 -- 172.21.15.33:0/729550732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 msgr2=0x556f416a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 -- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 msgr2=0x556f416a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 -- 172.21.15.33:0/729550732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4171d490 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86ce00640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb86e200640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb860009f60 tx=0x7fb86001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7afed389f4873a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb84f400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860016040 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb860004c00 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.996+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f41608c90 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb860004e00 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 10 client.16338 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f4171e800 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556f41608c90 con 0x556f416a08a0 2024-09-11T00:04:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb86000f040 con 0x556f416a08a0 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 10 client.16338 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 10 client.16338 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 20 client.16338 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4171edc0 0x556f417211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 4 client.16338 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ae422884", "release": true, "await": true}] 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.997+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ae422884", "release": true, "await": true}) -- 0x556f416060c0 con 0x556f4171edc0 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.998+0000 7fb86ce00640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4171edc0 0x556f417211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.998+0000 7fb86ce00640 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4171edc0 0x556f417211e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4f8ec1110fd9ae server_cookie=ca59740cc4415129 in_seq=0 out_seq=0 2024-09-11T00:04:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:21.998+0000 7fb84f400640 10 client.16338 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:22.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.051+0000 7fb84f400640 1 -- 172.21.15.33:0/729550732 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556f416060c0 con 0x556f4171edc0 2024-09-11T00:04:22.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.051+0000 7fb84f400640 10 client.16338 handle_command_reply: tid=0 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.051+0000 7fb872c9c740 1 client.16338 shutdown 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.051+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 msgr2=0x556f416a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.051+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb860009f60 tx=0x7fb86001d040 comp rx=0 tx=0).stop 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 shutdown_connections 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f416a08a0 0x556f416a42c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f41694910 0x556f416a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4171edc0 0x556f417211e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 --2- 172.21.15.33:0/729550732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f41693ff0 0x556f416a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 >> 172.21.15.33:0/729550732 conn(0x556f41691e20 msgr2=0x556f41690db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:22.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb84f400640 0 client.16338 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.052+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 shutdown_connections 2024-09-11T00:04:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.054+0000 7fb872c9c740 1 -- 172.21.15.33:0/729550732 wait complete. 2024-09-11T00:04:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.054+0000 7fb872c9c740 20 client.16338 trim_cache size 0 max 16384 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 24, 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "ae422884": { 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 24, 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:04:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 146.8, 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:04:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:04:22.059 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:04:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.055+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 msgr2=0x7fb8500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.055+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 0x7fb8500b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0c9180 tx=0x7fb85c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.055+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 msgr2=0x7fb86819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.055+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009230 tx=0x7fb85c004270 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 shutdown_connections 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb8500b52e0 0x7fb8500b77a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb86810b330 0x7fb8681a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb86810a9b0 0x7fb86819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 --2- 172.21.15.33:0/2512043205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb868104fa0 0x7fb86819b460 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 >> 172.21.15.33:0/2512043205 conn(0x7fb868100a50 msgr2=0x7fb868101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 shutdown_connections 2024-09-11T00:04:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:04:22.056+0000 7fb870200640 1 -- 172.21.15.33:0/2512043205 wait complete. 2024-09-11T00:04:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:22 smithi052 ceph-mon[33526]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 205 KiB/s wr, 32 op/s 2024-09-11T00:04:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:22 smithi033 ceph-mon[30593]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 205 KiB/s wr, 32 op/s 2024-09-11T00:04:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:22 smithi189 ceph-mon[34000]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 205 KiB/s wr, 32 op/s 2024-09-11T00:04:23.008 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ae422884', total seconds elapsed: 31.0 2024-09-11T00:04:23.326 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 275.0 s, 204.8 tps, lat 2607.418 ms stddev 7537.150 2024-09-11T00:04:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 -- 172.21.15.33:0/1525266423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141064c0 msgr2=0x7f3f1410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 --2- 172.21.15.33:0/1525266423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141064c0 0x7f3f1410ce40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009cd0 tx=0x7f3f0c02a8f0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 -- 172.21.15.33:0/1525266423 shutdown_connections 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 --2- 172.21.15.33:0/1525266423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141064c0 0x7f3f1410ce40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 --2- 172.21.15.33:0/1525266423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f14105b00 0x7f3f14105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 --2- 172.21.15.33:0/1525266423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f141049b0 0x7f3f14104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 -- 172.21.15.33:0/1525266423 >> 172.21.15.33:0/1525266423 conn(0x7f3f14100270 msgr2=0x7f3f14102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 -- 172.21.15.33:0/1525266423 shutdown_connections 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.835+0000 7f3f13200640 1 -- 172.21.15.33:0/1525266423 wait complete. 2024-09-11T00:04:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 Processor -- start 2024-09-11T00:04:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 -- start start 2024-09-11T00:04:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 0x7f3f1419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 0x7f3f1419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 0x7f3f1419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3f141104b0 con 0x7f3f14105b00 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.837+0000 7f3f13200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14110330 con 0x7f3f141064c0 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f13200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14110630 con 0x7f3f141049b0 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 0x7f3f1419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 0x7f3f1419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f12800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 0x7f3f1419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 0x7f3f1419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:43824/0 (socket says 172.21.15.33:43824) 2024-09-11T00:04:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11e00640 1 -- 172.21.15.33:0/3591714292 learned_addr learned my addr 172.21.15.33:0/3591714292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11400640 1 -- 172.21.15.33:0/3591714292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 msgr2=0x7f3f1419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11400640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 0x7f3f1419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.838+0000 7f3f11400640 1 -- 172.21.15.33:0/3591714292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 msgr2=0x7f3f1419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.839+0000 7f3f11400640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 0x7f3f1419beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.839+0000 7f3f11400640 1 -- 172.21.15.33:0/3591714292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1419c770 con 0x7f3f14105b00 2024-09-11T00:04:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.839+0000 7f3f12800640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 0x7f3f1419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.839+0000 7f3f11400640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 0x7f3f1419b280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9f0 tx=0x7f3f0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.840+0000 7f3f0aa00640 1 -- 172.21.15.33:0/3591714292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000ccc0 con 0x7f3f14105b00 2024-09-11T00:04:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.840+0000 7f3f0aa00640 1 -- 172.21.15.33:0/3591714292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f000108c0 con 0x7f3f14105b00 2024-09-11T00:04:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.840+0000 7f3f0aa00640 1 -- 172.21.15.33:0/3591714292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000187e0 con 0x7f3f14105b00 2024-09-11T00:04:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.840+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1419ca60 con 0x7f3f14105b00 2024-09-11T00:04:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.840+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f141a3130 con 0x7f3f14105b00 2024-09-11T00:04:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.844+0000 7f3f1be06740 1 Processor -- start 2024-09-11T00:04:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.845+0000 7f3f1be06740 1 -- start start 2024-09-11T00:04:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a12ab0 0x5653d2a14ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a154f0 0x5653d2a179b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653d297a6b0 con 0x5653d2a154f0 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653d2969ae0 con 0x5653d2a12ab0 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f1be06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653d296d8f0 con 0x5653d2a10180 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:43826/0 (socket says 172.21.15.33:43826) 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f12800640 1 -- 172.21.15.33:0/646055737 learned_addr learned my addr 172.21.15.33:0/646055737 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.846+0000 7f3f11e00640 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a12ab0 0x5653d2a14ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f12800640 1 -- 172.21.15.33:0/646055737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a12ab0 msgr2=0x5653d2a14ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f12800640 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a12ab0 0x5653d2a14ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f12800640 1 -- 172.21.15.33:0/646055737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a154f0 msgr2=0x5653d2a179b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f12800640 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a154f0 0x5653d2a179b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f12800640 1 -- 172.21.15.33:0/646055737 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d2936780 con 0x5653d2a10180 2024-09-11T00:04:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.847+0000 7f3f0aa00640 1 -- 172.21.15.33:0/3591714292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3f00010430 con 0x7f3f14105b00 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.848+0000 7f3f12800640 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ca0 tx=0x7f3f0c005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4bf2698f0042968 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.848+0000 7f3eff400640 1 -- 172.21.15.33:0/646055737 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0308b0 con 0x5653d2a10180 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.848+0000 7f3eff400640 1 -- 172.21.15.33:0/646055737 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0c036040 con 0x5653d2a10180 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.848+0000 7f3eff400640 1 -- 172.21.15.33:0/646055737 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0042a0 con 0x5653d2a10180 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 -- 172.21.15.33:0/646055737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 msgr2=0x5653d2a12570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.850 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ca0 tx=0x7f3f0c005f80 comp rx=0 tx=0).stop 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 -- 172.21.15.33:0/646055737 shutdown_connections 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a154f0 0x5653d2a179b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a12ab0 0x5653d2a14ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 --2- 172.21.15.33:0/646055737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a12570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.849+0000 7f3f1be06740 1 -- 172.21.15.33:0/646055737 >> 172.21.15.33:0/646055737 conn(0x5653d2a02ac0 msgr2=0x5653d2a03850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.851 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.850+0000 7f3f1be06740 1 -- 172.21.15.33:0/646055737 shutdown_connections 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.850+0000 7f3f1be06740 1 -- 172.21.15.33:0/646055737 wait complete. 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.850+0000 7f3f0aa00640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 0x7f3ef80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.851+0000 7f3f0aa00640 1 -- 172.21.15.33:0/3591714292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3f000e6190 con 0x7f3f14105b00 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.851+0000 7f3f1be06740 1 -- start start 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.851+0000 7f3f11e00640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 0x7f3ef80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.852 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.851+0000 7f3f1be06740 1 Processor -- start 2024-09-11T00:04:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a198f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a19f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653d28a1ab0 con 0x5653d2a12ab0 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653d2910570 con 0x5653d2a154f0 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653d2a18470 con 0x5653d2a10180 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f1be06740 10 client.0 _ll_register_callbacks cb 0x5653d291f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f12800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f12800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51448/0 (socket says 172.21.15.33:51448) 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.853+0000 7f3f12800640 1 -- 172.21.15.33:0/3341977038 learned_addr learned my addr 172.21.15.33:0/3341977038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.854+0000 7f3f11e00640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a198f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.854+0000 7f3f11400640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a19f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.854+0000 7f3f11e00640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 0x7f3ef80b78c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3f04005fd0 tx=0x7f3f0400bbb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.854+0000 7f3f12800640 1 -- 172.21.15.33:0/3341977038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 msgr2=0x5653d2a198f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.854+0000 7f3f12800640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a198f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.855+0000 7f3f12800640 1 -- 172.21.15.33:0/3341977038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 msgr2=0x5653d2a19f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.855+0000 7f3f12800640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a19f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.855+0000 7f3f12800640 1 -- 172.21.15.33:0/3341977038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d26cb790 con 0x5653d2a154f0 2024-09-11T00:04:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.856+0000 7f3f12800640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009bf0 tx=0x7f3f0c0304b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba9e191ed89483b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.856+0000 7f3ef3e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.856+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c04a040 con 0x5653d2a154f0 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.856+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3f0c003970 con 0x5653d2a154f0 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.857+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0c036040 con 0x5653d2a154f0 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.857+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f0c003b70 con 0x5653d2a154f0 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.857+0000 7f3f1be06740 10 client.36137 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.857+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653d2744620 con 0x5653d2a154f0 2024-09-11T00:04:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.858+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0c036040 con 0x5653d2a154f0 2024-09-11T00:04:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.858+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3f0c04d070 con 0x5653d2a154f0 2024-09-11T00:04:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 10 client.36137 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 10 client.36137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 20 client.36137 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a24d70 0x5653d2a27160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 4 client.36137 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.859+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653d297c600 con 0x5653d2a24d70 2024-09-11T00:04:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.860+0000 7f3f11e00640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a24d70 0x5653d2a27160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.862+0000 7f3f11e00640 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a24d70 0x5653d2a27160 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a564df8c6ff040 server_cookie=3c8d116330adb2ac in_seq=0 out_seq=0 2024-09-11T00:04:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.862+0000 7f3ef3e00640 10 client.36137 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.864+0000 7f3ef3e00640 1 -- 172.21.15.33:0/3341977038 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653d297c600 con 0x5653d2a24d70 2024-09-11T00:04:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.864+0000 7f3ef3e00640 10 client.36137 handle_command_reply: tid=0 2024-09-11T00:04:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.864+0000 7f3f1be06740 1 client.36137 shutdown 2024-09-11T00:04:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.864+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 msgr2=0x5653d2a1ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.864+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009bf0 tx=0x7f3f0c0304b0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 shutdown_connections 2024-09-11T00:04:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a1ab60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a19f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a24d70 0x5653d2a27160 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 --2- 172.21.15.33:0/3341977038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a10180 0x5653d2a198f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 >> 172.21.15.33:0/3341977038 conn(0x5653d2a02ac0 msgr2=0x5653d2a01bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3ef3e00640 0 client.36137 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 shutdown_connections 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 1 -- 172.21.15.33:0/3341977038 wait complete. 2024-09-11T00:04:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.865+0000 7f3f1be06740 20 client.36137 trim_cache size 0 max 16384 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.893+0000 7f3f1be06740 1 Processor -- start 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.893+0000 7f3f1be06740 1 -- start start 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.893+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 0x5653d2a023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.893+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 0x5653d2a21460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.893+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a15920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f1be06740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40125a0 con 0x5653d2a10180 2024-09-11T00:04:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f1be06740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef400fe70 con 0x5653d2a154f0 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f12800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a15920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f12800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a15920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51456/0 (socket says 172.21.15.33:51456) 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f12800640 1 -- 172.21.15.33:0/2742670669 learned_addr learned my addr 172.21.15.33:0/2742670669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f11400640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 0x5653d2a21460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f11e00640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 0x5653d2a023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.894+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef400dcc0 con 0x5653d2a12ab0 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.895+0000 7f3f11e00640 1 -- 172.21.15.33:0/2742670669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 msgr2=0x5653d2a21460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.895+0000 7f3f11e00640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 0x5653d2a21460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.895+0000 7f3f11e00640 1 -- 172.21.15.33:0/2742670669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 msgr2=0x5653d2a15920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.895+0000 7f3f11e00640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a15920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.895+0000 7f3f11e00640 1 -- 172.21.15.33:0/2742670669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d2a128e0 con 0x5653d2a10180 2024-09-11T00:04:23.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.896+0000 7f3f11400640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 0x5653d2a21460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.896+0000 7f3f11e00640 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 0x5653d2a023b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x5653d2a278d0 tx=0x7f3f04020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b521c082a15341b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.897+0000 7f3efea00640 1 -- 172.21.15.33:0/2742670669 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400be50 con 0x5653d2a10180 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.897+0000 7f3efea00640 1 -- 172.21.15.33:0/2742670669 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0401b040 con 0x5653d2a10180 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.897+0000 7f3efea00640 1 -- 172.21.15.33:0/2742670669 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04004a90 con 0x5653d2a10180 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 msgr2=0x5653d2a023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 0x5653d2a023b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x5653d2a278d0 tx=0x7f3f04020000 comp rx=0 tx=0).stop 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 shutdown_connections 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a154f0 0x5653d2a15920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a12ab0 0x5653d2a21460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 --2- 172.21.15.33:0/2742670669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a10180 0x5653d2a023b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 >> 172.21.15.33:0/2742670669 conn(0x5653d2a02ac0 msgr2=0x5653d2a03320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.898+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 shutdown_connections 2024-09-11T00:04:23.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.899+0000 7f3f1be06740 1 -- 172.21.15.33:0/2742670669 wait complete. 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.899+0000 7f3f1be06740 1 -- start start 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.899+0000 7f3f1be06740 1 Processor -- start 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 0x5653d2a21340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a20040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 0x5653d2a20580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef400e330 con 0x5653d2a12ab0 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef400f7a0 con 0x5653d2a10180 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef400ea00 con 0x5653d2a154f0 2024-09-11T00:04:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f1be06740 10 client.0 _ll_register_callbacks cb 0x7f3f0c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f11e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 0x5653d2a21340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.900+0000 7f3f12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 0x5653d2a20580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 0x5653d2a20580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:43858/0 (socket says 172.21.15.33:43858) 2024-09-11T00:04:23.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f12800640 1 -- 172.21.15.33:0/933999004 learned_addr learned my addr 172.21.15.33:0/933999004 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11e00640 1 -- 172.21.15.33:0/933999004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 msgr2=0x5653d2a20580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11e00640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 0x5653d2a20580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11e00640 1 -- 172.21.15.33:0/933999004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 msgr2=0x5653d2a20040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11400640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a20040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11e00640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a20040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11e00640 1 -- 172.21.15.33:0/933999004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d2a20d10 con 0x5653d2a10180 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.901+0000 7f3f11400640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a20040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.902+0000 7f3f11e00640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 0x5653d2a21340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f04003a30 tx=0x7f3f0400be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433c21c9b4ad2c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.902+0000 7f3ef3e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.902+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04022430 con 0x5653d2a10180 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.902+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3f0402f040 con 0x5653d2a10180 2024-09-11T00:04:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.903+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0401b040 con 0x5653d2a10180 2024-09-11T00:04:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.903+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f040225d0 con 0x5653d2a10180 2024-09-11T00:04:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.904+0000 7f3f1be06740 10 client.36143 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.904+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653d2a91c00 con 0x5653d2a10180 2024-09-11T00:04:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.904+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0401b040 con 0x5653d2a10180 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.905+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3f04033780 con 0x5653d2a10180 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 10 client.36143 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 10 client.36143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 20 client.36143 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a92560 0x5653d2a94980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 4 client.36143 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:04:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653d29780b0 con 0x5653d2a92560 2024-09-11T00:04:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.906+0000 7f3f11400640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a92560 0x5653d2a94980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.907+0000 7f3ef3e00640 10 client.36143 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.907+0000 7f3f11400640 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a92560 0x5653d2a94980 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5154997bcd2d4e0 server_cookie=67db74ac5225707e in_seq=0 out_seq=0 2024-09-11T00:04:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3ef3e00640 1 -- 172.21.15.33:0/933999004 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653d29780b0 con 0x5653d2a92560 2024-09-11T00:04:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3ef3e00640 10 client.36143 handle_command_reply: tid=0 2024-09-11T00:04:23.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3f1be06740 1 client.36143 shutdown 2024-09-11T00:04:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 msgr2=0x5653d2a21340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 0x5653d2a21340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f04003a30 tx=0x7f3f0400be50 comp rx=0 tx=0).stop 2024-09-11T00:04:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 shutdown_connections 2024-09-11T00:04:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.922+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653d2a92560 0x5653d2a94980 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653d2a154f0 0x5653d2a20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3ef3e00640 0 client.36143 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653d2a12ab0 0x5653d2a20040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 --2- 172.21.15.33:0/933999004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653d2a10180 0x5653d2a21340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 >> 172.21.15.33:0/933999004 conn(0x5653d2a02ac0 msgr2=0x5653d2a03320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 shutdown_connections 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 1 -- 172.21.15.33:0/933999004 wait complete. 2024-09-11T00:04:23.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.923+0000 7f3f1be06740 20 client.36143 trim_cache size 0 max 16384 2024-09-11T00:04:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:04:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:04:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:04:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 msgr2=0x7f3ef80b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 0x7f3ef80b78c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3f04005fd0 tx=0x7f3f0400bbb0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 msgr2=0x7f3f1419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 0x7f3f1419b280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9f0 tx=0x7f3f0000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 shutdown_connections 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3ef80b5400 0x7f3ef80b78c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f141064c0 0x7f3f1419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14105b00 0x7f3f1419b280 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 --2- 172.21.15.33:0/3591714292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f141049b0 0x7f3f1419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.925+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 >> 172.21.15.33:0/3591714292 conn(0x7f3f14100270 msgr2=0x7f3f14108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.926+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 shutdown_connections 2024-09-11T00:04:23.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:23.926+0000 7f3f13200640 1 -- 172.21.15.33:0/3591714292 wait complete. 2024-09-11T00:04:24.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:24 smithi052 ceph-mon[33526]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 213 KiB/s wr, 35 op/s 2024-09-11T00:04:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:24 smithi033 ceph-mon[30593]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 213 KiB/s wr, 35 op/s 2024-09-11T00:04:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:24 smithi189 ceph-mon[34000]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 213 KiB/s wr, 35 op/s 2024-09-11T00:04:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:26 smithi052 ceph-mon[33526]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 450 KiB/s wr, 54 op/s 2024-09-11T00:04:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:26 smithi033 ceph-mon[30593]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 450 KiB/s wr, 54 op/s 2024-09-11T00:04:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:26 smithi189 ceph-mon[34000]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 450 KiB/s wr, 54 op/s 2024-09-11T00:04:28.326 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 280.0 s, 643.4 tps, lat 154.766 ms stddev 176.243 2024-09-11T00:04:28.370 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:28 smithi033 ceph-mon[30593]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-09-11T00:04:28.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:28 smithi052 ceph-mon[33526]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-09-11T00:04:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:28 smithi189 ceph-mon[34000]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 207 op/s 2024-09-11T00:04:30.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:30 smithi052 ceph-mon[33526]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-11T00:04:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:30 smithi033 ceph-mon[30593]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-11T00:04:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:30 smithi189 ceph-mon[34000]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-11T00:04:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:32 smithi052 ceph-mon[33526]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 373 op/s 2024-09-11T00:04:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:32 smithi033 ceph-mon[30593]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 373 op/s 2024-09-11T00:04:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:32 smithi189 ceph-mon[34000]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.5 MiB/s wr, 373 op/s 2024-09-11T00:04:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 285.0 s, 581.0 tps, lat 172.917 ms stddev 58.533 2024-09-11T00:04:34.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:34 smithi052 ceph-mon[33526]: pgmap v670: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.1 MiB/s wr, 537 op/s 2024-09-11T00:04:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:34 smithi033 ceph-mon[30593]: pgmap v670: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.1 MiB/s wr, 537 op/s 2024-09-11T00:04:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:34 smithi189 ceph-mon[34000]: pgmap v670: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.1 MiB/s wr, 537 op/s 2024-09-11T00:04:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:36 smithi052 ceph-mon[33526]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.0 MiB/s wr, 605 op/s 2024-09-11T00:04:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:36 smithi033 ceph-mon[30593]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.0 MiB/s wr, 605 op/s 2024-09-11T00:04:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:36 smithi189 ceph-mon[34000]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 8.0 MiB/s wr, 605 op/s 2024-09-11T00:04:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.133+0000 7ff0d9c00640 1 -- 172.21.15.33:0/372925555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d4100ba0 msgr2=0x7ff0d4100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.133+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/372925555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4100fa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005fd0 tx=0x7ff0c402a2e0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 -- 172.21.15.33:0/372925555 shutdown_connections 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/372925555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d41026b0 0x7ff0d4109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/372925555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/372925555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4100fa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 -- 172.21.15.33:0/372925555 >> 172.21.15.33:0/372925555 conn(0x7ff0d40fc440 msgr2=0x7ff0d40fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 -- 172.21.15.33:0/372925555 shutdown_connections 2024-09-11T00:04:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.134+0000 7ff0d9c00640 1 -- 172.21.15.33:0/372925555 wait complete. 2024-09-11T00:04:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.136+0000 7ff0d9c00640 1 Processor -- start 2024-09-11T00:04:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.136+0000 7ff0d9c00640 1 -- start start 2024-09-11T00:04:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 0x7ff0d4072f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35896/0 (socket says 172.21.15.33:35896) 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0ca000640 1 -- 172.21.15.33:0/2046390025 learned_addr learned my addr 172.21.15.33:0/2046390025 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d410c240 con 0x7ff0d4100ba0 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d410c0c0 con 0x7ff0d41026b0 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d410c3c0 con 0x7ff0d4101cf0 2024-09-11T00:04:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.137+0000 7ff0d3400640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 0x7ff0d4072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d3400640 1 -- 172.21.15.33:0/2046390025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 msgr2=0x7ff0d4072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d3400640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d3400640 1 -- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 msgr2=0x7ff0d4071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d3400640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d3400640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40737d0 con 0x7ff0d41026b0 2024-09-11T00:04:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0ca000640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.138+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.139+0000 7ff0d3400640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 0x7ff0d4072f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc012c10 tx=0x7ff0cc010490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.139+0000 7ff0cbe00640 1 -- 172.21.15.33:0/2046390025 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc010b20 con 0x7ff0d41026b0 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.139+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d4073a60 con 0x7ff0d41026b0 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.140+0000 7ff0cbe00640 1 -- 172.21.15.33:0/2046390025 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0cc010cc0 con 0x7ff0d41026b0 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.140+0000 7ff0cbe00640 1 -- 172.21.15.33:0/2046390025 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc010b20 con 0x7ff0d41026b0 2024-09-11T00:04:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.140+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d4074160 con 0x7ff0d41026b0 2024-09-11T00:04:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.144+0000 7ff0dca3b740 1 Processor -- start 2024-09-11T00:04:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.145+0000 7ff0dca3b740 1 -- start start 2024-09-11T00:04:37.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0cbe00640 1 -- 172.21.15.33:0/2046390025 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff0cc00d0d0 con 0x7ff0d41026b0 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb62390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb628d0 0x56492cb64cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56492caca6b0 con 0x56492cb5ffa0 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56492cab9ae0 con 0x56492cb628d0 2024-09-11T00:04:37.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.146+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56492cabd8f0 con 0x56492cb65310 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.147+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.147+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb62390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.147+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb62390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38936/0 (socket says 172.21.15.33:38936) 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.147+0000 7ff0ca000640 1 -- 172.21.15.33:0/678507606 learned_addr learned my addr 172.21.15.33:0/678507606 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.147+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb628d0 0x56492cb64cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 -- 172.21.15.33:0/678507606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb628d0 msgr2=0x56492cb64cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb628d0 0x56492cb64cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 -- 172.21.15.33:0/678507606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 msgr2=0x56492cb62390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb62390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 -- 172.21.15.33:0/678507606 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492ca86780 con 0x56492cb65310 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.148+0000 7ff0ca000640 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb677d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00b610 tx=0x7ff0bc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dafa0435bc704ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.149+0000 7ff0c3e00640 1 -- 172.21.15.33:0/678507606 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc01b9e0 con 0x56492cb65310 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.149+0000 7ff0c3e00640 1 -- 172.21.15.33:0/678507606 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0bc00a8f0 con 0x56492cb65310 2024-09-11T00:04:37.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.149+0000 7ff0c3e00640 1 -- 172.21.15.33:0/678507606 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc004a90 con 0x56492cb65310 2024-09-11T00:04:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.150+0000 7ff0dca3b740 1 -- 172.21.15.33:0/678507606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 msgr2=0x56492cb677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.150+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb677d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00b610 tx=0x7ff0bc005f90 comp rx=0 tx=0).stop 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0dca3b740 1 -- 172.21.15.33:0/678507606 shutdown_connections 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb677d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb628d0 0x56492cb64cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/678507606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb62390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0dca3b740 1 -- 172.21.15.33:0/678507606 >> 172.21.15.33:0/678507606 conn(0x56492cb5b0f0 msgr2=0x56492cb5be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.151+0000 7ff0cbe00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 0x7ff0b80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.152+0000 7ff0cbe00640 1 -- 172.21.15.33:0/2046390025 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0cc0e4f20 con 0x7ff0d41026b0 2024-09-11T00:04:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.152+0000 7ff0dca3b740 1 -- 172.21.15.33:0/678507606 shutdown_connections 2024-09-11T00:04:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.152+0000 7ff0ca000640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 0x7ff0b80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.152+0000 7ff0dca3b740 1 -- 172.21.15.33:0/678507606 wait complete. 2024-09-11T00:04:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.153+0000 7ff0dca3b740 1 -- start start 2024-09-11T00:04:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.154+0000 7ff0dca3b740 1 Processor -- start 2024-09-11T00:04:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.154+0000 7ff0ca000640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 0x7ff0b80b7aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc001eb0 tx=0x7ff0bc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.154+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb628d0 0x56492cb69db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb6a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56492c9f1ab0 con 0x56492cb5ffa0 2024-09-11T00:04:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56492ca60570 con 0x56492cb65310 2024-09-11T00:04:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56492cb68290 con 0x56492cb628d0 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0dca3b740 10 client.0 _ll_register_callbacks cb 0x56492ca6f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38940/0 (socket says 172.21.15.33:38940) 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0d2a00640 1 -- 172.21.15.33:0/4196555445 learned_addr learned my addr 172.21.15.33:0/4196555445 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.155+0000 7ff0ca000640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb628d0 0x56492cb69db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.156+0000 7ff0d3400640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb6a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.156+0000 7ff0d2a00640 1 -- 172.21.15.33:0/4196555445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb628d0 msgr2=0x56492cb69db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.157+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb628d0 0x56492cb69db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.157+0000 7ff0d2a00640 1 -- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 msgr2=0x56492cb6a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.157+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb6a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.157+0000 7ff0d2a00640 1 -- 172.21.15.33:0/4196555445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492c81b790 con 0x56492cb5ffa0 2024-09-11T00:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.157+0000 7ff0d3400640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb6a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.158+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d090 tx=0x7ff0c40075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7678b0a601707cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.158+0000 7ff0c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.158+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4042070 con 0x56492cb5ffa0 2024-09-11T00:04:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.159+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0c4032790 con 0x56492cb5ffa0 2024-09-11T00:04:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.159+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc00a8f0 con 0x56492cb5ffa0 2024-09-11T00:04:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.160+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0c404c050 con 0x56492cb5ffa0 2024-09-11T00:04:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.160+0000 7ff0dca3b740 10 client.16362 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.161+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56492c894620 con 0x56492cb5ffa0 2024-09-11T00:04:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.161+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0bc00a8f0 con 0x56492cb5ffa0 2024-09-11T00:04:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff0c400a570 con 0x56492cb5ffa0 2024-09-11T00:04:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 10 client.16362 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 20 client.16362 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cb754b0 0x56492cb77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 4 client.16362 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.162+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56492cacc600 con 0x56492cb754b0 2024-09-11T00:04:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.163+0000 7ff0ca000640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cb754b0 0x56492cb77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.165+0000 7ff0ca000640 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cb754b0 0x56492cb77950 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b841f70004793031 server_cookie=4956b01c8f2f949 in_seq=0 out_seq=0 2024-09-11T00:04:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.165+0000 7ff0c0c00640 10 client.16362 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.166+0000 7ff0c0c00640 1 -- 172.21.15.33:0/4196555445 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56492cacc600 con 0x56492cb754b0 2024-09-11T00:04:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.166+0000 7ff0c0c00640 10 client.16362 handle_command_reply: tid=0 2024-09-11T00:04:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.166+0000 7ff0dca3b740 1 client.16362 shutdown 2024-09-11T00:04:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 msgr2=0x56492cb69710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400d090 tx=0x7ff0c40075a0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 shutdown_connections 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb6a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cb754b0 0x56492cb77950 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb628d0 0x56492cb69db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/4196555445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb5ffa0 0x56492cb69710 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 >> 172.21.15.33:0/4196555445 conn(0x56492cb5b0f0 msgr2=0x56492cb51a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.167+0000 7ff0c0c00640 0 client.16362 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.168+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 shutdown_connections 2024-09-11T00:04:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.168+0000 7ff0dca3b740 1 -- 172.21.15.33:0/4196555445 wait complete. 2024-09-11T00:04:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.168+0000 7ff0dca3b740 20 client.16362 trim_cache size 0 max 16384 2024-09-11T00:04:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.204+0000 7ff0dca3b740 1 Processor -- start 2024-09-11T00:04:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.204+0000 7ff0dca3b740 1 -- start start 2024-09-11T00:04:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb68e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0012480 con 0x56492cb628d0 2024-09-11T00:04:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b000fd50 con 0x56492cb65310 2024-09-11T00:04:37.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.205+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b000dba0 con 0x56492cb5ffa0 2024-09-11T00:04:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35928/0 (socket says 172.21.15.33:35928) 2024-09-11T00:04:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 -- 172.21.15.33:0/1706103205 learned_addr learned my addr 172.21.15.33:0/1706103205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 -- 172.21.15.33:0/1706103205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 msgr2=0x56492cb68e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb68e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.207+0000 7ff0d2a00640 1 -- 172.21.15.33:0/1706103205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 msgr2=0x56492cb688d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.208+0000 7ff0ca000640 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.208+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.208+0000 7ff0d2a00640 1 -- 172.21.15.33:0/1706103205 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492cb6acf0 con 0x56492cb5ffa0 2024-09-11T00:04:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.209+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0c402a800 tx=0x7ff0c40021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca93a2561ada6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.209+0000 7ff0c3400640 1 -- 172.21.15.33:0/1706103205 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4055020 con 0x56492cb5ffa0 2024-09-11T00:04:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.209+0000 7ff0c3400640 1 -- 172.21.15.33:0/1706103205 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c4004850 con 0x56492cb5ffa0 2024-09-11T00:04:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.209+0000 7ff0c3400640 1 -- 172.21.15.33:0/1706103205 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4042040 con 0x56492cb5ffa0 2024-09-11T00:04:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.210+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1706103205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 msgr2=0x56492cb69480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.210+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0c402a800 tx=0x7ff0c40021d0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.211+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1706103205 shutdown_connections 2024-09-11T00:04:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.211+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb65310 0x56492cb68e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.211+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.211+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1706103205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb5ffa0 0x56492cb69480 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.211+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1706103205 >> 172.21.15.33:0/1706103205 conn(0x56492cb5b0f0 msgr2=0x56492cb5f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.212+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1706103205 shutdown_connections 2024-09-11T00:04:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.212+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1706103205 wait complete. 2024-09-11T00:04:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.213+0000 7ff0dca3b740 1 -- start start 2024-09-11T00:04:37.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.213+0000 7ff0dca3b740 1 Processor -- start 2024-09-11T00:04:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 0x56492cb713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b000e210 con 0x56492cb628d0 2024-09-11T00:04:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b000f680 con 0x56492cb5ffa0 2024-09-11T00:04:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b000e8e0 con 0x56492cb65310 2024-09-11T00:04:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0dca3b740 10 client.0 _ll_register_callbacks cb 0x7ff0cc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:37.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.214+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 0x56492cb713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 0x56492cb713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:60704/0 (socket says 172.21.15.33:60704) 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d2a00640 1 -- 172.21.15.33:0/1737650342 learned_addr learned my addr 172.21.15.33:0/1737650342 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 -- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 msgr2=0x56492cb713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 0x56492cb713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 -- 172.21.15.33:0/1737650342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 msgr2=0x56492cb700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 -- 172.21.15.33:0/1737650342 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492cb6ecc0 con 0x56492cb65310 2024-09-11T00:04:37.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.215+0000 7ff0d3400640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb707a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0e2620 tx=0x7ff0cc0af190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a1c4d990808c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:37.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0afe80 con 0x56492cb65310 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff0cc0aebf0 con 0x56492cb65310 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0c4004850 con 0x56492cb65310 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0cc0af780 con 0x56492cb65310 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0dca3b740 10 client.26101 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:37.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.216+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56492cbe2680 con 0x56492cb65310 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c4004850 con 0x56492cb65310 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff0cc0ab0d0 con 0x56492cb65310 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 10 client.26101 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 20 client.26101 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cbe3080 0x56492cbe54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 4 client.26101 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.217+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56492cb69b60 con 0x56492cbe3080 2024-09-11T00:04:37.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.218+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cbe3080 0x56492cbe54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.219+0000 7ff0d2a00640 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cbe3080 0x56492cbe54a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c50f579e5048884b server_cookie=a931ed9cf508c120 in_seq=0 out_seq=0 2024-09-11T00:04:37.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.219+0000 7ff0c0c00640 10 client.26101 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.285+0000 7ff0c0c00640 1 -- 172.21.15.33:0/1737650342 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56492cb69b60 con 0x56492cbe3080 2024-09-11T00:04:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.285+0000 7ff0c0c00640 10 client.26101 handle_command_reply: tid=0 2024-09-11T00:04:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.285+0000 7ff0dca3b740 1 client.26101 shutdown 2024-09-11T00:04:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.286+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 msgr2=0x56492cb707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.287+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb707a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0e2620 tx=0x7ff0cc0af190 comp rx=0 tx=0).stop 2024-09-11T00:04:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.287+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 shutdown_connections 2024-09-11T00:04:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.287+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56492cbe3080 0x56492cbe54a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.288+0000 7ff0c0c00640 0 client.26101 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.289+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56492cb65310 0x56492cb707a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.289+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56492cb628d0 0x56492cb700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.289+0000 7ff0dca3b740 1 --2- 172.21.15.33:0/1737650342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56492cb5ffa0 0x56492cb713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.289+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 >> 172.21.15.33:0/1737650342 conn(0x56492cb5b0f0 msgr2=0x56492cb5bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.290+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 shutdown_connections 2024-09-11T00:04:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.291+0000 7ff0dca3b740 1 -- 172.21.15.33:0/1737650342 wait complete. 2024-09-11T00:04:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.291+0000 7ff0dca3b740 20 client.26101 trim_cache size 0 max 16384 2024-09-11T00:04:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:04:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:04:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:04:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:04:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 msgr2=0x7ff0b80b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 0x7ff0b80b7aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc001eb0 tx=0x7ff0bc00d040 comp rx=0 tx=0).stop 2024-09-11T00:04:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 msgr2=0x7ff0d4072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 0x7ff0d4072f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc012c10 tx=0x7ff0cc010490 comp rx=0 tx=0).stop 2024-09-11T00:04:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 shutdown_connections 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0b80b55e0 0x7ff0b80b7aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0d41026b0 0x7ff0d4072f10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0d4101cf0 0x7ff0d4072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 --2- 172.21.15.33:0/2046390025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0d4100ba0 0x7ff0d4071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.293+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 >> 172.21.15.33:0/2046390025 conn(0x7ff0d40fc440 msgr2=0x7ff0d4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.294+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 shutdown_connections 2024-09-11T00:04:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:37.294+0000 7ff0d9c00640 1 -- 172.21.15.33:0/2046390025 wait complete. 2024-09-11T00:04:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 290.0 s, 663.8 tps, lat 150.136 ms stddev 41.480 2024-09-11T00:04:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:38 smithi052 ceph-mon[33526]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-09-11T00:04:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:38 smithi033 ceph-mon[30593]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-09-11T00:04:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:38 smithi189 ceph-mon[34000]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.4 MiB/s wr, 733 op/s 2024-09-11T00:04:40.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:40 smithi052 ceph-mon[33526]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 658 op/s 2024-09-11T00:04:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:40 smithi033 ceph-mon[30593]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 658 op/s 2024-09-11T00:04:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:40 smithi189 ceph-mon[34000]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 658 op/s 2024-09-11T00:04:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:42 smithi052 ceph-mon[33526]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-09-11T00:04:42.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:42 smithi033 ceph-mon[30593]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-09-11T00:04:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:42 smithi189 ceph-mon[34000]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.2 MiB/s wr, 671 op/s 2024-09-11T00:04:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 295.0 s, 669.6 tps, lat 148.948 ms stddev 40.723 2024-09-11T00:04:44.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:44 smithi052 ceph-mon[33526]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-11T00:04:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:44 smithi033 ceph-mon[30593]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-11T00:04:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:44 smithi189 ceph-mon[34000]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 8.1 MiB/s wr, 786 op/s 2024-09-11T00:04:46.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:46 smithi052 ceph-mon[33526]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-11T00:04:46.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:46 smithi033 ceph-mon[30593]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-11T00:04:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:46 smithi189 ceph-mon[34000]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 684 op/s 2024-09-11T00:04:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 300.0 s, 653.4 tps, lat 153.117 ms stddev 42.750 2024-09-11T00:04:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:48 smithi052 ceph-mon[33526]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-11T00:04:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:48 smithi033 ceph-mon[30593]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-11T00:04:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:48 smithi189 ceph-mon[34000]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 771 op/s 2024-09-11T00:04:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.506+0000 7ff094000640 1 -- 172.21.15.33:0/2256362630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c105cd0 msgr2=0x7ff08c106150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.506+0000 7ff094000640 1 --2- 172.21.15.33:0/2256362630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c105cd0 0x7ff08c106150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff078009930 tx=0x7ff07802a440 comp rx=0 tx=0).stop 2024-09-11T00:04:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.506+0000 7ff094000640 1 -- 172.21.15.33:0/2256362630 shutdown_connections 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.506+0000 7ff094000640 1 --2- 172.21.15.33:0/2256362630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c10d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.507+0000 7ff094000640 1 --2- 172.21.15.33:0/2256362630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c105cd0 0x7ff08c106150 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff078009930 tx=0x7ff07802a440 comp rx=0 tx=0).stop 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.507+0000 7ff094000640 1 --2- 172.21.15.33:0/2256362630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c104b80 0x7ff08c104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.507+0000 7ff094000640 1 -- 172.21.15.33:0/2256362630 >> 172.21.15.33:0/2256362630 conn(0x7ff08c100440 msgr2=0x7ff08c102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.507+0000 7ff094000640 1 -- 172.21.15.33:0/2256362630 shutdown_connections 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.508+0000 7ff094000640 1 -- 172.21.15.33:0/2256362630 wait complete. 2024-09-11T00:04:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.508+0000 7ff094000640 1 Processor -- start 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.509+0000 7ff094000640 1 -- start start 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.509+0000 7ff094000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 0x7ff08c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.509+0000 7ff094000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff094000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c1a06b0 0x7ff08c1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff094000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0780f0 con 0x7ff08c106690 2024-09-11T00:04:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff094000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c077f70 con 0x7ff08c1a06b0 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff094000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c078270 con 0x7ff08c104b80 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff090c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff091600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 0x7ff08c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff090c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37884/0 (socket says 172.21.15.33:37884) 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff090c00640 1 -- 172.21.15.33:0/1542589053 learned_addr learned my addr 172.21.15.33:0/1542589053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.510+0000 7ff092000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c1a06b0 0x7ff08c1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 -- 172.21.15.33:0/1542589053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 msgr2=0x7ff08c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 0x7ff08c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 -- 172.21.15.33:0/1542589053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c1a06b0 msgr2=0x7ff08c1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c1a06b0 0x7ff08c1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 -- 172.21.15.33:0/1542589053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c1a1360 con 0x7ff08c106690 2024-09-11T00:04:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff091600640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 0x7ff08c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.511+0000 7ff090c00640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff078009230 tx=0x7ff078003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.513+0000 7ff08a000640 1 -- 172.21.15.33:0/1542589053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07803f020 con 0x7ff08c106690 2024-09-11T00:04:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.513+0000 7ff08a000640 1 -- 172.21.15.33:0/1542589053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff078031da0 con 0x7ff08c106690 2024-09-11T00:04:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.513+0000 7ff08a000640 1 -- 172.21.15.33:0/1542589053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078035070 con 0x7ff08c106690 2024-09-11T00:04:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.513+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c1a7750 con 0x7ff08c106690 2024-09-11T00:04:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.514+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c1a7b00 con 0x7ff08c106690 2024-09-11T00:04:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.520+0000 7ff096eaf740 1 Processor -- start 2024-09-11T00:04:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 -- start start 2024-09-11T00:04:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564537511790 0x564537513b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564537516b00 0x564537518fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5645374846b0 con 0x5645375140c0 2024-09-11T00:04:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564537473ae0 con 0x564537511790 2024-09-11T00:04:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.521+0000 7ff096eaf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5645374778f0 con 0x564537516b00 2024-09-11T00:04:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.522+0000 7ff091600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.523+0000 7ff091600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37894/0 (socket says 172.21.15.33:37894) 2024-09-11T00:04:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.523+0000 7ff091600640 1 -- 172.21.15.33:0/2909973823 learned_addr learned my addr 172.21.15.33:0/2909973823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff092000640 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564537511790 0x564537513b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff091600640 1 -- 172.21.15.33:0/2909973823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564537516b00 msgr2=0x564537518fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:04:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff091600640 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564537516b00 0x564537518fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff091600640 1 -- 172.21.15.33:0/2909973823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564537511790 msgr2=0x564537513b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff091600640 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564537511790 0x564537513b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.524+0000 7ff091600640 1 -- 172.21.15.33:0/2909973823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564537440780 con 0x5645375140c0 2024-09-11T00:04:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.526+0000 7ff091600640 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff080008c60 tx=0x7ff08000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec678e1353e2d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.528+0000 7ff07e600640 1 -- 172.21.15.33:0/2909973823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080014070 con 0x5645375140c0 2024-09-11T00:04:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.528+0000 7ff07e600640 1 -- 172.21.15.33:0/2909973823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0800047a0 con 0x5645375140c0 2024-09-11T00:04:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.528+0000 7ff07e600640 1 -- 172.21.15.33:0/2909973823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080010690 con 0x5645375140c0 2024-09-11T00:04:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.531+0000 7ff096eaf740 1 -- 172.21.15.33:0/2909973823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 msgr2=0x5645375164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.531+0000 7ff096eaf740 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff080008c60 tx=0x7ff08000e720 comp rx=0 tx=0).stop 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.531+0000 7ff08a000640 1 -- 172.21.15.33:0/1542589053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff07803b610 con 0x7ff08c106690 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 -- 172.21.15.33:0/2909973823 shutdown_connections 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564537516b00 0x564537518fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645375140c0 0x5645375164b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 --2- 172.21.15.33:0/2909973823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564537511790 0x564537513b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 -- 172.21.15.33:0/2909973823 >> 172.21.15.33:0/2909973823 conn(0x56453750c8e0 msgr2=0x56453750d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 -- 172.21.15.33:0/2909973823 shutdown_connections 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.532+0000 7ff096eaf740 1 -- 172.21.15.33:0/2909973823 wait complete. 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.533+0000 7ff096eaf740 1 -- start start 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.534+0000 7ff096eaf740 1 Processor -- start 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.535+0000 7ff08a000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 0x7ff0740b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff08a000640 1 -- 172.21.15.33:0/1542589053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff078106c20 con 0x7ff08c106690 2024-09-11T00:04:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 0x56453751b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56453751c320 0x56453751c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5645373abab0 con 0x564537511790 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56453741a570 con 0x56453751c320 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.536+0000 7ff096eaf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564537519ae0 con 0x5645375140c0 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.537+0000 7ff096eaf740 10 client.0 _ll_register_callbacks cb 0x564537429100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.537+0000 7ff092000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 0x7ff0740b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.538+0000 7ff090c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.538+0000 7ff090c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47654/0 (socket says 172.21.15.33:47654) 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.538+0000 7ff090c00640 1 -- 172.21.15.33:0/3807376327 learned_addr learned my addr 172.21.15.33:0/3807376327 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:50.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.538+0000 7ff091600640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 0x56453751b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff092000640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56453751c320 0x56453751c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff091600640 1 -- 172.21.15.33:0/3807376327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 msgr2=0x56453751b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff091600640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff091600640 1 -- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56453751c320 msgr2=0x56453751c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff091600640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56453751c320 0x56453751c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.539+0000 7ff091600640 1 -- 172.21.15.33:0/3807376327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645371d5790 con 0x564537511790 2024-09-11T00:04:50.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.540+0000 7ff092000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 0x7ff0740b7800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff084007e20 tx=0x7ff084007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.541+0000 7ff091600640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 0x56453751b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff080005e10 tx=0x7ff080005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3639afc5321e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.541+0000 7ff072a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:50.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.542+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080014070 con 0x564537511790 2024-09-11T00:04:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.542+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0800047a0 con 0x564537511790 2024-09-11T00:04:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.542+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff080004230 con 0x564537511790 2024-09-11T00:04:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.543+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff080008870 con 0x564537511790 2024-09-11T00:04:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.543+0000 7ff096eaf740 10 client.16371 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:50.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.543+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56453724e620 con 0x564537511790 2024-09-11T00:04:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0800047a0 con 0x564537511790 2024-09-11T00:04:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff080010430 con 0x564537511790 2024-09-11T00:04:50.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 10 client.16371 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 20 client.16371 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5645375269f0 0x564537528de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 4 client.16371 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:04:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.544+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564537486600 con 0x5645375269f0 2024-09-11T00:04:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.545+0000 7ff090c00640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5645375269f0 0x564537528de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.547+0000 7ff090c00640 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5645375269f0 0x564537528de0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796d12d0ea2a2836 server_cookie=b4e9d588f3df9b5d in_seq=0 out_seq=0 2024-09-11T00:04:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.547+0000 7ff072a00640 10 client.16371 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.548+0000 7ff072a00640 1 -- 172.21.15.33:0/3807376327 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564537486600 con 0x5645375269f0 2024-09-11T00:04:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.548+0000 7ff072a00640 10 client.16371 handle_command_reply: tid=0 2024-09-11T00:04:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.548+0000 7ff096eaf740 1 client.16371 shutdown 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.548+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 msgr2=0x56453751b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.548+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 0x56453751b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff080005e10 tx=0x7ff080005230 comp rx=0 tx=0).stop 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 shutdown_connections 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56453751c320 0x56453751c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5645375269f0 0x564537528de0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 --2- 172.21.15.33:0/3807376327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564537511790 0x56453751b0d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 >> 172.21.15.33:0/3807376327 conn(0x56453750c8e0 msgr2=0x56453750ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.549+0000 7ff072a00640 0 client.16371 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.550+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 shutdown_connections 2024-09-11T00:04:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.550+0000 7ff096eaf740 1 -- 172.21.15.33:0/3807376327 wait complete. 2024-09-11T00:04:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.550+0000 7ff096eaf740 20 client.16371 trim_cache size 0 max 16384 2024-09-11T00:04:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.585+0000 7ff096eaf740 1 Processor -- start 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.585+0000 7ff096eaf740 1 -- start start 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537516f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 0x56453750d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b49a0 con 0x56453751c320 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b2270 con 0x5645375174b0 2024-09-11T00:04:50.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.586+0000 7ff096eaf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b00c0 con 0x5645375140c0 2024-09-11T00:04:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff091600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff091600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47666/0 (socket says 172.21.15.33:47666) 2024-09-11T00:04:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff091600640 1 -- 172.21.15.33:0/506236219 learned_addr learned my addr 172.21.15.33:0/506236219 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff092000640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 0x56453750d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff090c00640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537516f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.587+0000 7ff091600640 1 -- 172.21.15.33:0/506236219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 msgr2=0x56453750d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.588+0000 7ff091600640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 0x56453750d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.588+0000 7ff091600640 1 -- 172.21.15.33:0/506236219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 msgr2=0x564537516f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.588+0000 7ff091600640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537516f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.588+0000 7ff091600640 1 -- 172.21.15.33:0/506236219 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564537508270 con 0x5645375140c0 2024-09-11T00:04:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.589+0000 7ff092000640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 0x56453750d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.589+0000 7ff090c00640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537516f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:04:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.589+0000 7ff091600640 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff080010880 tx=0x7ff080005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be75e760e37e5598 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.590+0000 7ff07dc00640 1 -- 172.21.15.33:0/506236219 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800055b0 con 0x5645375140c0 2024-09-11T00:04:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.591+0000 7ff07dc00640 1 -- 172.21.15.33:0/506236219 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff080010430 con 0x5645375140c0 2024-09-11T00:04:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.591+0000 7ff07dc00640 1 -- 172.21.15.33:0/506236219 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080004720 con 0x5645375140c0 2024-09-11T00:04:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 -- 172.21.15.33:0/506236219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 msgr2=0x56453751ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff080010880 tx=0x7ff080005f60 comp rx=0 tx=0).stop 2024-09-11T00:04:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 -- 172.21.15.33:0/506236219 shutdown_connections 2024-09-11T00:04:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375174b0 0x56453750d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537516f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.592+0000 7ff096eaf740 1 --2- 172.21.15.33:0/506236219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375140c0 0x56453751ae40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.593+0000 7ff096eaf740 1 -- 172.21.15.33:0/506236219 >> 172.21.15.33:0/506236219 conn(0x56453750c8e0 msgr2=0x564537510e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.593+0000 7ff096eaf740 1 -- 172.21.15.33:0/506236219 shutdown_connections 2024-09-11T00:04:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.594+0000 7ff096eaf740 1 -- 172.21.15.33:0/506236219 wait complete. 2024-09-11T00:04:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.594+0000 7ff096eaf740 1 -- start start 2024-09-11T00:04:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.594+0000 7ff096eaf740 1 Processor -- start 2024-09-11T00:04:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.595+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 0x564537521fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.595+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 0x5645375224e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff096eaf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff091600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 0x564537521fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff091600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 0x564537521fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49110/0 (socket says 172.21.15.33:49110) 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff090c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 0x5645375224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff090c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 0x5645375224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47680/0 (socket says 172.21.15.33:47680) 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff092000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff096eaf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b0730 con 0x56453751c320 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff096eaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b1ba0 con 0x5645375140c0 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff096eaf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1b0e00 con 0x5645375174b0 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff092000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37912/0 (socket says 172.21.15.33:37912) 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.596+0000 7ff091600640 1 -- 172.21.15.33:0/1737480526 learned_addr learned my addr 172.21.15.33:0/1737480526 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:04:50.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.597+0000 7ff096eaf740 10 client.0 _ll_register_callbacks cb 0x7ff080008ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.597+0000 7ff092000640 1 -- 172.21.15.33:0/1737480526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 msgr2=0x5645375224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.597+0000 7ff092000640 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 0x5645375224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.597+0000 7ff092000640 1 -- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 msgr2=0x564537521fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.597+0000 7ff092000640 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 0x564537521fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.598+0000 7ff092000640 1 -- 172.21.15.33:0/1737480526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564537520c30 con 0x56453751c320 2024-09-11T00:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.598+0000 7ff092000640 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff08401ee40 tx=0x7ff084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a05cb067cce681 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.598+0000 7ff072a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.599+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08401e260 con 0x56453751c320 2024-09-11T00:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.599+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff08401d430 con 0x56453751c320 2024-09-11T00:04:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.599+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff080010430 con 0x56453751c320 2024-09-11T00:04:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.600+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff08401d670 con 0x56453751c320 2024-09-11T00:04:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.600+0000 7ff096eaf740 10 client.16377 fetch_fsmap learned FSMap version 30 2024-09-11T00:04:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.600+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564537593dd0 con 0x56453751c320 2024-09-11T00:04:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff080010430 con 0x56453751c320 2024-09-11T00:04:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff0840327f0 con 0x56453751c320 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 10 client.16377 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 20 client.16377 populate_metadata read hostname 'smithi033' 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564537594790 0x564537596bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 4 client.16377 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.601+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5645374820b0 con 0x564537594790 2024-09-11T00:04:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.602+0000 7ff091600640 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564537594790 0x564537596bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.603+0000 7ff091600640 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564537594790 0x564537596bb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8285bbe7a9d218d8 server_cookie=bac5bae9abd0926a in_seq=0 out_seq=0 2024-09-11T00:04:50.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:50.603+0000 7ff072a00640 10 client.16377 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:50 smithi052 ceph-mon[33526]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.0 MiB/s wr, 695 op/s 2024-09-11T00:04:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:50 smithi033 ceph-mon[30593]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.0 MiB/s wr, 695 op/s 2024-09-11T00:04:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:50 smithi189 ceph-mon[34000]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.0 MiB/s wr, 695 op/s 2024-09-11T00:04:52.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:52 smithi052 ceph-mon[33526]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-11T00:04:52.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:52 smithi033 ceph-mon[30593]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-11T00:04:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:52 smithi189 ceph-mon[34000]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 742 op/s 2024-09-11T00:04:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 305.0 s, 664.0 tps, lat 150.650 ms stddev 40.109 2024-09-11T00:04:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.267+0000 7ff072a00640 1 -- 172.21.15.33:0/1737480526 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5645374820b0 con 0x564537594790 2024-09-11T00:04:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.267+0000 7ff072a00640 10 client.16377 handle_command_reply: tid=0 2024-09-11T00:04:54.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.268+0000 7ff096eaf740 1 client.16377 shutdown 2024-09-11T00:04:54.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 msgr2=0x564537522a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff08401ee40 tx=0x7ff084004a40 comp rx=0 tx=0).stop 2024-09-11T00:04:54.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 shutdown_connections 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56453751c320 0x564537522a20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564537594790 0x564537596bb0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5645375174b0 0x5645375224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 --2- 172.21.15.33:0/1737480526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645375140c0 0x564537521fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 >> 172.21.15.33:0/1737480526 conn(0x56453750c8e0 msgr2=0x56453750d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.269+0000 7ff072a00640 0 client.16377 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.270+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 shutdown_connections 2024-09-11T00:04:54.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.270+0000 7ff096eaf740 1 -- 172.21.15.33:0/1737480526 wait complete. 2024-09-11T00:04:54.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.270+0000 7ff096eaf740 20 client.16377 trim_cache size 0 max 16384 2024-09-11T00:04:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:04:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:04:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:04:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:04:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 msgr2=0x7ff0740b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 0x7ff0740b7800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff084007e20 tx=0x7ff084007520 comp rx=0 tx=0).stop 2024-09-11T00:04:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 msgr2=0x7ff08c19fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff078009230 tx=0x7ff078003d50 comp rx=0 tx=0).stop 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 shutdown_connections 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff0740b5340 0x7ff0740b7800 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff08c1a06b0 0x7ff08c1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08c106690 0x7ff08c19fa80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 --2- 172.21.15.33:0/1542589053 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08c104b80 0x7ff08c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 >> 172.21.15.33:0/1542589053 conn(0x7ff08c100440 msgr2=0x7ff08c07aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 shutdown_connections 2024-09-11T00:04:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:04:54.273+0000 7ff094000640 1 -- 172.21.15.33:0/1542589053 wait complete. 2024-09-11T00:04:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:54 smithi033 ceph-mon[30593]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 780 op/s 2024-09-11T00:04:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:54 smithi189 ceph-mon[34000]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 780 op/s 2024-09-11T00:04:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:54 smithi052 ceph-mon[33526]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 780 op/s 2024-09-11T00:04:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:56 smithi033 ceph-mon[30593]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-09-11T00:04:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:56 smithi189 ceph-mon[34000]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-09-11T00:04:56.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:56 smithi052 ceph-mon[33526]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 664 op/s 2024-09-11T00:04:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 310.0 s, 680.2 tps, lat 147.136 ms stddev 38.158 2024-09-11T00:04:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:04:58 smithi033 ceph-mon[30593]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-11T00:04:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:04:58 smithi189 ceph-mon[34000]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-11T00:04:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:04:58 smithi052 ceph-mon[33526]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 759 op/s 2024-09-11T00:05:00.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:00 smithi033 ceph-mon[30593]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-11T00:05:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:00 smithi189 ceph-mon[34000]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-11T00:05:00.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:00 smithi052 ceph-mon[33526]: pgmap v683: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-11T00:05:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:02 smithi033 ceph-mon[30593]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-09-11T00:05:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:02 smithi189 ceph-mon[34000]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-09-11T00:05:02.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:02 smithi052 ceph-mon[33526]: pgmap v684: 129 pgs: 129 active+clean; 1.2 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-09-11T00:05:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 315.0 s, 567.8 tps, lat 176.195 ms stddev 120.184 2024-09-11T00:05:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:04 smithi033 ceph-mon[30593]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:05:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:04 smithi189 ceph-mon[34000]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:05:04.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:04 smithi052 ceph-mon[33526]: pgmap v685: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:05:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:06 smithi033 ceph-mon[30593]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-11T00:05:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:06 smithi189 ceph-mon[34000]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-11T00:05:06.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:06 smithi052 ceph-mon[33526]: pgmap v686: 129 pgs: 129 active+clean; 1.2 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2024-09-11T00:05:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.489+0000 7f7f94000640 1 -- 172.21.15.33:0/4005053705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 msgr2=0x7f7f8c1158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.489+0000 7f7f94000640 1 --2- 172.21.15.33:0/4005053705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c1158a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f8402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 -- 172.21.15.33:0/4005053705 shutdown_connections 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 --2- 172.21.15.33:0/4005053705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c1158a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 --2- 172.21.15.33:0/4005053705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c10a150 0x7f7f8c10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 --2- 172.21.15.33:0/4005053705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c0743d0 0x7f7f8c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 -- 172.21.15.33:0/4005053705 >> 172.21.15.33:0/4005053705 conn(0x7f7f8c06fe80 msgr2=0x7f7f8c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 -- 172.21.15.33:0/4005053705 shutdown_connections 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.490+0000 7f7f94000640 1 -- 172.21.15.33:0/4005053705 wait complete. 2024-09-11T00:05:07.493 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.491+0000 7f7f94000640 1 Processor -- start 2024-09-11T00:05:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 -- start start 2024-09-11T00:05:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0743d0 0x7f7f8c11a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c11b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c10e500 con 0x7f7f8c0743d0 2024-09-11T00:05:07.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c10e380 con 0x7f7f8c10a150 2024-09-11T00:05:07.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.492+0000 7f7f94000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c10e680 con 0x7f7f8c10ab10 2024-09-11T00:05:07.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.493+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.493+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59488/0 (socket says 172.21.15.33:59488) 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.493+0000 7f7f90c00640 1 -- 172.21.15.33:0/183075998 learned_addr learned my addr 172.21.15.33:0/183075998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.493+0000 7f7f92000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c11b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 -- 172.21.15.33:0/183075998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 msgr2=0x7f7f8c11b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c11b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 -- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0743d0 msgr2=0x7f7f8c11a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0743d0 0x7f7f8c11a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 -- 172.21.15.33:0/183075998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c11c0d0 con 0x7f7f8c10a150 2024-09-11T00:05:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.494+0000 7f7f90c00640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800d950 tx=0x7f7f7800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.495+0000 7f7f8a000640 1 -- 172.21.15.33:0/183075998 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78017070 con 0x7f7f8c10a150 2024-09-11T00:05:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.495+0000 7f7f8a000640 1 -- 172.21.15.33:0/183075998 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f78009c30 con 0x7f7f8c10a150 2024-09-11T00:05:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.495+0000 7f7f8a000640 1 -- 172.21.15.33:0/183075998 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800f620 con 0x7f7f8c10a150 2024-09-11T00:05:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.495+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c11c3c0 con 0x7f7f8c10a150 2024-09-11T00:05:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.495+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c11ea70 con 0x7f7f8c10a150 2024-09-11T00:05:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.505+0000 7f7f8a000640 1 -- 172.21.15.33:0/183075998 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7f78010460 con 0x7f7f8c10a150 2024-09-11T00:05:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.508+0000 7f7f8a000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 0x7f7f740b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.508+0000 7f7f8a000640 1 -- 172.21.15.33:0/183075998 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f7f780e5c40 con 0x7f7f8c10a150 2024-09-11T00:05:07.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.509+0000 7f7f96dea740 1 Processor -- start 2024-09-11T00:05:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.509+0000 7f7f91600640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 0x7f7f740b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.510+0000 7f7f96dea740 1 -- start start 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ea8e0c96b0 con 0x55ea8e156790 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ea8e0b8ae0 con 0x55ea8e1590c0 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f96dea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea8e0bc8f0 con 0x55ea8e15bb00 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.511+0000 7f7f91600640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 0x7f7f740b78a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009710 tx=0x7f7f80006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.512+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.512+0000 7f7f92000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.512+0000 7f7f92000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:45936/0 (socket says 172.21.15.33:45936) 2024-09-11T00:05:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.512+0000 7f7f92000640 1 -- 172.21.15.33:0/2093029888 learned_addr learned my addr 172.21.15.33:0/2093029888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.512+0000 7f7f91600640 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.513+0000 7f7f92000640 1 -- 172.21.15.33:0/2093029888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 msgr2=0x55ea8e15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.513+0000 7f7f92000640 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.513+0000 7f7f92000640 1 -- 172.21.15.33:0/2093029888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 msgr2=0x55ea8e158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.513+0000 7f7f92000640 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.514+0000 7f7f92000640 1 -- 172.21.15.33:0/2093029888 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8e085780 con 0x55ea8e15bb00 2024-09-11T00:05:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.514+0000 7f7f91600640 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.514+0000 7f7f92000640 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f84009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d505b7c581ddd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.515+0000 7f7f7e600640 1 -- 172.21.15.33:0/2093029888 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84031c80 con 0x55ea8e15bb00 2024-09-11T00:05:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.515+0000 7f7f7e600640 1 -- 172.21.15.33:0/2093029888 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f84036040 con 0x55ea8e15bb00 2024-09-11T00:05:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.516+0000 7f7f96dea740 1 -- 172.21.15.33:0/2093029888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 msgr2=0x55ea8e15dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.516+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f84009a20 comp rx=0 tx=0).stop 2024-09-11T00:05:07.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 -- 172.21.15.33:0/2093029888 shutdown_connections 2024-09-11T00:05:07.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e15bb00 0x55ea8e15dfc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2093029888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 -- 172.21.15.33:0/2093029888 >> 172.21.15.33:0/2093029888 conn(0x55ea8e1518e0 msgr2=0x55ea8e152670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.517+0000 7f7f96dea740 1 -- 172.21.15.33:0/2093029888 shutdown_connections 2024-09-11T00:05:07.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.518+0000 7f7f96dea740 1 -- 172.21.15.33:0/2093029888 wait complete. 2024-09-11T00:05:07.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.518+0000 7f7f96dea740 1 -- start start 2024-09-11T00:05:07.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 Processor -- start 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e1610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ea8dff0ab0 con 0x55ea8e156790 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ea8e05f570 con 0x55ea8e15bb00 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.519+0000 7f7f96dea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea8e15ead0 con 0x55ea8e1590c0 2024-09-11T00:05:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f96dea740 10 client.0 _ll_register_callbacks cb 0x55ea8e06e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:45950/0 (socket says 172.21.15.33:45950) 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f90c00640 1 -- 172.21.15.33:0/3477330823 learned_addr learned my addr 172.21.15.33:0/3477330823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f91600640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.520+0000 7f7f92000640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e1610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.521+0000 7f7f90c00640 1 -- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 msgr2=0x55ea8e1610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.521+0000 7f7f90c00640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e1610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.521+0000 7f7f90c00640 1 -- 172.21.15.33:0/3477330823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 msgr2=0x55ea8e15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.521+0000 7f7f90c00640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.521+0000 7f7f90c00640 1 -- 172.21.15.33:0/3477330823 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8de1a790 con 0x55ea8e1590c0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.522+0000 7f7f90c00640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f780a9270 tx=0x7f7f780a7ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30ca0add7df731df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.522+0000 7f7f72a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.522+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78020040 con 0x55ea8e1590c0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.522+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f7f780ab460 con 0x55ea8e1590c0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.523+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f84036040 con 0x55ea8e1590c0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.523+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f780b3e60 con 0x55ea8e1590c0 2024-09-11T00:05:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.523+0000 7f7f96dea740 10 client.26128 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.523+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ea8de93620 con 0x55ea8e1590c0 2024-09-11T00:05:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f84036040 con 0x55ea8e1590c0 2024-09-11T00:05:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7f780971a0 con 0x55ea8e1590c0 2024-09-11T00:05:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 10 client.26128 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 10 client.26128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 20 client.26128 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e16b6c0 0x55ea8e16db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 4 client.26128 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.524+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea8e0cb600 con 0x55ea8e16b6c0 2024-09-11T00:05:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.525+0000 7f7f91600640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e16b6c0 0x55ea8e16db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.526+0000 7f7f91600640 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e16b6c0 0x55ea8e16db60 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3a1c61f1527d6ff server_cookie=9875aad4487086db in_seq=0 out_seq=0 2024-09-11T00:05:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.526+0000 7f7f72a00640 10 client.26128 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.527+0000 7f7f72a00640 1 -- 172.21.15.33:0/3477330823 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea8e0cb600 con 0x55ea8e16b6c0 2024-09-11T00:05:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.527+0000 7f7f72a00640 10 client.26128 handle_command_reply: tid=0 2024-09-11T00:05:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.527+0000 7f7f96dea740 1 client.26128 shutdown 2024-09-11T00:05:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.527+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 msgr2=0x55ea8e160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.527+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f780a9270 tx=0x7f7f780a7ea0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 shutdown_connections 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e1610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e16b6c0 0x55ea8e16db60 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e160510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 --2- 172.21.15.33:0/3477330823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 >> 172.21.15.33:0/3477330823 conn(0x55ea8e1518e0 msgr2=0x55ea8e150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f72a00640 0 client.26128 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 shutdown_connections 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.528+0000 7f7f96dea740 1 -- 172.21.15.33:0/3477330823 wait complete. 2024-09-11T00:05:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.529+0000 7f7f96dea740 20 client.26128 trim_cache size 0 max 16384 2024-09-11T00:05:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.572+0000 7f7f96dea740 1 Processor -- start 2024-09-11T00:05:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.572+0000 7f7f96dea740 1 -- start start 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e15f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c54b0 con 0x55ea8e156790 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c2d80 con 0x55ea8e15bb00 2024-09-11T00:05:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.573+0000 7f7f96dea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c0bd0 con 0x55ea8e1590c0 2024-09-11T00:05:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.574+0000 7f7f92000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.574+0000 7f7f92000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59532/0 (socket says 172.21.15.33:59532) 2024-09-11T00:05:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.575+0000 7f7f92000640 1 -- 172.21.15.33:0/1245490083 learned_addr learned my addr 172.21.15.33:0/1245490083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.575+0000 7f7f90c00640 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.575+0000 7f7f92000640 1 -- 172.21.15.33:0/1245490083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 msgr2=0x55ea8e15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.576+0000 7f7f92000640 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e15f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.576+0000 7f7f91600640 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.576+0000 7f7f92000640 1 -- 172.21.15.33:0/1245490083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 msgr2=0x55ea8e15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.576+0000 7f7f92000640 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.576+0000 7f7f92000640 1 -- 172.21.15.33:0/1245490083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8e15b820 con 0x55ea8e15bb00 2024-09-11T00:05:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.577+0000 7f7f92000640 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f84005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15fe1eff65520ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.577+0000 7f7f7dc00640 1 -- 172.21.15.33:0/1245490083 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84031680 con 0x55ea8e15bb00 2024-09-11T00:05:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.577+0000 7f7f7dc00640 1 -- 172.21.15.33:0/1245490083 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f84036040 con 0x55ea8e15bb00 2024-09-11T00:05:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.577+0000 7f7f7dc00640 1 -- 172.21.15.33:0/1245490083 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84003fe0 con 0x55ea8e15bb00 2024-09-11T00:05:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 -- 172.21.15.33:0/1245490083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 msgr2=0x55ea8e15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f84005de0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 -- 172.21.15.33:0/1245490083 shutdown_connections 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e15bb00 0x55ea8e15bee0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e1590c0 0x55ea8e15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 --2- 172.21.15.33:0/1245490083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e156790 0x55ea8e15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.578+0000 7f7f96dea740 1 -- 172.21.15.33:0/1245490083 >> 172.21.15.33:0/1245490083 conn(0x55ea8e1518e0 msgr2=0x55ea8e155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.579+0000 7f7f96dea740 1 -- 172.21.15.33:0/1245490083 shutdown_connections 2024-09-11T00:05:07.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.579+0000 7f7f96dea740 1 -- 172.21.15.33:0/1245490083 wait complete. 2024-09-11T00:05:07.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.580+0000 7f7f96dea740 1 -- start start 2024-09-11T00:05:07.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.580+0000 7f7f96dea740 1 Processor -- start 2024-09-11T00:05:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e15bb00 0x55ea8e166ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c1240 con 0x55ea8e15bb00 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c26b0 con 0x55ea8e1590c0 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1c1910 con 0x55ea8e156790 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.581+0000 7f7f96dea740 10 client.0 _ll_register_callbacks cb 0x7f7f780abdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.582+0000 7f7f91600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.582+0000 7f7f91600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:45966/0 (socket says 172.21.15.33:45966) 2024-09-11T00:05:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.582+0000 7f7f91600640 1 -- 172.21.15.33:0/2460719127 learned_addr learned my addr 172.21.15.33:0/2460719127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.582+0000 7f7f90c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.582+0000 7f7f92000640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e15bb00 0x55ea8e166ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 -- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 msgr2=0x55ea8e166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e166590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 -- 172.21.15.33:0/2460719127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e15bb00 msgr2=0x55ea8e166ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e15bb00 0x55ea8e166ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 -- 172.21.15.33:0/2460719127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8e167240 con 0x55ea8e156790 2024-09-11T00:05:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f91600640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b990 tx=0x7f7f80004840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c2bff2b2858fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.583+0000 7f7f72a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:05:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80013b30 con 0x55ea8e156790 2024-09-11T00:05:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f7f80013cd0 con 0x55ea8e156790 2024-09-11T00:05:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f84036040 con 0x55ea8e156790 2024-09-11T00:05:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f80035050 con 0x55ea8e156790 2024-09-11T00:05:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f96dea740 10 client.26134 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.584+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ea8e1d86c0 con 0x55ea8e156790 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f8002c070 con 0x55ea8e156790 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7f800273f0 con 0x55ea8e156790 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 10 client.26134 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 10 client.26134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 20 client.26134 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e1d90a0 0x55ea8e1db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 4 client.26134 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:05:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.585+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7f84036040 con 0x55ea8e1d90a0 2024-09-11T00:05:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.586+0000 7f7f90c00640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e1d90a0 0x55ea8e1db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.586+0000 7f7f90c00640 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e1d90a0 0x55ea8e1db4c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc0027d02c6ea5ed server_cookie=5e21f75297625e26 in_seq=0 out_seq=0 2024-09-11T00:05:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.586+0000 7f7f72a00640 10 client.26134 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:07.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.609+0000 7f7f72a00640 1 -- 172.21.15.33:0/2460719127 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7f84036040 con 0x55ea8e1d90a0 2024-09-11T00:05:07.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.609+0000 7f7f72a00640 10 client.26134 handle_command_reply: tid=0 2024-09-11T00:05:07.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.609+0000 7f7f96dea740 1 client.26134 shutdown 2024-09-11T00:05:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.610+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 msgr2=0x55ea8e167890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.610+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b990 tx=0x7f7f80004840 comp rx=0 tx=0).stop 2024-09-11T00:05:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 shutdown_connections 2024-09-11T00:05:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea8e15bb00 0x55ea8e166ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ea8e1590c0 0x55ea8e166590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ea8e1d90a0 0x55ea8e1db4c0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 --2- 172.21.15.33:0/2460719127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea8e156790 0x55ea8e167890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 >> 172.21.15.33:0/2460719127 conn(0x55ea8e1518e0 msgr2=0x55ea8e15ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f72a00640 0 client.26134 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 shutdown_connections 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 1 -- 172.21.15.33:0/2460719127 wait complete. 2024-09-11T00:05:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.611+0000 7f7f96dea740 20 client.26134 trim_cache size 0 max 16384 2024-09-11T00:05:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:05:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:05:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:05:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:05:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 msgr2=0x7f7f740b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 0x7f7f740b78a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009710 tx=0x7f7f80006c90 comp rx=0 tx=0).stop 2024-09-11T00:05:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 msgr2=0x7f7f8c11abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800d950 tx=0x7f7f7800de10 comp rx=0 tx=0).stop 2024-09-11T00:05:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 shutdown_connections 2024-09-11T00:05:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f7f740b53e0 0x7f7f740b78a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f8c10ab10 0x7f7f8c11b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f8c10a150 0x7f7f8c11abe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 --2- 172.21.15.33:0/183075998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0743d0 0x7f7f8c11a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.613+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 >> 172.21.15.33:0/183075998 conn(0x7f7f8c06fe80 msgr2=0x7f7f8c10eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.614+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 shutdown_connections 2024-09-11T00:05:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:07.614+0000 7f7f94000640 1 -- 172.21.15.33:0/183075998 wait complete. 2024-09-11T00:05:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 320.0 s, 699.0 tps, lat 143.149 ms stddev 40.818 2024-09-11T00:05:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:08 smithi033 ceph-mon[30593]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-09-11T00:05:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:08 smithi189 ceph-mon[34000]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-09-11T00:05:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:08 smithi052 ceph-mon[33526]: pgmap v687: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.6 MiB/s wr, 746 op/s 2024-09-11T00:05:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:10 smithi033 ceph-mon[30593]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 693 op/s 2024-09-11T00:05:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:10 smithi189 ceph-mon[34000]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 693 op/s 2024-09-11T00:05:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:10 smithi052 ceph-mon[33526]: pgmap v688: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 693 op/s 2024-09-11T00:05:12.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:12 smithi033 ceph-mon[30593]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 737 op/s 2024-09-11T00:05:12.780 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.4 2024-09-11T00:05:12.781 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:05:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:12 smithi189 ceph-mon[34000]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 737 op/s 2024-09-11T00:05:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:12 smithi052 ceph-mon[33526]: pgmap v689: 129 pgs: 129 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 737 op/s 2024-09-11T00:05:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 325.0 s, 770.8 tps, lat 129.758 ms stddev 38.406 2024-09-11T00:05:13.468 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:14.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:14 smithi033 ceph-mon[30593]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 848 op/s 2024-09-11T00:05:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:14 smithi189 ceph-mon[34000]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 848 op/s 2024-09-11T00:05:14.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:14 smithi052 ceph-mon[33526]: pgmap v690: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.7 MiB/s wr, 848 op/s 2024-09-11T00:05:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 -- 172.21.15.33:0/1016938486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5014104f90 msgr2=0x7f5014105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 --2- 172.21.15.33:0/1016938486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5014104f90 0x7f5014105370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5008009900 tx=0x7f500802a400 comp rx=0 tx=0).stop 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 -- 172.21.15.33:0/1016938486 shutdown_connections 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 --2- 172.21.15.33:0/1016938486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410b320 0x7f5014111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 --2- 172.21.15.33:0/1016938486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f501410a9a0 0x7f501410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 --2- 172.21.15.33:0/1016938486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5014104f90 0x7f5014105370 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.044+0000 7f501c000640 1 -- 172.21.15.33:0/1016938486 >> 172.21.15.33:0/1016938486 conn(0x7f5014100a00 msgr2=0x7f5014102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.045+0000 7f501c000640 1 -- 172.21.15.33:0/1016938486 shutdown_connections 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.045+0000 7f501c000640 1 -- 172.21.15.33:0/1016938486 wait complete. 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.046+0000 7f501c000640 1 Processor -- start 2024-09-11T00:05:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.046+0000 7f501c000640 1 -- start start 2024-09-11T00:05:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 0x7f5014110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:15.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:15.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f501410b320 0x7f50141ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:15.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5014078620 con 0x7f5014104f90 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50140784a0 con 0x7f501410b320 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.047+0000 7f501c000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50140787a0 con 0x7f501410a9a0 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.048+0000 7f5018c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.048+0000 7f5018c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40182/0 (socket says 172.21.15.33:40182) 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.048+0000 7f5018c00640 1 -- 172.21.15.33:0/1312013654 learned_addr learned my addr 172.21.15.33:0/1312013654 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.048+0000 7f5019600640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 0x7f5014110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:15.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.048+0000 7f501a000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f501410b320 0x7f50141ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.049+0000 7f5018c00640 1 -- 172.21.15.33:0/1312013654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f501410b320 msgr2=0x7f50141ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.049+0000 7f5018c00640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f501410b320 0x7f50141ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.049+0000 7f5018c00640 1 -- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 msgr2=0x7f5014110540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.050+0000 7f5018c00640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 0x7f5014110540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.050+0000 7f5018c00640 1 -- 172.21.15.33:0/1312013654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50141ab9a0 con 0x7f501410a9a0 2024-09-11T00:05:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.050+0000 7f5019600640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 0x7f5014110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.051+0000 7f5018c00640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f500000d950 tx=0x7f500000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.051+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000017070 con 0x7f501410a9a0 2024-09-11T00:05:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.052+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5000009c30 con 0x7f501410a9a0 2024-09-11T00:05:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.052+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500000f620 con 0x7f501410a9a0 2024-09-11T00:05:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.052+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50141abc90 con 0x7f501410a9a0 2024-09-11T00:05:15.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.052+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50141ac180 con 0x7f501410a9a0 2024-09-11T00:05:15.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.055+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5014105370 con 0x7f501410a9a0 2024-09-11T00:05:15.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.059+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5000005030 con 0x7f501410a9a0 2024-09-11T00:05:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.065+0000 7f5012000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 0x7f4ffc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.065+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f50000e5b00 con 0x7f501410a9a0 2024-09-11T00:05:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.066+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50001162a0 con 0x7f501410a9a0 2024-09-11T00:05:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.067+0000 7f5019600640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 0x7f4ffc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:15.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.070+0000 7f5019600640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 0x7f4ffc0b7820 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5008009230 tx=0x7f5008005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:15.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.511+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f501402e5c0 con 0x7f501410a9a0 2024-09-11T00:05:15.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.512+0000 7f5012000640 1 -- 172.21.15.33:0/1312013654 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f50000ac6a0 con 0x7f501410a9a0 2024-09-11T00:05:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:05:15.515 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:05:15.515 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:05:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 msgr2=0x7f4ffc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 0x7f4ffc0b7820 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5008009230 tx=0x7f5008005d50 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 msgr2=0x7f5014110a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f500000d950 tx=0x7f500000de10 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 shutdown_connections 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ffc0b5360 0x7f4ffc0b7820 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f501410b320 0x7f50141ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f501410a9a0 0x7f5014110a80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 --2- 172.21.15.33:0/1312013654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5014104f90 0x7f5014110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.521+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 >> 172.21.15.33:0/1312013654 conn(0x7f5014100a00 msgr2=0x7f5014102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.522+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 shutdown_connections 2024-09-11T00:05:15.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:15.522+0000 7f501c000640 1 -- 172.21.15.33:0/1312013654 wait complete. 2024-09-11T00:05:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:15 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:15.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:15 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1312013654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:15.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:15 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:15.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:15 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1312013654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:15 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:05:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:15 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1312013654' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:16.516 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 148.4 --await-for 45.0' 2024-09-11T00:05:16.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 148.4 --await-for 45.0 2024-09-11T00:05:16.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:16 smithi033 ceph-mon[30593]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 733 op/s 2024-09-11T00:05:16.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:16.536 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:16 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:16 smithi189 ceph-mon[34000]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 733 op/s 2024-09-11T00:05:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:16 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:16 smithi052 ceph-mon[33526]: pgmap v691: 129 pgs: 129 active+clean; 1.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 733 op/s 2024-09-11T00:05:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:16 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:17.279 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:17.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:17.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:17.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:17 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:17.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:17.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:17.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:17 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:17.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:05:17.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:05:17.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:17 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:05:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 -- 172.21.15.33:0/3161904531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 msgr2=0x7f95c4115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 --2- 172.21.15.33:0/3161904531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c4115bb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009900 tx=0x7f95b002a480 comp rx=0 tx=0).stop 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 -- 172.21.15.33:0/3161904531 shutdown_connections 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 --2- 172.21.15.33:0/3161904531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c4115bb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 --2- 172.21.15.33:0/3161904531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c410ab10 0x7f95c4113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 --2- 172.21.15.33:0/3161904531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410a1f0 0x7f95c410a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 -- 172.21.15.33:0/3161904531 >> 172.21.15.33:0/3161904531 conn(0x7f95c40788a0 msgr2=0x7f95c407acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.044+0000 7f95ca000640 1 -- 172.21.15.33:0/3161904531 shutdown_connections 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.045+0000 7f95ca000640 1 -- 172.21.15.33:0/3161904531 wait complete. 2024-09-11T00:05:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 Processor -- start 2024-09-11T00:05:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 -- start start 2024-09-11T00:05:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c410a1f0 0x7f95c419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c41a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95c4119240 con 0x7f95c410a1f0 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41190c0 con 0x7f95c4113710 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.046+0000 7f95ca000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41193c0 con 0x7f95c410ab10 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.047+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.047+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40200/0 (socket says 172.21.15.33:40200) 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.047+0000 7f95c2a00640 1 -- 172.21.15.33:0/3450905673 learned_addr learned my addr 172.21.15.33:0/3450905673 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.047+0000 7f95c3e00640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c41a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 -- 172.21.15.33:0/3450905673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 msgr2=0x7f95c41a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c41a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 -- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c410a1f0 msgr2=0x7f95c419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c410a1f0 0x7f95c419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 -- 172.21.15.33:0/3450905673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c41a5820 con 0x7f95c410ab10 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.048+0000 7f95c2a00640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95b400d950 tx=0x7f95b400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.049+0000 7f95bbe00640 1 -- 172.21.15.33:0/3450905673 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4017020 con 0x7f95c410ab10 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.049+0000 7f95bbe00640 1 -- 172.21.15.33:0/3450905673 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95b4009c30 con 0x7f95c410ab10 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.049+0000 7f95bbe00640 1 -- 172.21.15.33:0/3450905673 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b400f620 con 0x7f95c410ab10 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.049+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c41a5b10 con 0x7f95c410ab10 2024-09-11T00:05:18.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.049+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c41ac3a0 con 0x7f95c410ab10 2024-09-11T00:05:18.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.054+0000 7f95ccaab740 1 Processor -- start 2024-09-11T00:05:18.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.054+0000 7f95ccaab740 1 -- start start 2024-09-11T00:05:18.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd433534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43353a30 0x55dd43355e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd432bcca0 con 0x55dd43347aa0 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd432ac0d0 con 0x55dd43353a30 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.055+0000 7f95ccaab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd432afee0 con 0x55dd43347180 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.056+0000 7f95bbe00640 1 -- 172.21.15.33:0/3450905673 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f95b4010460 con 0x7f95c410ab10 2024-09-11T00:05:18.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.057+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.057+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40206/0 (socket says 172.21.15.33:40206) 2024-09-11T00:05:18.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.057+0000 7f95c3e00640 1 -- 172.21.15.33:0/644327416 learned_addr learned my addr 172.21.15.33:0/644327416 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:18.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 -- 172.21.15.33:0/644327416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43353a30 msgr2=0x55dd43355e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43353a30 0x55dd43355e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 -- 172.21.15.33:0/644327416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 msgr2=0x55dd433534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd433534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 -- 172.21.15.33:0/644327416 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4325e400 con 0x55dd43347180 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.058+0000 7f95c3e00640 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95b00057c0 tx=0x7f95b0004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1a4f8cea5044a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.059+0000 7f95bbe00640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 0x7f95a80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.060+0000 7f95afe00640 1 -- 172.21.15.33:0/644327416 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0040070 con 0x55dd43347180 2024-09-11T00:05:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.060+0000 7f95bbe00640 1 -- 172.21.15.33:0/3450905673 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f95b40e5f50 con 0x7f95c410ab10 2024-09-11T00:05:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.060+0000 7f95afe00640 1 -- 172.21.15.33:0/644327416 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95b0003a80 con 0x55dd43347180 2024-09-11T00:05:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.060+0000 7f95c3400640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 0x7f95a80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.060+0000 7f95afe00640 1 -- 172.21.15.33:0/644327416 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0035040 con 0x55dd43347180 2024-09-11T00:05:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 -- 172.21.15.33:0/644327416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 msgr2=0x55dd43347560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95c3400640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 0x7f95a80b78e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55dd43345e90 tx=0x7f95bc0093c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95b00057c0 tx=0x7f95b0004180 comp rx=0 tx=0).stop 2024-09-11T00:05:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 -- 172.21.15.33:0/644327416 shutdown_connections 2024-09-11T00:05:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43353a30 0x55dd43355e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd433534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 --2- 172.21.15.33:0/644327416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347180 0x55dd43347560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 -- 172.21.15.33:0/644327416 >> 172.21.15.33:0/644327416 conn(0x55dd43344fb0 msgr2=0x55dd43346150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 -- 172.21.15.33:0/644327416 shutdown_connections 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.062+0000 7f95ccaab740 1 -- 172.21.15.33:0/644327416 wait complete. 2024-09-11T00:05:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.063+0000 7f95ccaab740 1 -- start start 2024-09-11T00:05:18.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.063+0000 7f95ccaab740 1 Processor -- start 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347aa0 0x55dd43350850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43353a30 0x55dd43350f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd4310d7a0 con 0x55dd43353a30 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd43251a10 con 0x55dd43347180 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd43356650 con 0x55dd43347aa0 2024-09-11T00:05:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.064+0000 7f95ccaab740 10 client.0 _ll_register_callbacks cb 0x55dd43261be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:50992/0 (socket says 172.21.15.33:50992) 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 -- 172.21.15.33:0/1464306533 learned_addr learned my addr 172.21.15.33:0/1464306533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3e00640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43353a30 0x55dd43350f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c2a00640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347aa0 0x55dd43350850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 -- 172.21.15.33:0/1464306533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347aa0 msgr2=0x55dd43350850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347aa0 0x55dd43350850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 -- 172.21.15.33:0/1464306533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43353a30 msgr2=0x55dd43350f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43353a30 0x55dd43350f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.065+0000 7f95c3400640 1 -- 172.21.15.33:0/1464306533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd43019b90 con 0x55dd43347180 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.066+0000 7f95c3400640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004a80 tx=0x7f95bc009200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9748521abcedf387 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.066+0000 7f95acc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.067+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc022020 con 0x55dd43347180 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.067+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f95bc0108d0 con 0x55dd43347180 2024-09-11T00:05:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.067+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95b0003a80 con 0x55dd43347180 2024-09-11T00:05:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.067+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f95bc010ad0 con 0x55dd43347180 2024-09-11T00:05:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.067+0000 7f95ccaab740 10 client.36200 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dd43362160 con 0x55dd43347180 2024-09-11T00:05:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95b0003a80 con 0x55dd43347180 2024-09-11T00:05:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f95bc02f020 con 0x55dd43347180 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 10 client.36200 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 10 client.36200 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 20 client.36200 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433636c0 0x55dd43365b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 4 client.36200 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.068+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd432bebf0 con 0x55dd433636c0 2024-09-11T00:05:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.069+0000 7f95c2a00640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433636c0 0x55dd43365b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.070+0000 7f95c2a00640 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433636c0 0x55dd43365b10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f233b7a6f9f155d9 server_cookie=d1db50336372f123 in_seq=0 out_seq=0 2024-09-11T00:05:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.070+0000 7f95acc00640 10 client.36200 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.071+0000 7f95acc00640 1 -- 172.21.15.33:0/1464306533 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd432bebf0 con 0x55dd433636c0 2024-09-11T00:05:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.071+0000 7f95acc00640 10 client.36200 handle_command_reply: tid=0 2024-09-11T00:05:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.071+0000 7f95ccaab740 1 client.36200 shutdown 2024-09-11T00:05:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 msgr2=0x55dd43353400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004a80 tx=0x7f95bc009200 comp rx=0 tx=0).stop 2024-09-11T00:05:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 shutdown_connections 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43353a30 0x55dd43350f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433636c0 0x55dd43365b10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43347aa0 0x55dd43350850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 --2- 172.21.15.33:0/1464306533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd43353400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 >> 172.21.15.33:0/1464306533 conn(0x55dd43344fb0 msgr2=0x55dd4334ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.072+0000 7f95acc00640 0 client.36200 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.073+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 shutdown_connections 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.073+0000 7f95ccaab740 1 -- 172.21.15.33:0/1464306533 wait complete. 2024-09-11T00:05:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.073+0000 7f95ccaab740 20 client.36200 trim_cache size 0 max 16384 2024-09-11T00:05:18.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.102+0000 7f95ccaab740 1 Processor -- start 2024-09-11T00:05:18.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.102+0000 7f95ccaab740 1 -- start start 2024-09-11T00:05:18.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd4334f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd4334f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4012480 con 0x55dd43347aa0 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95a400fd50 con 0x55dd43347180 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95ccaab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95a400dba0 con 0x55dd43353a30 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:50998/0 (socket says 172.21.15.33:50998) 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95c3400640 1 -- 172.21.15.33:0/2322036584 learned_addr learned my addr 172.21.15.33:0/2322036584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.103+0000 7f95c3e00640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd4334f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd4334f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 -- 172.21.15.33:0/2322036584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 msgr2=0x55dd4334f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd4334f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 -- 172.21.15.33:0/2322036584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 msgr2=0x55dd4334f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd4334f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 -- 172.21.15.33:0/2322036584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4334c160 con 0x55dd43347180 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd4334f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3e00640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd4334f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.104+0000 7f95c3400640 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95bc013040 tx=0x7f95bc005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea450cbb0d7d217e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.105+0000 7f95af400640 1 -- 172.21.15.33:0/2322036584 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc036070 con 0x55dd43347180 2024-09-11T00:05:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.105+0000 7f95af400640 1 -- 172.21.15.33:0/2322036584 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95bc017030 con 0x55dd43347180 2024-09-11T00:05:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.105+0000 7f95af400640 1 -- 172.21.15.33:0/2322036584 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc022040 con 0x55dd43347180 2024-09-11T00:05:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 -- 172.21.15.33:0/2322036584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 msgr2=0x55dd433448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f95bc013040 tx=0x7f95bc005bd0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 -- 172.21.15.33:0/2322036584 shutdown_connections 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd4334f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347aa0 0x55dd4334f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2322036584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347180 0x55dd433448a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.106+0000 7f95ccaab740 1 -- 172.21.15.33:0/2322036584 >> 172.21.15.33:0/2322036584 conn(0x55dd43344fb0 msgr2=0x55dd4334fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.107+0000 7f95ccaab740 1 -- 172.21.15.33:0/2322036584 shutdown_connections 2024-09-11T00:05:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.107+0000 7f95ccaab740 1 -- 172.21.15.33:0/2322036584 wait complete. 2024-09-11T00:05:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.107+0000 7f95ccaab740 1 -- start start 2024-09-11T00:05:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.108+0000 7f95ccaab740 1 Processor -- start 2024-09-11T00:05:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.109+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 0x55dd4335b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.109+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 0x55dd4335bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95c3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 0x55dd4335b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95ccaab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd43356930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95c3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 0x55dd4335b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37746/0 (socket says 172.21.15.33:37746) 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95c3400640 1 -- 172.21.15.33:0/2008237321 learned_addr learned my addr 172.21.15.33:0/2008237321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95a400e210 con 0x55dd43347180 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95a400f680 con 0x55dd43347aa0 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95a400e8e0 con 0x55dd43353a30 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95ccaab740 10 client.0 _ll_register_callbacks cb 0x7f95bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.110+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 0x55dd4335bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 -- 172.21.15.33:0/2008237321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 msgr2=0x55dd43356930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd43356930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 -- 172.21.15.33:0/2008237321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 msgr2=0x55dd4335b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 0x55dd4335b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd43356e70 con 0x55dd43347aa0 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95c2a00640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 0x55dd4335bec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ac2a0 tx=0x7f95b4010df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3e3ac5261018198 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.111+0000 7f95acc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:05:18.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.112+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40b5040 con 0x55dd43347aa0 2024-09-11T00:05:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.112+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f95b40cf0b0 con 0x55dd43347aa0 2024-09-11T00:05:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.112+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95bc017030 con 0x55dd43347aa0 2024-09-11T00:05:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.113+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f95b4009de0 con 0x55dd43347aa0 2024-09-11T00:05:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.113+0000 7f95ccaab740 10 client.36206 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.113+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dd433d0d50 con 0x55dd43347aa0 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.113+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95bc017030 con 0x55dd43347aa0 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.113+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f95b40e3b10 con 0x55dd43347aa0 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 10 client.36206 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 10 client.36206 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 20 client.36206 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433d1540 0x55dd433d3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 4 client.36206 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.4, "await_for": 45.0}] 2024-09-11T00:05:18.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.4, "await_for": 45.0}) -- 0x55dd432ba6a0 con 0x55dd433d1540 2024-09-11T00:05:18.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.114+0000 7f95c3400640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433d1540 0x55dd433d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:18.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.115+0000 7f95c3400640 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433d1540 0x55dd433d3960 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc23a1613e06849 server_cookie=e3c214f826d8b372 in_seq=0 out_seq=0 2024-09-11T00:05:18.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.115+0000 7f95acc00640 10 client.36206 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 330.0 s, 633.0 tps, lat 157.255 ms stddev 48.013 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95acc00640 1 -- 172.21.15.33:0/2008237321 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dd432ba6a0 con 0x55dd433d1540 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95acc00640 10 client.36206 handle_command_reply: tid=0 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 client.36206 shutdown 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 msgr2=0x55dd4335bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 0x55dd4335bec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ac2a0 tx=0x7f95b4010df0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 shutdown_connections 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55dd433d1540 0x55dd433d3960 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd43353a30 0x55dd43356930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd43347aa0 0x55dd4335bec0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 --2- 172.21.15.33:0/2008237321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd43347180 0x55dd4335b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 >> 172.21.15.33:0/2008237321 conn(0x55dd43344fb0 msgr2=0x55dd43351e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95acc00640 0 client.36206 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 shutdown_connections 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.423+0000 7f95ccaab740 1 -- 172.21.15.33:0/2008237321 wait complete. 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.424+0000 7f95ccaab740 20 client.36206 trim_cache size 0 max 16384 2024-09-11T00:05:18.426 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 26, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "97bcea04": { 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 26, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:05:18.427 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 148.4, 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:18.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:18.429 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:05:18.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.424+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 msgr2=0x7f95a80b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.424+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 0x7f95a80b78e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55dd43345e90 tx=0x7f95bc0093c0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.424+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 msgr2=0x7f95c419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.424+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95b400d950 tx=0x7f95b400de10 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 shutdown_connections 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f95a80b5420 0x7f95a80b78e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95c4113710 0x7f95c41a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95c410ab10 0x7f95c419fcb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 --2- 172.21.15.33:0/3450905673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c410a1f0 0x7f95c419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 >> 172.21.15.33:0/3450905673 conn(0x7f95c40788a0 msgr2=0x7f95c4079540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 shutdown_connections 2024-09-11T00:05:18.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:18.425+0000 7f95ca000640 1 -- 172.21.15.33:0/3450905673 wait complete. 2024-09-11T00:05:18.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:18 smithi033 ceph-mon[30593]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 811 op/s 2024-09-11T00:05:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:18 smithi189 ceph-mon[34000]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 811 op/s 2024-09-11T00:05:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:18 smithi052 ceph-mon[33526]: pgmap v692: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 811 op/s 2024-09-11T00:05:19.511 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '97bcea04', quiesce took 6.7 seconds. Will release after: 21.7 2024-09-11T00:05:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 -- 172.21.15.33:0/1749802896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 msgr2=0x7f00ac10ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 --2- 172.21.15.33:0/1749802896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac10ac20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009cd0 tx=0x7f00a802a8e0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 -- 172.21.15.33:0/1749802896 shutdown_connections 2024-09-11T00:05:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 --2- 172.21.15.33:0/1749802896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac10ac20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 --2- 172.21.15.33:0/1749802896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 --2- 172.21.15.33:0/1749802896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 0x7f00ac102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 -- 172.21.15.33:0/1749802896 >> 172.21.15.33:0/1749802896 conn(0x7f00ac0fe030 msgr2=0x7f00ac100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 -- 172.21.15.33:0/1749802896 shutdown_connections 2024-09-11T00:05:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.755+0000 7f00b3200640 1 -- 172.21.15.33:0/1749802896 wait complete. 2024-09-11T00:05:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.756+0000 7f00b3200640 1 Processor -- start 2024-09-11T00:05:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.756+0000 7f00b3200640 1 -- start start 2024-09-11T00:05:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 0x7f00ac19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac10e300 con 0x7f00ac1042a0 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac10e180 con 0x7f00ac1038e0 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b3200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac10e480 con 0x7f00ac102790 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37764/0 (socket says 172.21.15.33:37764) 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b2800640 1 -- 172.21.15.33:0/1022739708 learned_addr learned my addr 172.21.15.33:0/1022739708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 0x7f00ac19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.757+0000 7f00b1400640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 -- 172.21.15.33:0/1022739708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 msgr2=0x7f00ac19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 0x7f00ac19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 -- 172.21.15.33:0/1022739708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 msgr2=0x7f00ac19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 -- 172.21.15.33:0/1022739708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac19c820 con 0x7f00ac1042a0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b1400640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b2800640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f00a8003ba0 tx=0x7f00a8003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00a6a00640 1 -- 172.21.15.33:0/1022739708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004240 con 0x7f00ac1042a0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00a6a00640 1 -- 172.21.15.33:0/1022739708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00a80305a0 con 0x7f00ac1042a0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00a6a00640 1 -- 172.21.15.33:0/1022739708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80466e0 con 0x7f00ac1042a0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac19cab0 con 0x7f00ac1042a0 2024-09-11T00:05:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.758+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac1a31e0 con 0x7f00ac1042a0 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.761+0000 7f00b76ca740 1 Processor -- start 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00a6a00640 1 -- 172.21.15.33:0/1022739708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f00a8030070 con 0x7f00ac1042a0 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 -- start start 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef523d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561ef51a86b0 con 0x561ef523ace0 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561ef5197ae0 con 0x561ef5235970 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.762+0000 7f00b76ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561ef519b8f0 con 0x561ef52382a0 2024-09-11T00:05:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51026/0 (socket says 172.21.15.33:51026) 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 -- 172.21.15.33:0/2196476163 learned_addr learned my addr 172.21.15.33:0/2196476163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef523d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1e00640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 -- 172.21.15.33:0/2196476163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 msgr2=0x561ef523a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 -- 172.21.15.33:0/2196476163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 msgr2=0x561ef523d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef523d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1400640 1 -- 172.21.15.33:0/2196476163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ef5164780 con 0x561ef5235970 2024-09-11T00:05:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00b1e00640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.763+0000 7f00a6a00640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 0x7f00940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f00a6a00640 1 -- 172.21.15.33:0/1022739708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00a802e030 con 0x7f00ac1042a0 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f00b1400640 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f009c0138e0 tx=0x7f009c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7fe0d27b02f1614 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 0x7f00940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f009b000640 1 -- 172.21.15.33:0/2196476163 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c004220 con 0x561ef5235970 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f009b000640 1 -- 172.21.15.33:0/2196476163 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f009c0043c0 con 0x561ef5235970 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.764+0000 7f009b000640 1 -- 172.21.15.33:0/2196476163 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c004b20 con 0x561ef5235970 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- 172.21.15.33:0/2196476163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 msgr2=0x561ef5237d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f009c0138e0 tx=0x7f009c00b480 comp rx=0 tx=0).stop 2024-09-11T00:05:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 0x7f00940b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- 172.21.15.33:0/2196476163 shutdown_connections 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef523d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 --2- 172.21.15.33:0/2196476163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef5237d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- 172.21.15.33:0/2196476163 >> 172.21.15.33:0/2196476163 conn(0x561ef5230ac0 msgr2=0x561ef5231850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- 172.21.15.33:0/2196476163 shutdown_connections 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- 172.21.15.33:0/2196476163 wait complete. 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.765+0000 7f00b76ca740 1 -- start start 2024-09-11T00:05:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 Processor -- start 2024-09-11T00:05:20.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef523f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561ef50cfab0 con 0x561ef523ace0 2024-09-11T00:05:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561ef513e570 con 0x561ef5235970 2024-09-11T00:05:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561ef523dc60 con 0x561ef52382a0 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b76ca740 10 client.0 _ll_register_callbacks cb 0x561ef514d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef523f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37784/0 (socket says 172.21.15.33:37784) 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef523f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:51030/0 (socket says 172.21.15.33:51030) 2024-09-11T00:05:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.766+0000 7f00b2800640 1 -- 172.21.15.33:0/1177010167 learned_addr learned my addr 172.21.15.33:0/1177010167 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b1400640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 -- 172.21.15.33:0/1177010167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 msgr2=0x561ef523f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 -- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 msgr2=0x561ef523f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef523f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 -- 172.21.15.33:0/1177010167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ef4ef9790 con 0x561ef523ace0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b2800640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f00a802aea0 tx=0x7f00a80ccb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2f8cefdb02875 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f008f400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80cd390 con 0x561ef523ace0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00a8104b90 con 0x561ef523ace0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.767+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f009c0043c0 con 0x561ef523ace0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00a80d1e70 con 0x561ef523ace0 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 10 client.16413 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ef4f72620 con 0x561ef523ace0 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f009c0043c0 con 0x561ef523ace0 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f00a80cc5f0 con 0x561ef523ace0 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 10 client.16413 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 20 client.16413 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef524a7f0 0x561ef524cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 4 client.16413 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.768+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ef51aa600 con 0x561ef524a7f0 2024-09-11T00:05:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.769+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef524a7f0 0x561ef524cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.769+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef524a7f0 0x561ef524cc90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd8dc779f8127a9a server_cookie=b2ecffa47f55d7c6 in_seq=0 out_seq=0 2024-09-11T00:05:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.769+0000 7f008f400640 10 client.16413 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f008f400640 1 -- 172.21.15.33:0/1177010167 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ef51aa600 con 0x561ef524a7f0 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f008f400640 10 client.16413 handle_command_reply: tid=0 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f00b76ca740 1 client.16413 shutdown 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 msgr2=0x561ef5240280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f00a802aea0 tx=0x7f00a80ccb00 comp rx=0 tx=0).stop 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.770+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 shutdown_connections 2024-09-11T00:05:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5240280 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef524a7f0 0x561ef524cc90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef523f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1177010167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef523f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 >> 172.21.15.33:0/1177010167 conn(0x561ef5230ac0 msgr2=0x561ef522fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f008f400640 0 client.16413 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 shutdown_connections 2024-09-11T00:05:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 1 -- 172.21.15.33:0/1177010167 wait complete. 2024-09-11T00:05:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.771+0000 7f00b76ca740 20 client.16413 trim_cache size 0 max 16384 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 Processor -- start 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 -- start start 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef522bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5234dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1afd90 con 0x561ef523ace0 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1ad660 con 0x561ef5235970 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.786+0000 7f00b76ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1ab4b0 con 0x561ef52382a0 2024-09-11T00:05:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37794/0 (socket says 172.21.15.33:37794) 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 -- 172.21.15.33:0/1947363178 learned_addr learned my addr 172.21.15.33:0/1947363178 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b1e00640 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef522bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b1400640 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5234dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 -- 172.21.15.33:0/1947363178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 msgr2=0x561ef5234dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5234dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 -- 172.21.15.33:0/1947363178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 msgr2=0x561ef522bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef522bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 -- 172.21.15.33:0/1947363178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ef52380d0 con 0x561ef523ace0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.787+0000 7f00b2800640 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f00a80cd320 tx=0x7f00a8030960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575631185a0b1ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f009a600640 1 -- 172.21.15.33:0/1947363178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80e6030 con 0x561ef523ace0 2024-09-11T00:05:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f009a600640 1 -- 172.21.15.33:0/1947363178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00a8036070 con 0x561ef523ace0 2024-09-11T00:05:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f009a600640 1 -- 172.21.15.33:0/1947363178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80cd390 con 0x561ef523ace0 2024-09-11T00:05:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 -- 172.21.15.33:0/1947363178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 msgr2=0x561ef5235310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f00a80cd320 tx=0x7f00a8030960 comp rx=0 tx=0).stop 2024-09-11T00:05:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 -- 172.21.15.33:0/1947363178 shutdown_connections 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef523ace0 0x561ef5235310 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5234dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 --2- 172.21.15.33:0/1947363178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef5235970 0x561ef522bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 -- 172.21.15.33:0/1947363178 >> 172.21.15.33:0/1947363178 conn(0x561ef5230ac0 msgr2=0x561ef5233b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 -- 172.21.15.33:0/1947363178 shutdown_connections 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.788+0000 7f00b76ca740 1 -- 172.21.15.33:0/1947363178 wait complete. 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 -- start start 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 Processor -- start 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5246220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 0x561ef5246760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1abb20 con 0x561ef5235970 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1acf90 con 0x561ef523ace0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac1ac1f0 con 0x561ef52382a0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b76ca740 10 client.0 _ll_register_callbacks cb 0x7f00a8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.789+0000 7f00b1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37800/0 (socket says 172.21.15.33:37800) 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 -- 172.21.15.33:0/594032375 learned_addr learned my addr 172.21.15.33:0/594032375 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1400640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5246220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b2800640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 0x561ef5246760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 -- 172.21.15.33:0/594032375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 msgr2=0x561ef5246220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5246220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 -- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 msgr2=0x561ef5246760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 0x561ef5246760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 -- 172.21.15.33:0/594032375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ef5244aa0 con 0x561ef5235970 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b2800640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 0x561ef5246760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f00b1e00640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f00a000bfd0 tx=0x7f00a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ea5052a6d72128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.790+0000 7f008f400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0035060 con 0x561ef5235970 2024-09-11T00:05:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a8036070 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00a0017030 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00a003c050 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 10 client.16419 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ef52c05f0 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00a8036070 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f00a0030ac0 con 0x561ef5235970 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 10 client.16419 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 20 client.16419 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef52c0f80 0x561ef52c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 4 client.16419 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:05:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.791+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ef51a60b0 con 0x561ef52c0f80 2024-09-11T00:05:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.792+0000 7f00b1400640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef52c0f80 0x561ef52c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.792+0000 7f00b1400640 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef52c0f80 0x561ef52c33a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d152676bacc14ec6 server_cookie=e77c8e0fa6b6be90 in_seq=0 out_seq=0 2024-09-11T00:05:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.792+0000 7f008f400640 10 client.16419 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.807+0000 7f008f400640 1 -- 172.21.15.33:0/594032375 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ef51a60b0 con 0x561ef52c0f80 2024-09-11T00:05:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f008f400640 10 client.16419 handle_command_reply: tid=0 2024-09-11T00:05:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 client.16419 shutdown 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 msgr2=0x561ef5245ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f00a000bfd0 tx=0x7f00a00046c0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 shutdown_connections 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ef523ace0 0x561ef5246760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561ef52c0f80 0x561ef52c33a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561ef52382a0 0x561ef5246220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 --2- 172.21.15.33:0/594032375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561ef5235970 0x561ef5245ce0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f008f400640 0 client.16419 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 >> 172.21.15.33:0/594032375 conn(0x561ef5230ac0 msgr2=0x561ef5233b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 shutdown_connections 2024-09-11T00:05:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 1 -- 172.21.15.33:0/594032375 wait complete. 2024-09-11T00:05:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.808+0000 7f00b76ca740 20 client.16419 trim_cache size 0 max 16384 2024-09-11T00:05:20.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:05:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:05:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:05:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 msgr2=0x7f00940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 0x7f00940b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a000b390 comp rx=0 tx=0).stop 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 msgr2=0x7f00ac19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f00a8003ba0 tx=0x7f00a8003bd0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 shutdown_connections 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00940b5360 0x7f00940b7820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00ac1042a0 0x7f00ac19bf60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00ac1038e0 0x7f00ac19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 --2- 172.21.15.33:0/1022739708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00ac102790 0x7f00ac19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 >> 172.21.15.33:0/1022739708 conn(0x7f00ac0fe030 msgr2=0x7f00ac109050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 shutdown_connections 2024-09-11T00:05:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:20.809+0000 7f00b3200640 1 -- 172.21.15.33:0/1022739708 wait complete. 2024-09-11T00:05:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:20 smithi189 ceph-mon[34000]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:05:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:20 smithi052 ceph-mon[33526]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:05:21.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:20 smithi033 ceph-mon[30593]: pgmap v693: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-09-11T00:05:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:22 smithi189 ceph-mon[34000]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-09-11T00:05:22.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:22 smithi052 ceph-mon[33526]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-09-11T00:05:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:22 smithi033 ceph-mon[30593]: pgmap v694: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 710 op/s 2024-09-11T00:05:23.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:05:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:24 smithi189 ceph-mon[34000]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 636 op/s 2024-09-11T00:05:24.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:24 smithi052 ceph-mon[33526]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 636 op/s 2024-09-11T00:05:25.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:24 smithi033 ceph-mon[30593]: pgmap v695: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 636 op/s 2024-09-11T00:05:26.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:26 smithi033 ceph-mon[30593]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T00:05:26.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:26 smithi189 ceph-mon[34000]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T00:05:26.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:26 smithi052 ceph-mon[33526]: pgmap v696: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.1 MiB/s wr, 428 op/s 2024-09-11T00:05:28.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:05:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:28 smithi189 ceph-mon[34000]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.6 MiB/s wr, 369 op/s 2024-09-11T00:05:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:28 smithi052 ceph-mon[33526]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.6 MiB/s wr, 369 op/s 2024-09-11T00:05:29.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:28 smithi033 ceph-mon[30593]: pgmap v697: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.6 MiB/s wr, 369 op/s 2024-09-11T00:05:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:30 smithi189 ceph-mon[34000]: pgmap v698: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-11T00:05:30.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:30 smithi052 ceph-mon[33526]: pgmap v698: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-11T00:05:31.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:30 smithi033 ceph-mon[30593]: pgmap v698: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-11T00:05:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:32 smithi189 ceph-mon[34000]: pgmap v699: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 987 KiB/s wr, 111 op/s 2024-09-11T00:05:32.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:32 smithi052 ceph-mon[33526]: pgmap v699: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 987 KiB/s wr, 111 op/s 2024-09-11T00:05:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:32 smithi033 ceph-mon[30593]: pgmap v699: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 987 KiB/s wr, 111 op/s 2024-09-11T00:05:33.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 -- 172.21.15.33:0/1886269814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844104b90 msgr2=0x7fa844104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 --2- 172.21.15.33:0/1886269814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844104b90 0x7fa844104f90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa834009930 tx=0x7fa83402a440 comp rx=0 tx=0).stop 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 -- 172.21.15.33:0/1886269814 shutdown_connections 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 --2- 172.21.15.33:0/1886269814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84410d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 --2- 172.21.15.33:0/1886269814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844105ce0 0x7fa844106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 --2- 172.21.15.33:0/1886269814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844104b90 0x7fa844104f90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 -- 172.21.15.33:0/1886269814 >> 172.21.15.33:0/1886269814 conn(0x7fa844100470 msgr2=0x7fa844102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 -- 172.21.15.33:0/1886269814 shutdown_connections 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.932+0000 7fa849c00640 1 -- 172.21.15.33:0/1886269814 wait complete. 2024-09-11T00:05:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.933+0000 7fa849c00640 1 Processor -- start 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.933+0000 7fa849c00640 1 -- start start 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844104b90 0x7fa84419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441106e0 con 0x7fa844105ce0 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa844110560 con 0x7fa8441066a0 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa849c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa844110860 con 0x7fa844104b90 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43312/0 (socket says 172.21.15.33:43312) 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa83be00640 1 -- 172.21.15.33:0/2191729264 learned_addr learned my addr 172.21.15.33:0/2191729264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa842a00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844104b90 0x7fa84419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa843400640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa83be00640 1 -- 172.21.15.33:0/2191729264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844104b90 msgr2=0x7fa84419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.934+0000 7fa83be00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844104b90 0x7fa84419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83be00640 1 -- 172.21.15.33:0/2191729264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 msgr2=0x7fa84419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83be00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83be00640 1 -- 172.21.15.33:0/2191729264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84419c9a0 con 0x7fa844105ce0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa843400640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83be00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c920 tx=0x7fa82c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83b400640 1 -- 172.21.15.33:0/2191729264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c007c70 con 0x7fa844105ce0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83b400640 1 -- 172.21.15.33:0/2191729264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa82c007e10 con 0x7fa844105ce0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84419cc90 con 0x7fa844105ce0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa83b400640 1 -- 172.21.15.33:0/2191729264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c018710 con 0x7fa844105ce0 2024-09-11T00:05:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.935+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8441a3360 con 0x7fa844105ce0 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.938+0000 7fa84cc1f740 1 Processor -- start 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 -- start start 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558699867790 0x558699869b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55869986cb00 0x55869986efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586997da6b0 con 0x55869986a0c0 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5586997c9ae0 con 0x55869986cb00 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5586997cd8f0 con 0x558699867790 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa83b400640 1 -- 172.21.15.33:0/2191729264 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa82c00f450 con 0x7fa844105ce0 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa842a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa842a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43324/0 (socket says 172.21.15.33:43324) 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa842a00640 1 -- 172.21.15.33:0/972090204 learned_addr learned my addr 172.21.15.33:0/972090204 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.939+0000 7fa843400640 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558699867790 0x558699869b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa83be00640 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55869986cb00 0x55869986efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 -- 172.21.15.33:0/972090204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558699867790 msgr2=0x558699869b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558699867790 0x558699869b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 -- 172.21.15.33:0/972090204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55869986cb00 msgr2=0x55869986efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55869986cb00 0x55869986efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 -- 172.21.15.33:0/972090204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558699796780 con 0x55869986a0c0 2024-09-11T00:05:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa842a00640 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa834004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da52577f3e98c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.940+0000 7fa833e00640 1 -- 172.21.15.33:0/972090204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834035030 con 0x55869986a0c0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa833e00640 1 -- 172.21.15.33:0/972090204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa834040070 con 0x55869986a0c0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa833e00640 1 -- 172.21.15.33:0/972090204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834031970 con 0x55869986a0c0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa83b400640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 0x7fa8280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa83b400640 1 -- 172.21.15.33:0/2191729264 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa82c0e6110 con 0x7fa844105ce0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa843400640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 0x7fa8280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 -- 172.21.15.33:0/972090204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 msgr2=0x55869986c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa834009900 tx=0x7fa834004200 comp rx=0 tx=0).stop 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 -- 172.21.15.33:0/972090204 shutdown_connections 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55869986cb00 0x55869986efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x55869986c4b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/972090204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558699867790 0x558699869b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.941+0000 7fa84cc1f740 1 -- 172.21.15.33:0/972090204 >> 172.21.15.33:0/972090204 conn(0x5586998628e0 msgr2=0x558699863670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.942+0000 7fa84cc1f740 1 -- 172.21.15.33:0/972090204 shutdown_connections 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.942+0000 7fa84cc1f740 1 -- 172.21.15.33:0/972090204 wait complete. 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.942+0000 7fa843400640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 0x7fa8280b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa84419bbe0 tx=0x7fa83c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.942+0000 7fa84cc1f740 1 -- start start 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.942+0000 7fa84cc1f740 1 Processor -- start 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699870ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699872130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558699701ab0 con 0x55869986a0c0 2024-09-11T00:05:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558699770570 con 0x558699867790 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55869986fa80 con 0x55869986cb00 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa84cc1f740 10 client.0 _ll_register_callbacks cb 0x55869977f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43328/0 (socket says 172.21.15.33:43328) 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 -- 172.21.15.33:0/38716924 learned_addr learned my addr 172.21.15.33:0/38716924 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa842a00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699870ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 -- 172.21.15.33:0/38716924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 msgr2=0x558699872130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699872130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 -- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 msgr2=0x558699870ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699870ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa83be00640 1 -- 172.21.15.33:0/38716924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869952b790 con 0x55869986a0c0 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.943+0000 7fa842a00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699870ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa83be00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ac460 tx=0x7fa82c0abe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81b8c5db0ce2bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa830c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0acbd0 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa82c0a6bd0 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa834040070 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa82c0ac4d0 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa84cc1f740 10 client.16431 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586995a4620 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.944+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa834040070 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa82c093070 con 0x55869986a0c0 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 10 client.16431 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 20 client.16431 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55869987c7d0 0x55869987ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 4 client.16431 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586997dc600 con 0x55869987c7d0 2024-09-11T00:05:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.945+0000 7fa842a00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55869987c7d0 0x55869987ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.946+0000 7fa842a00640 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55869987c7d0 0x55869987ec50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899ca9c2f22a3411 server_cookie=47f72306c45dc3cb in_seq=0 out_seq=0 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.946+0000 7fa830c00640 10 client.16431 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa830c00640 1 -- 172.21.15.33:0/38716924 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586997dc600 con 0x55869987c7d0 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa830c00640 10 client.16431 handle_command_reply: tid=0 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 client.16431 shutdown 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 msgr2=0x558699871560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ac460 tx=0x7fa82c0abe20 comp rx=0 tx=0).stop 2024-09-11T00:05:33.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 shutdown_connections 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55869987c7d0 0x55869987ec50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699872130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699871560 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/38716924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699870ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.947+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 >> 172.21.15.33:0/38716924 conn(0x5586998628e0 msgr2=0x558699861a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.948+0000 7fa830c00640 0 client.16431 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.948+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 shutdown_connections 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.948+0000 7fa84cc1f740 1 -- 172.21.15.33:0/38716924 wait complete. 2024-09-11T00:05:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.948+0000 7fa84cc1f740 20 client.16431 trim_cache size 0 max 16384 2024-09-11T00:05:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 Processor -- start 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 -- start start 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x55869986cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986a0c0 0x55869986d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441aff80 con 0x55869986cb00 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ad850 con 0x558699867790 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ab6a0 con 0x55869986a0c0 2024-09-11T00:05:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa843400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa843400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43340/0 (socket says 172.21.15.33:43340) 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.964+0000 7fa843400640 1 -- 172.21.15.33:0/1534597888 learned_addr learned my addr 172.21.15.33:0/1534597888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa83be00640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986a0c0 0x55869986d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa842a00640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x55869986cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 -- 172.21.15.33:0/1534597888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986a0c0 msgr2=0x55869986d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986a0c0 0x55869986d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 -- 172.21.15.33:0/1534597888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 msgr2=0x55869986cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x55869986cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 -- 172.21.15.33:0/1534597888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558699869ef0 con 0x55869986cb00 2024-09-11T00:05:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa842a00640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x55869986cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa843400640 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa83c011730 tx=0x7fa83c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39354d0e4fd76fac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa833400640 1 -- 172.21.15.33:0/1534597888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02b070 con 0x55869986cb00 2024-09-11T00:05:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa833400640 1 -- 172.21.15.33:0/1534597888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c01ea50 con 0x55869986cb00 2024-09-11T00:05:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.965+0000 7fa833400640 1 -- 172.21.15.33:0/1534597888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c01cb90 con 0x55869986cb00 2024-09-11T00:05:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1534597888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 msgr2=0x558699864710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa83c011730 tx=0x7fa83c015040 comp rx=0 tx=0).stop 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1534597888 shutdown_connections 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986cb00 0x558699864710 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986a0c0 0x55869986d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1534597888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x55869986cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1534597888 >> 172.21.15.33:0/1534597888 conn(0x5586998628e0 msgr2=0x558699863140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1534597888 shutdown_connections 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.966+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1534597888 wait complete. 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 -- start start 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 Processor -- start 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699878c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699878160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441abd10 con 0x55869986a0c0 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ad180 con 0x558699867790 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ac3e0 con 0x55869986cb00 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa84cc1f740 10 client.0 _ll_register_callbacks cb 0x7fa82c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa83be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43350/0 (socket says 172.21.15.33:43350) 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.967+0000 7fa83be00640 1 -- 172.21.15.33:0/1426945522 learned_addr learned my addr 172.21.15.33:0/1426945522 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa842a00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699878c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa843400640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699878160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 -- 172.21.15.33:0/1426945522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 msgr2=0x558699878160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699878160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 -- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 msgr2=0x558699878c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699878c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 -- 172.21.15.33:0/1426945522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586998764c0 con 0x55869986a0c0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa842a00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699878c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa83be00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ec040 tx=0x7fa82c00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd9cd5e61101a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa830c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0d31a0 con 0x55869986a0c0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa82c0e9170 con 0x55869986a0c0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.968+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83c01ea50 con 0x55869986a0c0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa82c095080 con 0x55869986a0c0 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 10 client.16437 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586998e99e0 con 0x55869986a0c0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa83c01ea50 con 0x55869986a0c0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa82c093040 con 0x55869986a0c0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 10 client.16437 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 20 client.16437 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5586998ea3c0 0x5586998ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 4 client.16437 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.969+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5586997d80b0 con 0x5586998ea3c0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.970+0000 7fa842a00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5586998ea3c0 0x5586998ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.970+0000 7fa842a00640 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5586998ea3c0 0x5586998ec7e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbdbe5fe7479aaa server_cookie=7d7a86f9f87ebb38 in_seq=0 out_seq=0 2024-09-11T00:05:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.970+0000 7fa830c00640 10 client.16437 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa830c00640 1 -- 172.21.15.33:0/1426945522 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5586997d80b0 con 0x5586998ea3c0 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa830c00640 10 client.16437 handle_command_reply: tid=0 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 client.16437 shutdown 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 msgr2=0x558699877ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0ec040 tx=0x7fa82c00f9a0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 shutdown_connections 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5586998ea3c0 0x5586998ec7e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55869986cb00 0x558699878160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55869986a0c0 0x558699877ab0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 --2- 172.21.15.33:0/1426945522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558699867790 0x558699878c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 >> 172.21.15.33:0/1426945522 conn(0x5586998628e0 msgr2=0x558699866880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa830c00640 0 client.16437 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 shutdown_connections 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 1 -- 172.21.15.33:0/1426945522 wait complete. 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.984+0000 7fa84cc1f740 20 client.16437 trim_cache size 0 max 16384 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:05:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 msgr2=0x7fa8280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 0x7fa8280b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa84419bbe0 tx=0x7fa83c009800 comp rx=0 tx=0).stop 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 msgr2=0x7fa84419b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c920 tx=0x7fa82c00cde0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 shutdown_connections 2024-09-11T00:05:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8280b5360 0x7fa8280b7820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8441066a0 0x7fa84419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa844105ce0 0x7fa84419b4b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 --2- 172.21.15.33:0/2191729264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa844104b90 0x7fa84419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 >> 172.21.15.33:0/2191729264 conn(0x7fa844100470 msgr2=0x7fa8441090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 shutdown_connections 2024-09-11T00:05:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:33.985+0000 7fa849c00640 1 -- 172.21.15.33:0/2191729264 wait complete. 2024-09-11T00:05:34.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:34 smithi052 ceph-mon[33526]: pgmap v700: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 613 KiB/s wr, 75 op/s 2024-09-11T00:05:35.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:34 smithi033 ceph-mon[30593]: pgmap v700: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 613 KiB/s wr, 75 op/s 2024-09-11T00:05:35.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:34 smithi189 ceph-mon[34000]: pgmap v700: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 613 KiB/s wr, 75 op/s 2024-09-11T00:05:36.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:36 smithi189 ceph-mon[34000]: pgmap v701: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 188 KiB/s wr, 30 op/s 2024-09-11T00:05:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:36 smithi052 ceph-mon[33526]: pgmap v701: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 188 KiB/s wr, 30 op/s 2024-09-11T00:05:37.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:36 smithi033 ceph-mon[30593]: pgmap v701: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 188 KiB/s wr, 30 op/s 2024-09-11T00:05:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:05:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:38 smithi052 ceph-mon[33526]: pgmap v702: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 33 op/s 2024-09-11T00:05:39.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:38 smithi033 ceph-mon[30593]: pgmap v702: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 33 op/s 2024-09-11T00:05:39.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:38 smithi189 ceph-mon[34000]: pgmap v702: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 33 op/s 2024-09-11T00:05:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:40 smithi052 ceph-mon[33526]: pgmap v703: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 206 KiB/s wr, 33 op/s 2024-09-11T00:05:41.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:40 smithi033 ceph-mon[30593]: pgmap v703: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 206 KiB/s wr, 33 op/s 2024-09-11T00:05:41.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:40 smithi189 ceph-mon[34000]: pgmap v703: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 206 KiB/s wr, 33 op/s 2024-09-11T00:05:41.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:05:41.609 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:42.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 -- 172.21.15.33:0/2783567339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 msgr2=0x7f6e30108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:42.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 --2- 172.21.15.33:0/2783567339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e30108c10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009900 tx=0x7f6e1802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 -- 172.21.15.33:0/2783567339 shutdown_connections 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 --2- 172.21.15.33:0/2783567339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 0x7f6e3010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 --2- 172.21.15.33:0/2783567339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e30108c10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 --2- 172.21.15.33:0/2783567339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 0x7f6e301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.201+0000 7f6e34c00640 1 -- 172.21.15.33:0/2783567339 >> 172.21.15.33:0/2783567339 conn(0x7f6e300fe830 msgr2=0x7f6e30100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.202+0000 7f6e34c00640 1 -- 172.21.15.33:0/2783567339 shutdown_connections 2024-09-11T00:05:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.202+0000 7f6e34c00640 1 -- 172.21.15.33:0/2783567339 wait complete. 2024-09-11T00:05:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.202+0000 7f6e34c00640 1 Processor -- start 2024-09-11T00:05:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 -- start start 2024-09-11T00:05:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 0x7f6e300754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 0x7f6e30075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30112ca0 con 0x7f6e301087d0 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30112b20 con 0x7f6e30109150 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e34c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30112e20 con 0x7f6e30102dc0 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e25400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e25400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45508/0 (socket says 172.21.15.33:45508) 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e25400640 1 -- 172.21.15.33:0/3227741682 learned_addr learned my addr 172.21.15.33:0/3227741682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.203+0000 7f6e2e800640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 0x7f6e30075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e2de00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 0x7f6e300754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 -- 172.21.15.33:0/3227741682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 msgr2=0x7f6e300754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 0x7f6e300754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 -- 172.21.15.33:0/3227741682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 msgr2=0x7f6e30075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 0x7f6e30075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 -- 172.21.15.33:0/3227741682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e301a7580 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.204+0000 7f6e25400640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6e1802a910 tx=0x7f6e18003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.205+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1803f070 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.205+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e301a7810 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.205+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e18003e40 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.205+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18035030 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.205+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e301a7d40 con 0x7f6e301087d0 2024-09-11T00:05:42.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.206+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e301031a0 con 0x7f6e301087d0 2024-09-11T00:05:42.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.208+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6e18031400 con 0x7f6e301087d0 2024-09-11T00:05:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.210+0000 7f6e27400640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 0x7f6e140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.210+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6e18106d70 con 0x7f6e301087d0 2024-09-11T00:05:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.210+0000 7f6e2de00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 0x7f6e140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:42.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.211+0000 7f6e2de00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 0x7f6e140b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bbe0 tx=0x7f6e2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:42.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.211+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6e180cd1e0 con 0x7f6e301087d0 2024-09-11T00:05:42.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.449+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e3010af90 con 0x7f6e301087d0 2024-09-11T00:05:42.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.450+0000 7f6e27400640 1 -- 172.21.15.33:0/3227741682 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f6e180d1c10 con 0x7f6e301087d0 2024-09-11T00:05:42.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:05:42.452 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:05:42.452 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:05:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 msgr2=0x7f6e140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 0x7f6e140b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bbe0 tx=0x7f6e2000b390 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 msgr2=0x7f6e300759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6e1802a910 tx=0x7f6e18003c20 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 shutdown_connections 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e140b5360 0x7f6e140b7820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e30109150 0x7f6e30075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e301087d0 0x7f6e300759e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 --2- 172.21.15.33:0/3227741682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e30102dc0 0x7f6e300754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 >> 172.21.15.33:0/3227741682 conn(0x7f6e300fe830 msgr2=0x7f6e30100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 shutdown_connections 2024-09-11T00:05:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:42.453+0000 7f6e34c00640 1 -- 172.21.15.33:0/3227741682 wait complete. 2024-09-11T00:05:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:42 smithi033 ceph-mon[30593]: pgmap v704: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 KiB/s wr, 34 op/s 2024-09-11T00:05:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3227741682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:42 smithi052 ceph-mon[33526]: pgmap v704: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 KiB/s wr, 34 op/s 2024-09-11T00:05:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:42 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3227741682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:43.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:42 smithi189 ceph-mon[34000]: pgmap v704: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 KiB/s wr, 34 op/s 2024-09-11T00:05:43.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:42 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3227741682' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:05:43.207 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id 97bcea04 --release --await' 2024-09-11T00:05:43.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id 97bcea04 --release --await 2024-09-11T00:05:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:05:43.589 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:05:44.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 -- 172.21.15.33:0/1313877841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad810a9b0 msgr2=0x7f1ad810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 --2- 172.21.15.33:0/1313877841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad810a9b0 0x7f1ad810adf0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009900 tx=0x7f1ac002a410 comp rx=0 tx=0).stop 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 -- 172.21.15.33:0/1313877841 shutdown_connections 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 --2- 172.21.15.33:0/1313877841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 0x7f1ad8111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 --2- 172.21.15.33:0/1313877841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad810a9b0 0x7f1ad810adf0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 --2- 172.21.15.33:0/1313877841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad8104fa0 0x7f1ad8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 -- 172.21.15.33:0/1313877841 >> 172.21.15.33:0/1313877841 conn(0x7f1ad8100a50 msgr2=0x7f1ad8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 -- 172.21.15.33:0/1313877841 shutdown_connections 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.191+0000 7f1adf000640 1 -- 172.21.15.33:0/1313877841 wait complete. 2024-09-11T00:05:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.192+0000 7f1adf000640 1 Processor -- start 2024-09-11T00:05:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.192+0000 7f1adf000640 1 -- start start 2024-09-11T00:05:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad810a9b0 0x7f1ad819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 0x7f1ad81a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8114de0 con 0x7f1ad8104fa0 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8114c60 con 0x7f1ad810a9b0 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1adf000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8114f60 con 0x7f1ad810b330 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1ad7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1ad7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45514/0 (socket says 172.21.15.33:45514) 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1ad7e00640 1 -- 172.21.15.33:0/1852223960 learned_addr learned my addr 172.21.15.33:0/1852223960 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1add000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 0x7f1ad81a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.193+0000 7f1ad7400640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad810a9b0 0x7f1ad819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 -- 172.21.15.33:0/1852223960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 msgr2=0x7f1ad81a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 0x7f1ad81a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 -- 172.21.15.33:0/1852223960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad810a9b0 msgr2=0x7f1ad819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad810a9b0 0x7f1ad819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 -- 172.21.15.33:0/1852223960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad81a1440 con 0x7f1ad8104fa0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebc0 tx=0x7f1ac800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad4c00640 1 -- 172.21.15.33:0/1852223960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8010630 con 0x7f1ad8104fa0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad81a1730 con 0x7f1ad8104fa0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1ad4c00640 1 -- 172.21.15.33:0/1852223960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ac8010c60 con 0x7f1ad8104fa0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.194+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad81a7df0 con 0x7f1ad8104fa0 2024-09-11T00:05:44.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.195+0000 7f1ad4c00640 1 -- 172.21.15.33:0/1852223960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8018aa0 con 0x7f1ad8104fa0 2024-09-11T00:05:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 Processor -- start 2024-09-11T00:05:44.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 -- start start 2024-09-11T00:05:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ad4c00640 1 -- 172.21.15.33:0/1852223960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1ac8018c40 con 0x7f1ad8104fa0 2024-09-11T00:05:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642cb910 0x5614642d7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561464242290 con 0x5614642caff0 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5614642316c0 con 0x5614642cb910 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614642354d0 con 0x5614642d78a0 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1add000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1add000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45526/0 (socket says 172.21.15.33:45526) 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1add000640 1 -- 172.21.15.33:0/3684956229 learned_addr learned my addr 172.21.15.33:0/3684956229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.198+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642cb910 0x5614642d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1ad7400640 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 -- 172.21.15.33:0/3684956229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 msgr2=0x5614642d9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642d9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 -- 172.21.15.33:0/3684956229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642cb910 msgr2=0x5614642d7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642cb910 0x5614642d7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 -- 172.21.15.33:0/3684956229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614641be460 con 0x5614642caff0 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.199+0000 7f1add000640 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000bca0 tx=0x7f1ad000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034a6aea086dfff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1acd600640 1 -- 172.21.15.33:0/3684956229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0015070 con 0x5614642caff0 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1acd600640 1 -- 172.21.15.33:0/3684956229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ad001a8f0 con 0x5614642caff0 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1acd600640 1 -- 172.21.15.33:0/3684956229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00117e0 con 0x5614642caff0 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ad4c00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 0x7f1abc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 -- 172.21.15.33:0/3684956229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 msgr2=0x5614642cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000bca0 tx=0x7f1ad000f730 comp rx=0 tx=0).stop 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 -- 172.21.15.33:0/3684956229 shutdown_connections 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642d9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642cb910 0x5614642d7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/3684956229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642cb3d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ae1c63740 1 -- 172.21.15.33:0/3684956229 >> 172.21.15.33:0/3684956229 conn(0x5614642c8e20 msgr2=0x5614642c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.200+0000 7f1ad4c00640 1 -- 172.21.15.33:0/1852223960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1ac80e66d0 con 0x7f1ad8104fa0 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 0x7f1abc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ae1c63740 1 -- 172.21.15.33:0/3684956229 shutdown_connections 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ae1c63740 1 -- 172.21.15.33:0/3684956229 wait complete. 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ae1c63740 1 -- start start 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ad7e00640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 0x7f1abc0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80e6970 tx=0x7f1ac80ec530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.201+0000 7f1ae1c63740 1 Processor -- start 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642caff0 0x5614642d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561464092bb0 con 0x5614642cb910 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5614641cc6c0 con 0x5614642d78a0 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614642da550 con 0x5614642caff0 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ae1c63740 10 client.0 _ll_register_callbacks cb 0x5614641e7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:44.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45528/0 (socket says 172.21.15.33:45528) 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.202+0000 7f1ad7400640 1 -- 172.21.15.33:0/808487010 learned_addr learned my addr 172.21.15.33:0/808487010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1add000640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642caff0 0x5614642d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1add000640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 -- 172.21.15.33:0/808487010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642caff0 msgr2=0x5614642d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642caff0 0x5614642d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 -- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 msgr2=0x5614642d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642d5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 -- 172.21.15.33:0/808487010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561463f8fb00 con 0x5614642cb910 2024-09-11T00:05:44.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ad7400640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002a930 tx=0x7f1ac0031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bf1d956963d0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ac6000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.203+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0035040 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1ac0004240 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad001a8f0 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1ac0004440 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 10 client.16455 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561464006960 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ad001a8f0 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1ac00049c0 con 0x5614642cb910 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:44.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 10 client.16455 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 20 client.16455 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5614642e7470 0x5614642e9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 4 client.16455 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.204+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614642441e0 con 0x5614642e7470 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.205+0000 7f1add000640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5614642e7470 0x5614642e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.206+0000 7f1add000640 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5614642e7470 0x5614642e9890 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b444a997bea4940a server_cookie=7cdd85e1738ce002 in_seq=0 out_seq=0 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.206+0000 7f1ac6000640 10 client.16455 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ac6000640 1 -- 172.21.15.33:0/808487010 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614642441e0 con 0x5614642e7470 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ac6000640 10 client.16455 handle_command_reply: tid=0 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 client.16455 shutdown 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 msgr2=0x5614642d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002a930 tx=0x7f1ac0031630 comp rx=0 tx=0).stop 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 shutdown_connections 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642d4dd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5614642e7470 0x5614642e9890 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/808487010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642caff0 0x5614642d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ac6000640 0 client.16455 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 >> 172.21.15.33:0/808487010 conn(0x5614642c8e20 msgr2=0x5614642ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 shutdown_connections 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 1 -- 172.21.15.33:0/808487010 wait complete. 2024-09-11T00:05:44.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.207+0000 7f1ae1c63740 20 client.16455 trim_cache size 0 max 16384 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 Processor -- start 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 -- start start 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 0x5614642d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642ef160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81b45a0 con 0x5614642caff0 2024-09-11T00:05:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81b1e70 con 0x5614642d78a0 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.225+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81afcc0 con 0x5614642cb910 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1add000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1add000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45532/0 (socket says 172.21.15.33:45532) 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1add000640 1 -- 172.21.15.33:0/317649597 learned_addr learned my addr 172.21.15.33:0/317649597 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 0x5614642d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1add000640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 -- 172.21.15.33:0/317649597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 msgr2=0x5614642ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642ef160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 -- 172.21.15.33:0/317649597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 msgr2=0x5614642d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1ad7400640 1 -- 172.21.15.33:0/317649597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614642cb740 con 0x5614642cb910 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.226+0000 7f1add000640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:44.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.227+0000 7f1ad7400640 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 0x5614642d1fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0004f20 tx=0x7f1ac0005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3f651b8f12a9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.227+0000 7f1accc00640 1 -- 172.21.15.33:0/317649597 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0035070 con 0x5614642cb910 2024-09-11T00:05:44.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.227+0000 7f1accc00640 1 -- 172.21.15.33:0/317649597 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ac00318e0 con 0x5614642cb910 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.227+0000 7f1accc00640 1 -- 172.21.15.33:0/317649597 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0005220 con 0x5614642cb910 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- 172.21.15.33:0/317649597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 msgr2=0x5614642d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 0x5614642d1fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0004f20 tx=0x7f1ac0005d50 comp rx=0 tx=0).stop 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- 172.21.15.33:0/317649597 shutdown_connections 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642d78a0 0x5614642ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642cb910 0x5614642d1fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/317649597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642caff0 0x5614642d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- 172.21.15.33:0/317649597 >> 172.21.15.33:0/317649597 conn(0x5614642c8e20 msgr2=0x5614642c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- 172.21.15.33:0/317649597 shutdown_connections 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- 172.21.15.33:0/317649597 wait complete. 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.228+0000 7f1ae1c63740 1 -- start start 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 Processor -- start 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642caff0 0x5614642dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642dc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81b0330 con 0x5614642cb910 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81b17a0 con 0x5614642caff0 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81b0a00 con 0x5614642d78a0 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ae1c63740 10 client.0 _ll_register_callbacks cb 0x7f1ac0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45538/0 (socket says 172.21.15.33:45538) 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.229+0000 7f1ad7400640 1 -- 172.21.15.33:0/1186861666 learned_addr learned my addr 172.21.15.33:0/1186861666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:44.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1add000640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642caff0 0x5614642dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 -- 172.21.15.33:0/1186861666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 msgr2=0x5614642dc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1add000640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642dc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642dc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 -- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642caff0 msgr2=0x5614642dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642caff0 0x5614642dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 -- 172.21.15.33:0/1186861666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614642dcdf0 con 0x5614642cb910 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1add000640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642dc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ad7400640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0004ea0 tx=0x7f1ac0032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff82e26a55b5ca83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ac6000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0060060 con 0x5614642cb910 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1ac00051a0 con 0x5614642cb910 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.230+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac00318e0 con 0x5614642cb910 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1ac0067050 con 0x5614642cb910 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 10 client.16461 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561464355220 con 0x5614642cb910 2024-09-11T00:05:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ac00318e0 con 0x5614642cb910 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1ac005b480 con 0x5614642cb910 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 10 client.16461 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 10 client.16461 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 20 client.16461 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561464355930 0x561464357d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 4 client.16461 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "97bcea04", "release": true, "await": true}] 2024-09-11T00:05:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.231+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "97bcea04", "release": true, "await": true}) -- 0x56146423fc90 con 0x561464355930 2024-09-11T00:05:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.232+0000 7f1add000640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561464355930 0x561464357d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.232+0000 7f1add000640 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561464355930 0x561464357d50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff340649644545a8 server_cookie=f65e28b2e60f2b97 in_seq=0 out_seq=0 2024-09-11T00:05:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.232+0000 7f1ac6000640 10 client.16461 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:44.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.286+0000 7f1ac6000640 1 -- 172.21.15.33:0/1186861666 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56146423fc90 con 0x561464355930 2024-09-11T00:05:44.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.286+0000 7f1ac6000640 10 client.16461 handle_command_reply: tid=0 2024-09-11T00:05:44.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.286+0000 7f1ae1c63740 1 client.16461 shutdown 2024-09-11T00:05:44.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.286+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 msgr2=0x5614642dc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.286+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0004ea0 tx=0x7f1ac0032fc0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 shutdown_connections 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561464355930 0x561464357d50 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614642d78a0 0x5614642dc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5614642cb910 0x5614642dc270 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 --2- 172.21.15.33:0/1186861666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614642caff0 0x5614642dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ac6000640 0 client.16461 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 >> 172.21.15.33:0/1186861666 conn(0x5614642c8e20 msgr2=0x5614642d5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.287+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 shutdown_connections 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 28, 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "97bcea04": { 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 28, 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:05:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 148.4, 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:44.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.288+0000 7f1ae1c63740 1 -- 172.21.15.33:0/1186861666 wait complete. 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.288+0000 7f1ae1c63740 20 client.16461 trim_cache size 0 max 16384 2024-09-11T00:05:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.289+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 msgr2=0x7f1abc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.289+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 0x7f1abc0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80e6970 tx=0x7f1ac80ec530 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.289+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 msgr2=0x7f1ad819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.289+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebc0 tx=0x7f1ac800c6a0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 shutdown_connections 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1abc0b52e0 0x7f1abc0b77a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ad810b330 0x7f1ad81a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ad810a9b0 0x7f1ad819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 --2- 172.21.15.33:0/1852223960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ad8104fa0 0x7f1ad819b390 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 >> 172.21.15.33:0/1852223960 conn(0x7f1ad8100a50 msgr2=0x7f1ad8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 shutdown_connections 2024-09-11T00:05:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:05:44.290+0000 7f1adf000640 1 -- 172.21.15.33:0/1852223960 wait complete. 2024-09-11T00:05:44.853 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:44 smithi033 ceph-mon[30593]: pgmap v705: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 238 KiB/s wr, 38 op/s 2024-09-11T00:05:44.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:44 smithi052 ceph-mon[33526]: pgmap v705: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 238 KiB/s wr, 38 op/s 2024-09-11T00:05:45.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:44 smithi189 ceph-mon[34000]: pgmap v705: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 238 KiB/s wr, 38 op/s 2024-09-11T00:05:45.327 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '97bcea04', total seconds elapsed: 32.5 2024-09-11T00:05:46.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:46 smithi052 ceph-mon[33526]: pgmap v706: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 189 KiB/s wr, 31 op/s 2024-09-11T00:05:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:46 smithi033 ceph-mon[30593]: pgmap v706: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 189 KiB/s wr, 31 op/s 2024-09-11T00:05:47.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:46 smithi189 ceph-mon[34000]: pgmap v706: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 189 KiB/s wr, 31 op/s 2024-09-11T00:05:47.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 -- 172.21.15.33:0/2726430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac1058f0 msgr2=0x7f96ac107d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 --2- 172.21.15.33:0/2726430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac1058f0 0x7f96ac107d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9698009900 tx=0x7f969802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 -- 172.21.15.33:0/2726430578 shutdown_connections 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 --2- 172.21.15.33:0/2726430578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 0x7f96ac10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 --2- 172.21.15.33:0/2726430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac1058f0 0x7f96ac107d60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 --2- 172.21.15.33:0/2726430578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac06b470 0x7f96ac105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 -- 172.21.15.33:0/2726430578 >> 172.21.15.33:0/2726430578 conn(0x7f96ac0fcf30 msgr2=0x7f96ac0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 -- 172.21.15.33:0/2726430578 shutdown_connections 2024-09-11T00:05:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.209+0000 7f96b1c00640 1 -- 172.21.15.33:0/2726430578 wait complete. 2024-09-11T00:05:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.211+0000 7f96b1c00640 1 Processor -- start 2024-09-11T00:05:47.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.211+0000 7f96b1c00640 1 -- start start 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 0x7f96ac19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1018a0 con 0x7f96ac1084a0 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac101720 con 0x7f96ac06b470 2024-09-11T00:05:47.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96b1c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac101a20 con 0x7f96ac1058f0 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.212+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34152/0 (socket says 172.21.15.33:34152) 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54426/0 (socket says 172.21.15.33:54426) 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96ab400640 1 -- 172.21.15.33:0/660894740 learned_addr learned my addr 172.21.15.33:0/660894740 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:47.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96b1200640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 0x7f96ac19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96abe00640 1 -- 172.21.15.33:0/660894740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 msgr2=0x7f96ac19b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96abe00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96abe00640 1 -- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 msgr2=0x7f96ac19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.213+0000 7f96abe00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 0x7f96ac19bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.214+0000 7f96abe00640 1 -- 172.21.15.33:0/660894740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac19c820 con 0x7f96ac06b470 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.214+0000 7f96ab400640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:47.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.214+0000 7f96abe00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f969c00e9f0 tx=0x7f969c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.215+0000 7f96a8c00640 1 -- 172.21.15.33:0/660894740 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c00ccc0 con 0x7f96ac06b470 2024-09-11T00:05:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.215+0000 7f96a8c00640 1 -- 172.21.15.33:0/660894740 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f969c005020 con 0x7f96ac06b470 2024-09-11T00:05:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.215+0000 7f96a8c00640 1 -- 172.21.15.33:0/660894740 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c004a00 con 0x7f96ac06b470 2024-09-11T00:05:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.215+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac19cb10 con 0x7f96ac06b470 2024-09-11T00:05:47.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.215+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac1a31e0 con 0x7f96ac06b470 2024-09-11T00:05:47.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.220+0000 7f96b6017740 1 Processor -- start 2024-09-11T00:05:47.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.221+0000 7f96b6017740 1 -- start start 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c21570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c23ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd06b896b0 con 0x55fd06c1f180 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fd06b78ae0 con 0x55fd06c21ab0 2024-09-11T00:05:47.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96b6017740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd06b7c8f0 con 0x55fd06c244f0 2024-09-11T00:05:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96a8c00640 1 -- 172.21.15.33:0/660894740 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f969c004ba0 con 0x7f96ac06b470 2024-09-11T00:05:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.224 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34168/0 (socket says 172.21.15.33:34168) 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.222+0000 7f96ab400640 1 -- 172.21.15.33:0/543300937 learned_addr learned my addr 172.21.15.33:0/543300937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96abe00640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c23ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96b1200640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c21570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96ab400640 1 -- 172.21.15.33:0/543300937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 msgr2=0x55fd06c23ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96ab400640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c23ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96ab400640 1 -- 172.21.15.33:0/543300937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 msgr2=0x55fd06c21570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96ab400640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c21570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96ab400640 1 -- 172.21.15.33:0/543300937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd06b45780 con 0x55fd06c244f0 2024-09-11T00:05:47.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.223+0000 7f96b1200640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c21570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:05:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.224+0000 7f96ab400640 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96980057c0 tx=0x7f9698005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76248dd25b2577c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.224+0000 7f96a1600640 1 -- 172.21.15.33:0/543300937 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698035030 con 0x55fd06c244f0 2024-09-11T00:05:47.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.224+0000 7f96a1600640 1 -- 172.21.15.33:0/543300937 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9698040070 con 0x55fd06c244f0 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.224+0000 7f96a1600640 1 -- 172.21.15.33:0/543300937 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698031b20 con 0x55fd06c244f0 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.224+0000 7f96a8c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 0x7f96900b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.225+0000 7f96a8c00640 1 -- 172.21.15.33:0/660894740 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f969c0e5eb0 con 0x7f96ac06b470 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.225+0000 7f96b1200640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 0x7f96900b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.225+0000 7f96b6017740 1 -- 172.21.15.33:0/543300937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 msgr2=0x55fd06c269b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.225+0000 7f96b6017740 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f96980057c0 tx=0x7f9698005c00 comp rx=0 tx=0).stop 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 -- 172.21.15.33:0/543300937 shutdown_connections 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c244f0 0x55fd06c269b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c23ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 --2- 172.21.15.33:0/543300937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c21570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 -- 172.21.15.33:0/543300937 >> 172.21.15.33:0/543300937 conn(0x55fd06c11ac0 msgr2=0x55fd06c12850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 -- 172.21.15.33:0/543300937 shutdown_connections 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b6017740 1 -- 172.21.15.33:0/543300937 wait complete. 2024-09-11T00:05:47.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.226+0000 7f96b1200640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 0x7f96900b7970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f96ac19ba60 tx=0x7f96a4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.227+0000 7f96b6017740 1 -- start start 2024-09-11T00:05:47.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 Processor -- start 2024-09-11T00:05:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c28f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c244f0 0x55fd06c29ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd06ab0ab0 con 0x55fd06c244f0 2024-09-11T00:05:47.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fd06b1f570 con 0x55fd06c21ab0 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd06c27470 con 0x55fd06c1f180 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.228+0000 7f96b6017740 10 client.0 _ll_register_callbacks cb 0x55fd06b2e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.229+0000 7f96ab400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.229+0000 7f96abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.229+0000 7f96abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34182/0 (socket says 172.21.15.33:34182) 2024-09-11T00:05:47.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.229+0000 7f96abe00640 1 -- 172.21.15.33:0/3839417325 learned_addr learned my addr 172.21.15.33:0/3839417325 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.229+0000 7f96b1200640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c244f0 0x55fd06c29ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 -- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 msgr2=0x55fd06c28f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c28f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 -- 172.21.15.33:0/3839417325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c244f0 msgr2=0x55fd06c29ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c244f0 0x55fd06c29ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 -- 172.21.15.33:0/3839417325 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd068da790 con 0x55fd06c1f180 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.230+0000 7f96abe00640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f969c009230 tx=0x7f969c0a89f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d23767fd1e5899b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.231+0000 7f9696000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:05:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.231+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c01c040 con 0x55fd06c1f180 2024-09-11T00:05:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.231+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f969c0cf070 con 0x55fd06c1f180 2024-09-11T00:05:47.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.231+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9698040070 con 0x55fd06c1f180 2024-09-11T00:05:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.232+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f969c0ab9e0 con 0x55fd06c1f180 2024-09-11T00:05:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.232+0000 7f96b6017740 10 client.26218 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.232+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fd06953620 con 0x55fd06c1f180 2024-09-11T00:05:47.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.232+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9698040070 con 0x55fd06c1f180 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f969c0b5370 con 0x55fd06c1f180 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 10 client.26218 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 10 client.26218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 20 client.26218 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c34120 0x55fd06c36510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 4 client.26218 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd06b8b600 con 0x55fd06c34120 2024-09-11T00:05:47.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.233+0000 7f96ab400640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c34120 0x55fd06c36510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.235+0000 7f96ab400640 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c34120 0x55fd06c36510 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6632831163ad46fc server_cookie=bb7ec80e93084eda in_seq=0 out_seq=0 2024-09-11T00:05:47.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.235+0000 7f9696000640 10 client.26218 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.235+0000 7f9696000640 1 -- 172.21.15.33:0/3839417325 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd06b8b600 con 0x55fd06c34120 2024-09-11T00:05:47.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.235+0000 7f9696000640 10 client.26218 handle_command_reply: tid=0 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 client.26218 shutdown 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 msgr2=0x55fd06c288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f969c009230 tx=0x7f969c0a89f0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 shutdown_connections 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c244f0 0x55fd06c29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c21ab0 0x55fd06c28f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c34120 0x55fd06c36510 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 --2- 172.21.15.33:0/3839417325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c288c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 >> 172.21.15.33:0/3839417325 conn(0x55fd06c11ac0 msgr2=0x55fd06c10bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.236+0000 7f9696000640 0 client.26218 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.237+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 shutdown_connections 2024-09-11T00:05:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.237+0000 7f96b6017740 1 -- 172.21.15.33:0/3839417325 wait complete. 2024-09-11T00:05:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.238+0000 7f96b6017740 20 client.26218 trim_cache size 0 max 16384 2024-09-11T00:05:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.269+0000 7f96b6017740 1 Processor -- start 2024-09-11T00:05:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.269+0000 7f96b6017740 1 -- start start 2024-09-11T00:05:47.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c21ab0 0x55fd06c15e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c163d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1ab9a0 con 0x55fd06c21ab0 2024-09-11T00:05:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1a9270 con 0x55fd06c244f0 2024-09-11T00:05:47.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.270+0000 7f96b6017740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1a7120 con 0x55fd06c1f180 2024-09-11T00:05:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.271+0000 7f96abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.271+0000 7f96abe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34190/0 (socket says 172.21.15.33:34190) 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.271+0000 7f96abe00640 1 -- 172.21.15.33:0/1210617650 learned_addr learned my addr 172.21.15.33:0/1210617650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.271+0000 7f96b1200640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.271+0000 7f96ab400640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c21ab0 0x55fd06c15e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96abe00640 1 -- 172.21.15.33:0/1210617650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 msgr2=0x55fd06c163d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96abe00640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c163d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96abe00640 1 -- 172.21.15.33:0/1210617650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c21ab0 msgr2=0x55fd06c15e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:05:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96abe00640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c21ab0 0x55fd06c15e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96abe00640 1 -- 172.21.15.33:0/1210617650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd06c283c0 con 0x55fd06c1f180 2024-09-11T00:05:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.272+0000 7f96b1200640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.273+0000 7f96abe00640 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f969c0a8840 tx=0x7f969c0b5730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f152c6d51db41b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.274+0000 7f96a0c00640 1 -- 172.21.15.33:0/1210617650 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0c6070 con 0x55fd06c1f180 2024-09-11T00:05:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.275+0000 7f96a0c00640 1 -- 172.21.15.33:0/1210617650 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f969c0abd80 con 0x55fd06c1f180 2024-09-11T00:05:47.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.275+0000 7f96a0c00640 1 -- 172.21.15.33:0/1210617650 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c01c070 con 0x55fd06c1f180 2024-09-11T00:05:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 -- 172.21.15.33:0/1210617650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 msgr2=0x55fd06c12560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f969c0a8840 tx=0x7f969c0b5730 comp rx=0 tx=0).stop 2024-09-11T00:05:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 -- 172.21.15.33:0/1210617650 shutdown_connections 2024-09-11T00:05:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c21ab0 0x55fd06c15e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 --2- 172.21.15.33:0/1210617650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c1f180 0x55fd06c12560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.276+0000 7f96b6017740 1 -- 172.21.15.33:0/1210617650 >> 172.21.15.33:0/1210617650 conn(0x55fd06c11ac0 msgr2=0x55fd06c0cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.277+0000 7f96b6017740 1 -- 172.21.15.33:0/1210617650 shutdown_connections 2024-09-11T00:05:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.277+0000 7f96b6017740 1 -- 172.21.15.33:0/1210617650 wait complete. 2024-09-11T00:05:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.277+0000 7f96b6017740 1 -- start start 2024-09-11T00:05:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.277+0000 7f96b6017740 1 Processor -- start 2024-09-11T00:05:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c2d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c2e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1a7770 con 0x55fd06c1f180 2024-09-11T00:05:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1a8ba0 con 0x55fd06c244f0 2024-09-11T00:05:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac1a7e00 con 0x55fd06c21ab0 2024-09-11T00:05:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96b6017740 10 client.0 _ll_register_callbacks cb 0x7f969c005b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:05:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96ab400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:34202/0 (socket says 172.21.15.33:34202) 2024-09-11T00:05:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.279+0000 7f96ab400640 1 -- 172.21.15.33:0/2515960540 learned_addr learned my addr 172.21.15.33:0/2515960540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:05:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.280+0000 7f96ab400640 1 -- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 msgr2=0x55fd06c2e810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:05:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.280+0000 7f96ab400640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c2e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.280+0000 7f96ab400640 1 -- 172.21.15.33:0/2515960540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 msgr2=0x55fd06c2d5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.281+0000 7f96abe00640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c2d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.281+0000 7f96ab400640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c2d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.281+0000 7f96ab400640 1 -- 172.21.15.33:0/2515960540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd06c27870 con 0x55fd06c21ab0 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.281+0000 7f96abe00640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c2d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.282+0000 7f96ab400640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9698005dc0 tx=0x7f9698009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f8c0b41883ecb90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.282+0000 7f9696000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:05:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.282+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969805c060 con 0x55fd06c21ab0 2024-09-11T00:05:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.283+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9698031700 con 0x55fd06c21ab0 2024-09-11T00:05:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.283+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f969c0abd80 con 0x55fd06c21ab0 2024-09-11T00:05:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.283+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9698035040 con 0x55fd06c21ab0 2024-09-11T00:05:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.284+0000 7f96b6017740 10 client.26224 fetch_fsmap learned FSMap version 30 2024-09-11T00:05:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.284+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fd06c30290 con 0x55fd06c21ab0 2024-09-11T00:05:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.284+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f969c0abd80 con 0x55fd06c21ab0 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.284+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f969804e070 con 0x55fd06c21ab0 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 10 client.26224 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 10 client.26224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 20 client.26224 populate_metadata read hostname 'smithi033' 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c30790 0x55fd06ca3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 4 client.26224 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd06b870b0 con 0x55fd06c30790 2024-09-11T00:05:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.285+0000 7f96abe00640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c30790 0x55fd06ca3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.287+0000 7f9696000640 10 client.26224 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.287+0000 7f96abe00640 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c30790 0x55fd06ca3010 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ceb0ccc437fceef server_cookie=10257e9bdaa0bf4f in_seq=0 out_seq=0 2024-09-11T00:05:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.340+0000 7f9696000640 1 -- 172.21.15.33:0/2515960540 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd06b870b0 con 0x55fd06c30790 2024-09-11T00:05:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.340+0000 7f9696000640 10 client.26224 handle_command_reply: tid=0 2024-09-11T00:05:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.340+0000 7f96b6017740 1 client.26224 shutdown 2024-09-11T00:05:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.340+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 msgr2=0x55fd06c2dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.340+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9698005dc0 tx=0x7f9698009260 comp rx=0 tx=0).stop 2024-09-11T00:05:47.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 shutdown_connections 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fd06c244f0 0x55fd06c2e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fd06c30790 0x55fd06ca3010 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd06c21ab0 0x55fd06c2dc40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 --2- 172.21.15.33:0/2515960540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd06c1f180 0x55fd06c2d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f9696000640 0 client.26224 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 >> 172.21.15.33:0/2515960540 conn(0x55fd06c11ac0 msgr2=0x55fd06c12560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 shutdown_connections 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.341+0000 7f96b6017740 1 -- 172.21.15.33:0/2515960540 wait complete. 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.342+0000 7f96b6017740 20 client.26224 trim_cache size 0 max 16384 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:05:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:05:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.343+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 msgr2=0x7f96900b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.343+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 0x7f96900b7970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f96ac19ba60 tx=0x7f96a4009500 comp rx=0 tx=0).stop 2024-09-11T00:05:47.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.343+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 msgr2=0x7f96ac19ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.343+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f969c00e9f0 tx=0x7f969c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 shutdown_connections 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96900b54b0 0x7f96900b7970 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ac1084a0 0x7f96ac19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96ac1058f0 0x7f96ac19b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 --2- 172.21.15.33:0/660894740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96ac06b470 0x7f96ac19ace0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:47.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 >> 172.21.15.33:0/660894740 conn(0x7f96ac0fcf30 msgr2=0x7f96ac10a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:47.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 shutdown_connections 2024-09-11T00:05:47.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:05:47.344+0000 7f96b1c00640 1 -- 172.21.15.33:0/660894740 wait complete. 2024-09-11T00:05:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 360.0 s, 559.6 tps, lat 1073.498 ms stddev 4820.024 2024-09-11T00:05:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:48 smithi052 ceph-mon[33526]: pgmap v707: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 974 KiB/s wr, 95 op/s 2024-09-11T00:05:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:48 smithi033 ceph-mon[30593]: pgmap v707: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 974 KiB/s wr, 95 op/s 2024-09-11T00:05:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:48 smithi189 ceph-mon[34000]: pgmap v707: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 974 KiB/s wr, 95 op/s 2024-09-11T00:05:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:50 smithi052 ceph-mon[33526]: pgmap v708: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-11T00:05:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:50 smithi033 ceph-mon[30593]: pgmap v708: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-11T00:05:51.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:50 smithi189 ceph-mon[34000]: pgmap v708: 129 pgs: 129 active+clean; 1.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-09-11T00:05:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:52 smithi052 ceph-mon[33526]: pgmap v709: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 221 op/s 2024-09-11T00:05:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:52 smithi033 ceph-mon[30593]: pgmap v709: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 221 op/s 2024-09-11T00:05:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:52 smithi189 ceph-mon[34000]: pgmap v709: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 221 op/s 2024-09-11T00:05:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 365.0 s, 676.4 tps, lat 147.833 ms stddev 44.651 2024-09-11T00:05:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:54 smithi052 ceph-mon[33526]: pgmap v710: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 430 op/s 2024-09-11T00:05:55.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:54 smithi033 ceph-mon[30593]: pgmap v710: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 430 op/s 2024-09-11T00:05:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:54 smithi189 ceph-mon[34000]: pgmap v710: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 430 op/s 2024-09-11T00:05:56.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:56 smithi052 ceph-mon[33526]: pgmap v711: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T00:05:57.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:56 smithi033 ceph-mon[30593]: pgmap v711: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T00:05:57.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:56 smithi189 ceph-mon[34000]: pgmap v711: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 478 op/s 2024-09-11T00:05:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 370.0 s, 763.4 tps, lat 131.109 ms stddev 38.335 2024-09-11T00:05:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:58 smithi052 ceph-mon[33526]: pgmap v712: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 697 op/s 2024-09-11T00:05:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:58 smithi033 ceph-mon[30593]: pgmap v712: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 697 op/s 2024-09-11T00:05:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:58 smithi189 ceph-mon[34000]: pgmap v712: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 697 op/s 2024-09-11T00:05:59.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:05:59 smithi052 ceph-mon[33526]: pgmap v713: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 733 op/s 2024-09-11T00:06:00.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:05:59 smithi033 ceph-mon[30593]: pgmap v713: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 733 op/s 2024-09-11T00:06:00.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:05:59 smithi189 ceph-mon[34000]: pgmap v713: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 733 op/s 2024-09-11T00:06:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.557+0000 7fcf65a00640 1 -- 172.21.15.33:0/386407243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60075b20 msgr2=0x7fcf60075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 --2- 172.21.15.33:0/386407243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60075b20 0x7fcf60075fa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009900 tx=0x7fcf4802a440 comp rx=0 tx=0).stop 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 -- 172.21.15.33:0/386407243 shutdown_connections 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 --2- 172.21.15.33:0/386407243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60106490 0x7fcf60111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 --2- 172.21.15.33:0/386407243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60075b20 0x7fcf60075fa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 --2- 172.21.15.33:0/386407243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf60076f90 0x7fcf600755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.558+0000 7fcf65a00640 1 -- 172.21.15.33:0/386407243 >> 172.21.15.33:0/386407243 conn(0x7fcf600fe240 msgr2=0x7fcf60100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.559+0000 7fcf65a00640 1 -- 172.21.15.33:0/386407243 shutdown_connections 2024-09-11T00:06:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.559+0000 7fcf65a00640 1 -- 172.21.15.33:0/386407243 wait complete. 2024-09-11T00:06:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.560+0000 7fcf65a00640 1 Processor -- start 2024-09-11T00:06:00.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.561+0000 7fcf65a00640 1 -- start start 2024-09-11T00:06:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.562+0000 7fcf65a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 0x7fcf6019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.563+0000 7fcf65a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.563+0000 7fcf65a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 0x7fcf601a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59404/0 (socket says 172.21.15.33:59404) 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf65a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114c00 con 0x7fcf601a06d0 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf5e000640 1 -- 172.21.15.33:0/4249841192 learned_addr learned my addr 172.21.15.33:0/4249841192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114a80 con 0x7fcf60076f90 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.564+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60114d80 con 0x7fcf60075b20 2024-09-11T00:06:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.565+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 0x7fcf6019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.565+0000 7fcf5f400640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 0x7fcf601a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.565+0000 7fcf5e000640 1 -- 172.21.15.33:0/4249841192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 msgr2=0x7fcf6019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 0x7fcf6019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5e000640 1 -- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 msgr2=0x7fcf601a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 0x7fcf601a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5e000640 1 -- 172.21.15.33:0/4249841192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf601a1380 con 0x7fcf60076f90 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 0x7fcf6019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5f400640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 0x7fcf601a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.566+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009850 tx=0x7fcf48003e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.567+0000 7fcf57400640 1 -- 172.21.15.33:0/4249841192 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4803f070 con 0x7fcf60076f90 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.567+0000 7fcf57400640 1 -- 172.21.15.33:0/4249841192 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf48031dd0 con 0x7fcf60076f90 2024-09-11T00:06:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.567+0000 7fcf57400640 1 -- 172.21.15.33:0/4249841192 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48035030 con 0x7fcf60076f90 2024-09-11T00:06:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.567+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf601a7770 con 0x7fcf60076f90 2024-09-11T00:06:00.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.567+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf601a7c00 con 0x7fcf60076f90 2024-09-11T00:06:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.575+0000 7fcf57400640 1 -- 172.21.15.33:0/4249841192 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcf4803b610 con 0x7fcf60076f90 2024-09-11T00:06:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.575+0000 7fcf687d9740 1 Processor -- start 2024-09-11T00:06:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.575+0000 7fcf687d9740 1 -- start start 2024-09-11T00:06:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 0x55fb703acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703ad0c0 0x55fb703af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 0x55fb703b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fb7031d6b0 con 0x55fb703afb00 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fb7030cae0 con 0x55fb703ad0c0 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf687d9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fb703108f0 con 0x55fb703aa790 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.576+0000 7fcf57400640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 0x7fcf440b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf57400640 1 -- 172.21.15.33:0/4249841192 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcf48106cc0 con 0x7fcf60076f90 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 0x55fb703acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 0x55fb703acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37092/0 (socket says 172.21.15.33:37092) 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5f400640 1 -- 172.21.15.33:0/1824086526 learned_addr learned my addr 172.21.15.33:0/1824086526 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 0x55fb703b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5f400640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 0x7fcf440b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.577+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703ad0c0 0x55fb703af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 -- 172.21.15.33:0/1824086526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 msgr2=0x55fb703acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 0x55fb703acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 -- 172.21.15.33:0/1824086526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703ad0c0 msgr2=0x55fb703af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703ad0c0 0x55fb703af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 -- 172.21.15.33:0/1824086526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb702d9780 con 0x55fb703afb00 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.578+0000 7fcf5e000640 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 0x55fb703b1fc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf480094a0 tx=0x7fcf480040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18f6e3bf8e1f8ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.579+0000 7fcf5f400640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 0x7fcf440b7930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800afd0 tx=0x7fcf58006d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.579+0000 7fcf4fe00640 1 -- 172.21.15.33:0/1824086526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48049040 con 0x55fb703afb00 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.579+0000 7fcf4fe00640 1 -- 172.21.15.33:0/1824086526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf480cd7e0 con 0x55fb703afb00 2024-09-11T00:06:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.579+0000 7fcf4fe00640 1 -- 172.21.15.33:0/1824086526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480d61e0 con 0x55fb703afb00 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 -- 172.21.15.33:0/1824086526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 msgr2=0x55fb703b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 0x55fb703b1fc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf480094a0 tx=0x7fcf480040f0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 -- 172.21.15.33:0/1824086526 shutdown_connections 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703afb00 0x55fb703b1fc0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703ad0c0 0x55fb703af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 --2- 172.21.15.33:0/1824086526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703aa790 0x55fb703acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 -- 172.21.15.33:0/1824086526 >> 172.21.15.33:0/1824086526 conn(0x55fb703a58e0 msgr2=0x55fb703a6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.581+0000 7fcf687d9740 1 -- 172.21.15.33:0/1824086526 shutdown_connections 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.583+0000 7fcf687d9740 1 -- 172.21.15.33:0/1824086526 wait complete. 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.583+0000 7fcf687d9740 1 -- start start 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.584+0000 7fcf687d9740 1 Processor -- start 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.584+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.584+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.584+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf687d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fb70244ab0 con 0x55fb703aa790 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf687d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fb702b3570 con 0x55fb703afb00 2024-09-11T00:06:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf687d9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fb703b28a0 con 0x55fb703ad0c0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf687d9740 10 client.0 _ll_register_callbacks cb 0x55fb702c2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37106/0 (socket says 172.21.15.33:37106) 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5e000640 1 -- 172.21.15.33:0/4081532330 learned_addr learned my addr 172.21.15.33:0/4081532330 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5f400640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5e000640 1 -- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 msgr2=0x55fb703b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.585+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf5e000640 1 -- 172.21.15.33:0/4081532330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 msgr2=0x55fb703b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf5e000640 1 -- 172.21.15.33:0/4081532330 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb7006e790 con 0x55fb703ad0c0 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf5e000640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf480c96b0 tx=0x7fcf48005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5a15cdc13377ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48049070 con 0x55fb703ad0c0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.586+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcf480d63e0 con 0x55fb703ad0c0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.587+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf480cd7e0 con 0x55fb703ad0c0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.587+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf480cd0e0 con 0x55fb703ad0c0 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.587+0000 7fcf687d9740 10 client.26233 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.587+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb700e7620 con 0x55fb703ad0c0 2024-09-11T00:06:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.587+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf480cd7e0 con 0x55fb703ad0c0 2024-09-11T00:06:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.589+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcf480cc340 con 0x55fb703ad0c0 2024-09-11T00:06:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 10 client.26233 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 10 client.26233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 20 client.26233 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb703bf210 0x55fb703c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 4 client.26233 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.590+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb7031f600 con 0x55fb703bf210 2024-09-11T00:06:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.591+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb703bf210 0x55fb703c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.591+0000 7fcf4cc00640 10 client.26233 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.591+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb703bf210 0x55fb703c1630 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c7c496f15820a13 server_cookie=5eec4303d697d31f in_seq=0 out_seq=0 2024-09-11T00:06:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.593+0000 7fcf4cc00640 1 -- 172.21.15.33:0/4081532330 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb7031f600 con 0x55fb703bf210 2024-09-11T00:06:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.593+0000 7fcf4cc00640 10 client.26233 handle_command_reply: tid=0 2024-09-11T00:06:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.593+0000 7fcf687d9740 1 client.26233 shutdown 2024-09-11T00:06:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.593+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 msgr2=0x55fb703b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.593+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf480c96b0 tx=0x7fcf48005bd0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 shutdown_connections 2024-09-11T00:06:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb703bf210 0x55fb703c1630 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703b4320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 --2- 172.21.15.33:0/4081532330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 >> 172.21.15.33:0/4081532330 conn(0x55fb703a58e0 msgr2=0x55fb703a4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf4cc00640 0 client.26233 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 shutdown_connections 2024-09-11T00:06:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.595+0000 7fcf687d9740 1 -- 172.21.15.33:0/4081532330 wait complete. 2024-09-11T00:06:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.596+0000 7fcf687d9740 20 client.26233 trim_cache size 0 max 16384 2024-09-11T00:06:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.630+0000 7fcf687d9740 1 Processor -- start 2024-09-11T00:06:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 -- start start 2024-09-11T00:06:00.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 0x55fb703b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703afb00 0x55fb703aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601b44d0 con 0x55fb703ad0c0 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601b1da0 con 0x55fb703aa790 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.631+0000 7fcf687d9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601afbf0 con 0x55fb703afb00 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.632+0000 7fcf5ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.632+0000 7fcf5ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59438/0 (socket says 172.21.15.33:59438) 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.632+0000 7fcf5ea00640 1 -- 172.21.15.33:0/2130902318 learned_addr learned my addr 172.21.15.33:0/2130902318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.632+0000 7fcf5e000640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 0x55fb703b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.632+0000 7fcf5f400640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703afb00 0x55fb703aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 -- 172.21.15.33:0/2130902318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703afb00 msgr2=0x55fb703aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703afb00 0x55fb703aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 -- 172.21.15.33:0/2130902318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 msgr2=0x55fb703b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 0x55fb703b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 -- 172.21.15.33:0/2130902318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb703af820 con 0x55fb703aa790 2024-09-11T00:06:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5e000640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 0x55fb703b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.633+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000a880 tx=0x7fcf500096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab849a24ef383ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.634+0000 7fcf4f400640 1 -- 172.21.15.33:0/2130902318 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50024070 con 0x55fb703aa790 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.634+0000 7fcf4f400640 1 -- 172.21.15.33:0/2130902318 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf50017d00 con 0x55fb703aa790 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.634+0000 7fcf4f400640 1 -- 172.21.15.33:0/2130902318 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50018660 con 0x55fb703aa790 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.635+0000 7fcf687d9740 1 -- 172.21.15.33:0/2130902318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 msgr2=0x55fb703b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.635+0000 7fcf687d9740 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000a880 tx=0x7fcf500096d0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 -- 172.21.15.33:0/2130902318 shutdown_connections 2024-09-11T00:06:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703afb00 0x55fb703aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703ad0c0 0x55fb703b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 --2- 172.21.15.33:0/2130902318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703aa790 0x55fb703b3c80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 -- 172.21.15.33:0/2130902318 >> 172.21.15.33:0/2130902318 conn(0x55fb703a58e0 msgr2=0x55fb703a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 -- 172.21.15.33:0/2130902318 shutdown_connections 2024-09-11T00:06:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.636+0000 7fcf687d9740 1 -- 172.21.15.33:0/2130902318 wait complete. 2024-09-11T00:06:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.637+0000 7fcf687d9740 1 -- start start 2024-09-11T00:06:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.637+0000 7fcf687d9740 1 Processor -- start 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.638+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601b0260 con 0x55fb703aa790 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601b16d0 con 0x55fb703afb00 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf601b0930 con 0x55fb703ad0c0 2024-09-11T00:06:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf687d9740 10 client.0 _ll_register_callbacks cb 0x7fcf480d1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf5e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37124/0 (socket says 172.21.15.33:37124) 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf5e000640 1 -- 172.21.15.33:0/3435404810 learned_addr learned my addr 172.21.15.33:0/3435404810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.639+0000 7fcf5f400640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5e000640 1 -- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 msgr2=0x55fb703bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5e000640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5e000640 1 -- 172.21.15.33:0/3435404810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 msgr2=0x55fb703bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5e000640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5e000640 1 -- 172.21.15.33:0/3435404810 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb703b8fc0 con 0x55fb703ad0c0 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5f400640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.640+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.641+0000 7fcf5e000640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf480cc6e0 tx=0x7fcf480cc950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429ba4d466576c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.641+0000 7fcf4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:06:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.641+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48049070 con 0x55fb703ad0c0 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.641+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf50017d00 con 0x55fb703ad0c0 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.641+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcf480b81b0 con 0x55fb703ad0c0 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcf480cd7e0 con 0x55fb703ad0c0 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 10 client.26239 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb703b8fc0 con 0x55fb703ad0c0 2024-09-11T00:06:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf480d6670 con 0x55fb703ad0c0 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcf480cbdb0 con 0x55fb703ad0c0 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 10 client.26239 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 20 client.26239 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb7042c860 0x55fb7042ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 4 client.26239 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:06:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.642+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcf50017d00 con 0x55fb7042c860 2024-09-11T00:06:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.644+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb7042c860 0x55fb7042ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.644+0000 7fcf5ea00640 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb7042c860 0x55fb7042ec80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2cb91a5ba9e81 server_cookie=6450404e101c2fb0 in_seq=0 out_seq=0 2024-09-11T00:06:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.644+0000 7fcf4cc00640 10 client.26239 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.679+0000 7fcf4cc00640 1 -- 172.21.15.33:0/3435404810 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fcf50017d00 con 0x55fb7042c860 2024-09-11T00:06:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.679+0000 7fcf4cc00640 10 client.26239 handle_command_reply: tid=0 2024-09-11T00:06:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.679+0000 7fcf687d9740 1 client.26239 shutdown 2024-09-11T00:06:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 msgr2=0x55fb703ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf480cc6e0 tx=0x7fcf480cc950 comp rx=0 tx=0).stop 2024-09-11T00:06:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 shutdown_connections 2024-09-11T00:06:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fb703afb00 0x55fb703bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fb7042c860 0x55fb7042ec80 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fb703ad0c0 0x55fb703ba4a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.680+0000 7fcf687d9740 1 --2- 172.21.15.33:0/3435404810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb703aa790 0x55fb703bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.681+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 >> 172.21.15.33:0/3435404810 conn(0x55fb703a58e0 msgr2=0x55fb703a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.681+0000 7fcf4cc00640 0 client.26239 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.681+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 shutdown_connections 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.681+0000 7fcf687d9740 1 -- 172.21.15.33:0/3435404810 wait complete. 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.681+0000 7fcf687d9740 20 client.26239 trim_cache size 0 max 16384 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:06:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:06:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:06:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:06:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 msgr2=0x7fcf440b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 0x7fcf440b7930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800afd0 tx=0x7fcf58006d50 comp rx=0 tx=0).stop 2024-09-11T00:06:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 msgr2=0x7fcf6019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009850 tx=0x7fcf48003e10 comp rx=0 tx=0).stop 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 shutdown_connections 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcf440b5470 0x7fcf440b7930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.684+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf601a06d0 0x7fcf601a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.685+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf60076f90 0x7fcf6019faa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.685+0000 7fcf65a00640 1 --2- 172.21.15.33:0/4249841192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf60075b20 0x7fcf6019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.685+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 >> 172.21.15.33:0/4249841192 conn(0x7fcf600fe240 msgr2=0x7fcf60100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.685+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 shutdown_connections 2024-09-11T00:06:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:00.685+0000 7fcf65a00640 1 -- 172.21.15.33:0/4249841192 wait complete. 2024-09-11T00:06:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:02 smithi052 ceph-mon[33526]: pgmap v714: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-09-11T00:06:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:02 smithi033 ceph-mon[30593]: pgmap v714: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-09-11T00:06:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:02 smithi189 ceph-mon[34000]: pgmap v714: 129 pgs: 129 active+clean; 1.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-09-11T00:06:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 375.0 s, 667.6 tps, lat 150.181 ms stddev 40.873 2024-09-11T00:06:04.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:04 smithi052 ceph-mon[33526]: pgmap v715: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-11T00:06:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:04 smithi033 ceph-mon[30593]: pgmap v715: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-11T00:06:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:04 smithi189 ceph-mon[34000]: pgmap v715: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.2 MiB/s wr, 858 op/s 2024-09-11T00:06:06.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:06 smithi189 ceph-mon[34000]: pgmap v716: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-11T00:06:06.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:06 smithi052 ceph-mon[33526]: pgmap v716: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-11T00:06:06.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:06 smithi033 ceph-mon[30593]: pgmap v716: 129 pgs: 129 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 724 op/s 2024-09-11T00:06:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 380.0 s, 649.0 tps, lat 153.624 ms stddev 56.254 2024-09-11T00:06:08.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:08 smithi052 ceph-mon[33526]: pgmap v717: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-11T00:06:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:08 smithi033 ceph-mon[30593]: pgmap v717: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-11T00:06:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:08 smithi189 ceph-mon[34000]: pgmap v717: 129 pgs: 129 active+clean; 1.2 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-11T00:06:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:10 smithi052 ceph-mon[33526]: pgmap v718: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 669 op/s 2024-09-11T00:06:10.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:10 smithi033 ceph-mon[30593]: pgmap v718: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 669 op/s 2024-09-11T00:06:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:10 smithi189 ceph-mon[34000]: pgmap v718: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.1 MiB/s wr, 669 op/s 2024-09-11T00:06:12.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:12 smithi052 ceph-mon[33526]: pgmap v719: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 691 op/s 2024-09-11T00:06:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:12 smithi033 ceph-mon[30593]: pgmap v719: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 691 op/s 2024-09-11T00:06:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:12 smithi189 ceph-mon[34000]: pgmap v719: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 691 op/s 2024-09-11T00:06:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 385.0 s, 714.6 tps, lat 140.184 ms stddev 40.962 2024-09-11T00:06:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 -- 172.21.15.33:0/620157348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc16406c030 msgr2=0x7fc164105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 --2- 172.21.15.33:0/620157348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc16406c030 0x7fc164105540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc154009900 tx=0x7fc15402a400 comp rx=0 tx=0).stop 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 -- 172.21.15.33:0/620157348 shutdown_connections 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 --2- 172.21.15.33:0/620157348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc164108680 0x7fc16410ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 --2- 172.21.15.33:0/620157348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc164107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 --2- 172.21.15.33:0/620157348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc16406c030 0x7fc164105540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.898+0000 7fc169c00640 1 -- 172.21.15.33:0/620157348 >> 172.21.15.33:0/620157348 conn(0x7fc1640fd150 msgr2=0x7fc1640ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.899+0000 7fc169c00640 1 -- 172.21.15.33:0/620157348 shutdown_connections 2024-09-11T00:06:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.899+0000 7fc169c00640 1 -- 172.21.15.33:0/620157348 wait complete. 2024-09-11T00:06:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.900+0000 7fc169c00640 1 Processor -- start 2024-09-11T00:06:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 -- start start 2024-09-11T00:06:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 0x7fc16419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc16419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc164108680 0x7fc1641a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc164102680 con 0x7fc16406c030 2024-09-11T00:06:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc164102500 con 0x7fc164108680 2024-09-11T00:06:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.901+0000 7fc169c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc164102800 con 0x7fc164105ad0 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 0x7fc16419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 0x7fc16419f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36218/0 (socket says 172.21.15.33:36218) 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162a00640 1 -- 172.21.15.33:0/4271952229 learned_addr learned my addr 172.21.15.33:0/4271952229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc163400640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc164108680 0x7fc1641a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162000640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc16419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162000640 1 -- 172.21.15.33:0/4271952229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc164108680 msgr2=0x7fc1641a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162000640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc164108680 0x7fc1641a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162000640 1 -- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 msgr2=0x7fc16419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.902+0000 7fc162000640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 0x7fc16419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.903+0000 7fc162000640 1 -- 172.21.15.33:0/4271952229 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1641a0df0 con 0x7fc164105ad0 2024-09-11T00:06:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc162000640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc16419f970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e9f0 tx=0x7fc15000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc15b400640 1 -- 172.21.15.33:0/4271952229 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15000ccc0 con 0x7fc164105ad0 2024-09-11T00:06:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1641a10e0 con 0x7fc164105ad0 2024-09-11T00:06:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc15b400640 1 -- 172.21.15.33:0/4271952229 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1500108c0 con 0x7fc164105ad0 2024-09-11T00:06:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc15b400640 1 -- 172.21.15.33:0/4271952229 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15000ccc0 con 0x7fc164105ad0 2024-09-11T00:06:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.905+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641a77b0 con 0x7fc164105ad0 2024-09-11T00:06:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.910+0000 7fc16cbbf740 1 Processor -- start 2024-09-11T00:06:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.913+0000 7fc15b400640 1 -- 172.21.15.33:0/4271952229 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc150010430 con 0x7fc164105ad0 2024-09-11T00:06:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.913+0000 7fc16cbbf740 1 -- start start 2024-09-11T00:06:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff72b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff77fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cbefee36b0 con 0x55cbeff730c0 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cbefed2ae0 con 0x55cbeff75b00 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.914+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cbefed68f0 con 0x55cbeff70790 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.915+0000 7fc162000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff77fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.915+0000 7fc162000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff77fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:59620/0 (socket says 172.21.15.33:59620) 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.915+0000 7fc162000640 1 -- 172.21.15.33:0/3639077915 learned_addr learned my addr 172.21.15.33:0/3639077915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.915+0000 7fc162a00640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.915+0000 7fc163400640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff72b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 -- 172.21.15.33:0/3639077915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 msgr2=0x55cbeff72b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff72b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 -- 172.21.15.33:0/3639077915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 msgr2=0x55cbeff77fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff77fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 -- 172.21.15.33:0/3639077915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbefe9f780 con 0x55cbeff730c0 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc163400640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff72b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc15b400640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 0x7fc1480b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc15b400640 1 -- 172.21.15.33:0/4271952229 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc1500e5ee0 con 0x7fc164105ad0 2024-09-11T00:06:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc162a00640 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff754b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc732010e2b3cd00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.917+0000 7fc163400640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 0x7fc1480b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.918+0000 7fc14fe00640 1 -- 172.21.15.33:0/3639077915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154035030 con 0x55cbeff730c0 2024-09-11T00:06:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.918+0000 7fc14fe00640 1 -- 172.21.15.33:0/3639077915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc154040070 con 0x55cbeff730c0 2024-09-11T00:06:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.918+0000 7fc14fe00640 1 -- 172.21.15.33:0/3639077915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154035030 con 0x55cbeff730c0 2024-09-11T00:06:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3639077915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 msgr2=0x55cbeff754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff754b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc154006010 tx=0x7fc154004180 comp rx=0 tx=0).stop 2024-09-11T00:06:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc163400640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 0x7fc1480b7ae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1641a00a0 tx=0x7fc15c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3639077915 shutdown_connections 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff77fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff754b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3639077915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff72b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.920+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3639077915 >> 172.21.15.33:0/3639077915 conn(0x55cbeff6b8e0 msgr2=0x55cbeff6c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.921+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3639077915 shutdown_connections 2024-09-11T00:06:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.921+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3639077915 wait complete. 2024-09-11T00:06:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.922+0000 7fc16cbbf740 1 -- start start 2024-09-11T00:06:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.922+0000 7fc16cbbf740 1 Processor -- start 2024-09-11T00:06:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff730c0 0x55cbeff7a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff75b00 0x55cbeff7b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cbefe0aab0 con 0x55cbeff70790 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cbefe79570 con 0x55cbeff730c0 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cbeff78ad0 con 0x55cbeff75b00 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc16cbbf740 10 client.0 _ll_register_callbacks cb 0x55cbefe88100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36244/0 (socket says 172.21.15.33:36244) 2024-09-11T00:06:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.923+0000 7fc162a00640 1 -- 172.21.15.33:0/2662984671 learned_addr learned my addr 172.21.15.33:0/2662984671 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162000640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff730c0 0x55cbeff7a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc163400640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff75b00 0x55cbeff7b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162a00640 1 -- 172.21.15.33:0/2662984671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff75b00 msgr2=0x55cbeff7b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162a00640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff75b00 0x55cbeff7b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162a00640 1 -- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff730c0 msgr2=0x55cbeff7a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162a00640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff730c0 0x55cbeff7a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.924+0000 7fc162a00640 1 -- 172.21.15.33:0/2662984671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbefc34790 con 0x55cbeff70790 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.925+0000 7fc162a00640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1540092a0 tx=0x7fc1540095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b111ee77dc391982 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.925+0000 7fc14cc00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:06:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.926+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154052060 con 0x55cbeff70790 2024-09-11T00:06:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.926+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc154040070 con 0x55cbeff70790 2024-09-11T00:06:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.926+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc154031d10 con 0x55cbeff70790 2024-09-11T00:06:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.927+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc154035050 con 0x55cbeff70790 2024-09-11T00:06:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.927+0000 7fc16cbbf740 10 client.16500 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.927+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cbefcad620 con 0x55cbeff70790 2024-09-11T00:06:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.928+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc154040070 con 0x55cbeff70790 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.928+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc154045500 con 0x55cbeff70790 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.928+0000 7fc16cbbf740 10 client.16500 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.928+0000 7fc16cbbf740 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.929+0000 7fc16cbbf740 20 client.16500 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.929+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbeff85330 0x55cbeff87720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.929+0000 7fc16cbbf740 4 client.16500 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.929+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbefee5600 con 0x55cbeff85330 2024-09-11T00:06:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.929+0000 7fc162000640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbeff85330 0x55cbeff87720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.930+0000 7fc162000640 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbeff85330 0x55cbeff87720 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f26bfd4555f5e2 server_cookie=b5944d0fe0503e12 in_seq=0 out_seq=0 2024-09-11T00:06:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.930+0000 7fc14cc00640 10 client.16500 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.931+0000 7fc14cc00640 1 -- 172.21.15.33:0/2662984671 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbefee5600 con 0x55cbeff85330 2024-09-11T00:06:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.931+0000 7fc14cc00640 10 client.16500 handle_command_reply: tid=0 2024-09-11T00:06:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.931+0000 7fc16cbbf740 1 client.16500 shutdown 2024-09-11T00:06:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 msgr2=0x55cbeff79f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc1540092a0 tx=0x7fc1540095f0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 shutdown_connections 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbeff85330 0x55cbeff87720 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff75b00 0x55cbeff7b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff730c0 0x55cbeff7a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/2662984671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc14cc00640 0 client.16500 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.932+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 >> 172.21.15.33:0/2662984671 conn(0x55cbeff6b8e0 msgr2=0x55cbeff6aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.933+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 shutdown_connections 2024-09-11T00:06:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.933+0000 7fc16cbbf740 1 -- 172.21.15.33:0/2662984671 wait complete. 2024-09-11T00:06:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.933+0000 7fc16cbbf740 20 client.16500 trim_cache size 0 max 16384 2024-09-11T00:06:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 Processor -- start 2024-09-11T00:06:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 -- start start 2024-09-11T00:06:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff730c0 0x55cbeff79110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff79650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b45c0 con 0x55cbeff70790 2024-09-11T00:06:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b1e90 con 0x55cbeff75b00 2024-09-11T00:06:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.965+0000 7fc16cbbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641afcd0 con 0x55cbeff730c0 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36254/0 (socket says 172.21.15.33:36254) 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 -- 172.21.15.33:0/4289189981 learned_addr learned my addr 172.21.15.33:0/4289189981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162000640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff730c0 0x55cbeff79110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 -- 172.21.15.33:0/4289189981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff730c0 msgr2=0x55cbeff79110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff730c0 0x55cbeff79110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 -- 172.21.15.33:0/4289189981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 msgr2=0x55cbeff79650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc163400640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff79650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff79650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.966+0000 7fc162a00640 1 -- 172.21.15.33:0/4289189981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbeff72ef0 con 0x55cbeff70790 2024-09-11T00:06:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.967+0000 7fc163400640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff79650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.967+0000 7fc162a00640 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc15402a440 tx=0x7fc154031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64ddf252bb5cb98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.968+0000 7fc14f400640 1 -- 172.21.15.33:0/4289189981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154035050 con 0x55cbeff70790 2024-09-11T00:06:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.968+0000 7fc14f400640 1 -- 172.21.15.33:0/4289189981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc154040040 con 0x55cbeff70790 2024-09-11T00:06:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.968+0000 7fc14f400640 1 -- 172.21.15.33:0/4289189981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154045c70 con 0x55cbeff70790 2024-09-11T00:06:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 -- 172.21.15.33:0/4289189981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 msgr2=0x55cbeff79f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc15402a440 tx=0x7fc154031ca0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 -- 172.21.15.33:0/4289189981 shutdown_connections 2024-09-11T00:06:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff79650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff730c0 0x55cbeff79110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/4289189981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff70790 0x55cbeff79f10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.969+0000 7fc16cbbf740 1 -- 172.21.15.33:0/4289189981 >> 172.21.15.33:0/4289189981 conn(0x55cbeff6b8e0 msgr2=0x55cbeff6fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.970+0000 7fc16cbbf740 1 -- 172.21.15.33:0/4289189981 shutdown_connections 2024-09-11T00:06:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.970+0000 7fc16cbbf740 1 -- 172.21.15.33:0/4289189981 wait complete. 2024-09-11T00:06:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.970+0000 7fc16cbbf740 1 -- start start 2024-09-11T00:06:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.971+0000 7fc16cbbf740 1 Processor -- start 2024-09-11T00:06:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.971+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.971+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff80630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.971+0000 7fc16cbbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff80b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc162000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff80630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc162a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc162a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54232/0 (socket says 172.21.15.33:54232) 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc162a00640 1 -- 172.21.15.33:0/3182462499 learned_addr learned my addr 172.21.15.33:0/3182462499 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b0350 con 0x55cbeff730c0 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b17c0 con 0x55cbeff75b00 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b0a20 con 0x55cbeff70790 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.972+0000 7fc163400640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff80b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.973+0000 7fc16cbbf740 10 client.0 _ll_register_callbacks cb 0x7fc15c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc163400640 1 -- 172.21.15.33:0/3182462499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 msgr2=0x55cbeff81930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc163400640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc163400640 1 -- 172.21.15.33:0/3182462499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 msgr2=0x55cbeff80630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc163400640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff80630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc163400640 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbeff813a0 con 0x55cbeff75b00 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc162000640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff80630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.974+0000 7fc162a00640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.975+0000 7fc163400640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff80b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55cbeff7acc0 tx=0x7fc15c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d60ae82576a1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.975+0000 7fc14cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:06:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.976+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c02e060 con 0x55cbeff75b00 2024-09-11T00:06:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.976+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc15c020b00 con 0x55cbeff75b00 2024-09-11T00:06:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.976+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc154040040 con 0x55cbeff75b00 2024-09-11T00:06:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.977+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc15c020d40 con 0x55cbeff75b00 2024-09-11T00:06:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.977+0000 7fc16cbbf740 10 client.36296 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.977+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cbefff20d0 con 0x55cbeff75b00 2024-09-11T00:06:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.977+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc154040040 con 0x55cbeff75b00 2024-09-11T00:06:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc15c028070 con 0x55cbeff75b00 2024-09-11T00:06:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 10 client.36296 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 10 client.36296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 20 client.36296 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbefff2a60 0x55cbefff4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 4 client.36296 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:06:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.978+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbefee10b0 con 0x55cbefff2a60 2024-09-11T00:06:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.979+0000 7fc162a00640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbefff2a60 0x55cbefff4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:13.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.980+0000 7fc162a00640 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbefff2a60 0x55cbefff4e80 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86cf59141287519b server_cookie=70fe8ef9ecc0fe6a in_seq=0 out_seq=0 2024-09-11T00:06:13.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.980+0000 7fc14cc00640 10 client.36296 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.997+0000 7fc14cc00640 1 -- 172.21.15.33:0/3182462499 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbefee10b0 con 0x55cbefff2a60 2024-09-11T00:06:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.997+0000 7fc14cc00640 10 client.36296 handle_command_reply: tid=0 2024-09-11T00:06:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 client.36296 shutdown 2024-09-11T00:06:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 msgr2=0x55cbeff80b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff80b70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55cbeff7acc0 tx=0x7fc15c004a40 comp rx=0 tx=0).stop 2024-09-11T00:06:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 shutdown_connections 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cbeff75b00 0x55cbeff80b70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cbeff730c0 0x55cbeff80630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cbefff2a60 0x55cbefff4e80 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 --2- 172.21.15.33:0/3182462499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cbeff70790 0x55cbeff81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc14cc00640 0 client.36296 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.998+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 >> 172.21.15.33:0/3182462499 conn(0x55cbeff6b8e0 msgr2=0x55cbeff6fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.999+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 shutdown_connections 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.999+0000 7fc16cbbf740 1 -- 172.21.15.33:0/3182462499 wait complete. 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:13.999+0000 7fc16cbbf740 20 client.36296 trim_cache size 0 max 16384 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:06:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 msgr2=0x7fc1480b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 0x7fc1480b7ae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1641a00a0 tx=0x7fc15c009600 comp rx=0 tx=0).stop 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 msgr2=0x7fc16419f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc16419f970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e9f0 tx=0x7fc15000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 shutdown_connections 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1480b5620 0x7fc1480b7ae0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc164108680 0x7fc1641a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc164105ad0 0x7fc16419f970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 --2- 172.21.15.33:0/4271952229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc16406c030 0x7fc16419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.000+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 >> 172.21.15.33:0/4271952229 conn(0x7fc1640fd150 msgr2=0x7fc1640ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.001+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 shutdown_connections 2024-09-11T00:06:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:14.001+0000 7fc169c00640 1 -- 172.21.15.33:0/4271952229 wait complete. 2024-09-11T00:06:14.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:14 smithi052 ceph-mon[33526]: pgmap v720: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-11T00:06:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:14 smithi033 ceph-mon[30593]: pgmap v720: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-11T00:06:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:14 smithi189 ceph-mon[34000]: pgmap v720: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-11T00:06:16.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:16 smithi052 ceph-mon[33526]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-09-11T00:06:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:16 smithi033 ceph-mon[30593]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-09-11T00:06:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:16 smithi189 ceph-mon[34000]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-09-11T00:06:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 390.0 s, 725.7 tps, lat 137.456 ms stddev 37.133 2024-09-11T00:06:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:18 smithi052 ceph-mon[33526]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-11T00:06:18.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:18 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:18.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:18 smithi033 ceph-mon[30593]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-11T00:06:18.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:18 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:18 smithi189 ceph-mon[34000]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 785 op/s 2024-09-11T00:06:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:18 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:19 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.754 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.754 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:19 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:19.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:19 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:20 smithi033 ceph-mon[30593]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 750 op/s 2024-09-11T00:06:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:20 smithi189 ceph-mon[34000]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 750 op/s 2024-09-11T00:06:20.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:20 smithi052 ceph-mon[33526]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 750 op/s 2024-09-11T00:06:22.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 751 op/s 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:22 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 751 op/s 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:22 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 751 op/s 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:22 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 395.0 s, 500.6 tps, lat 173.175 ms stddev 92.851 2024-09-11T00:06:23.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:23 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:23.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:23 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:23.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:23 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:23.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:23 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:23.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:23 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:23.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:23 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:23 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:23 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:06:23.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:23 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:06:24.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:24 smithi189 ceph-mon[34000]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.3 MiB/s wr, 793 op/s 2024-09-11T00:06:24.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:24 smithi052 ceph-mon[33526]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.3 MiB/s wr, 793 op/s 2024-09-11T00:06:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:24 smithi033 ceph-mon[30593]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.3 MiB/s wr, 793 op/s 2024-09-11T00:06:26.328 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:26 smithi033 ceph-mon[30593]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.3 MiB/s wr, 666 op/s 2024-09-11T00:06:26.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:26 smithi189 ceph-mon[34000]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.3 MiB/s wr, 666 op/s 2024-09-11T00:06:26.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:26 smithi052 ceph-mon[33526]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.3 MiB/s wr, 666 op/s 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 -- 172.21.15.33:0/993342166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 msgr2=0x7f081c077e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 --2- 172.21.15.33:0/993342166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c077e20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f080c009900 tx=0x7f080c02a420 comp rx=0 tx=0).stop 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 -- 172.21.15.33:0/993342166 shutdown_connections 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 --2- 172.21.15.33:0/993342166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 0x7f081c079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 --2- 172.21.15.33:0/993342166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081c078b70 0x7f081c078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 --2- 172.21.15.33:0/993342166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c077e20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.212+0000 7f0822a00640 1 -- 172.21.15.33:0/993342166 >> 172.21.15.33:0/993342166 conn(0x7f081c100440 msgr2=0x7f081c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.213+0000 7f0822a00640 1 -- 172.21.15.33:0/993342166 shutdown_connections 2024-09-11T00:06:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.213+0000 7f0822a00640 1 -- 172.21.15.33:0/993342166 wait complete. 2024-09-11T00:06:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.214+0000 7f0822a00640 1 Processor -- start 2024-09-11T00:06:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 -- start start 2024-09-11T00:06:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081c078b70 0x7f081c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 0x7f081c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f081c114b10 con 0x7f081c078b70 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f081c114990 con 0x7f081c077a20 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.215+0000 7f0822a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c114c90 con 0x7f081c079530 2024-09-11T00:06:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33146/0 (socket says 172.21.15.33:33146) 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 -- 172.21.15.33:0/4035404251 learned_addr learned my addr 172.21.15.33:0/4035404251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f0820a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 0x7f081c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 -- 172.21.15.33:0/4035404251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 msgr2=0x7f081c1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 0x7f081c1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 -- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081c078b70 msgr2=0x7f081c19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081c078b70 0x7f081c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.216+0000 7f081be00640 1 -- 172.21.15.33:0/4035404251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c1a0c40 con 0x7f081c077a20 2024-09-11T00:06:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.217+0000 7f081be00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f080c009850 tx=0x7f080c003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.218+0000 7f0818c00640 1 -- 172.21.15.33:0/4035404251 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c03f030 con 0x7f081c077a20 2024-09-11T00:06:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.218+0000 7f0818c00640 1 -- 172.21.15.33:0/4035404251 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f080c032ba0 con 0x7f081c077a20 2024-09-11T00:06:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.218+0000 7f0818c00640 1 -- 172.21.15.33:0/4035404251 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c035070 con 0x7f081c077a20 2024-09-11T00:06:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.218+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c1a0ed0 con 0x7f081c077a20 2024-09-11T00:06:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.218+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c1a7420 con 0x7f081c077a20 2024-09-11T00:06:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.223+0000 7f08259bc740 1 Processor -- start 2024-09-11T00:06:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 -- start start 2024-09-11T00:06:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 0x55cb00ceb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00cebb00 0x55cb00cedfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb00c596b0 con 0x55cb00ce6790 2024-09-11T00:06:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb00c48ae0 con 0x55cb00ce90c0 2024-09-11T00:06:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.224+0000 7f08259bc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb00c4c8f0 con 0x55cb00cebb00 2024-09-11T00:06:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.225+0000 7f0820a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.225+0000 7f0820a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38056/0 (socket says 172.21.15.33:38056) 2024-09-11T00:06:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.225+0000 7f0820a00640 1 -- 172.21.15.33:0/3268617750 learned_addr learned my addr 172.21.15.33:0/3268617750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.225+0000 7f081b400640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00cebb00 0x55cb00cedfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.225+0000 7f0818c00640 1 -- 172.21.15.33:0/4035404251 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f080c032710 con 0x7f081c077a20 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f081be00640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 0x55cb00ceb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f0820a00640 1 -- 172.21.15.33:0/3268617750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00cebb00 msgr2=0x55cb00cedfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f0820a00640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00cebb00 0x55cb00cedfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f0820a00640 1 -- 172.21.15.33:0/3268617750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 msgr2=0x55cb00ceb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f0820a00640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 0x55cb00ceb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f0820a00640 1 -- 172.21.15.33:0/3268617750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb00c15780 con 0x55cb00ce6790 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.226+0000 7f081be00640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 0x55cb00ceb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.227+0000 7f0820a00640 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f081400ae60 tx=0x7f081400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b34c61cfeb99dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.227+0000 7f0811200640 1 -- 172.21.15.33:0/3268617750 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814003b70 con 0x55cb00ce6790 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.227+0000 7f0811200640 1 -- 172.21.15.33:0/3268617750 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0814003d10 con 0x55cb00ce6790 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.227+0000 7f0811200640 1 -- 172.21.15.33:0/3268617750 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814010ae0 con 0x55cb00ce6790 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.228+0000 7f0818c00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 0x7f08000b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.228+0000 7f0818c00640 1 -- 172.21.15.33:0/4035404251 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f080c106af0 con 0x7f081c077a20 2024-09-11T00:06:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.228+0000 7f08259bc740 1 -- 172.21.15.33:0/3268617750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 msgr2=0x55cb00ce8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.228+0000 7f08259bc740 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f081400ae60 tx=0x7f081400f790 comp rx=0 tx=0).stop 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.228+0000 7f081be00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 0x7f08000b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 -- 172.21.15.33:0/3268617750 shutdown_connections 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00cebb00 0x55cb00cedfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce90c0 0x55cb00ceb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 --2- 172.21.15.33:0/3268617750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00ce8b80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 -- 172.21.15.33:0/3268617750 >> 172.21.15.33:0/3268617750 conn(0x55cb00ce18e0 msgr2=0x55cb00ce2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 -- 172.21.15.33:0/3268617750 shutdown_connections 2024-09-11T00:06:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f081be00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 0x7f08000b7970 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f080c0cce40 tx=0x7f080c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.229+0000 7f08259bc740 1 -- 172.21.15.33:0/3268617750 wait complete. 2024-09-11T00:06:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.230+0000 7f08259bc740 1 -- start start 2024-09-11T00:06:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.230+0000 7f08259bc740 1 Processor -- start 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00d00fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d01660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d021c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cb00b80ab0 con 0x55cb00ce6790 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb00bef570 con 0x55cb00cebb00 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.231+0000 7f08259bc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb00cffaf0 con 0x55cb00ce90c0 2024-09-11T00:06:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.232+0000 7f08259bc740 10 client.0 _ll_register_callbacks cb 0x55cb00bfe100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.232+0000 7f081b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d01660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.232+0000 7f081b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d01660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51876/0 (socket says 172.21.15.33:51876) 2024-09-11T00:06:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.232+0000 7f081b400640 1 -- 172.21.15.33:0/1786528832 learned_addr learned my addr 172.21.15.33:0/1786528832 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.232+0000 7f0820a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00d00fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 -- 172.21.15.33:0/1786528832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 msgr2=0x55cb00d01660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d01660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 -- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 msgr2=0x55cb00d021c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d021c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.233+0000 7f0820a00640 1 -- 172.21.15.33:0/1786528832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb009aa790 con 0x55cb00ce6790 2024-09-11T00:06:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.234+0000 7f0820a00640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00d00fc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f081400b010 tx=0x7f081400a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7874b36b098d61bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.234+0000 7f0805600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:06:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081402c060 con 0x55cb00ce6790 2024-09-11T00:06:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0814010c70 con 0x55cb00ce6790 2024-09-11T00:06:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0814003d10 con 0x55cb00ce6790 2024-09-11T00:06:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0814004e60 con 0x55cb00ce6790 2024-09-11T00:06:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f08259bc740 10 client.16515 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.235+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cb00a23620 con 0x55cb00ce6790 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.236+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0814003d10 con 0x55cb00ce6790 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.236+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0814025460 con 0x55cb00ce6790 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 10 client.16515 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 20 client.16515 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d0c480 0x55cb00d0e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 4 client.16515 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb00c5b600 con 0x55cb00d0c480 2024-09-11T00:06:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.237+0000 7f081b400640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d0c480 0x55cb00d0e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.238+0000 7f081b400640 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d0c480 0x55cb00d0e870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a0760da8cd5af6 server_cookie=cbb969c644bc46b1 in_seq=0 out_seq=0 2024-09-11T00:06:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.238+0000 7f0805600640 10 client.16515 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.239+0000 7f0805600640 1 -- 172.21.15.33:0/1786528832 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb00c5b600 con 0x55cb00d0c480 2024-09-11T00:06:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.240+0000 7f0805600640 10 client.16515 handle_command_reply: tid=0 2024-09-11T00:06:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.240+0000 7f08259bc740 1 client.16515 shutdown 2024-09-11T00:06:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.243+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 msgr2=0x55cb00d00fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.243+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00d00fc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f081400b010 tx=0x7f081400a980 comp rx=0 tx=0).stop 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 shutdown_connections 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d0c480 0x55cb00d0e870 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d01660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 --2- 172.21.15.33:0/1786528832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce6790 0x55cb00d00fc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 >> 172.21.15.33:0/1786528832 conn(0x55cb00ce18e0 msgr2=0x55cb00ce0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f0805600640 0 client.16515 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 shutdown_connections 2024-09-11T00:06:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.244+0000 7f08259bc740 1 -- 172.21.15.33:0/1786528832 wait complete. 2024-09-11T00:06:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.245+0000 7f08259bc740 20 client.16515 trim_cache size 0 max 16384 2024-09-11T00:06:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.282+0000 7f08259bc740 1 Processor -- start 2024-09-11T00:06:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.282+0000 7f08259bc740 1 -- start start 2024-09-11T00:06:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 0x55cb00d00630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d08ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 0x55cb00ce3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f0820a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 0x55cb00d00630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1abd10 con 0x55cb00cebb00 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1a95e0 con 0x55cb00ce6790 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f0820a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 0x55cb00d00630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33170/0 (socket says 172.21.15.33:33170) 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f0820a00640 1 -- 172.21.15.33:0/3059818743 learned_addr learned my addr 172.21.15.33:0/3059818743 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c10cc10 con 0x55cb00ce90c0 2024-09-11T00:06:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.283+0000 7f081b400640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d08ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f081b400640 1 -- 172.21.15.33:0/3059818743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 msgr2=0x55cb00d00630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f0820a00640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 0x55cb00ce3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f081b400640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 0x55cb00d00630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f081b400640 1 -- 172.21.15.33:0/3059818743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 msgr2=0x55cb00ce3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f081b400640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 0x55cb00ce3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f081b400640 1 -- 172.21.15.33:0/3059818743 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb00ce2f70 con 0x55cb00ce90c0 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.284+0000 7f0820a00640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 0x55cb00ce3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.285+0000 7f081b400640 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d08ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55cb00d0edb0 tx=0x7f080800b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71edd94ba531bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.285+0000 7f0807e00640 1 -- 172.21.15.33:0/3059818743 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08080130d0 con 0x55cb00ce90c0 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.285+0000 7f0807e00640 1 -- 172.21.15.33:0/3059818743 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f080801e030 con 0x55cb00ce90c0 2024-09-11T00:06:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.285+0000 7f0807e00640 1 -- 172.21.15.33:0/3059818743 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808004c40 con 0x55cb00ce90c0 2024-09-11T00:06:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 msgr2=0x55cb00d08ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d08ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55cb00d0edb0 tx=0x7f080800b450 comp rx=0 tx=0).stop 2024-09-11T00:06:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 shutdown_connections 2024-09-11T00:06:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00cebb00 0x55cb00ce3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce90c0 0x55cb00d08ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 --2- 172.21.15.33:0/3059818743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00ce6790 0x55cb00d00630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.287+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 >> 172.21.15.33:0/3059818743 conn(0x55cb00ce18e0 msgr2=0x55cb00cfff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.288+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 shutdown_connections 2024-09-11T00:06:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.288+0000 7f08259bc740 1 -- 172.21.15.33:0/3059818743 wait complete. 2024-09-11T00:06:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.289+0000 7f08259bc740 1 -- start start 2024-09-11T00:06:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.290+0000 7f08259bc740 1 Processor -- start 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce90c0 0x55cb00d08d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d07110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1a7aa0 con 0x55cb00ce90c0 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1a8f10 con 0x55cb00cebb00 2024-09-11T00:06:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f081c1a8170 con 0x55cb00ce6790 2024-09-11T00:06:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f08259bc740 10 client.0 _ll_register_callbacks cb 0x7f081400ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f0820a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f0820a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51900/0 (socket says 172.21.15.33:51900) 2024-09-11T00:06:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.291+0000 7f0820a00640 1 -- 172.21.15.33:0/4023695695 learned_addr learned my addr 172.21.15.33:0/4023695695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 -- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 msgr2=0x55cb00d07110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d07110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 -- 172.21.15.33:0/4023695695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce90c0 msgr2=0x55cb00d08d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce90c0 0x55cb00d08d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 -- 172.21.15.33:0/4023695695 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb00d07940 con 0x55cb00ce6790 2024-09-11T00:06:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.292+0000 7f0820a00640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f081400adb0 tx=0x7f081400a980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42061abfb575042d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f0805600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081402c030 con 0x55cb00ce6790 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080801e030 con 0x55cb00ce6790 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0814010c70 con 0x55cb00ce6790 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0814048050 con 0x55cb00ce6790 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.293+0000 7f08259bc740 10 client.26272 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.294+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cb00d79f40 con 0x55cb00ce6790 2024-09-11T00:06:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.294+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f080801e030 con 0x55cb00ce6790 2024-09-11T00:06:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.294+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0814027c90 con 0x55cb00ce6790 2024-09-11T00:06:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 10 client.26272 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 20 client.26272 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d7a8c0 0x55cb00d7cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 4 client.26272 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb00c570b0 con 0x55cb00d7a8c0 2024-09-11T00:06:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.295+0000 7f081b400640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d7a8c0 0x55cb00d7cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.296+0000 7f081b400640 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d7a8c0 0x55cb00d7cce0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca38e7fa932b9dd4 server_cookie=1d4b769b15823b27 in_seq=0 out_seq=0 2024-09-11T00:06:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.296+0000 7f0805600640 10 client.26272 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.321+0000 7f0805600640 1 -- 172.21.15.33:0/4023695695 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb00c570b0 con 0x55cb00d7a8c0 2024-09-11T00:06:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f0805600640 10 client.26272 handle_command_reply: tid=0 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 client.26272 shutdown 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 msgr2=0x55cb00d086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f081400adb0 tx=0x7f081400a980 comp rx=0 tx=0).stop 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 shutdown_connections 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb00cebb00 0x55cb00d07110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cb00ce90c0 0x55cb00d08d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55cb00d7a8c0 0x55cb00d7cce0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 --2- 172.21.15.33:0/4023695695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb00ce6790 0x55cb00d086c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 >> 172.21.15.33:0/4023695695 conn(0x55cb00ce18e0 msgr2=0x55cb00ce0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f0805600640 0 client.26272 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.322+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 shutdown_connections 2024-09-11T00:06:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.323+0000 7f08259bc740 1 -- 172.21.15.33:0/4023695695 wait complete. 2024-09-11T00:06:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.323+0000 7f08259bc740 20 client.26272 trim_cache size 0 max 16384 2024-09-11T00:06:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:06:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:06:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:06:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 msgr2=0x7f08000b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 0x7f08000b7970 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f080c0cce40 tx=0x7f080c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 msgr2=0x7f081c19f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f080c009850 tx=0x7f080c003f80 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 shutdown_connections 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f08000b54b0 0x7f08000b7970 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f081c079530 0x7f081c1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081c078b70 0x7f081c19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 --2- 172.21.15.33:0/4035404251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f081c077a20 0x7f081c19f100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:27.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.324+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 >> 172.21.15.33:0/4035404251 conn(0x7f081c100440 msgr2=0x7f081c101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.325+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 shutdown_connections 2024-09-11T00:06:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:27.325+0000 7f0822a00640 1 -- 172.21.15.33:0/4035404251 wait complete. 2024-09-11T00:06:28.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:28 smithi033 ceph-mon[30593]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-09-11T00:06:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 400.0 s, 645.3 tps, lat 175.327 ms stddev 142.372 2024-09-11T00:06:28.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:28 smithi189 ceph-mon[34000]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-09-11T00:06:28.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:28 smithi052 ceph-mon[33526]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-09-11T00:06:30.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:30 smithi052 ceph-mon[33526]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 587 op/s 2024-09-11T00:06:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:30 smithi033 ceph-mon[30593]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 587 op/s 2024-09-11T00:06:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:30 smithi189 ceph-mon[34000]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.4 MiB/s wr, 587 op/s 2024-09-11T00:06:32.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:32 smithi052 ceph-mon[33526]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-11T00:06:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:32 smithi033 ceph-mon[30593]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-11T00:06:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:32 smithi189 ceph-mon[34000]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-11T00:06:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 405.0 s, 619.3 tps, lat 161.478 ms stddev 42.713 2024-09-11T00:06:34.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:34 smithi052 ceph-mon[33526]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T00:06:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:34 smithi033 ceph-mon[30593]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T00:06:34.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:34 smithi189 ceph-mon[34000]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-11T00:06:36.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:36 smithi189 ceph-mon[34000]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-11T00:06:36.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:36 smithi052 ceph-mon[33526]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-11T00:06:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:36 smithi033 ceph-mon[30593]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-09-11T00:06:38.071 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.4 2024-09-11T00:06:38.072 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:06:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 410.0 s, 639.0 tps, lat 156.236 ms stddev 45.940 2024-09-11T00:06:38.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:38 smithi052 ceph-mon[33526]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 640 op/s 2024-09-11T00:06:38.528 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:38 smithi033 ceph-mon[30593]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 640 op/s 2024-09-11T00:06:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:38 smithi189 ceph-mon[34000]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 640 op/s 2024-09-11T00:06:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:40.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:40 smithi033 ceph-mon[30593]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 645 op/s 2024-09-11T00:06:40.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:40 smithi052 ceph-mon[33526]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 645 op/s 2024-09-11T00:06:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 -- 172.21.15.33:0/66917513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff938076f90 msgr2=0x7ff9380755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 --2- 172.21.15.33:0/66917513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff938076f90 0x7ff9380755e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009900 tx=0x7ff92c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 -- 172.21.15.33:0/66917513 shutdown_connections 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 --2- 172.21.15.33:0/66917513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9381064a0 0x7ff938111180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 --2- 172.21.15.33:0/66917513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff938075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 --2- 172.21.15.33:0/66917513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff938076f90 0x7ff9380755e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.521+0000 7ff93f800640 1 -- 172.21.15.33:0/66917513 >> 172.21.15.33:0/66917513 conn(0x7ff9380fe250 msgr2=0x7ff938100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.522+0000 7ff93f800640 1 -- 172.21.15.33:0/66917513 shutdown_connections 2024-09-11T00:06:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.522+0000 7ff93f800640 1 -- 172.21.15.33:0/66917513 wait complete. 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.523+0000 7ff93f800640 1 Processor -- start 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.523+0000 7ff93f800640 1 -- start start 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff938076f90 0x7ff93819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 0x7ff9381a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff938114b00 con 0x7ff938076f90 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff938114980 con 0x7ff9381a0560 2024-09-11T00:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff938114c80 con 0x7ff938075b20 2024-09-11T00:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40390/0 (socket says 172.21.15.33:40390) 2024-09-11T00:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.524+0000 7ff93ce00640 1 -- 172.21.15.33:0/2609729513 learned_addr learned my addr 172.21.15.33:0/2609729513 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93d800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 0x7ff9381a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff937e00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff938076f90 0x7ff93819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93ce00640 1 -- 172.21.15.33:0/2609729513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 msgr2=0x7ff9381a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93ce00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 0x7ff9381a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93ce00640 1 -- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff938076f90 msgr2=0x7ff93819f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93ce00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff938076f90 0x7ff93819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93ce00640 1 -- 172.21.15.33:0/2609729513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9381a1210 con 0x7ff938075b20 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.525+0000 7ff93d800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 0x7ff9381a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.526+0000 7ff93ce00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff92c031460 tx=0x7ff92c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.526+0000 7ff935600640 1 -- 172.21.15.33:0/2609729513 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c03f070 con 0x7ff938075b20 2024-09-11T00:06:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.526+0000 7ff935600640 1 -- 172.21.15.33:0/2609729513 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff92c031ba0 con 0x7ff938075b20 2024-09-11T00:06:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.526+0000 7ff935600640 1 -- 172.21.15.33:0/2609729513 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c035030 con 0x7ff938075b20 2024-09-11T00:06:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.526+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93806cb70 con 0x7ff938075b20 2024-09-11T00:06:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.527+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93806d010 con 0x7ff938075b20 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.535+0000 7ff942695740 1 Processor -- start 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.535+0000 7ff942695740 1 -- start start 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.535+0000 7ff942695740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.535+0000 7ff942695740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff942695740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff942695740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653020346b0 con 0x5653020d50d0 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff942695740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x565302023ae0 con 0x5653020d7b10 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff942695740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653020278f0 con 0x5653020d27a0 2024-09-11T00:06:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff93d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff93d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40394/0 (socket says 172.21.15.33:40394) 2024-09-11T00:06:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.536+0000 7ff93d800640 1 -- 172.21.15.33:0/530492706 learned_addr learned my addr 172.21.15.33:0/530492706 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 -- 172.21.15.33:0/530492706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 msgr2=0x5653020d9fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d9fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 -- 172.21.15.33:0/530492706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 msgr2=0x5653020d74c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d74c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 -- 172.21.15.33:0/530492706 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565301ff0780 con 0x5653020d27a0 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.537+0000 7ff93d800640 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff930011810 tx=0x7ff930011cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a9a489903fad09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.538+0000 7ff935600640 1 -- 172.21.15.33:0/2609729513 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff92c031710 con 0x7ff938075b20 2024-09-11T00:06:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.538+0000 7ff92a000640 1 -- 172.21.15.33:0/530492706 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930011310 con 0x5653020d27a0 2024-09-11T00:06:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.538+0000 7ff92a000640 1 -- 172.21.15.33:0/530492706 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff93000f9a0 con 0x5653020d27a0 2024-09-11T00:06:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.538+0000 7ff92a000640 1 -- 172.21.15.33:0/530492706 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930005630 con 0x5653020d27a0 2024-09-11T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 -- 172.21.15.33:0/530492706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 msgr2=0x5653020d4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff930011810 tx=0x7ff930011cd0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 -- 172.21.15.33:0/530492706 shutdown_connections 2024-09-11T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 --2- 172.21.15.33:0/530492706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020d4b90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.542+0000 7ff942695740 1 -- 172.21.15.33:0/530492706 >> 172.21.15.33:0/530492706 conn(0x5653020bc8e0 msgr2=0x5653020bd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.543+0000 7ff942695740 1 -- 172.21.15.33:0/530492706 shutdown_connections 2024-09-11T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.543+0000 7ff942695740 1 -- 172.21.15.33:0/530492706 wait complete. 2024-09-11T00:06:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.543+0000 7ff935600640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 0x7ff9200b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.543+0000 7ff942695740 1 -- start start 2024-09-11T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff935600640 1 -- 172.21.15.33:0/2609729513 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff92c106e80 con 0x7ff938075b20 2024-09-11T00:06:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 Processor -- start 2024-09-11T00:06:40.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 0x5653020dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d50d0 0x5653020dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x565301f5bab0 con 0x5653020d27a0 2024-09-11T00:06:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x565301fca570 con 0x5653020d50d0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653020daaf0 con 0x5653020d7b10 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.544+0000 7ff942695740 10 client.0 _ll_register_callbacks cb 0x565301fd9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.545+0000 7ff937e00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 0x7ff9200b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.545+0000 7ff93d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.545+0000 7ff93d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40410/0 (socket says 172.21.15.33:40410) 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.545+0000 7ff93d800640 1 -- 172.21.15.33:0/1527525755 learned_addr learned my addr 172.21.15.33:0/1527525755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.545+0000 7ff937e00640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d50d0 0x5653020dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93ce00640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 0x5653020dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93d800640 1 -- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d50d0 msgr2=0x5653020dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93d800640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d50d0 0x5653020dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93d800640 1 -- 172.21.15.33:0/1527525755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 msgr2=0x5653020dbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff937e00640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 0x7ff9200b7730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff924009da0 tx=0x7ff9240157f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93d800640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 0x5653020dbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.546+0000 7ff93d800640 1 -- 172.21.15.33:0/1527525755 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565301d85790 con 0x5653020d7b10 2024-09-11T00:06:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.547+0000 7ff93ce00640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 0x5653020dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.547+0000 7ff93d800640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff930005f40 tx=0x7ff9300115c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf5e7525476d3f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.547+0000 7ff91ea00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:06:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.548+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930028020 con 0x5653020d7b10 2024-09-11T00:06:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.548+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff930004f00 con 0x5653020d7b10 2024-09-11T00:06:40.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.548+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff93000f9a0 con 0x5653020d7b10 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.548+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff930005350 con 0x5653020d7b10 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.549+0000 7ff942695740 10 client.26284 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.549+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565301dfe620 con 0x5653020d7b10 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff93000f9a0 con 0x5653020d7b10 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff930018070 con 0x5653020d7b10 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 10 client.26284 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 20 client.26284 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653020e75c0 0x5653020e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 4 client.26284 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.550+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565302036600 con 0x5653020e75c0 2024-09-11T00:06:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.551+0000 7ff93ce00640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653020e75c0 0x5653020e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.553+0000 7ff91ea00640 10 client.26284 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.553+0000 7ff93ce00640 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653020e75c0 0x5653020e99b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53df2d71f2c5d595 server_cookie=684efca0921cdb22 in_seq=0 out_seq=0 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.554+0000 7ff91ea00640 1 -- 172.21.15.33:0/1527525755 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565302036600 con 0x5653020e75c0 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.554+0000 7ff91ea00640 10 client.26284 handle_command_reply: tid=0 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.554+0000 7ff942695740 1 client.26284 shutdown 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.555+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 msgr2=0x5653020dd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.555+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff930005f40 tx=0x7ff9300115c0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 shutdown_connections 2024-09-11T00:06:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5653020e75c0 0x5653020e99b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d7b10 0x5653020dd230 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d50d0 0x5653020dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 --2- 172.21.15.33:0/1527525755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d27a0 0x5653020dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 >> 172.21.15.33:0/1527525755 conn(0x5653020bc8e0 msgr2=0x5653020bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.558+0000 7ff91ea00640 0 client.26284 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.559+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 shutdown_connections 2024-09-11T00:06:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.560+0000 7ff942695740 1 -- 172.21.15.33:0/1527525755 wait complete. 2024-09-11T00:06:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.560+0000 7ff942695740 20 client.26284 trim_cache size 0 max 16384 2024-09-11T00:06:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:40 smithi189 ceph-mon[34000]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 645 op/s 2024-09-11T00:06:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.591+0000 7ff942695740 1 Processor -- start 2024-09-11T00:06:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.591+0000 7ff942695740 1 -- start start 2024-09-11T00:06:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.591+0000 7ff942695740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff942695740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff942695740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff942695740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff93810af20 con 0x5653020d50d0 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff942695740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9381087f0 con 0x5653020d7b10 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff942695740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff938106660 con 0x5653020d27a0 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020dd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40426/0 (socket says 172.21.15.33:40426) 2024-09-11T00:06:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.593+0000 7ff93ce00640 1 -- 172.21.15.33:0/3676348485 learned_addr learned my addr 172.21.15.33:0/3676348485 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.594+0000 7ff937e00640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.594+0000 7ff93d800640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff937e00640 1 -- 172.21.15.33:0/3676348485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 msgr2=0x5653020dd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff937e00640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020dd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff937e00640 1 -- 172.21.15.33:0/3676348485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 msgr2=0x5653020d8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff937e00640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff937e00640 1 -- 172.21.15.33:0/3676348485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653020dc9d0 con 0x5653020d50d0 2024-09-11T00:06:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.595+0000 7ff93d800640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.596+0000 7ff937e00640 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d7ef0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff924015cf0 tx=0x7ff924018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfd0e7f1f960a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.596+0000 7ff929600640 1 -- 172.21.15.33:0/3676348485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924013c80 con 0x5653020d50d0 2024-09-11T00:06:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.597+0000 7ff929600640 1 -- 172.21.15.33:0/3676348485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff924013e20 con 0x5653020d50d0 2024-09-11T00:06:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.597+0000 7ff929600640 1 -- 172.21.15.33:0/3676348485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92401f790 con 0x5653020d50d0 2024-09-11T00:06:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 -- 172.21.15.33:0/3676348485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 msgr2=0x5653020d7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d7ef0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff924015cf0 tx=0x7ff924018000 comp rx=0 tx=0).stop 2024-09-11T00:06:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 -- 172.21.15.33:0/3676348485 shutdown_connections 2024-09-11T00:06:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d7b10 0x5653020d8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d50d0 0x5653020d7ef0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 --2- 172.21.15.33:0/3676348485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d27a0 0x5653020dd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.598+0000 7ff942695740 1 -- 172.21.15.33:0/3676348485 >> 172.21.15.33:0/3676348485 conn(0x5653020bc8e0 msgr2=0x5653020db160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.601+0000 7ff942695740 1 -- 172.21.15.33:0/3676348485 shutdown_connections 2024-09-11T00:06:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.602+0000 7ff942695740 1 -- 172.21.15.33:0/3676348485 wait complete. 2024-09-11T00:06:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.603+0000 7ff942695740 1 -- start start 2024-09-11T00:06:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.603+0000 7ff942695740 1 Processor -- start 2024-09-11T00:06:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d50d0 0x5653020e3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d7b10 0x5653020e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff938106cb0 con 0x5653020d7b10 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff938108120 con 0x5653020d27a0 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff938107380 con 0x5653020d50d0 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff942695740 10 client.0 _ll_register_callbacks cb 0x7ff9300116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff93ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:48944/0 (socket says 172.21.15.33:48944) 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff937e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d50d0 0x5653020e3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.604+0000 7ff93ce00640 1 -- 172.21.15.33:0/834282308 learned_addr learned my addr 172.21.15.33:0/834282308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93d800640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d7b10 0x5653020e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93ce00640 1 -- 172.21.15.33:0/834282308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d50d0 msgr2=0x5653020e3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93ce00640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d50d0 0x5653020e3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93ce00640 1 -- 172.21.15.33:0/834282308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d7b10 msgr2=0x5653020e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93ce00640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d7b10 0x5653020e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.605+0000 7ff93ce00640 1 -- 172.21.15.33:0/834282308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653020e1af0 con 0x5653020d27a0 2024-09-11T00:06:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.607+0000 7ff93ce00640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff92c104630 tx=0x7ff92c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66259a5fc4df2f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.607+0000 7ff91ea00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:06:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.608+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c049050 con 0x5653020d27a0 2024-09-11T00:06:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.608+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff92c0f00b0 con 0x5653020d27a0 2024-09-11T00:06:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.608+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff924013e20 con 0x5653020d27a0 2024-09-11T00:06:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.609+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff92c0ccdb0 con 0x5653020d27a0 2024-09-11T00:06:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.609+0000 7ff942695740 10 client.36326 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.609+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565302154ad0 con 0x5653020d27a0 2024-09-11T00:06:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.610+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff924013e20 con 0x5653020d27a0 2024-09-11T00:06:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.610+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff92c0cd500 con 0x5653020d27a0 2024-09-11T00:06:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.612+0000 7ff942695740 10 client.36326 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff942695740 10 client.36326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff942695740 20 client.36326 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x565302155430 0x565302157850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff942695740 4 client.36326 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653020320b0 con 0x565302155430 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.613+0000 7ff937e00640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x565302155430 0x565302157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.615+0000 7ff91ea00640 10 client.36326 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.615+0000 7ff937e00640 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x565302155430 0x565302157850 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141a65a251a3debf server_cookie=407956d8ba87ff0 in_seq=0 out_seq=0 2024-09-11T00:06:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.658+0000 7ff91ea00640 1 -- 172.21.15.33:0/834282308 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653020320b0 con 0x565302155430 2024-09-11T00:06:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.658+0000 7ff91ea00640 10 client.36326 handle_command_reply: tid=0 2024-09-11T00:06:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.658+0000 7ff942695740 1 client.36326 shutdown 2024-09-11T00:06:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 msgr2=0x5653020e2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff92c104630 tx=0x7ff92c009260 comp rx=0 tx=0).stop 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 shutdown_connections 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653020d7b10 0x5653020e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x565302155430 0x565302157850 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653020d50d0 0x5653020e3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 --2- 172.21.15.33:0/834282308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653020d27a0 0x5653020e2cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 >> 172.21.15.33:0/834282308 conn(0x5653020bc8e0 msgr2=0x5653020d7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.660+0000 7ff91ea00640 0 client.36326 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.661+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 shutdown_connections 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.661+0000 7ff942695740 1 -- 172.21.15.33:0/834282308 wait complete. 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.661+0000 7ff942695740 20 client.36326 trim_cache size 0 max 16384 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:06:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:06:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 msgr2=0x7ff9200b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 0x7ff9200b7730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff924009da0 tx=0x7ff9240157f0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 msgr2=0x7ff93819f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff92c031460 tx=0x7ff92c003c10 comp rx=0 tx=0).stop 2024-09-11T00:06:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 shutdown_connections 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff9200b5270 0x7ff9200b7730 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9381a0560 0x7ff9381a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff938076f90 0x7ff93819f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 --2- 172.21.15.33:0/2609729513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff938075b20 0x7ff93819f2e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.663+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 >> 172.21.15.33:0/2609729513 conn(0x7ff9380fe250 msgr2=0x7ff938100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.664+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 shutdown_connections 2024-09-11T00:06:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:40.664+0000 7ff93f800640 1 -- 172.21.15.33:0/2609729513 wait complete. 2024-09-11T00:06:40.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 -- 172.21.15.33:0/3644892844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 msgr2=0x7fb03410dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 --2- 172.21.15.33:0/3644892844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb03410dfe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009ca0 tx=0x7fb02c02b9d0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 -- 172.21.15.33:0/3644892844 shutdown_connections 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 --2- 172.21.15.33:0/3644892844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb03410dfe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 --2- 172.21.15.33:0/3644892844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 0x7fb0341072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 --2- 172.21.15.33:0/3644892844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 -- 172.21.15.33:0/3644892844 >> 172.21.15.33:0/3644892844 conn(0x7fb034078140 msgr2=0x7fb0340ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.740+0000 7fb039c00640 1 -- 172.21.15.33:0/3644892844 shutdown_connections 2024-09-11T00:06:40.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.741+0000 7fb039c00640 1 -- 172.21.15.33:0/3644892844 wait complete. 2024-09-11T00:06:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.742+0000 7fb039c00640 1 Processor -- start 2024-09-11T00:06:40.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 -- start start 2024-09-11T00:06:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 0x7fb03419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb034197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb034110ab0 con 0x7fb034106e60 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb034110930 con 0x7fb034107800 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.743+0000 7fb039c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb034110c30 con 0x7fb034101450 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.744+0000 7fb032a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.744+0000 7fb032a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40442/0 (socket says 172.21.15.33:40442) 2024-09-11T00:06:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.744+0000 7fb032a00640 1 -- 172.21.15.33:0/3724960066 learned_addr learned my addr 172.21.15.33:0/3724960066 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.744+0000 7fb033400640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb034197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.744+0000 7fb02a000640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 0x7fb03419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.745+0000 7fb032a00640 1 -- 172.21.15.33:0/3724960066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 msgr2=0x7fb034197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.745+0000 7fb032a00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb034197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.745+0000 7fb032a00640 1 -- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 msgr2=0x7fb03419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.745+0000 7fb032a00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 0x7fb03419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.745+0000 7fb032a00640 1 -- 172.21.15.33:0/3724960066 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0341abbd0 con 0x7fb034101450 2024-09-11T00:06:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.747+0000 7fb032a00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9f0 tx=0x7fb02400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.747+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02400cd80 con 0x7fb034101450 2024-09-11T00:06:40.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.747+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0240108c0 con 0x7fb034101450 2024-09-11T00:06:40.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.747+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0240187c0 con 0x7fb034101450 2024-09-11T00:06:40.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.747+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0341a13b0 con 0x7fb034101450 2024-09-11T00:06:40.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.748+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0341a18a0 con 0x7fb034101450 2024-09-11T00:06:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.751+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb034102700 con 0x7fb034101450 2024-09-11T00:06:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.753+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb024010430 con 0x7fb034101450 2024-09-11T00:06:40.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.756+0000 7fb02be00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 0x7fb0180b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:40.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.757+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb0240e62e0 con 0x7fb034101450 2024-09-11T00:06:40.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.757+0000 7fb02a000640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 0x7fb0180b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:40.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.758+0000 7fb02a000640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 0x7fb0180b7970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb034198960 tx=0x7fb01c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:40.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:40.759+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0240acda0 con 0x7fb034101450 2024-09-11T00:06:41.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.214+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0341095c0 con 0x7fb034101450 2024-09-11T00:06:41.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.215+0000 7fb02be00640 1 -- 172.21.15.33:0/3724960066 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fb0240ac6a0 con 0x7fb034101450 2024-09-11T00:06:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:06:41.221 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:06:41.221 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:06:41.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 msgr2=0x7fb0180b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:41.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 0x7fb0180b7970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb034198960 tx=0x7fb01c005f90 comp rx=0 tx=0).stop 2024-09-11T00:06:41.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 msgr2=0x7fb034196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9f0 tx=0x7fb02400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 shutdown_connections 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb0180b54b0 0x7fb0180b7970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb034107800 0x7fb034197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb034106e60 0x7fb03419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 --2- 172.21.15.33:0/3724960066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb034101450 0x7fb034196e70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.219+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 >> 172.21.15.33:0/3724960066 conn(0x7fb034078140 msgr2=0x7fb0340ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.220+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 shutdown_connections 2024-09-11T00:06:41.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:41.220+0000 7fb039c00640 1 -- 172.21.15.33:0/3724960066 wait complete. 2024-09-11T00:06:42.272 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 153.4 --await-for 45.0' 2024-09-11T00:06:42.272 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 153.4 --await-for 45.0 2024-09-11T00:06:42.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:42 smithi033 ceph-mon[30593]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-11T00:06:42.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:42 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3724960066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:42.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:42 smithi052 ceph-mon[33526]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-11T00:06:42.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:42 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3724960066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:42 smithi189 ceph-mon[34000]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-11T00:06:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:42 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3724960066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:06:42.985 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:06:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 415.0 s, 619.2 tps, lat 162.068 ms stddev 45.422 2024-09-11T00:06:44.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 -- 172.21.15.33:0/3967212499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e010ad20 msgr2=0x7fc9e010f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 --2- 172.21.15.33:0/3967212499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e010ad20 0x7fc9e010f750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009860 tx=0x7fc9cc02a360 comp rx=0 tx=0).stop 2024-09-11T00:06:44.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 -- 172.21.15.33:0/3967212499 shutdown_connections 2024-09-11T00:06:44.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 --2- 172.21.15.33:0/3967212499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e0114360 0x7fc9e0116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 --2- 172.21.15.33:0/3967212499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e010ad20 0x7fc9e010f750 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 --2- 172.21.15.33:0/3967212499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e006aa40 0x7fc9e010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.389+0000 7fc9e6200640 1 -- 172.21.15.33:0/3967212499 >> 172.21.15.33:0/3967212499 conn(0x7fc9e006e2e0 msgr2=0x7fc9e006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.392 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:44 smithi033 ceph-mon[30593]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-11T00:06:44.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.390+0000 7fc9e6200640 1 -- 172.21.15.33:0/3967212499 shutdown_connections 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.390+0000 7fc9e6200640 1 -- 172.21.15.33:0/3967212499 wait complete. 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.391+0000 7fc9e6200640 1 Processor -- start 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.392+0000 7fc9e6200640 1 -- start start 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.392+0000 7fc9e6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.392+0000 7fc9e6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e0114360 0x7fc9e011abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.392+0000 7fc9e6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 0x7fc9e011b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51278/0 (socket says 172.21.15.33:51278) 2024-09-11T00:06:44.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9df400640 1 -- 172.21.15.33:0/2601460383 learned_addr learned my addr 172.21.15.33:0/2601460383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0119280 con 0x7fc9e0114360 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0119100 con 0x7fc9e011b0f0 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e0119400 con 0x7fc9e006aa40 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.393+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 0x7fc9e011b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 -- 172.21.15.33:0/2601460383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 msgr2=0x7fc9e011b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 0x7fc9e011b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 -- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e0114360 msgr2=0x7fc9e011abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e0114360 0x7fc9e011abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e01b4940 con 0x7fc9e006aa40 2024-09-11T00:06:44.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 0x7fc9e011b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.394+0000 7fc9df400640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e9c0 tx=0x7fc9d000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.395+0000 7fc9d7e00640 1 -- 172.21.15.33:0/2601460383 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000ccc0 con 0x7fc9e006aa40 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.395+0000 7fc9d7e00640 1 -- 172.21.15.33:0/2601460383 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d00054b0 con 0x7fc9e006aa40 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.395+0000 7fc9d7e00640 1 -- 172.21.15.33:0/2601460383 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0010430 con 0x7fc9e006aa40 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.395+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e01b4bd0 con 0x7fc9e006aa40 2024-09-11T00:06:44.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.395+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e01b5090 con 0x7fc9e006aa40 2024-09-11T00:06:44.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.401+0000 7fc9d7e00640 1 -- 172.21.15.33:0/2601460383 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc9d00105d0 con 0x7fc9e006aa40 2024-09-11T00:06:44.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.402+0000 7fc9e8e09740 1 Processor -- start 2024-09-11T00:06:44.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 -- start start 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6a4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 0x55a80c6b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a80c619ca0 con 0x55a80c6a4aa0 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a80c6090d0 con 0x55a80c6b0a30 2024-09-11T00:06:44.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.405+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a80c60cee0 con 0x55a80c6a4180 2024-09-11T00:06:44.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.406+0000 7fc9df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.406+0000 7fc9df400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50662/0 (socket says 172.21.15.33:50662) 2024-09-11T00:06:44.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.406+0000 7fc9df400640 1 -- 172.21.15.33:0/1199854228 learned_addr learned my addr 172.21.15.33:0/1199854228 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:44.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.407+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9dea00640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 0x55a80c6b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9df400640 1 -- 172.21.15.33:0/1199854228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 msgr2=0x55a80c6a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9df400640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9df400640 1 -- 172.21.15.33:0/1199854228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 msgr2=0x55a80c6b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9df400640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 0x55a80c6b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9df400640 1 -- 172.21.15.33:0/1199854228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80c5bb400 con 0x55a80c6a4aa0 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.408+0000 7fc9dea00640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 0x55a80c6b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.409+0000 7fc9df400640 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ee0e0 tx=0x7fc9d00ee5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d7baf4490a9611 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.409+0000 7fc9d7e00640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 0x7fc9c40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.410+0000 7fc9cbe00640 1 -- 172.21.15.33:0/1199854228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00f9070 con 0x55a80c6a4aa0 2024-09-11T00:06:44.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.410+0000 7fc9cbe00640 1 -- 172.21.15.33:0/1199854228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d0023670 con 0x55a80c6a4aa0 2024-09-11T00:06:44.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.410+0000 7fc9cbe00640 1 -- 172.21.15.33:0/1199854228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00a9c10 con 0x55a80c6a4aa0 2024-09-11T00:06:44.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.411+0000 7fc9d7e00640 1 -- 172.21.15.33:0/2601460383 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc9d00e6070 con 0x7fc9e006aa40 2024-09-11T00:06:44.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.411+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 0x7fc9c40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 -- 172.21.15.33:0/1199854228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 msgr2=0x55a80c6b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ee0e0 tx=0x7fc9d00ee5a0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 -- 172.21.15.33:0/1199854228 shutdown_connections 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b0a30 0x55a80c6b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6a4aa0 0x55a80c6b04f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/1199854228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 -- 172.21.15.33:0/1199854228 >> 172.21.15.33:0/1199854228 conn(0x55a80c6a1fb0 msgr2=0x55a80c6a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.412+0000 7fc9e8e09740 1 -- 172.21.15.33:0/1199854228 shutdown_connections 2024-09-11T00:06:44.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.413+0000 7fc9e8e09740 1 -- 172.21.15.33:0/1199854228 wait complete. 2024-09-11T00:06:44.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.414+0000 7fc9e8e09740 1 -- start start 2024-09-11T00:06:44.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.415+0000 7fc9e8e09740 1 Processor -- start 2024-09-11T00:06:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6a4aa0 0x55a80c6ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a80c46a7a0 con 0x55a80c6b0a30 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a80c5aea10 con 0x55a80c6a4aa0 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a80c6b36b0 con 0x55a80c6a4180 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 0x7fc9c40b78f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006c130 tx=0x7fc9d800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.417+0000 7fc9e8e09740 10 client.0 _ll_register_callbacks cb 0x55a80c5bebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51294/0 (socket says 172.21.15.33:51294) 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 -- 172.21.15.33:0/3821248593 learned_addr learned my addr 172.21.15.33:0/3821248593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9dea00640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6a4aa0 0x55a80c6ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 -- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6a4aa0 msgr2=0x55a80c6ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6a4aa0 0x55a80c6ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.418+0000 7fc9df400640 1 -- 172.21.15.33:0/3821248593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 msgr2=0x55a80c6add20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:06:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.420+0000 7fc9df400640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.420+0000 7fc9df400640 1 -- 172.21.15.33:0/3821248593 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80c376b90 con 0x55a80c6a4180 2024-09-11T00:06:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.420+0000 7fc9df400640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ee0e0 tx=0x7fc9d0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70de49d8e00d1fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.420+0000 7fc9c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:06:44.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.421+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000ce60 con 0x55a80c6a4180 2024-09-11T00:06:44.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.421+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc9d00ada20 con 0x55a80c6a4180 2024-09-11T00:06:44.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.421+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d0023670 con 0x55a80c6a4180 2024-09-11T00:06:44.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.422+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc9d00acd30 con 0x55a80c6a4180 2024-09-11T00:06:44.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.422+0000 7fc9e8e09740 10 client.26308 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:44.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.422+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a80c6bf040 con 0x55a80c6a4180 2024-09-11T00:06:44.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.422+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d0023670 con 0x55a80c6a4180 2024-09-11T00:06:44.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc9d00b66c0 con 0x55a80c6a4180 2024-09-11T00:06:44.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 10 client.26308 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:44.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 10 client.26308 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:06:44.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 20 client.26308 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:44.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c6c0390 0x55a80c6c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 4 client.26308 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:44.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.423+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a80c61bbf0 con 0x55a80c6c0390 2024-09-11T00:06:44.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.424+0000 7fc9dea00640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c6c0390 0x55a80c6c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.425+0000 7fc9dea00640 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c6c0390 0x55a80c6c2780 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9398dcf7e37fe42 server_cookie=57810a9653b9735c in_seq=0 out_seq=0 2024-09-11T00:06:44.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.425+0000 7fc9c8c00640 10 client.26308 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:44.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.426+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3821248593 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a80c61bbf0 con 0x55a80c6c0390 2024-09-11T00:06:44.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.426+0000 7fc9c8c00640 10 client.26308 handle_command_reply: tid=0 2024-09-11T00:06:44.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.426+0000 7fc9e8e09740 1 client.26308 shutdown 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 msgr2=0x55a80c6b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ee0e0 tx=0x7fc9d0014000 comp rx=0 tx=0).stop 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 shutdown_connections 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6a4aa0 0x55a80c6ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.427+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c6c0390 0x55a80c6c2780 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.428+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3821248593 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4180 0x55a80c6b02f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.428+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 >> 172.21.15.33:0/3821248593 conn(0x55a80c6a1fb0 msgr2=0x55a80c6a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.428+0000 7fc9c8c00640 0 client.26308 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:44.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.429+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 shutdown_connections 2024-09-11T00:06:44.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.429+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3821248593 wait complete. 2024-09-11T00:06:44.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.430+0000 7fc9e8e09740 20 client.26308 trim_cache size 0 max 16384 2024-09-11T00:06:44.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:44 smithi052 ceph-mon[33526]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-11T00:06:44.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.468+0000 7fc9e8e09740 1 Processor -- start 2024-09-11T00:06:44.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 -- start start 2024-09-11T00:06:44.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c6aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0012550 con 0x55a80c6b0a30 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c000fe20 con 0x55a80c6b2360 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.469+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c000dc70 con 0x55a80c6a4aa0 2024-09-11T00:06:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.470+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.470+0000 7fc9df400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51310/0 (socket says 172.21.15.33:51310) 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.470+0000 7fc9df400640 1 -- 172.21.15.33:0/2352806056 learned_addr learned my addr 172.21.15.33:0/2352806056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.470+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c6aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.470+0000 7fc9dea00640 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 -- 172.21.15.33:0/2352806056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 msgr2=0x55a80c6a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 -- 172.21.15.33:0/2352806056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 msgr2=0x55a80c6b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 -- 172.21.15.33:0/2352806056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a80c6a1de0 con 0x55a80c6b2360 2024-09-11T00:06:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.471+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c6aa950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800af30 tx=0x7fc9d8004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204f1367cdca36db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.472+0000 7fc9cb400640 1 -- 172.21.15.33:0/2352806056 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8028070 con 0x55a80c6b2360 2024-09-11T00:06:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.472+0000 7fc9cb400640 1 -- 172.21.15.33:0/2352806056 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d8016dc0 con 0x55a80c6b2360 2024-09-11T00:06:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.472+0000 7fc9cb400640 1 -- 172.21.15.33:0/2352806056 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011ea0 con 0x55a80c6b2360 2024-09-11T00:06:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.474+0000 7fc9e8e09740 1 -- 172.21.15.33:0/2352806056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 msgr2=0x55a80c6aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.474+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c6aa950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800af30 tx=0x7fc9d8004b50 comp rx=0 tx=0).stop 2024-09-11T00:06:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.474+0000 7fc9e8e09740 1 -- 172.21.15.33:0/2352806056 shutdown_connections 2024-09-11T00:06:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.475+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c6aa950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.475+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.475+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/2352806056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.475+0000 7fc9e8e09740 1 -- 172.21.15.33:0/2352806056 >> 172.21.15.33:0/2352806056 conn(0x55a80c6a1fb0 msgr2=0x55a80c6a2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.475+0000 7fc9e8e09740 1 -- 172.21.15.33:0/2352806056 shutdown_connections 2024-09-11T00:06:44.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.476+0000 7fc9e8e09740 1 -- 172.21.15.33:0/2352806056 wait complete. 2024-09-11T00:06:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.477+0000 7fc9e8e09740 1 -- start start 2024-09-11T00:06:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.478+0000 7fc9e8e09740 1 Processor -- start 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.479+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.479+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.479+0000 7fc9e8e09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c000e2e0 con 0x55a80c6b0a30 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c000f750 con 0x55a80c6b2360 2024-09-11T00:06:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9e8e09740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c000e9b0 con 0x55a80c6a4aa0 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9e8e09740 10 client.0 _ll_register_callbacks cb 0x7fc9d00f7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9dea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:46730/0 (socket says 172.21.15.33:46730) 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9dfe00640 1 -- 172.21.15.33:0/3735525107 learned_addr learned my addr 172.21.15.33:0/3735525107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.480+0000 7fc9df400640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 -- 172.21.15.33:0/3735525107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 msgr2=0x55a80c6c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 -- 172.21.15.33:0/3735525107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 msgr2=0x55a80c6c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:44.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 -- 172.21.15.33:0/3735525107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a80c727610 con 0x55a80c6b2360 2024-09-11T00:06:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9df400640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dea00640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.482+0000 7fc9dfe00640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8004a80 tx=0x7fc9d8016fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54bb62dde1c38baf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.483+0000 7fc9c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:06:44.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.483+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8031020 con 0x55a80c6b2360 2024-09-11T00:06:44.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.484+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc9d8011da0 con 0x55a80c6b2360 2024-09-11T00:06:44.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.484+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d8016dc0 con 0x55a80c6b2360 2024-09-11T00:06:44.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.485+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc9d8028040 con 0x55a80c6b2360 2024-09-11T00:06:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.486+0000 7fc9e8e09740 10 client.36350 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.486+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a80c72e9c0 con 0x55a80c6b2360 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9d8016dc0 con 0x55a80c6b2360 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc9d802da50 con 0x55a80c6b2360 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 10 client.36350 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 10 client.36350 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 20 client.36350 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c72f030 0x55a80c731450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 4 client.36350 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.4, "await_for": 45.0}] 2024-09-11T00:06:44.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.487+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 153.4, "await_for": 45.0}) -- 0x55a80c6176a0 con 0x55a80c72f030 2024-09-11T00:06:44.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.489+0000 7fc9df400640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c72f030 0x55a80c731450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.490+0000 7fc9df400640 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c72f030 0x55a80c731450 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73d42a6d0d3826c server_cookie=24a249dd22b619c2 in_seq=0 out_seq=0 2024-09-11T00:06:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.490+0000 7fc9c8c00640 10 client.36350 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:44 smithi189 ceph-mon[34000]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-11T00:06:44.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.775+0000 7fc9c8c00640 1 -- 172.21.15.33:0/3735525107 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a80c6176a0 con 0x55a80c72f030 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.775+0000 7fc9c8c00640 10 client.36350 handle_command_reply: tid=0 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 client.36350 shutdown 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 msgr2=0x55a80c726ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8004a80 tx=0x7fc9d8016fe0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 shutdown_connections 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a80c6b2360 0x55a80c726ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a80c6b0a30 0x55a80c6c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a80c72f030 0x55a80c731450 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 --2- 172.21.15.33:0/3735525107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a80c6a4aa0 0x55a80c6c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 >> 172.21.15.33:0/3735525107 conn(0x55a80c6a1fb0 msgr2=0x55a80c6aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9c8c00640 0 client.36350 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:44.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 shutdown_connections 2024-09-11T00:06:44.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.776+0000 7fc9e8e09740 1 -- 172.21.15.33:0/3735525107 wait complete. 2024-09-11T00:06:44.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.777+0000 7fc9e8e09740 20 client.36350 trim_cache size 0 max 16384 2024-09-11T00:06:44.779 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 30, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "d753d2d": { 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 30, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:06:44.780 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 153.4, 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:06:44.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 msgr2=0x7fc9c40b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 0x7fc9c40b78f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006c130 tx=0x7fc9d800d040 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 msgr2=0x7fc9e011d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000e9c0 tx=0x7fc9d000ee80 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 shutdown_connections 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc9c40b5430 0x7fc9c40b78f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e011b0f0 0x7fc9e011b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e0114360 0x7fc9e011abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 --2- 172.21.15.33:0/2601460383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9e006aa40 0x7fc9e011d960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 >> 172.21.15.33:0/2601460383 conn(0x7fc9e006e2e0 msgr2=0x7fc9e010c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 shutdown_connections 2024-09-11T00:06:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:06:44.778+0000 7fc9e6200640 1 -- 172.21.15.33:0/2601460383 wait complete. 2024-09-11T00:06:45.779 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd753d2d', quiesce took 7.7 seconds. Will release after: 25.7 2024-09-11T00:06:46.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:46 smithi052 ceph-mon[33526]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T00:06:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:46 smithi033 ceph-mon[30593]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T00:06:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:46 smithi189 ceph-mon[34000]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-09-11T00:06:48.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 420.0 s, 154.0 tps, lat 175.938 ms stddev 45.543 2024-09-11T00:06:48.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:48 smithi052 ceph-mon[33526]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T00:06:48.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:48 smithi033 ceph-mon[30593]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T00:06:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:48 smithi189 ceph-mon[34000]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 665 op/s 2024-09-11T00:06:50.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:50 smithi052 ceph-mon[33526]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-11T00:06:50.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:50 smithi033 ceph-mon[30593]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-11T00:06:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:50 smithi189 ceph-mon[34000]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-09-11T00:06:52.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:52 smithi052 ceph-mon[33526]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-11T00:06:52.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:52 smithi033 ceph-mon[30593]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-11T00:06:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:52 smithi189 ceph-mon[34000]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.2 MiB/s wr, 465 op/s 2024-09-11T00:06:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:06:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2618842251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 msgr2=0x7f3ba0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2618842251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba0102b90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009930 tx=0x7f3b9002a420 comp rx=0 tx=0).stop 2024-09-11T00:06:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2618842251 shutdown_connections 2024-09-11T00:06:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2618842251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01042a0 0x7f3ba010ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2618842251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01038e0 0x7f3ba0103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2618842251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba0102b90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2618842251 >> 172.21.15.33:0/2618842251 conn(0x7f3ba00fe030 msgr2=0x7f3ba0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2618842251 shutdown_connections 2024-09-11T00:06:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.805+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2618842251 wait complete. 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.806+0000 7f3ba5a00640 1 Processor -- start 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.806+0000 7f3ba5a00640 1 -- start start 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 0x7f3ba019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01042a0 0x7f3ba019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba010e2e0 con 0x7f3ba0102790 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba010e160 con 0x7f3ba01038e0 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba010e460 con 0x7f3ba01042a0 2024-09-11T00:06:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59104/0 (socket says 172.21.15.33:59104) 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 -- 172.21.15.33:0/2863906609 learned_addr learned my addr 172.21.15.33:0/2863906609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3ba5000640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01042a0 0x7f3ba019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 0x7f3ba019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 -- 172.21.15.33:0/2863906609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01042a0 msgr2=0x7f3ba019bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01042a0 0x7f3ba019bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 -- 172.21.15.33:0/2863906609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 msgr2=0x7f3ba019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 0x7f3ba019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.807+0000 7f3b9fe00640 1 -- 172.21.15.33:0/2863906609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba019c870 con 0x7f3ba0102790 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 0x7f3ba019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3b90031460 tx=0x7f3b90003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3b9cc00640 1 -- 172.21.15.33:0/2863906609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9003f070 con 0x7f3ba0102790 2024-09-11T00:06:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3b9cc00640 1 -- 172.21.15.33:0/2863906609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b90031da0 con 0x7f3ba0102790 2024-09-11T00:06:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba019cb00 con 0x7f3ba0102790 2024-09-11T00:06:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3b9cc00640 1 -- 172.21.15.33:0/2863906609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90035030 con 0x7f3ba0102790 2024-09-11T00:06:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.808+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba01a3230 con 0x7f3ba0102790 2024-09-11T00:06:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.812+0000 7f3ba9df0740 1 Processor -- start 2024-09-11T00:06:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.812+0000 7f3ba9df0740 1 -- start start 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a587970 0x56306a589d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a58a2a0 0x56306a58c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56306a4fa6b0 con 0x56306a58cce0 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56306a4e9ae0 con 0x56306a587970 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56306a4ed8f0 con 0x56306a58a2a0 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59114/0 (socket says 172.21.15.33:59114) 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3b9f400640 1 -- 172.21.15.33:0/2999475822 learned_addr learned my addr 172.21.15.33:0/2999475822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3ba5000640 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a587970 0x56306a589d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.813+0000 7f3b9cc00640 1 -- 172.21.15.33:0/2863906609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3b9003b460 con 0x7f3ba0102790 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 -- 172.21.15.33:0/2999475822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a58a2a0 msgr2=0x56306a58c690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a58a2a0 0x56306a58c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 -- 172.21.15.33:0/2999475822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a587970 msgr2=0x56306a589d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a587970 0x56306a589d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 -- 172.21.15.33:0/2999475822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56306a4b6780 con 0x56306a58cce0 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009c50 tx=0x7f3b8c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b816887cbea166 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b95600640 1 -- 172.21.15.33:0/2999475822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c016070 con 0x56306a58cce0 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b95600640 1 -- 172.21.15.33:0/2999475822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b8c0054b0 con 0x56306a58cce0 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.814+0000 7f3b95600640 1 -- 172.21.15.33:0/2999475822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c011470 con 0x56306a58cce0 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 -- 172.21.15.33:0/2999475822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 msgr2=0x56306a58f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009c50 tx=0x7f3b8c00e6c0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 -- 172.21.15.33:0/2999475822 shutdown_connections 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a58f1a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a58a2a0 0x56306a58c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/2999475822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a587970 0x56306a589d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 -- 172.21.15.33:0/2999475822 >> 172.21.15.33:0/2999475822 conn(0x56306a582ac0 msgr2=0x56306a583850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 -- 172.21.15.33:0/2999475822 shutdown_connections 2024-09-11T00:06:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3ba9df0740 1 -- 172.21.15.33:0/2999475822 wait complete. 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3b9cc00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 0x7f3b840b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.815+0000 7f3b9cc00640 1 -- 172.21.15.33:0/2863906609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b90106ba0 con 0x7f3ba0102790 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.816+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 0x7f3b840b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.816+0000 7f3ba9df0740 1 -- start start 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.816+0000 7f3ba9df0740 1 Processor -- start 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.816+0000 7f3b9f400640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 0x7f3b840b7730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00f010 tx=0x7f3b8c005eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a591090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a592300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56306a421ab0 con 0x56306a58a2a0 2024-09-11T00:06:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56306a490570 con 0x56306a58cce0 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56306a58fcc0 con 0x56306a587970 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba9df0740 10 client.0 _ll_register_callbacks cb 0x56306a49f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59126/0 (socket says 172.21.15.33:59126) 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 -- 172.21.15.33:0/3980746548 learned_addr learned my addr 172.21.15.33:0/3980746548 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3ba5000640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a592300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a591090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 -- 172.21.15.33:0/3980746548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 msgr2=0x56306a591090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a591090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 -- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 msgr2=0x56306a592300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a592300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.817+0000 7f3b9f400640 1 -- 172.21.15.33:0/3980746548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56306a24b790 con 0x56306a58a2a0 2024-09-11T00:06:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0050e0 tx=0x7f3b8c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d0af3581fec4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3b8a000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:06:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c016040 con 0x56306a58a2a0 2024-09-11T00:06:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b8c020030 con 0x56306a58a2a0 2024-09-11T00:06:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b8c0054b0 con 0x56306a58a2a0 2024-09-11T00:06:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b8c03b050 con 0x56306a58a2a0 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3ba9df0740 10 client.16548 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.818+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56306a2c4620 con 0x56306a58a2a0 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b8c0054b0 con 0x56306a58a2a0 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3b8c00f040 con 0x56306a58a2a0 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 10 client.16548 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 10 client.16548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 20 client.16548 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a59c6b0 0x56306a59eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 4 client.16548 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:06:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56306a4fc600 con 0x56306a59c6b0 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.819+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a59c6b0 0x56306a59eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.820+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a59c6b0 0x56306a59eaa0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9887467550515dc server_cookie=80920e0e676b8978 in_seq=0 out_seq=0 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.820+0000 7f3b8a000640 10 client.16548 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3b8a000640 1 -- 172.21.15.33:0/3980746548 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56306a4fc600 con 0x56306a59c6b0 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3b8a000640 10 client.16548 handle_command_reply: tid=0 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 client.16548 shutdown 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 msgr2=0x56306a591730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0050e0 tx=0x7f3b8c00e6c0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 shutdown_connections 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a592300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a591730 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a59c6b0 0x56306a59eaa0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3980746548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a591090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 >> 172.21.15.33:0/3980746548 conn(0x56306a582ac0 msgr2=0x56306a581bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3b8a000640 0 client.16548 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 shutdown_connections 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3980746548 wait complete. 2024-09-11T00:06:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.821+0000 7f3ba9df0740 20 client.16548 trim_cache size 0 max 16384 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 Processor -- start 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 -- start start 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a5848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58a2a0 0x56306a584e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01aff30 con 0x56306a58cce0 2024-09-11T00:06:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01ad800 con 0x56306a58a2a0 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01ab650 con 0x56306a587970 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.837+0000 7f3ba5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59132/0 (socket says 172.21.15.33:59132) 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 -- 172.21.15.33:0/3530949457 learned_addr learned my addr 172.21.15.33:0/3530949457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58a2a0 0x56306a584e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a5848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 -- 172.21.15.33:0/3530949457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 msgr2=0x56306a5848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a5848f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 -- 172.21.15.33:0/3530949457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58a2a0 msgr2=0x56306a584e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58a2a0 0x56306a584e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 -- 172.21.15.33:0/3530949457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56306a5996f0 con 0x56306a58cce0 2024-09-11T00:06:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3ba5000640 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009fd0 tx=0x7f3b980128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393465ef594fc3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3b94c00640 1 -- 172.21.15.33:0/3530949457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004b20 con 0x56306a58cce0 2024-09-11T00:06:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.838+0000 7f3b94c00640 1 -- 172.21.15.33:0/3530949457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b98004cc0 con 0x56306a58cce0 2024-09-11T00:06:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3b94c00640 1 -- 172.21.15.33:0/3530949457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004840 con 0x56306a58cce0 2024-09-11T00:06:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3530949457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 msgr2=0x56306a585370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009fd0 tx=0x7f3b980128e0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3530949457 shutdown_connections 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58cce0 0x56306a585370 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58a2a0 0x56306a584e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3530949457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a5848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3530949457 >> 172.21.15.33:0/3530949457 conn(0x56306a582ac0 msgr2=0x56306a58d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3530949457 shutdown_connections 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.839+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3530949457 wait complete. 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 -- start start 2024-09-11T00:06:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 Processor -- start 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a598e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a5983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01abcc0 con 0x56306a58a2a0 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01ad130 con 0x56306a58cce0 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba01ac390 con 0x56306a587970 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba9df0740 10 client.0 _ll_register_callbacks cb 0x7f3b98009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3b9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59148/0 (socket says 172.21.15.33:59148) 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3b9f400640 1 -- 172.21.15.33:0/3960060039 learned_addr learned my addr 172.21.15.33:0/3960060039 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:06:53.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.840+0000 7f3ba5000640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a5983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a598e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 -- 172.21.15.33:0/3960060039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 msgr2=0x56306a598e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a598e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 -- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 msgr2=0x56306a5983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a5983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 -- 172.21.15.33:0/3960060039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56306a5966f0 con 0x56306a58a2a0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b9f400640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00ebc0 tx=0x7f3b8c009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c956c9279c11b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b8a000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c016040 con 0x56306a58a2a0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b98004cc0 con 0x56306a58a2a0 2024-09-11T00:06:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.841+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3b8c02c040 con 0x56306a58a2a0 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b8c04c050 con 0x56306a58a2a0 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 10 client.16554 fetch_fsmap learned FSMap version 30 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56306a609910 con 0x56306a58a2a0 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b98004cc0 con 0x56306a58a2a0 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3b8c011960 con 0x56306a58a2a0 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 10 client.16554 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 20 client.16554 populate_metadata read hostname 'smithi033' 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a60a280 0x56306a60c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 4 client.16554 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:06:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.842+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56306a4f80b0 con 0x56306a60a280 2024-09-11T00:06:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.843+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a60a280 0x56306a60c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.843+0000 7f3b9fe00640 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a60a280 0x56306a60c6a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d0e2ded47a066a server_cookie=1cea37d0b64474ba in_seq=0 out_seq=0 2024-09-11T00:06:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.843+0000 7f3b8a000640 10 client.16554 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.858+0000 7f3b8a000640 1 -- 172.21.15.33:0/3960060039 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56306a4f80b0 con 0x56306a60a280 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.858+0000 7f3b8a000640 10 client.16554 handle_command_reply: tid=0 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.858+0000 7f3ba9df0740 1 client.16554 shutdown 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.858+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 msgr2=0x56306a597cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.858+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00ebc0 tx=0x7f3b8c009d40 comp rx=0 tx=0).stop 2024-09-11T00:06:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 shutdown_connections 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56306a58cce0 0x56306a5983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56306a58a2a0 0x56306a597cc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56306a60a280 0x56306a60c6a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 --2- 172.21.15.33:0/3960060039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56306a587970 0x56306a598e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3b8a000640 0 client.16554 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 >> 172.21.15.33:0/3960060039 conn(0x56306a582ac0 msgr2=0x56306a587240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 shutdown_connections 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 1 -- 172.21.15.33:0/3960060039 wait complete. 2024-09-11T00:06:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba9df0740 20 client.16554 trim_cache size 0 max 16384 2024-09-11T00:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:06:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 msgr2=0x7f3b840b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.859+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 0x7f3b840b7730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00f010 tx=0x7f3b8c005eb0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 msgr2=0x7f3ba019ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3b90031460 tx=0x7f3b90003c80 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 shutdown_connections 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f3b840b5270 0x7f3b840b7730 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba01042a0 0x7f3ba019bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba01038e0 0x7f3ba019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 --2- 172.21.15.33:0/2863906609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0102790 0x7f3ba019ad30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 >> 172.21.15.33:0/2863906609 conn(0x7f3ba00fe030 msgr2=0x7f3ba01090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 shutdown_connections 2024-09-11T00:06:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:06:53.860+0000 7f3ba5a00640 1 -- 172.21.15.33:0/2863906609 wait complete. 2024-09-11T00:06:54.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:54 smithi052 ceph-mon[33526]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 387 op/s 2024-09-11T00:06:54.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:54 smithi033 ceph-mon[30593]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 387 op/s 2024-09-11T00:06:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:54 smithi189 ceph-mon[34000]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 387 op/s 2024-09-11T00:06:56.365 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:56 smithi033 ceph-mon[30593]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 202 op/s 2024-09-11T00:06:56.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:56 smithi052 ceph-mon[33526]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 202 op/s 2024-09-11T00:06:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:56 smithi189 ceph-mon[34000]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.8 MiB/s wr, 202 op/s 2024-09-11T00:06:58.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:06:58.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:06:58 smithi052 ceph-mon[33526]: pgmap v742: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-11T00:06:58.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:06:58 smithi033 ceph-mon[30593]: pgmap v742: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-11T00:06:58.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:06:58 smithi189 ceph-mon[34000]: pgmap v742: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-11T00:07:00.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:00 smithi052 ceph-mon[33526]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 410 KiB/s wr, 58 op/s 2024-09-11T00:07:00.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:00 smithi033 ceph-mon[30593]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 410 KiB/s wr, 58 op/s 2024-09-11T00:07:00.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:00 smithi189 ceph-mon[34000]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 410 KiB/s wr, 58 op/s 2024-09-11T00:07:02.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:02 smithi052 ceph-mon[33526]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 187 KiB/s wr, 33 op/s 2024-09-11T00:07:02.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:02 smithi033 ceph-mon[30593]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 187 KiB/s wr, 33 op/s 2024-09-11T00:07:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:02 smithi189 ceph-mon[34000]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 187 KiB/s wr, 33 op/s 2024-09-11T00:07:03.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:07:04.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:04 smithi052 ceph-mon[33526]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 234 KiB/s wr, 40 op/s 2024-09-11T00:07:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:04 smithi033 ceph-mon[30593]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 234 KiB/s wr, 40 op/s 2024-09-11T00:07:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:04 smithi189 ceph-mon[34000]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 234 KiB/s wr, 40 op/s 2024-09-11T00:07:06.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:06 smithi052 ceph-mon[33526]: pgmap v746: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 202 KiB/s wr, 35 op/s 2024-09-11T00:07:06.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:06 smithi033 ceph-mon[30593]: pgmap v746: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 202 KiB/s wr, 35 op/s 2024-09-11T00:07:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:06 smithi189 ceph-mon[34000]: pgmap v746: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 202 KiB/s wr, 35 op/s 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 -- 172.21.15.33:0/1815053290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b810a6d0 msgr2=0x7f11b810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 --2- 172.21.15.33:0/1815053290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b810a6d0 0x7f11b810cb90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009ca0 tx=0x7f11b002a950 comp rx=0 tx=0).stop 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 -- 172.21.15.33:0/1815053290 shutdown_connections 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 --2- 172.21.15.33:0/1815053290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b810a6d0 0x7f11b810cb90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 --2- 172.21.15.33:0/1815053290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b8107d20 0x7f11b810a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 --2- 172.21.15.33:0/1815053290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b806b2e0 0x7f11b81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 -- 172.21.15.33:0/1815053290 >> 172.21.15.33:0/1815053290 conn(0x7f11b80fcf30 msgr2=0x7f11b80ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 -- 172.21.15.33:0/1815053290 shutdown_connections 2024-09-11T00:07:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.988+0000 7f11b7e00640 1 -- 172.21.15.33:0/1815053290 wait complete. 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.989+0000 7f11b7e00640 1 Processor -- start 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 -- start start 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b806b2e0 0x7f11b819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b810a6d0 0x7f11b819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81104d0 con 0x7f11b8107d20 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8110350 con 0x7f11b810a6d0 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11b7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8110650 con 0x7f11b806b2e0 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11ae000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11ae000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32768/0 (socket says 172.21.15.33:32768) 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.990+0000 7f11ae000640 1 -- 172.21.15.33:0/2626672501 learned_addr learned my addr 172.21.15.33:0/2626672501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11b7400640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b810a6d0 0x7f11b819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11b6a00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b806b2e0 0x7f11b819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 -- 172.21.15.33:0/2626672501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b806b2e0 msgr2=0x7f11b819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b806b2e0 0x7f11b819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 -- 172.21.15.33:0/2626672501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b810a6d0 msgr2=0x7f11b819bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b810a6d0 0x7f11b819bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 -- 172.21.15.33:0/2626672501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b819c760 con 0x7f11b8107d20 2024-09-11T00:07:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.991+0000 7f11ae000640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f11a000d770 tx=0x7f11a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.992+0000 7f11bca00640 1 -- 172.21.15.33:0/2626672501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0017070 con 0x7f11b8107d20 2024-09-11T00:07:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.992+0000 7f11bca00640 1 -- 172.21.15.33:0/2626672501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a0009c30 con 0x7f11b8107d20 2024-09-11T00:07:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.992+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b819ca50 con 0x7f11b8107d20 2024-09-11T00:07:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.992+0000 7f11bca00640 1 -- 172.21.15.33:0/2626672501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a000f620 con 0x7f11b8107d20 2024-09-11T00:07:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.992+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81a3120 con 0x7f11b8107d20 2024-09-11T00:07:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.995+0000 7f11c0dc7740 1 Processor -- start 2024-09-11T00:07:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.995+0000 7f11c0dc7740 1 -- start start 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.995+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d95970 0x55b1f3d97d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.995+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d9d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3d086b0 con 0x55b1f3d9ace0 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3cf7ae0 con 0x55b1f3d982a0 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3cfb8f0 con 0x55b1f3d95970 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11bca00640 1 -- 172.21.15.33:0/2626672501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f11a0010460 con 0x7f11b8107d20 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11ae000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d9d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49398/0 (socket says 172.21.15.33:49398) 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11b6a00640 1 -- 172.21.15.33:0/543602663 learned_addr learned my addr 172.21.15.33:0/543602663 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11b7400640 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d95970 0x55b1f3d97d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11ae000640 1 -- 172.21.15.33:0/543602663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d95970 msgr2=0x55b1f3d97d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11ae000640 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d95970 0x55b1f3d97d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11ae000640 1 -- 172.21.15.33:0/543602663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 msgr2=0x55b1f3d9a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.996+0000 7f11ae000640 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11ae000640 1 -- 172.21.15.33:0/543602663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f3cc4780 con 0x55b1f3d9ace0 2024-09-11T00:07:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11b6a00640 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11ae000640 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d9d1a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f11a00e2c70 tx=0x7f11a00ebab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2719821adaf3d690 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11a7e00640 1 -- 172.21.15.33:0/543602663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00f8070 con 0x55b1f3d9ace0 2024-09-11T00:07:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11a7e00640 1 -- 172.21.15.33:0/543602663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a00e5d90 con 0x55b1f3d9ace0 2024-09-11T00:07:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.997+0000 7f11a7e00640 1 -- 172.21.15.33:0/543602663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00f3900 con 0x55b1f3d9ace0 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11bca00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 0x7f119c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11bca00640 1 -- 172.21.15.33:0/2626672501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f11a00e55d0 con 0x7f11b8107d20 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11b7400640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 0x7f119c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 -- 172.21.15.33:0/543602663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 msgr2=0x55b1f3d9d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d9d1a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f11a00e2c70 tx=0x7f11a00ebab0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 -- 172.21.15.33:0/543602663 shutdown_connections 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d9d1a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/543602663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d95970 0x55b1f3d97d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.998+0000 7f11c0dc7740 1 -- 172.21.15.33:0/543602663 >> 172.21.15.33:0/543602663 conn(0x55b1f3d90ac0 msgr2=0x55b1f3d91850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.999+0000 7f11c0dc7740 1 -- 172.21.15.33:0/543602663 shutdown_connections 2024-09-11T00:07:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.999+0000 7f11c0dc7740 1 -- 172.21.15.33:0/543602663 wait complete. 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.999+0000 7f11b7400640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 0x7f119c0b78a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11b819b9a0 tx=0x7f11b002f860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.999+0000 7f11c0dc7740 1 -- start start 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:06.999+0000 7f11c0dc7740 1 Processor -- start 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 0x55b1f3d9f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3c2fab0 con 0x55b1f3d982a0 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3c9e570 con 0x55b1f3d95970 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b1f3d9dcc0 con 0x55b1f3d9ace0 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11c0dc7740 10 client.0 _ll_register_callbacks cb 0x55b1f3cad100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11ae000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11ae000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32792/0 (socket says 172.21.15.33:32792) 2024-09-11T00:07:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.000+0000 7f11ae000640 1 -- 172.21.15.33:0/118921433 learned_addr learned my addr 172.21.15.33:0/118921433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11b6a00640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 0x55b1f3d9f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11b7400640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 -- 172.21.15.33:0/118921433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d9ace0 msgr2=0x55b1f3da03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 -- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 msgr2=0x55b1f3d9f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 0x55b1f3d9f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 -- 172.21.15.33:0/118921433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f3a59790 con 0x55b1f3d982a0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11b6a00640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 0x55b1f3d9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11ae000640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000c00 tx=0x7f11a00e5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bedbcf3ba6be605 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00a8090 con 0x55b1f3d982a0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f11a00e5290 con 0x55b1f3d982a0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.001+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a00e5d90 con 0x55b1f3d982a0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f11a00a71b0 con 0x55b1f3d982a0 2024-09-11T00:07:07.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 10 client.16566 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1f3ad2620 con 0x55b1f3d982a0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a00e5d90 con 0x55b1f3d982a0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f11a00cece0 con 0x55b1f3d982a0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 10 client.16566 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 20 client.16566 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3daa5e0 0x55b1f3dac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 4 client.16566 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.002+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1f3d0a600 con 0x55b1f3daa5e0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.003+0000 7f11b6a00640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3daa5e0 0x55b1f3dac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.004+0000 7f11b6a00640 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3daa5e0 0x55b1f3dac9d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c657c0e83dde53 server_cookie=6ca5ba57364419d6 in_seq=0 out_seq=0 2024-09-11T00:07:07.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.004+0000 7f11a4c00640 10 client.16566 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.004+0000 7f11a4c00640 1 -- 172.21.15.33:0/118921433 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1f3d0a600 con 0x55b1f3daa5e0 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.004+0000 7f11a4c00640 10 client.16566 handle_command_reply: tid=0 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.004+0000 7f11c0dc7740 1 client.16566 shutdown 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 msgr2=0x55b1f3d9f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000c00 tx=0x7f11a00e5f40 comp rx=0 tx=0).stop 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 shutdown_connections 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3daa5e0 0x55b1f3dac9d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9f7e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/118921433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d95970 0x55b1f3d9f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11a4c00640 0 client.16566 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 >> 172.21.15.33:0/118921433 conn(0x55b1f3d90ac0 msgr2=0x55b1f3d8fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 shutdown_connections 2024-09-11T00:07:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 1 -- 172.21.15.33:0/118921433 wait complete. 2024-09-11T00:07:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.005+0000 7f11c0dc7740 20 client.16566 trim_cache size 0 max 16384 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 Processor -- start 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 -- start start 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3d9b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81afe70 con 0x55b1f3d95970 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ad740 con 0x55b1f3d9ace0 2024-09-11T00:07:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.021+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ab590 con 0x55b1f3d982a0 2024-09-11T00:07:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3d9b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49406/0 (socket says 172.21.15.33:49406) 2024-09-11T00:07:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b7400640 1 -- 172.21.15.33:0/4015289880 learned_addr learned my addr 172.21.15.33:0/4015289880 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11ae000640 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 -- 172.21.15.33:0/4015289880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 msgr2=0x55b1f3d9b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 -- 172.21.15.33:0/4015289880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 msgr2=0x55b1f3d928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b6a00640 1 -- 172.21.15.33:0/4015289880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f3da77a0 con 0x55b1f3d95970 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.022+0000 7f11b7400640 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.023+0000 7f11b6a00640 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3d9b130 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55b1f3d08700 tx=0x7f11a8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54aa311690521172 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.023+0000 7f11a7400640 1 -- 172.21.15.33:0/4015289880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004220 con 0x55b1f3d95970 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.023+0000 7f11a7400640 1 -- 172.21.15.33:0/4015289880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a80043c0 con 0x55b1f3d95970 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.023+0000 7f11a7400640 1 -- 172.21.15.33:0/4015289880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004e50 con 0x55b1f3d95970 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- 172.21.15.33:0/4015289880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 msgr2=0x55b1f3d9b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3d9b130 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55b1f3d08700 tx=0x7f11a8005f90 comp rx=0 tx=0).stop 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- 172.21.15.33:0/4015289880 shutdown_connections 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3d928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3d9b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/4015289880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3d9b130 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- 172.21.15.33:0/4015289880 >> 172.21.15.33:0/4015289880 conn(0x55b1f3d90ac0 msgr2=0x55b1f3d9e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- 172.21.15.33:0/4015289880 shutdown_connections 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- 172.21.15.33:0/4015289880 wait complete. 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.024+0000 7f11c0dc7740 1 -- start start 2024-09-11T00:07:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 Processor -- start 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3da5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81abc00 con 0x55b1f3d95970 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ad070 con 0x55b1f3d9ace0 2024-09-11T00:07:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ac2d0 con 0x55b1f3d982a0 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11c0dc7740 10 client.0 _ll_register_callbacks cb 0x7f11a00f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32800/0 (socket says 172.21.15.33:32800) 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11b6a00640 1 -- 172.21.15.33:0/3090258458 learned_addr learned my addr 172.21.15.33:0/3090258458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.025+0000 7f11ae000640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3da5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b7400640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 -- 172.21.15.33:0/3090258458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 msgr2=0x55b1f3da5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3da5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 -- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 msgr2=0x55b1f3da5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 -- 172.21.15.33:0/3090258458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f3da6790 con 0x55b1f3d95970 2024-09-11T00:07:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11b6a00640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfaeadefcba6d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8028040 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a80043c0 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.026+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f11a8004dd0 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f11a803a050 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 10 client.16572 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1f3e17500 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a80043c0 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f11a802b070 con 0x55b1f3d95970 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 10 client.16572 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 10 client.16572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 20 client.16572 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3e17e80 0x55b1f3e1a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 4 client.16572 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:07:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.027+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b1f3d060b0 con 0x55b1f3e17e80 2024-09-11T00:07:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.028+0000 7f11ae000640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3e17e80 0x55b1f3e1a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.029+0000 7f11ae000640 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3e17e80 0x55b1f3e1a2a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c45f1e0973936a server_cookie=9c1cb47fd0ae679 in_seq=0 out_seq=0 2024-09-11T00:07:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.029+0000 7f11a4c00640 10 client.16572 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11a4c00640 1 -- 172.21.15.33:0/3090258458 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b1f3d060b0 con 0x55b1f3e17e80 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11a4c00640 10 client.16572 handle_command_reply: tid=0 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 client.16572 shutdown 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 msgr2=0x55b1f3da6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a8009b60 comp rx=0 tx=0).stop 2024-09-11T00:07:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 shutdown_connections 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1f3d9ace0 0x55b1f3da5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55b1f3e17e80 0x55b1f3e1a2a0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1f3d982a0 0x55b1f3da5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 --2- 172.21.15.33:0/3090258458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1f3d95970 0x55b1f3da6c60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11a4c00640 0 client.16572 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 >> 172.21.15.33:0/3090258458 conn(0x55b1f3d90ac0 msgr2=0x55b1f3d9e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 shutdown_connections 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.042+0000 7f11c0dc7740 1 -- 172.21.15.33:0/3090258458 wait complete. 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11c0dc7740 20 client.16572 trim_cache size 0 max 16384 2024-09-11T00:07:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:07:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:07:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:07:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:07:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 msgr2=0x7f119c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 0x7f119c0b78a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11b819b9a0 tx=0x7f11b002f860 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 msgr2=0x7f11b819b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f11a000d770 tx=0x7f11a000dc30 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 shutdown_connections 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f119c0b53e0 0x7f119c0b78a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11b810a6d0 0x7f11b819bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b8107d20 0x7f11b819b270 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 --2- 172.21.15.33:0/2626672501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11b806b2e0 0x7f11b819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 >> 172.21.15.33:0/2626672501 conn(0x7f11b80fcf30 msgr2=0x7f11b81089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.043+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 shutdown_connections 2024-09-11T00:07:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:07.044+0000 7f11b7e00640 1 -- 172.21.15.33:0/2626672501 wait complete. 2024-09-11T00:07:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:07:08.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:08 smithi052 ceph-mon[33526]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 233 KiB/s wr, 39 op/s 2024-09-11T00:07:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:08 smithi033 ceph-mon[30593]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 233 KiB/s wr, 39 op/s 2024-09-11T00:07:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:08 smithi189 ceph-mon[34000]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 233 KiB/s wr, 39 op/s 2024-09-11T00:07:10.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:10 smithi052 ceph-mon[33526]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 228 KiB/s wr, 34 op/s 2024-09-11T00:07:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:10 smithi033 ceph-mon[30593]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 228 KiB/s wr, 34 op/s 2024-09-11T00:07:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:10 smithi189 ceph-mon[34000]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 228 KiB/s wr, 34 op/s 2024-09-11T00:07:11.481 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:07:11.882 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:12.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:12 smithi033 ceph-mon[30593]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 272 KiB/s wr, 33 op/s 2024-09-11T00:07:12.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:12 smithi052 ceph-mon[33526]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 272 KiB/s wr, 33 op/s 2024-09-11T00:07:12.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 -- 172.21.15.33:0/3960346022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 msgr2=0x7f4e741051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/3960346022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e741051d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009ca0 tx=0x7f4e6802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 -- 172.21.15.33:0/3960346022 shutdown_connections 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/3960346022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 0x7f4e74111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/3960346022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 0x7f4e7410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/3960346022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e741051d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 -- 172.21.15.33:0/3960346022 >> 172.21.15.33:0/3960346022 conn(0x7f4e74100840 msgr2=0x7f4e74102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 -- 172.21.15.33:0/3960346022 shutdown_connections 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.507+0000 7f4e7aa00640 1 -- 172.21.15.33:0/3960346022 wait complete. 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.508+0000 7f4e7aa00640 1 Processor -- start 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.508+0000 7f4e7aa00640 1 -- start start 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:12.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 0x7f4e7419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 0x7f4e741a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74114d00 con 0x7f4e74104df0 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74114b80 con 0x7f4e7410a800 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74114e80 con 0x7f4e7410b180 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56036/0 (socket says 172.21.15.33:56036) 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 -- 172.21.15.33:0/1482434138 learned_addr learned my addr 172.21.15.33:0/1482434138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e78c00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 0x7f4e7419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e7a000640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 0x7f4e741a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 -- 172.21.15.33:0/1482434138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 msgr2=0x7f4e741a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 0x7f4e741a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 -- 172.21.15.33:0/1482434138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 msgr2=0x7f4e7419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:12.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 0x7f4e7419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.509+0000 7f4e79600640 1 -- 172.21.15.33:0/1482434138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741a1140 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e79600640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e68032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68004040 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e68004670 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e741a13d0 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68030c80 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.510+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a7af0 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.511+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e741051d0 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.513+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4e680041e0 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.515+0000 7f4e72000640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 0x7f4e5c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.515+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4e68107310 con 0x7f4e74104df0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.515+0000 7f4e78c00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 0x7f4e5c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:12.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.516+0000 7f4e78c00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 0x7f4e5c0b7850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e74103070 tx=0x7f4e6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:12.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.517+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e680cddd0 con 0x7f4e74104df0 2024-09-11T00:07:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:12 smithi189 ceph-mon[34000]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 272 KiB/s wr, 33 op/s 2024-09-11T00:07:12.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.758+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e741a7d80 con 0x7f4e74104df0 2024-09-11T00:07:12.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.759+0000 7f4e72000640 1 -- 172.21.15.33:0/1482434138 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f4e68004820 con 0x7f4e74104df0 2024-09-11T00:07:12.761 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:07:12.762 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:07:12.762 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:07:12.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 msgr2=0x7f4e5c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 0x7f4e5c0b7850 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e74103070 tx=0x7f4e6000b390 comp rx=0 tx=0).stop 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 msgr2=0x7f4e7419b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e68032bc0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 shutdown_connections 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e5c0b5390 0x7f4e5c0b7850 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e7410b180 0x7f4e741a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7410a800 0x7f4e7419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 --2- 172.21.15.33:0/1482434138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74104df0 0x7f4e7419b090 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:12.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 >> 172.21.15.33:0/1482434138 conn(0x7f4e74100840 msgr2=0x7f4e74103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:12.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 shutdown_connections 2024-09-11T00:07:12.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:12.762+0000 7f4e7aa00640 1 -- 172.21.15.33:0/1482434138 wait complete. 2024-09-11T00:07:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:07:13.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:13 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1482434138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:13.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:13 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1482434138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:13.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:13 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1482434138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:07:13.693 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id d753d2d --release --await' 2024-09-11T00:07:13.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id d753d2d --release --await 2024-09-11T00:07:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:14.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:14 smithi033 ceph-mon[30593]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 305 KiB/s wr, 40 op/s 2024-09-11T00:07:14.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:14 smithi052 ceph-mon[33526]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 305 KiB/s wr, 40 op/s 2024-09-11T00:07:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:14 smithi189 ceph-mon[34000]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 305 KiB/s wr, 40 op/s 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 -- 172.21.15.33:0/193705861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c102dc0 msgr2=0x7fe36c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 --2- 172.21.15.33:0/193705861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c102dc0 0x7fe36c1031a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe360009900 tx=0x7fe36002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 -- 172.21.15.33:0/193705861 shutdown_connections 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 --2- 172.21.15.33:0/193705861 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 0x7fe36c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 --2- 172.21.15.33:0/193705861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c1087d0 0x7fe36c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 --2- 172.21.15.33:0/193705861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c102dc0 0x7fe36c1031a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 -- 172.21.15.33:0/193705861 >> 172.21.15.33:0/193705861 conn(0x7fe36c0fe830 msgr2=0x7fe36c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 -- 172.21.15.33:0/193705861 shutdown_connections 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.676+0000 7fe374600640 1 -- 172.21.15.33:0/193705861 wait complete. 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 Processor -- start 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 -- start start 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 0x7fe36c19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 0x7fe36c1a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c112cc0 con 0x7fe36c1087d0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c112b40 con 0x7fe36c102dc0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.677+0000 7fe374600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c112e40 con 0x7fe36c109150 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56046/0 (socket says 172.21.15.33:56046) 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 -- 172.21.15.33:0/382019064 learned_addr learned my addr 172.21.15.33:0/382019064 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe372600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 0x7fe36c1a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371c00640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 0x7fe36c19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 -- 172.21.15.33:0/382019064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 msgr2=0x7fe36c1a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 0x7fe36c1a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 -- 172.21.15.33:0/382019064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 msgr2=0x7fe36c19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 0x7fe36c19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 -- 172.21.15.33:0/382019064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c1a1440 con 0x7fe36c1087d0 2024-09-11T00:07:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371c00640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 0x7fe36c19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.678+0000 7fe371200640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe35800d950 tx=0x7fe35800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.679+0000 7fe36a000640 1 -- 172.21.15.33:0/382019064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe358017070 con 0x7fe36c1087d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.679+0000 7fe36a000640 1 -- 172.21.15.33:0/382019064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe358009c30 con 0x7fe36c1087d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.679+0000 7fe36a000640 1 -- 172.21.15.33:0/382019064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35800f620 con 0x7fe36c1087d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.679+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36c1a1730 con 0x7fe36c1087d0 2024-09-11T00:07:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.679+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36c1a7fc0 con 0x7fe36c1087d0 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.682+0000 7fe37703e740 1 Processor -- start 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.682+0000 7fe37703e740 1 -- start start 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe36a000640 1 -- 172.21.15.33:0/382019064 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe358010460 con 0x7fe36c1087d0 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 0x564dd26a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 0x564dd26ac360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26ac8a0 0x564dd26aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564dd2617290 con 0x564dd26ac8a0 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564dd26066c0 con 0x564dd26a0910 2024-09-11T00:07:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe37703e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564dd260a4d0 con 0x564dd269fff0 2024-09-11T00:07:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe372600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 0x564dd26a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe371c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 0x564dd26ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe372600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 0x564dd26a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50232/0 (socket says 172.21.15.33:50232) 2024-09-11T00:07:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe372600640 1 -- 172.21.15.33:0/3517756990 learned_addr learned my addr 172.21.15.33:0/3517756990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.683+0000 7fe371200640 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26ac8a0 0x564dd26aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 -- 172.21.15.33:0/3517756990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 msgr2=0x564dd26a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 0x564dd26a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 -- 172.21.15.33:0/3517756990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26ac8a0 msgr2=0x564dd26aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26ac8a0 0x564dd26aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 -- 172.21.15.33:0/3517756990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd2593460 con 0x564dd26a0910 2024-09-11T00:07:14.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.684+0000 7fe371c00640 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 0x564dd26ac360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3600057c0 tx=0x7fe360032dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb117074df9a2414 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe35ea00640 1 -- 172.21.15.33:0/3517756990 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36003f070 con 0x564dd26a0910 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe35ea00640 1 -- 172.21.15.33:0/3517756990 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3600044c0 con 0x564dd26a0910 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe35ea00640 1 -- 172.21.15.33:0/3517756990 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360035070 con 0x564dd26a0910 2024-09-11T00:07:14.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe36a000640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 0x7fe3540b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe36a000640 1 -- 172.21.15.33:0/382019064 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3580e5b90 con 0x7fe36c1087d0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe372600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 0x7fe3540b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe37703e740 1 -- 172.21.15.33:0/3517756990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 msgr2=0x564dd26ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.685+0000 7fe37703e740 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 0x564dd26ac360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3600057c0 tx=0x7fe360032dd0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 -- 172.21.15.33:0/3517756990 shutdown_connections 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26ac8a0 0x564dd26aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26a0910 0x564dd26ac360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 --2- 172.21.15.33:0/3517756990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd269fff0 0x564dd26a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 -- 172.21.15.33:0/3517756990 >> 172.21.15.33:0/3517756990 conn(0x564dd269de20 msgr2=0x564dd269efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe372600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 0x7fe3540b7820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe364010540 tx=0x7fe364007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 -- 172.21.15.33:0/3517756990 shutdown_connections 2024-09-11T00:07:14.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 -- 172.21.15.33:0/3517756990 wait complete. 2024-09-11T00:07:14.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 -- start start 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.686+0000 7fe37703e740 1 Processor -- start 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd26aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564dd2467bb0 con 0x564dd26a0910 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564dd25a16c0 con 0x564dd269fff0 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564dd26af4f0 con 0x564dd26ac8a0 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe37703e740 10 client.0 _ll_register_callbacks cb 0x564dd25bc490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56062/0 (socket says 172.21.15.33:56062) 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe371200640 1 -- 172.21.15.33:0/2127955439 learned_addr learned my addr 172.21.15.33:0/2127955439 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe371c00640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.687+0000 7fe372600640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd26aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 -- 172.21.15.33:0/2127955439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 msgr2=0x564dd26aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd26aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 -- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 msgr2=0x564dd26a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 -- 172.21.15.33:0/2127955439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd2364b00 con 0x564dd26a0910 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe371200640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe3580abee0 tx=0x7fe35800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2d09b9a6ffbdc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe353400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:07:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe358020070 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3580930f0 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564dd26191e0 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3580eb030 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe37703e740 10 client.16590 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.688+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564dd23db960 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564dd26191e0 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe3580a78a0 con 0x564dd26a0910 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 10 client.16590 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 10 client.16590 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 20 client.16590 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd26bc310 0x564dd26be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 4 client.16590 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:14.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.689+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd2614c90 con 0x564dd26bc310 2024-09-11T00:07:14.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.690+0000 7fe371c00640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd26bc310 0x564dd26be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.690+0000 7fe371c00640 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd26bc310 0x564dd26be740 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbf97e3d01e61ae server_cookie=420cdf262dea3d55 in_seq=0 out_seq=0 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.690+0000 7fe353400640 10 client.16590 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe353400640 1 -- 172.21.15.33:0/2127955439 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564dd2614c90 con 0x564dd26bc310 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe353400640 10 client.16590 handle_command_reply: tid=0 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 client.16590 shutdown 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 msgr2=0x564dd26a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe3580abee0 tx=0x7fe35800bf60 comp rx=0 tx=0).stop 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 shutdown_connections 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd26bc310 0x564dd26be740 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd26aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.691+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26a9dd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe37703e740 1 --2- 172.21.15.33:0/2127955439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 >> 172.21.15.33:0/2127955439 conn(0x564dd269de20 msgr2=0x564dd26a39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe353400640 0 client.16590 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 shutdown_connections 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe37703e740 1 -- 172.21.15.33:0/2127955439 wait complete. 2024-09-11T00:07:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.692+0000 7fe37703e740 20 client.16590 trim_cache size 0 max 16384 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 Processor -- start 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 -- start start 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 0x564dd26a6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 0x564dd26c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1b4460 con 0x564dd269fff0 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1b1d30 con 0x564dd26ac8a0 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe37703e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1afb80 con 0x564dd26a0910 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe371c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe371c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56064/0 (socket says 172.21.15.33:56064) 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.710+0000 7fe371c00640 1 -- 172.21.15.33:0/1124838758 learned_addr learned my addr 172.21.15.33:0/1124838758 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371200640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 0x564dd26a6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe372600640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 0x564dd26c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 -- 172.21.15.33:0/1124838758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 msgr2=0x564dd26a6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 0x564dd26a6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 -- 172.21.15.33:0/1124838758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 msgr2=0x564dd26c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 0x564dd26c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 -- 172.21.15.33:0/1124838758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd269e8a0 con 0x564dd269fff0 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe372600640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 0x564dd26c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371200640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 0x564dd26a6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe371c00640 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe360033000 tx=0x7fe360009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966c8daa07e156fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe35e000640 1 -- 172.21.15.33:0/1124838758 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe360035040 con 0x564dd269fff0 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.711+0000 7fe35e000640 1 -- 172.21.15.33:0/1124838758 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe360031cf0 con 0x564dd269fff0 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe35e000640 1 -- 172.21.15.33:0/1124838758 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36003f040 con 0x564dd269fff0 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 -- 172.21.15.33:0/1124838758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 msgr2=0x564dd26a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe360033000 tx=0x7fe360009670 comp rx=0 tx=0).stop 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 -- 172.21.15.33:0/1124838758 shutdown_connections 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd26ac8a0 0x564dd26c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26a0910 0x564dd26a6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 --2- 172.21.15.33:0/1124838758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd269fff0 0x564dd26a6aa0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 -- 172.21.15.33:0/1124838758 >> 172.21.15.33:0/1124838758 conn(0x564dd269de20 msgr2=0x564dd26ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 -- 172.21.15.33:0/1124838758 shutdown_connections 2024-09-11T00:07:14.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.712+0000 7fe37703e740 1 -- 172.21.15.33:0/1124838758 wait complete. 2024-09-11T00:07:14.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 -- start start 2024-09-11T00:07:14.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 Processor -- start 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd2728210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1b01f0 con 0x564dd26a0910 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1b1660 con 0x564dd269fff0 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.713+0000 7fe37703e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c1b08c0 con 0x564dd26ac8a0 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe37703e740 10 client.0 _ll_register_callbacks cb 0x7fe35800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56076/0 (socket says 172.21.15.33:56076) 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 -- 172.21.15.33:0/859950565 learned_addr learned my addr 172.21.15.33:0/859950565 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe372600640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd2728210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 -- 172.21.15.33:0/859950565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 msgr2=0x564dd2728210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd2728210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 -- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 msgr2=0x564dd26b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371200640 1 -- 172.21.15.33:0/859950565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd26b8720 con 0x564dd26a0910 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.714+0000 7fe371c00640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe371200640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe358009e00 tx=0x7fe3580e9640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cfdd743a6bc635 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe353400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe358020040 con 0x564dd26a0910 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe358097170 con 0x564dd26a0910 2024-09-11T00:07:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe360031cf0 con 0x564dd26a0910 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3580ab8a0 con 0x564dd26a0910 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe37703e740 10 client.16596 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.715+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564dd2729a30 con 0x564dd26a0910 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe360031cf0 con 0x564dd26a0910 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe3580ab1b0 con 0x564dd26a0910 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 10 client.16596 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 10 client.16596 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 20 client.16596 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd272a130 0x564dd272c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 4 client.16596 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d753d2d", "release": true, "await": true}] 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d753d2d", "release": true, "await": true}) -- 0x564dd26120c0 con 0x564dd272a130 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.716+0000 7fe371c00640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd272a130 0x564dd272c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.718+0000 7fe371c00640 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd272a130 0x564dd272c550 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22753bbbf374dd57 server_cookie=da5877d7e2e99ce5 in_seq=0 out_seq=0 2024-09-11T00:07:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.718+0000 7fe353400640 10 client.16596 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.774+0000 7fe353400640 1 -- 172.21.15.33:0/859950565 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564dd26120c0 con 0x564dd272a130 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.774+0000 7fe353400640 10 client.16596 handle_command_reply: tid=0 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.774+0000 7fe37703e740 1 client.16596 shutdown 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 msgr2=0x564dd26b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe358009e00 tx=0x7fe3580e9640 comp rx=0 tx=0).stop 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 shutdown_connections 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564dd272a130 0x564dd272c550 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564dd26ac8a0 0x564dd2728210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd26a0910 0x564dd26b1550 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 --2- 172.21.15.33:0/859950565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564dd269fff0 0x564dd26b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 >> 172.21.15.33:0/859950565 conn(0x564dd269de20 msgr2=0x564dd269c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe353400640 0 client.16596 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.775+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 shutdown_connections 2024-09-11T00:07:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.776+0000 7fe37703e740 1 -- 172.21.15.33:0/859950565 wait complete. 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.776+0000 7fe37703e740 20 client.16596 trim_cache size 0 max 16384 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 32, 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:07:14.780 INFO:teuthology.orchestra.run.smithi033.stdout: "d753d2d": { 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 32, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 153.4, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:07:14.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:07:14.782 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.777+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 msgr2=0x7fe3540b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.777+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 0x7fe3540b7820 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe364010540 tx=0x7fe364007520 comp rx=0 tx=0).stop 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.777+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 msgr2=0x7fe36c19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.777+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe35800d950 tx=0x7fe35800de10 comp rx=0 tx=0).stop 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 shutdown_connections 2024-09-11T00:07:14.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3540b5360 0x7fe3540b7820 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe36c109150 0x7fe36c1a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe36c1087d0 0x7fe36c19b8d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 --2- 172.21.15.33:0/382019064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe36c102dc0 0x7fe36c19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.778+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 >> 172.21.15.33:0/382019064 conn(0x7fe36c0fe830 msgr2=0x7fe36c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.779+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 shutdown_connections 2024-09-11T00:07:14.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:07:14.779+0000 7fe374600640 1 -- 172.21.15.33:0/382019064 wait complete. 2024-09-11T00:07:15.674 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd753d2d', total seconds elapsed: 37.6 2024-09-11T00:07:16.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:16 smithi052 ceph-mon[33526]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 KiB/s wr, 32 op/s 2024-09-11T00:07:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:16 smithi033 ceph-mon[30593]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 KiB/s wr, 32 op/s 2024-09-11T00:07:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:16 smithi189 ceph-mon[34000]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 KiB/s wr, 32 op/s 2024-09-11T00:07:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 450.0 s, 588.8 tps, lat 1143.645 ms stddev 5454.368 2024-09-11T00:07:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:18 smithi052 ceph-mon[33526]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 693 KiB/s wr, 70 op/s 2024-09-11T00:07:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:18 smithi033 ceph-mon[30593]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 693 KiB/s wr, 70 op/s 2024-09-11T00:07:18.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:18 smithi189 ceph-mon[34000]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 693 KiB/s wr, 70 op/s 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 -- 172.21.15.33:0/1202519355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c074470 msgr2=0x7fcc0c074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 --2- 172.21.15.33:0/1202519355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c074470 0x7fcc0c074870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009900 tx=0x7fcbfc02a3e0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 -- 172.21.15.33:0/1202519355 shutdown_connections 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 --2- 172.21.15.33:0/1202519355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 --2- 172.21.15.33:0/1202519355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10a150 0x7fcc0c10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 --2- 172.21.15.33:0/1202519355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c074470 0x7fcc0c074870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 -- 172.21.15.33:0/1202519355 >> 172.21.15.33:0/1202519355 conn(0x7fcc0c06fa40 msgr2=0x7fcc0c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.241+0000 7fcc11000640 1 -- 172.21.15.33:0/1202519355 shutdown_connections 2024-09-11T00:07:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.242+0000 7fcc11000640 1 -- 172.21.15.33:0/1202519355 wait complete. 2024-09-11T00:07:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 Processor -- start 2024-09-11T00:07:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 -- start start 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 0x7fcc0c1a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c116cd0 con 0x7fcc0c074470 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c116b50 con 0x7fcc0c10a150 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.243+0000 7fcc11000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c116e50 con 0x7fcc0c10ab10 2024-09-11T00:07:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc09e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 0x7fcc0c1a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc09400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc09400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35634/0 (socket says 172.21.15.33:35634) 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc09e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 0x7fcc0c1a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56094/0 (socket says 172.21.15.33:56094) 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc09400640 1 -- 172.21.15.33:0/315479539 learned_addr learned my addr 172.21.15.33:0/315479539 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.244+0000 7fcc0a800640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 -- 172.21.15.33:0/315479539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 msgr2=0x7fcc0c1a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 -- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 msgr2=0x7fcc0c1a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 0x7fcc0c1a7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 -- 172.21.15.33:0/315479539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c1a95c0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc09400640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.245+0000 7fcc0a800640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1a8d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400cab0 tx=0x7fcc0400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.246+0000 7fcc02a00640 1 -- 172.21.15.33:0/315479539 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400ae20 con 0x7fcc0c10ab10 2024-09-11T00:07:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.246+0000 7fcc02a00640 1 -- 172.21.15.33:0/315479539 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc0400f8e0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.246+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c1a98b0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.246+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c1aff80 con 0x7fcc0c10ab10 2024-09-11T00:07:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.246+0000 7fcc02a00640 1 -- 172.21.15.33:0/315479539 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040189a0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.251+0000 7fcc13e63740 1 Processor -- start 2024-09-11T00:07:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.252+0000 7fcc02a00640 1 -- 172.21.15.33:0/315479539 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcc040213f0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.253+0000 7fcc13e63740 1 -- start start 2024-09-11T00:07:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 0x56383a610b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a615fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56383a5816b0 con 0x56383a60e790 2024-09-11T00:07:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56383a570ae0 con 0x56383a613b00 2024-09-11T00:07:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc13e63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56383a5748f0 con 0x56383a6110c0 2024-09-11T00:07:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc09e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc09e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50274/0 (socket says 172.21.15.33:50274) 2024-09-11T00:07:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc09e00640 1 -- 172.21.15.33:0/2021420773 learned_addr learned my addr 172.21.15.33:0/2021420773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc09400640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a615fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.255+0000 7fcc09400640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 0x56383a610b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09e00640 1 -- 172.21.15.33:0/2021420773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 msgr2=0x56383a615fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09e00640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a615fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09e00640 1 -- 172.21.15.33:0/2021420773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 msgr2=0x56383a610b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09e00640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 0x56383a610b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09e00640 1 -- 172.21.15.33:0/2021420773 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a53d780 con 0x56383a6110c0 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc09400640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 0x56383a610b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.256+0000 7fcc02a00640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 0x7fcbf00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.257+0000 7fcc02a00640 1 -- 172.21.15.33:0/315479539 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcc040e65b0 con 0x7fcc0c10ab10 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.257+0000 7fcc09400640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 0x7fcbf00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.257+0000 7fcc09e00640 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02a9d0 tx=0x7fcbfc004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651d75d64dd241d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.258+0000 7fcbf7400640 1 -- 172.21.15.33:0/2021420773 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc035030 con 0x56383a6110c0 2024-09-11T00:07:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.258+0000 7fcbf7400640 1 -- 172.21.15.33:0/2021420773 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbfc040070 con 0x56383a6110c0 2024-09-11T00:07:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.258+0000 7fcbf7400640 1 -- 172.21.15.33:0/2021420773 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc031a20 con 0x56383a6110c0 2024-09-11T00:07:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 -- 172.21.15.33:0/2021420773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 msgr2=0x56383a6134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02a9d0 tx=0x7fcbfc004390 comp rx=0 tx=0).stop 2024-09-11T00:07:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 -- 172.21.15.33:0/2021420773 shutdown_connections 2024-09-11T00:07:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a615fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a6110c0 0x56383a6134b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc09400640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 0x7fcbf00b7820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800b770 tx=0x7fcbf800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 --2- 172.21.15.33:0/2021420773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60e790 0x56383a610b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.259+0000 7fcc13e63740 1 -- 172.21.15.33:0/2021420773 >> 172.21.15.33:0/2021420773 conn(0x56383a6098e0 msgr2=0x56383a60a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.260+0000 7fcc13e63740 1 -- 172.21.15.33:0/2021420773 shutdown_connections 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.260+0000 7fcc13e63740 1 -- 172.21.15.33:0/2021420773 wait complete. 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.261+0000 7fcc13e63740 1 -- start start 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.261+0000 7fcc13e63740 1 Processor -- start 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a617d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a613b00 0x56383a619000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56383a4a8ab0 con 0x56383a613b00 2024-09-11T00:07:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56383a517570 con 0x56383a6110c0 2024-09-11T00:07:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56383a616a80 con 0x56383a60e790 2024-09-11T00:07:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc13e63740 10 client.0 _ll_register_callbacks cb 0x56383a526100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc09400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.262+0000 7fcc09400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35650/0 (socket says 172.21.15.33:35650) 2024-09-11T00:07:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 -- 172.21.15.33:0/1923981311 learned_addr learned my addr 172.21.15.33:0/1923981311 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc0a800640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a613b00 0x56383a619000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a617d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 -- 172.21.15.33:0/1923981311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 msgr2=0x56383a617d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a617d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 -- 172.21.15.33:0/1923981311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a613b00 msgr2=0x56383a619000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a613b00 0x56383a619000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09400640 1 -- 172.21.15.33:0/1923981311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383a2d2790 con 0x56383a6110c0 2024-09-11T00:07:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.263+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a617d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.264+0000 7fcc09400640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8003a10 tx=0x7fcbf8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38607cb32bb4a384 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.264+0000 7fcbebe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8026070 con 0x56383a6110c0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcbf801fd20 con 0x56383a6110c0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbfc040070 con 0x56383a6110c0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbf8005020 con 0x56383a6110c0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcc13e63740 10 client.36416 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.265+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56383a34b620 con 0x56383a6110c0 2024-09-11T00:07:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbfc040070 con 0x56383a6110c0 2024-09-11T00:07:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcbf8004cd0 con 0x56383a6110c0 2024-09-11T00:07:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcc13e63740 10 client.36416 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcc13e63740 10 client.36416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcc13e63740 20 client.36416 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.266+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a623720 0x56383a625b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.267+0000 7fcc13e63740 4 client.36416 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.267+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56383a583600 con 0x56383a623720 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.267+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a623720 0x56383a625b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.268+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a623720 0x56383a625b80 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e830848ff1e731c server_cookie=f83ca7c6cb67254a in_seq=0 out_seq=0 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.268+0000 7fcbebe00640 10 client.36416 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.269+0000 7fcbebe00640 1 -- 172.21.15.33:0/1923981311 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56383a583600 con 0x56383a623720 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.269+0000 7fcbebe00640 10 client.36416 handle_command_reply: tid=0 2024-09-11T00:07:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.269+0000 7fcc13e63740 1 client.36416 shutdown 2024-09-11T00:07:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 msgr2=0x56383a618430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8003a10 tx=0x7fcbf8004730 comp rx=0 tx=0).stop 2024-09-11T00:07:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 shutdown_connections 2024-09-11T00:07:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a613b00 0x56383a619000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a6110c0 0x56383a618430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a623720 0x56383a625b80 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1923981311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a617d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 >> 172.21.15.33:0/1923981311 conn(0x56383a6098e0 msgr2=0x56383a608a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.272+0000 7fcbebe00640 0 client.36416 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.273+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 shutdown_connections 2024-09-11T00:07:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.273+0000 7fcc13e63740 1 -- 172.21.15.33:0/1923981311 wait complete. 2024-09-11T00:07:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.273+0000 7fcc13e63740 20 client.36416 trim_cache size 0 max 16384 2024-09-11T00:07:20.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.306+0000 7fcc13e63740 1 Processor -- start 2024-09-11T00:07:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.306+0000 7fcc13e63740 1 -- start start 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a60db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a60e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec012550 con 0x56383a60a140 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00fe20 con 0x56383a613b00 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc13e63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00dc70 con 0x56383a60e790 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.307+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.308+0000 7fcc0a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56112/0 (socket says 172.21.15.33:56112) 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.308+0000 7fcc0a800640 1 -- 172.21.15.33:0/3473234443 learned_addr learned my addr 172.21.15.33:0/3473234443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.308+0000 7fcc09400640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a60e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.308+0000 7fcc09e00640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a60db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.310+0000 7fcc0a800640 1 -- 172.21.15.33:0/3473234443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 msgr2=0x56383a60db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.311+0000 7fcc0a800640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a60db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.311+0000 7fcc0a800640 1 -- 172.21.15.33:0/3473234443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 msgr2=0x56383a60e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.311+0000 7fcc0a800640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a60e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.311+0000 7fcc0a800640 1 -- 172.21.15.33:0/3473234443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a610ef0 con 0x56383a60a140 2024-09-11T00:07:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.311+0000 7fcc09400640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a60e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.312+0000 7fcc0a800640 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcc040ac960 tx=0x7fcc040ac200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c1f47dbe2d90db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.313+0000 7fcbf6a00640 1 -- 172.21.15.33:0/3473234443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040ac9d0 con 0x56383a60a140 2024-09-11T00:07:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.313+0000 7fcbf6a00640 1 -- 172.21.15.33:0/3473234443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc040b14b0 con 0x56383a60a140 2024-09-11T00:07:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.313+0000 7fcbf6a00640 1 -- 172.21.15.33:0/3473234443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040b5ad0 con 0x56383a60a140 2024-09-11T00:07:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 -- 172.21.15.33:0/3473234443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 msgr2=0x56383a60a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcc040ac960 tx=0x7fcc040ac200 comp rx=0 tx=0).stop 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 -- 172.21.15.33:0/3473234443 shutdown_connections 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a60a5d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a60e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 --2- 172.21.15.33:0/3473234443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a60db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.314+0000 7fcc13e63740 1 -- 172.21.15.33:0/3473234443 >> 172.21.15.33:0/3473234443 conn(0x56383a6098e0 msgr2=0x56383a617280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.315+0000 7fcc13e63740 1 -- 172.21.15.33:0/3473234443 shutdown_connections 2024-09-11T00:07:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.315+0000 7fcc13e63740 1 -- 172.21.15.33:0/3473234443 wait complete. 2024-09-11T00:07:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.315+0000 7fcc13e63740 1 -- start start 2024-09-11T00:07:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 Processor -- start 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a61f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a61f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a61da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00e2e0 con 0x56383a60a140 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00f750 con 0x56383a613b00 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec00e9b0 con 0x56383a60e790 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.316+0000 7fcc13e63740 10 client.0 _ll_register_callbacks cb 0x7fcbf80036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a61f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a61f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50302/0 (socket says 172.21.15.33:50302) 2024-09-11T00:07:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09400640 1 -- 172.21.15.33:0/1197498149 learned_addr learned my addr 172.21.15.33:0/1197498149 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a61f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc0a800640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a61da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 -- 172.21.15.33:0/1197498149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 msgr2=0x56383a61f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a61f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 -- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 msgr2=0x56383a61da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a61da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.317+0000 7fcc09e00640 1 -- 172.21.15.33:0/1197498149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383a61e1d0 con 0x56383a60a140 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.318+0000 7fcc09e00640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a61f1c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0057c0 tx=0x7fcbfc031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a728d7823b7f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.318+0000 7fcbebe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:07:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.319+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc035040 con 0x56383a60a140 2024-09-11T00:07:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.319+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcbfc031b20 con 0x56383a60a140 2024-09-11T00:07:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.319+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc040b14b0 con 0x56383a60a140 2024-09-11T00:07:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.319+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbfc031d20 con 0x56383a60a140 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 10 client.16611 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56383a6910a0 con 0x56383a60a140 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc040b14b0 con 0x56383a60a140 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcbfc05e030 con 0x56383a60a140 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 10 client.16611 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 20 client.16611 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a691610 0x56383a693a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 4 client.16611 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:07:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.320+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56383a57f0b0 con 0x56383a691610 2024-09-11T00:07:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.321+0000 7fcc09400640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a691610 0x56383a693a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.322+0000 7fcc09400640 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a691610 0x56383a693a00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f4493d2419c904 server_cookie=8ae8d61d4ce11569 in_seq=0 out_seq=0 2024-09-11T00:07:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.322+0000 7fcbebe00640 10 client.16611 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.340+0000 7fcbebe00640 1 -- 172.21.15.33:0/1197498149 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56383a57f0b0 con 0x56383a691610 2024-09-11T00:07:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.340+0000 7fcbebe00640 10 client.16611 handle_command_reply: tid=0 2024-09-11T00:07:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.340+0000 7fcc13e63740 1 client.16611 shutdown 2024-09-11T00:07:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 msgr2=0x56383a61f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a61f1c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0057c0 tx=0x7fcbfc031500 comp rx=0 tx=0).stop 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 shutdown_connections 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56383a613b00 0x56383a61da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56383a691610 0x56383a693a00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56383a60e790 0x56383a61f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 --2- 172.21.15.33:0/1197498149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56383a60a140 0x56383a61f1c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.341+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 >> 172.21.15.33:0/1197498149 conn(0x56383a6098e0 msgr2=0x56383a60c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.342+0000 7fcbebe00640 0 client.16611 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.342+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 shutdown_connections 2024-09-11T00:07:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.343+0000 7fcc13e63740 1 -- 172.21.15.33:0/1197498149 wait complete. 2024-09-11T00:07:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.343+0000 7fcc13e63740 20 client.16611 trim_cache size 0 max 16384 2024-09-11T00:07:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:07:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:07:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:07:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:07:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.344+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 msgr2=0x7fcbf00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.344+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 0x7fcbf00b7820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800b770 tx=0x7fcbf800b480 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.344+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 msgr2=0x7fcc0c1a8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.344+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1a8d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400cab0 tx=0x7fcc0400cf70 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 shutdown_connections 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcbf00b5360 0x7fcbf00b7820 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc0c10ab10 0x7fcc0c1a8d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc0c10a150 0x7fcc0c1a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 --2- 172.21.15.33:0/315479539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc0c074470 0x7fcc0c1a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 >> 172.21.15.33:0/315479539 conn(0x7fcc0c06fa40 msgr2=0x7fcc0c10d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 shutdown_connections 2024-09-11T00:07:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:20.345+0000 7fcc11000640 1 -- 172.21.15.33:0/315479539 wait complete. 2024-09-11T00:07:20.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:20 smithi033 ceph-mon[30593]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 904 KiB/s wr, 94 op/s 2024-09-11T00:07:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:20 smithi189 ceph-mon[34000]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 904 KiB/s wr, 94 op/s 2024-09-11T00:07:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:20 smithi052 ceph-mon[33526]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 904 KiB/s wr, 94 op/s 2024-09-11T00:07:22.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:22 smithi033 ceph-mon[30593]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-11T00:07:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:22 smithi189 ceph-mon[34000]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-11T00:07:22.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:22 smithi052 ceph-mon[33526]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-11T00:07:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 455.0 s, 595.2 tps, lat 152.164 ms stddev 82.693 2024-09-11T00:07:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:23 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:23 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:23.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:23 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:24 smithi033 ceph-mon[30593]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-09-11T00:07:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:24 smithi189 ceph-mon[34000]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-09-11T00:07:24.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:24 smithi052 ceph-mon[33526]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 MiB/s wr, 389 op/s 2024-09-11T00:07:25.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:25.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:25.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:07:25.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:25.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:25.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:07:25.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:25.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:25.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:07:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:26 smithi033 ceph-mon[30593]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 435 op/s 2024-09-11T00:07:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:26 smithi189 ceph-mon[34000]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 435 op/s 2024-09-11T00:07:26.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:26 smithi052 ceph-mon[33526]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 MiB/s wr, 435 op/s 2024-09-11T00:07:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 460.0 s, 618.2 tps, lat 176.606 ms stddev 116.286 2024-09-11T00:07:28.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:28 smithi033 ceph-mon[30593]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-09-11T00:07:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:28 smithi189 ceph-mon[34000]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-09-11T00:07:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:28 smithi052 ceph-mon[33526]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-09-11T00:07:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:30 smithi189 ceph-mon[34000]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.6 MiB/s wr, 615 op/s 2024-09-11T00:07:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:30 smithi052 ceph-mon[33526]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.6 MiB/s wr, 615 op/s 2024-09-11T00:07:31.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:30 smithi033 ceph-mon[30593]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.6 MiB/s wr, 615 op/s 2024-09-11T00:07:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:32 smithi189 ceph-mon[34000]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.1 MiB/s wr, 692 op/s 2024-09-11T00:07:32.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:32 smithi052 ceph-mon[33526]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.1 MiB/s wr, 692 op/s 2024-09-11T00:07:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:32 smithi033 ceph-mon[30593]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 7.1 MiB/s wr, 692 op/s 2024-09-11T00:07:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 465.0 s, 591.0 tps, lat 165.614 ms stddev 47.820 2024-09-11T00:07:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 -- 172.21.15.33:0/3023978539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af0076f90 msgr2=0x7f5af00755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 --2- 172.21.15.33:0/3023978539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af0076f90 0x7f5af00755e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009900 tx=0x7f5ae402a420 comp rx=0 tx=0).stop 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 -- 172.21.15.33:0/3023978539 shutdown_connections 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 --2- 172.21.15.33:0/3023978539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0106490 0x7f5af0111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 --2- 172.21.15.33:0/3023978539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0075b20 0x7f5af0075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 --2- 172.21.15.33:0/3023978539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af0076f90 0x7f5af00755e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.559+0000 7f5af7e00640 1 -- 172.21.15.33:0/3023978539 >> 172.21.15.33:0/3023978539 conn(0x7f5af00fe240 msgr2=0x7f5af0100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.560+0000 7f5af7e00640 1 -- 172.21.15.33:0/3023978539 shutdown_connections 2024-09-11T00:07:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.560+0000 7f5af7e00640 1 -- 172.21.15.33:0/3023978539 wait complete. 2024-09-11T00:07:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.562+0000 7f5af7e00640 1 Processor -- start 2024-09-11T00:07:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.562+0000 7f5af7e00640 1 -- start start 2024-09-11T00:07:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0075b20 0x7f5af019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af01a0570 0x7f5af01a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0114af0 con 0x7f5af0076f90 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0114970 con 0x7f5af0075b20 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0114c70 con 0x7f5af01a0570 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0075b20 0x7f5af019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37972/0 (socket says 172.21.15.33:37972) 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af4a00640 1 -- 172.21.15.33:0/4209717151 learned_addr learned my addr 172.21.15.33:0/4209717151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.563+0000 7f5af5e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af01a0570 0x7f5af01a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.565+0000 7f5af4a00640 1 -- 172.21.15.33:0/4209717151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af01a0570 msgr2=0x7f5af01a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.565+0000 7f5af4a00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af01a0570 0x7f5af01a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.565+0000 7f5af4a00640 1 -- 172.21.15.33:0/4209717151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0075b20 msgr2=0x7f5af019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.565+0000 7f5af4a00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0075b20 0x7f5af019f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.565+0000 7f5af4a00640 1 -- 172.21.15.33:0/4209717151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01a1220 con 0x7f5af0076f90 2024-09-11T00:07:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.566+0000 7f5af4a00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00d950 tx=0x7f5adc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.567+0000 7f5aee000640 1 -- 172.21.15.33:0/4209717151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc017030 con 0x7f5af0076f90 2024-09-11T00:07:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.567+0000 7f5aee000640 1 -- 172.21.15.33:0/4209717151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5adc004020 con 0x7f5af0076f90 2024-09-11T00:07:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.567+0000 7f5aee000640 1 -- 172.21.15.33:0/4209717151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0055d0 con 0x7f5af0076f90 2024-09-11T00:07:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.567+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af01a7610 con 0x7f5af0076f90 2024-09-11T00:07:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.568+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af01a7ab0 con 0x7f5af0076f90 2024-09-11T00:07:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.577+0000 7f5afacda740 1 Processor -- start 2024-09-11T00:07:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.577+0000 7f5afacda740 1 -- start start 2024-09-11T00:07:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ace4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ad0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55daf4a3c6b0 con 0x55daf4ac9790 2024-09-11T00:07:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55daf4a2bae0 con 0x55daf4acc0c0 2024-09-11T00:07:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.578+0000 7f5afacda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55daf4a2f8f0 con 0x55daf4aceb00 2024-09-11T00:07:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.579+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.579+0000 7f5af5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ace4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.579+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37984/0 (socket says 172.21.15.33:37984) 2024-09-11T00:07:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.579+0000 7f5af5e00640 1 -- 172.21.15.33:0/2990065825 learned_addr learned my addr 172.21.15.33:0/2990065825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.579+0000 7f5aee000640 1 -- 172.21.15.33:0/4209717151 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5adc009a30 con 0x7f5af0076f90 2024-09-11T00:07:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.580+0000 7f5af5e00640 1 -- 172.21.15.33:0/2990065825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 msgr2=0x55daf4ad0fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:07:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.581+0000 7f5af5e00640 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ad0fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.581+0000 7f5af5e00640 1 -- 172.21.15.33:0/2990065825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 msgr2=0x55daf4ace4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.581+0000 7f5af5e00640 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ace4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.581+0000 7f5af5e00640 1 -- 172.21.15.33:0/2990065825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf49f8780 con 0x55daf4ac9790 2024-09-11T00:07:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.581+0000 7f5af5400640 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ace4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.582+0000 7f5af5e00640 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009f50 tx=0x7f5ae80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9252b0c29ffd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.583+0000 7f5ae2600640 1 -- 172.21.15.33:0/2990065825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8004d20 con 0x55daf4ac9790 2024-09-11T00:07:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.583+0000 7f5ae2600640 1 -- 172.21.15.33:0/2990065825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae8004050 con 0x55daf4ac9790 2024-09-11T00:07:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.583+0000 7f5ae2600640 1 -- 172.21.15.33:0/2990065825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8005260 con 0x55daf4ac9790 2024-09-11T00:07:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.584+0000 7f5afacda740 1 -- 172.21.15.33:0/2990065825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 msgr2=0x55daf4acbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.584+0000 7f5afacda740 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009f50 tx=0x7f5ae80118d0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.584+0000 7f5aee000640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 0x7f5ad80b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 -- 172.21.15.33:0/2990065825 shutdown_connections 2024-09-11T00:07:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ad0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ace4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 --2- 172.21.15.33:0/2990065825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4acbb80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 -- 172.21.15.33:0/2990065825 >> 172.21.15.33:0/2990065825 conn(0x55daf4ac48e0 msgr2=0x55daf4ac5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5af5e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 0x7f5ad80b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5aee000640 1 -- 172.21.15.33:0/4209717151 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5adc0e5920 con 0x7f5af0076f90 2024-09-11T00:07:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.585+0000 7f5afacda740 1 -- 172.21.15.33:0/2990065825 shutdown_connections 2024-09-11T00:07:33.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.586+0000 7f5afacda740 1 -- 172.21.15.33:0/2990065825 wait complete. 2024-09-11T00:07:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.587+0000 7f5af5e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 0x7f5ad80b7970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d60 tx=0x7f5ae8000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.587+0000 7f5afacda740 1 -- start start 2024-09-11T00:07:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.588+0000 7f5afacda740 1 Processor -- start 2024-09-11T00:07:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.591+0000 7f5afacda740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4ae3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55daf4963ab0 con 0x55daf4acc0c0 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55daf49d2570 con 0x55daf4ac9790 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55daf4ae2af0 con 0x55daf4aceb00 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.592+0000 7f5afacda740 10 client.0 _ll_register_callbacks cb 0x55daf49e1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.593+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.593+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.593+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40720/0 (socket says 172.21.15.33:40720) 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.593+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37990/0 (socket says 172.21.15.33:37990) 2024-09-11T00:07:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.593+0000 7f5af5e00640 1 -- 172.21.15.33:0/3739870319 learned_addr learned my addr 172.21.15.33:0/3739870319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.595+0000 7f5af5e00640 1 -- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 msgr2=0x55daf4ae3fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.595+0000 7f5af5e00640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4ae3fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.595+0000 7f5af5e00640 1 -- 172.21.15.33:0/3739870319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 msgr2=0x55daf4ae4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.595+0000 7f5af5e00640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.596+0000 7f5af5e00640 1 -- 172.21.15.33:0/3739870319 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf478d790 con 0x55daf4aceb00 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.596+0000 7f5af4a00640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.596+0000 7f5af5e00640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009f50 tx=0x7f5ae80047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7e16601fe94f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.596+0000 7f5ad6a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:07:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.597+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8044070 con 0x55daf4aceb00 2024-09-11T00:07:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.597+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5ae800f480 con 0x55daf4aceb00 2024-09-11T00:07:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.597+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae8004050 con 0x55daf4aceb00 2024-09-11T00:07:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.598+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5ae804e050 con 0x55daf4aceb00 2024-09-11T00:07:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.598+0000 7f5afacda740 10 client.26389 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.598+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55daf4806620 con 0x55daf4aceb00 2024-09-11T00:07:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.599+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae8004050 con 0x55daf4aceb00 2024-09-11T00:07:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.599+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5ae8049440 con 0x55daf4aceb00 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 10 client.26389 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 10 client.26389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 20 client.26389 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aef710 0x55daf4af1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 4 client.26389 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.600+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf4a3e600 con 0x55daf4aef710 2024-09-11T00:07:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.601+0000 7f5af5400640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aef710 0x55daf4af1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.604+0000 7f5af5400640 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aef710 0x55daf4af1b00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eec0622775e3150 server_cookie=996ccc9786271336 in_seq=0 out_seq=0 2024-09-11T00:07:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.604+0000 7f5ad6a00640 10 client.26389 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.604+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3739870319 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55daf4a3e600 con 0x55daf4aef710 2024-09-11T00:07:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.604+0000 7f5ad6a00640 10 client.26389 handle_command_reply: tid=0 2024-09-11T00:07:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 client.26389 shutdown 2024-09-11T00:07:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 msgr2=0x55daf4ae5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009f50 tx=0x7f5ae80047b0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 shutdown_connections 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aef710 0x55daf4af1b00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4aceb00 0x55daf4ae5230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4acc0c0 0x55daf4ae4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 --2- 172.21.15.33:0/3739870319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4ae3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.605+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 >> 172.21.15.33:0/3739870319 conn(0x55daf4ac48e0 msgr2=0x55daf4ac3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.606+0000 7f5ad6a00640 0 client.26389 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.606+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 shutdown_connections 2024-09-11T00:07:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.607+0000 7f5afacda740 1 -- 172.21.15.33:0/3739870319 wait complete. 2024-09-11T00:07:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.607+0000 7f5afacda740 20 client.26389 trim_cache size 0 max 16384 2024-09-11T00:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.637+0000 7f5afacda740 1 Processor -- start 2024-09-11T00:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.637+0000 7f5afacda740 1 -- start start 2024-09-11T00:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4ac48e0 0x55daf4ae3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4ac5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5af010a7d0 con 0x55daf4ac9790 2024-09-11T00:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01080a0 con 0x55daf4acc0c0 2024-09-11T00:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5afacda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0074de0 con 0x55daf4ac48e0 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5af5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4ac48e0 0x55daf4ae3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56434/0 (socket says 172.21.15.33:56434) 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.638+0000 7f5af5e00640 1 -- 172.21.15.33:0/1813391141 learned_addr learned my addr 172.21.15.33:0/1813391141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 -- 172.21.15.33:0/1813391141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4ac48e0 msgr2=0x55daf4ae3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4ac48e0 0x55daf4ae3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 -- 172.21.15.33:0/1813391141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 msgr2=0x55daf4ac5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4ac5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 -- 172.21.15.33:0/1813391141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf4acbef0 con 0x55daf4acc0c0 2024-09-11T00:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.639+0000 7f5af5e00640 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009730 tx=0x7f5ae8009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae47b19110ab3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.640+0000 7f5ae1c00640 1 -- 172.21.15.33:0/1813391141 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8044040 con 0x55daf4acc0c0 2024-09-11T00:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.640+0000 7f5ae1c00640 1 -- 172.21.15.33:0/1813391141 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae8029070 con 0x55daf4acc0c0 2024-09-11T00:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.640+0000 7f5ae1c00640 1 -- 172.21.15.33:0/1813391141 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8053440 con 0x55daf4acc0c0 2024-09-11T00:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 -- 172.21.15.33:0/1813391141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 msgr2=0x55daf4ac5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009730 tx=0x7f5ae8009ee0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 -- 172.21.15.33:0/1813391141 shutdown_connections 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4acc0c0 0x55daf4ac5680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac9790 0x55daf4ac5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 --2- 172.21.15.33:0/1813391141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4ac48e0 0x55daf4ae3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.641+0000 7f5afacda740 1 -- 172.21.15.33:0/1813391141 >> 172.21.15.33:0/1813391141 conn(0x55daf4ac4500 msgr2=0x55daf4ae3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.642+0000 7f5afacda740 1 -- 172.21.15.33:0/1813391141 shutdown_connections 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.642+0000 7f5afacda740 1 -- 172.21.15.33:0/1813391141 wait complete. 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.642+0000 7f5afacda740 1 -- start start 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.643+0000 7f5afacda740 1 Processor -- start 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.643+0000 7f5afacda740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 0x55daf4aebab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.643+0000 7f5afacda740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.643+0000 7f5afacda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 0x55daf4aeacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5afacda740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0106560 con 0x55daf4ac48e0 2024-09-11T00:07:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5afacda740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01079d0 con 0x55daf4ac9790 2024-09-11T00:07:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5afacda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0106c30 con 0x55daf4acc0c0 2024-09-11T00:07:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5afacda740 10 client.0 _ll_register_callbacks cb 0x7f5ae80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56446/0 (socket says 172.21.15.33:56446) 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af4a00640 1 -- 172.21.15.33:0/3399246107 learned_addr learned my addr 172.21.15.33:0/3399246107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af5e00640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 0x55daf4aeacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af5400640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 0x55daf4aebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af4a00640 1 -- 172.21.15.33:0/3399246107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 msgr2=0x55daf4aeacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.644+0000 7f5af4a00640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 0x55daf4aeacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.645+0000 7f5af4a00640 1 -- 172.21.15.33:0/3399246107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 msgr2=0x55daf4aebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.645+0000 7f5af4a00640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 0x55daf4aebab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.645+0000 7f5af4a00640 1 -- 172.21.15.33:0/3399246107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf4aeb520 con 0x55daf4ac9790 2024-09-11T00:07:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.645+0000 7f5af5e00640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 0x55daf4aeacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.645+0000 7f5af5400640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 0x55daf4aebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:07:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.646+0000 7f5af4a00640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0e5c00 tx=0x7f5adc0ab6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed82f3822a79af57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.646+0000 7f5ad6a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:07:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.649+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0b3d40 con 0x55daf4ac9790 2024-09-11T00:07:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.649+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f5adc0aaf40 con 0x55daf4ac9790 2024-09-11T00:07:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.649+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae8029070 con 0x55daf4ac9790 2024-09-11T00:07:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.649+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5adc0ab7f0 con 0x55daf4ac9790 2024-09-11T00:07:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.649+0000 7f5afacda740 10 client.36437 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.650+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55daf4b5c6a0 con 0x55daf4ac9790 2024-09-11T00:07:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.651+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ae8029070 con 0x55daf4ac9790 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.651+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5adc0aa9b0 con 0x55daf4ac9790 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 10 client.36437 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 10 client.36437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 20 client.36437 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aceb00 0x55daf4b5f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 4 client.36437 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55daf4a3a0b0 con 0x55daf4aceb00 2024-09-11T00:07:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.652+0000 7f5af5400640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aceb00 0x55daf4b5f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.655+0000 7f5af5400640 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aceb00 0x55daf4b5f040 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3b06a9097c3aa9 server_cookie=bd6c558d311af2e5 in_seq=0 out_seq=0 2024-09-11T00:07:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.655+0000 7f5ad6a00640 10 client.36437 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.746+0000 7f5ad6a00640 1 -- 172.21.15.33:0/3399246107 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55daf4a3a0b0 con 0x55daf4aceb00 2024-09-11T00:07:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.746+0000 7f5ad6a00640 10 client.36437 handle_command_reply: tid=0 2024-09-11T00:07:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.747+0000 7f5afacda740 1 client.36437 shutdown 2024-09-11T00:07:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.747+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 msgr2=0x55daf4aea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.747+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0e5c00 tx=0x7f5adc0ab6f0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.747+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 shutdown_connections 2024-09-11T00:07:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55daf4aceb00 0x55daf4b5f040 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55daf4acc0c0 0x55daf4aeacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55daf4ac9790 0x55daf4aea7b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 --2- 172.21.15.33:0/3399246107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55daf4ac48e0 0x55daf4aebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 >> 172.21.15.33:0/3399246107 conn(0x55daf4ac4500 msgr2=0x55daf4acef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5ad6a00640 0 client.36437 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 shutdown_connections 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.748+0000 7f5afacda740 1 -- 172.21.15.33:0/3399246107 wait complete. 2024-09-11T00:07:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.749+0000 7f5afacda740 20 client.36437 trim_cache size 0 max 16384 2024-09-11T00:07:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:07:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:07:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:07:33.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:07:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 msgr2=0x7f5ad80b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 0x7f5ad80b7970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d60 tx=0x7f5ae8000f40 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 msgr2=0x7f5af019f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00d950 tx=0x7f5adc00de10 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 shutdown_connections 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f5ad80b54b0 0x7f5ad80b7970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5af01a0570 0x7f5af01a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af0076f90 0x7f5af019f940 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 --2- 172.21.15.33:0/4209717151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5af0075b20 0x7f5af019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:33.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.751+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 >> 172.21.15.33:0/4209717151 conn(0x7f5af00fe240 msgr2=0x7f5af0100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.752+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 shutdown_connections 2024-09-11T00:07:33.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:33.752+0000 7f5af7e00640 1 -- 172.21.15.33:0/4209717151 wait complete. 2024-09-11T00:07:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:34 smithi189 ceph-mon[34000]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 755 op/s 2024-09-11T00:07:34.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:34 smithi052 ceph-mon[33526]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 755 op/s 2024-09-11T00:07:35.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:34 smithi033 ceph-mon[30593]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.6 MiB/s wr, 755 op/s 2024-09-11T00:07:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:36 smithi189 ceph-mon[34000]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.5 MiB/s wr, 600 op/s 2024-09-11T00:07:36.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:36 smithi052 ceph-mon[33526]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.5 MiB/s wr, 600 op/s 2024-09-11T00:07:37.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:36 smithi033 ceph-mon[30593]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.5 MiB/s wr, 600 op/s 2024-09-11T00:07:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 470.0 s, 691.4 tps, lat 149.137 ms stddev 84.041 2024-09-11T00:07:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:38 smithi189 ceph-mon[34000]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.9 MiB/s wr, 723 op/s 2024-09-11T00:07:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:38 smithi052 ceph-mon[33526]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.9 MiB/s wr, 723 op/s 2024-09-11T00:07:39.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:38 smithi033 ceph-mon[30593]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.9 MiB/s wr, 723 op/s 2024-09-11T00:07:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:40 smithi033 ceph-mon[30593]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.9 MiB/s wr, 667 op/s 2024-09-11T00:07:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:40 smithi189 ceph-mon[34000]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.9 MiB/s wr, 667 op/s 2024-09-11T00:07:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:40 smithi052 ceph-mon[33526]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.9 MiB/s wr, 667 op/s 2024-09-11T00:07:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:42 smithi189 ceph-mon[34000]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.8 MiB/s wr, 694 op/s 2024-09-11T00:07:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:42 smithi052 ceph-mon[33526]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.8 MiB/s wr, 694 op/s 2024-09-11T00:07:43.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:42 smithi033 ceph-mon[30593]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.8 MiB/s wr, 694 op/s 2024-09-11T00:07:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 475.0 s, 733.0 tps, lat 135.697 ms stddev 38.819 2024-09-11T00:07:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:44 smithi189 ceph-mon[34000]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:07:44.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:44 smithi052 ceph-mon[33526]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:07:45.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:44 smithi033 ceph-mon[30593]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:07:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 -- 172.21.15.33:0/1482750779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c075ac0 msgr2=0x7f587c075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 --2- 172.21.15.33:0/1482750779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c075ac0 0x7f587c075f40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5868009860 tx=0x7f586802a340 comp rx=0 tx=0).stop 2024-09-11T00:07:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 -- 172.21.15.33:0/1482750779 shutdown_connections 2024-09-11T00:07:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 --2- 172.21.15.33:0/1482750779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 0x7f587c10cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 --2- 172.21.15.33:0/1482750779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c075ac0 0x7f587c075f40 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5868009860 tx=0x7f586802a340 comp rx=0 tx=0).stop 2024-09-11T00:07:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 --2- 172.21.15.33:0/1482750779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f587c076f30 0x7f587c075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.945+0000 7f5882800640 1 -- 172.21.15.33:0/1482750779 >> 172.21.15.33:0/1482750779 conn(0x7f587c0fe030 msgr2=0x7f587c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.947+0000 7f5882800640 1 -- 172.21.15.33:0/1482750779 shutdown_connections 2024-09-11T00:07:46.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.947+0000 7f5882800640 1 -- 172.21.15.33:0/1482750779 wait complete. 2024-09-11T00:07:46.949 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.948+0000 7f5882800640 1 Processor -- start 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.948+0000 7f5882800640 1 -- start start 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 0x7f587c19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f587c19c130 0x7f587c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f587c110490 con 0x7f587c19c130 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f587c110310 con 0x7f587c076f30 2024-09-11T00:07:46.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5882800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f587c110610 con 0x7f587c10a710 2024-09-11T00:07:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5881400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5881400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52214/0 (socket says 172.21.15.33:52214) 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5880a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 0x7f587c19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.949+0000 7f5881400640 1 -- 172.21.15.33:0/1647445678 learned_addr learned my addr 172.21.15.33:0/1647445678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.950+0000 7f5881400640 1 -- 172.21.15.33:0/1647445678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 msgr2=0x7f587c19b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.950+0000 7f5881400640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 0x7f587c19b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.950+0000 7f5881400640 1 -- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f587c19c130 msgr2=0x7f587c19c5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.950+0000 7f5881400640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f587c19c130 0x7f587c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.950+0000 7f5881400640 1 -- 172.21.15.33:0/1647445678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c19cde0 con 0x7f587c076f30 2024-09-11T00:07:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.951+0000 7f5881400640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f587000e9c0 tx=0x7f587000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.951+0000 7f587a000640 1 -- 172.21.15.33:0/1647445678 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587000ccc0 con 0x7f587c076f30 2024-09-11T00:07:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.951+0000 7f587a000640 1 -- 172.21.15.33:0/1647445678 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58700054b0 con 0x7f587c076f30 2024-09-11T00:07:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.951+0000 7f587a000640 1 -- 172.21.15.33:0/1647445678 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870010430 con 0x7f587c076f30 2024-09-11T00:07:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.952+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c1a31d0 con 0x7f587c076f30 2024-09-11T00:07:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.952+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c1a3670 con 0x7f587c076f30 2024-09-11T00:07:46.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:46 smithi052 ceph-mon[33526]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 10 MiB/s wr, 661 op/s 2024-09-11T00:07:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.957+0000 7f5886dbf740 1 Processor -- start 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 -- start start 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe36690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe391a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55605fda46b0 con 0x55605fe342a0 2024-09-11T00:07:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55605fd93ae0 con 0x55605fe31970 2024-09-11T00:07:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5886dbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55605fd978f0 con 0x55605fe36ce0 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.958+0000 7f5881e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52226/0 (socket says 172.21.15.33:52226) 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 -- 172.21.15.33:0/367813590 learned_addr learned my addr 172.21.15.33:0/367813590 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 -- 172.21.15.33:0/367813590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 msgr2=0x55605fe391a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe391a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 -- 172.21.15.33:0/367813590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 msgr2=0x55605fe36690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe36690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.959+0000 7f5881e00640 1 -- 172.21.15.33:0/367813590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605fd60780 con 0x55605fe31970 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.960+0000 7f5881e00640 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5874009ea0 tx=0x7f5874009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4f9cb680371e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.960+0000 7f586e600640 1 -- 172.21.15.33:0/367813590 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874004d20 con 0x55605fe31970 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.960+0000 7f586e600640 1 -- 172.21.15.33:0/367813590 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f587400ee60 con 0x55605fe31970 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.960+0000 7f586e600640 1 -- 172.21.15.33:0/367813590 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740107f0 con 0x55605fe31970 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.961+0000 7f587a000640 1 -- 172.21.15.33:0/1647445678 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5870004eb0 con 0x7f587c076f30 2024-09-11T00:07:46.963 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 -- 172.21.15.33:0/367813590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 msgr2=0x55605fe33d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5874009ea0 tx=0x7f5874009f90 comp rx=0 tx=0).stop 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 -- 172.21.15.33:0/367813590 shutdown_connections 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe36690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 --2- 172.21.15.33:0/367813590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe31970 0x55605fe33d60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.962+0000 7f5886dbf740 1 -- 172.21.15.33:0/367813590 >> 172.21.15.33:0/367813590 conn(0x55605fe2cac0 msgr2=0x55605fe2d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.963+0000 7f587a000640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 0x7f58640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.963+0000 7f587a000640 1 -- 172.21.15.33:0/1647445678 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f58700e62d0 con 0x7f587c076f30 2024-09-11T00:07:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.964+0000 7f5880a00640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 0x7f58640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.966+0000 7f5880a00640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 0x7f58640b7820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5868035040 tx=0x7f5868005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.966+0000 7f5886dbf740 1 -- 172.21.15.33:0/367813590 shutdown_connections 2024-09-11T00:07:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.967+0000 7f5886dbf740 1 -- 172.21.15.33:0/367813590 wait complete. 2024-09-11T00:07:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.968+0000 7f5886dbf740 1 -- start start 2024-09-11T00:07:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.968+0000 7f5886dbf740 1 Processor -- start 2024-09-11T00:07:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.969+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.970+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.970+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe3c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.970+0000 7f5880a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.970+0000 7f5880a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52228/0 (socket says 172.21.15.33:52228) 2024-09-11T00:07:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5880a00640 1 -- 172.21.15.33:0/927814165 learned_addr learned my addr 172.21.15.33:0/927814165 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5881400640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5881e00640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe3c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55605fccbab0 con 0x55605fe31970 2024-09-11T00:07:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55605fd3a570 con 0x55605fe342a0 2024-09-11T00:07:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.971+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55605fe39cc0 con 0x55605fe36ce0 2024-09-11T00:07:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.972+0000 7f5886dbf740 10 client.0 _ll_register_callbacks cb 0x55605fd49100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.972+0000 7f5880a00640 1 -- 172.21.15.33:0/927814165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 msgr2=0x55605fe3c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.972+0000 7f5880a00640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe3c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.972+0000 7f5880a00640 1 -- 172.21.15.33:0/927814165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 msgr2=0x55605fe3b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5880a00640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5880a00640 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605faf5790 con 0x55605fe342a0 2024-09-11T00:07:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5881400640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f587400ee60 con 0x55605fe342a0 2024-09-11T00:07:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5880a00640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5868009230 tx=0x7f5868005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9faebb2c924c4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.973+0000 7f5862a00640 10 client.36449 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:07:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.974+0000 7f5862a00640 1 -- 172.21.15.33:0/927814165 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868037040 con 0x55605fe342a0 2024-09-11T00:07:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.974+0000 7f5862a00640 1 -- 172.21.15.33:0/927814165 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f58680046c0 con 0x55605fe342a0 2024-09-11T00:07:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.974+0000 7f5862a00640 1 -- 172.21.15.33:0/927814165 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58680048c0 con 0x55605fe342a0 2024-09-11T00:07:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.974+0000 7f5886dbf740 10 client.36449 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.974+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55605fb6e620 con 0x55605fe342a0 2024-09-11T00:07:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5862a00640 1 -- 172.21.15.33:0/927814165 <== mon.2 v2:172.21.15.52:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5868004a60 con 0x55605fe342a0 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 10 client.36449 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 10 client.36449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 20 client.36449 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fe468d0 0x55605fe48d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 4 client.36449 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.975+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55605fda6600 con 0x55605fe468d0 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.976+0000 7f5881400640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fe468d0 0x55605fe48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.976+0000 7f5881400640 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fe468d0 0x55605fe48d20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3771bf073d0366 server_cookie=6475db2dd93b52f1 in_seq=0 out_seq=0 2024-09-11T00:07:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.976+0000 7f5862a00640 10 client.36449 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5862a00640 1 -- 172.21.15.33:0/927814165 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55605fda6600 con 0x55605fe468d0 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5862a00640 10 client.36449 handle_command_reply: tid=0 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 client.36449 shutdown 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 msgr2=0x55605fe3b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5868009230 tx=0x7f5868005f90 comp rx=0 tx=0).stop 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 shutdown_connections 2024-09-11T00:07:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fe468d0 0x55605fe48d20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe3c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b7e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 --2- 172.21.15.33:0/927814165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5862a00640 0 client.36449 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.977+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 >> 172.21.15.33:0/927814165 conn(0x55605fe2cac0 msgr2=0x55605fe2bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.978+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 shutdown_connections 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.978+0000 7f5886dbf740 1 -- 172.21.15.33:0/927814165 wait complete. 2024-09-11T00:07:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:46.978+0000 7f5886dbf740 20 client.36449 trim_cache size 0 max 16384 2024-09-11T00:07:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 Processor -- start 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 -- start start 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1b4850 con 0x55605fe31970 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.004+0000 7f5886dbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1b2120 con 0x55605fe342a0 2024-09-11T00:07:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.005+0000 7f5886dbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1aff90 con 0x55605fe36ce0 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.005+0000 7f5881400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.005+0000 7f5881400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38298/0 (socket says 172.21.15.33:38298) 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5880a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:54708/0 (socket says 172.21.15.33:54708) 2024-09-11T00:07:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5880a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52234/0 (socket says 172.21.15.33:52234) 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881400640 1 -- 172.21.15.33:0/3276818462 learned_addr learned my addr 172.21.15.33:0/3276818462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 -- 172.21.15.33:0/3276818462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 msgr2=0x55605fe3b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 -- 172.21.15.33:0/3276818462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 msgr2=0x55605fe3b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.006+0000 7f5881e00640 1 -- 172.21.15.33:0/3276818462 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605fe3ac40 con 0x55605fe36ce0 2024-09-11T00:07:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.007+0000 7f5881400640 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.007+0000 7f5881e00640 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5874004a80 tx=0x7f5874009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5305ead686e30143 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.008+0000 7f586dc00640 1 -- 172.21.15.33:0/3276818462 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874027020 con 0x55605fe36ce0 2024-09-11T00:07:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.008+0000 7f586dc00640 1 -- 172.21.15.33:0/3276818462 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5874019b50 con 0x55605fe36ce0 2024-09-11T00:07:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.008+0000 7f586dc00640 1 -- 172.21.15.33:0/3276818462 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587401d040 con 0x55605fe36ce0 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 -- 172.21.15.33:0/3276818462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 msgr2=0x55605fe370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5874004a80 tx=0x7f5874009c60 comp rx=0 tx=0).stop 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 -- 172.21.15.33:0/3276818462 shutdown_connections 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe36ce0 0x55605fe370c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe342a0 0x55605fe3b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 --2- 172.21.15.33:0/3276818462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe31970 0x55605fe3b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 -- 172.21.15.33:0/3276818462 >> 172.21.15.33:0/3276818462 conn(0x55605fe2cac0 msgr2=0x55605fe2d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 -- 172.21.15.33:0/3276818462 shutdown_connections 2024-09-11T00:07:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.010+0000 7f5886dbf740 1 -- 172.21.15.33:0/3276818462 wait complete. 2024-09-11T00:07:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.011+0000 7f5886dbf740 1 -- start start 2024-09-11T00:07:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.011+0000 7f5886dbf740 1 Processor -- start 2024-09-11T00:07:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.011+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe31970 0x55605feb1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.011+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe41420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5886dbf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5886dbf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1b05e0 con 0x55605fe342a0 2024-09-11T00:07:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5886dbf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1b1a50 con 0x55605fe36ce0 2024-09-11T00:07:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5886dbf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f587c1b0cb0 con 0x55605fe31970 2024-09-11T00:07:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5886dbf740 10 client.0 _ll_register_callbacks cb 0x7f5868035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:07:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52250/0 (socket says 172.21.15.33:52250) 2024-09-11T00:07:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 -- 172.21.15.33:0/950228662 learned_addr learned my addr 172.21.15.33:0/950228662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:07:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881400640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe31970 0x55605feb1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 -- 172.21.15.33:0/950228662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe31970 msgr2=0x55605feb1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:07:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe31970 0x55605feb1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.012+0000 7f5881e00640 1 -- 172.21.15.33:0/950228662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 msgr2=0x55605fe41420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5880a00640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe41420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5881e00640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe41420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5881e00640 1 -- 172.21.15.33:0/950228662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605fe42340 con 0x55605fe36ce0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5880a00640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe41420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5862a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.013+0000 7f5881e00640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5874006010 tx=0x7f5874003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27dc93b0e556f05a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874032070 con 0x55605fe36ce0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5874019b50 con 0x55605fe36ce0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f58740194c0 con 0x55605fe36ce0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5874019700 con 0x55605fe36ce0 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5886dbf740 10 client.36455 fetch_fsmap learned FSMap version 30 2024-09-11T00:07:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.014+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55605fec4aa0 con 0x55605fe36ce0 2024-09-11T00:07:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5874019b50 con 0x55605fe36ce0 2024-09-11T00:07:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5874004260 con 0x55605fe36ce0 2024-09-11T00:07:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 10 client.36455 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 10 client.36455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 20 client.36455 populate_metadata read hostname 'smithi033' 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fec5100 0x55605fec74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 4 client.36455 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.015+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55605fda20b0 con 0x55605fec5100 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.016+0000 7f5881400640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fec5100 0x55605fec74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.016+0000 7f5881400640 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fec5100 0x55605fec74f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce649db32601f07 server_cookie=52639839c7b109e0 in_seq=0 out_seq=0 2024-09-11T00:07:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.016+0000 7f5862a00640 10 client.36455 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:47.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:46 smithi033 ceph-mon[30593]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 10 MiB/s wr, 661 op/s 2024-09-11T00:07:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.037+0000 7f5862a00640 1 -- 172.21.15.33:0/950228662 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55605fda20b0 con 0x55605fec5100 2024-09-11T00:07:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.037+0000 7f5862a00640 10 client.36455 handle_command_reply: tid=0 2024-09-11T00:07:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.037+0000 7f5886dbf740 1 client.36455 shutdown 2024-09-11T00:07:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.038+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 msgr2=0x55605fe41b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.038+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5874006010 tx=0x7f5874003e70 comp rx=0 tx=0).stop 2024-09-11T00:07:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 shutdown_connections 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55605fe36ce0 0x55605fe41b10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55605fe342a0 0x55605fe41420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55605fec5100 0x55605fec74f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 --2- 172.21.15.33:0/950228662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55605fe31970 0x55605feb1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5862a00640 0 client.36455 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 >> 172.21.15.33:0/950228662 conn(0x55605fe2cac0 msgr2=0x55605fe2d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.039+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 shutdown_connections 2024-09-11T00:07:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.040+0000 7f5886dbf740 1 -- 172.21.15.33:0/950228662 wait complete. 2024-09-11T00:07:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.040+0000 7f5886dbf740 20 client.36455 trim_cache size 0 max 16384 2024-09-11T00:07:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:07:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:07:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:07:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 msgr2=0x7f58640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 0x7f58640b7820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5868035040 tx=0x7f5868005c90 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 msgr2=0x7f587c19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f587000e9c0 tx=0x7f587000ee80 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 shutdown_connections 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f58640b5360 0x7f58640b7820 secure :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5868035040 tx=0x7f5868005c90 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f587c19c130 0x7f587c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f587c10a710 0x7f587c19b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 --2- 172.21.15.33:0/1647445678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f587c076f30 0x7f587c19aeb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.041+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 >> 172.21.15.33:0/1647445678 conn(0x7f587c0fe030 msgr2=0x7f587c100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.042+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 shutdown_connections 2024-09-11T00:07:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:07:47.042+0000 7f5882800640 1 -- 172.21.15.33:0/1647445678 wait complete. 2024-09-11T00:07:47.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:46 smithi189 ceph-mon[34000]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 10 MiB/s wr, 661 op/s 2024-09-11T00:07:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 480.0 s, 681.4 tps, lat 146.409 ms stddev 43.870 2024-09-11T00:07:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:48 smithi189 ceph-mon[34000]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 765 op/s 2024-09-11T00:07:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:48 smithi052 ceph-mon[33526]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 765 op/s 2024-09-11T00:07:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:48 smithi033 ceph-mon[30593]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 765 op/s 2024-09-11T00:07:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:50 smithi052 ceph-mon[33526]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-09-11T00:07:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:50 smithi033 ceph-mon[30593]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-09-11T00:07:51.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:50 smithi189 ceph-mon[34000]: pgmap v768: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 10 MiB/s wr, 667 op/s 2024-09-11T00:07:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:52 smithi052 ceph-mon[33526]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 660 op/s 2024-09-11T00:07:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:52 smithi033 ceph-mon[30593]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 660 op/s 2024-09-11T00:07:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:52 smithi189 ceph-mon[34000]: pgmap v769: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 660 op/s 2024-09-11T00:07:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 485.0 s, 728.6 tps, lat 136.995 ms stddev 39.165 2024-09-11T00:07:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:54 smithi052 ceph-mon[33526]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-11T00:07:55.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:54 smithi033 ceph-mon[30593]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-11T00:07:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:54 smithi189 ceph-mon[34000]: pgmap v770: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-09-11T00:07:56.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:56 smithi052 ceph-mon[33526]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 686 op/s 2024-09-11T00:07:57.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:56 smithi033 ceph-mon[30593]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 686 op/s 2024-09-11T00:07:57.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:56 smithi189 ceph-mon[34000]: pgmap v771: 129 pgs: 129 active+clean; 1.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 10 MiB/s wr, 686 op/s 2024-09-11T00:07:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 490.0 s, 720.4 tps, lat 139.338 ms stddev 41.247 2024-09-11T00:07:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:07:58 smithi052 ceph-mon[33526]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 796 op/s 2024-09-11T00:07:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:07:58 smithi033 ceph-mon[30593]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 796 op/s 2024-09-11T00:07:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:07:58 smithi189 ceph-mon[34000]: pgmap v772: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 796 op/s 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 -- 172.21.15.33:0/3248570677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a0100860 msgr2=0x7fe3a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3248570677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a0100860 0x7fe3a0100c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe388009900 tx=0x7fe38802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 -- 172.21.15.33:0/3248570677 shutdown_connections 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3248570677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0102260 0x7fe3a0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3248570677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a01018a0 0x7fe3a0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3248570677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a0100860 0x7fe3a0100c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 -- 172.21.15.33:0/3248570677 >> 172.21.15.33:0/3248570677 conn(0x7fe3a00fc440 msgr2=0x7fe3a00fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.270+0000 7fe3a6800640 1 -- 172.21.15.33:0/3248570677 shutdown_connections 2024-09-11T00:08:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.271+0000 7fe3a6800640 1 -- 172.21.15.33:0/3248570677 wait complete. 2024-09-11T00:08:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.272+0000 7fe3a6800640 1 Processor -- start 2024-09-11T00:08:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.272+0000 7fe3a6800640 1 -- start start 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0100860 0x7fe3a019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 0x7fe3a01a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0114ae0 con 0x7fe3a0102260 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0114960 con 0x7fe3a0100860 2024-09-11T00:08:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe3a6800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0114c60 con 0x7fe3a01018a0 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe39f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0100860 0x7fe3a019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42188/0 (socket says 172.21.15.33:42188) 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe39ea00640 1 -- 172.21.15.33:0/3819696875 learned_addr learned my addr 172.21.15.33:0/3819696875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.273+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 0x7fe3a01a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 -- 172.21.15.33:0/3819696875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0100860 msgr2=0x7fe3a019f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0100860 0x7fe3a019f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 -- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 msgr2=0x7fe3a01a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 0x7fe3a01a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 -- 172.21.15.33:0/3819696875 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a01a0dc0 con 0x7fe3a01018a0 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 0x7fe3a01a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe39ea00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d950 tx=0x7fe39000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.274+0000 7fe397e00640 1 -- 172.21.15.33:0/3819696875 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390017030 con 0x7fe3a01018a0 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.275+0000 7fe397e00640 1 -- 172.21.15.33:0/3819696875 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe390004020 con 0x7fe3a01018a0 2024-09-11T00:08:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.275+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a01a10b0 con 0x7fe3a01018a0 2024-09-11T00:08:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.275+0000 7fe397e00640 1 -- 172.21.15.33:0/3819696875 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3900055b0 con 0x7fe3a01018a0 2024-09-11T00:08:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.275+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a01a7780 con 0x7fe3a01018a0 2024-09-11T00:08:00.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.281+0000 7fe397e00640 1 -- 172.21.15.33:0/3819696875 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe390009a30 con 0x7fe3a01018a0 2024-09-11T00:08:00.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.281+0000 7fe3a987f740 1 Processor -- start 2024-09-11T00:08:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.282+0000 7fe397e00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 0x7fe3840b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 -- start start 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe397e00640 1 -- 172.21.15.33:0/3819696875 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3900e5980 con 0x7fe3a01018a0 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedd8cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedd8f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559dedcfd6b0 con 0x559dedd8a790 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559dedcecae0 con 0x559dedd8fb00 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.283+0000 7fe3a987f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559dedcf08f0 con 0x559dedd8d0c0 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.284+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 0x7fe3840b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.284+0000 7fe39fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.284+0000 7fe39fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52000/0 (socket says 172.21.15.33:52000) 2024-09-11T00:08:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.284+0000 7fe39fe00640 1 -- 172.21.15.33:0/3528672731 learned_addr learned my addr 172.21.15.33:0/3528672731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.285+0000 7fe39fe00640 1 -- 172.21.15.33:0/3528672731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 msgr2=0x559dedd8f4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:08:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.285+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedd8f4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.285+0000 7fe39fe00640 1 -- 172.21.15.33:0/3528672731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 msgr2=0x559dedd8cb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.285+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedd8cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.285+0000 7fe39fe00640 1 -- 172.21.15.33:0/3528672731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dedcb9780 con 0x559dedd8fb00 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.286+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 0x7fe3840b7970 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe398009fd0 tx=0x7fe398014c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.286+0000 7fe39fe00640 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3980107a0 tx=0x7fe39801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f9ec994a525e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.287+0000 7fe394c00640 1 -- 172.21.15.33:0/3528672731 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398014170 con 0x559dedd8fb00 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.287+0000 7fe394c00640 1 -- 172.21.15.33:0/3528672731 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe39800ec50 con 0x559dedd8fb00 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.287+0000 7fe394c00640 1 -- 172.21.15.33:0/3528672731 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398020440 con 0x559dedd8fb00 2024-09-11T00:08:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.288+0000 7fe3a987f740 1 -- 172.21.15.33:0/3528672731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 msgr2=0x559dedd91fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.288+0000 7fe3a987f740 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe3980107a0 tx=0x7fe39801e000 comp rx=0 tx=0).stop 2024-09-11T00:08:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.289+0000 7fe3a987f740 1 -- 172.21.15.33:0/3528672731 shutdown_connections 2024-09-11T00:08:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.289+0000 7fe3a987f740 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedd91fc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.289+0000 7fe3a987f740 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedd8f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.289+0000 7fe3a987f740 1 --2- 172.21.15.33:0/3528672731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedd8cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.289+0000 7fe3a987f740 1 -- 172.21.15.33:0/3528672731 >> 172.21.15.33:0/3528672731 conn(0x559dedd858e0 msgr2=0x559dedd86670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.290+0000 7fe3a987f740 1 -- 172.21.15.33:0/3528672731 shutdown_connections 2024-09-11T00:08:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.291+0000 7fe3a987f740 1 -- 172.21.15.33:0/3528672731 wait complete. 2024-09-11T00:08:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.292+0000 7fe3a987f740 1 -- start start 2024-09-11T00:08:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.292+0000 7fe3a987f740 1 Processor -- start 2024-09-11T00:08:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedda4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedda6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559dedc24ab0 con 0x559dedd8a790 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559dedc93570 con 0x559dedd8fb00 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559dedda3a90 con 0x559dedd8d0c0 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.293+0000 7fe3a987f740 10 client.0 _ll_register_callbacks cb 0x559dedca2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42208/0 (socket says 172.21.15.33:42208) 2024-09-11T00:08:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 -- 172.21.15.33:0/2731662750 learned_addr learned my addr 172.21.15.33:0/2731662750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39f400640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedda4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 -- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 msgr2=0x559dedda6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedda6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 -- 172.21.15.33:0/2731662750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 msgr2=0x559dedda4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.294+0000 7fe39ea00640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedda4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe39ea00640 1 -- 172.21.15.33:0/2731662750 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559deda4e790 con 0x559dedd8d0c0 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe39ea00640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3900abcd0 tx=0x7fe3900ab570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8976c552835099e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe38d600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3900b0070 con 0x559dedd8d0c0 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3900a7fb0 con 0x559dedd8d0c0 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.295+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe39800ec50 con 0x559dedd8d0c0 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.296+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3900d2030 con 0x559dedd8d0c0 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.296+0000 7fe3a987f740 10 client.26416 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.296+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559dedac7620 con 0x559dedd8d0c0 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe39800ec50 con 0x559dedd8d0c0 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe3900a7690 con 0x559dedd8d0c0 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 10 client.26416 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 10 client.26416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 20 client.26416 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559deddb08f0 0x559deddb2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 4 client.26416 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.297+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dedcff600 con 0x559deddb08f0 2024-09-11T00:08:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.298+0000 7fe39f400640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559deddb08f0 0x559deddb2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.299+0000 7fe39f400640 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559deddb08f0 0x559deddb2ce0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc097cf935ec407 server_cookie=d1d946a7d7f9cc4e in_seq=0 out_seq=0 2024-09-11T00:08:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.299+0000 7fe38d600640 10 client.26416 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.300+0000 7fe38d600640 1 -- 172.21.15.33:0/2731662750 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559dedcff600 con 0x559deddb08f0 2024-09-11T00:08:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.300+0000 7fe38d600640 10 client.26416 handle_command_reply: tid=0 2024-09-11T00:08:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.300+0000 7fe3a987f740 1 client.26416 shutdown 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 msgr2=0x559dedda5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3900abcd0 tx=0x7fe3900ab570 comp rx=0 tx=0).stop 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 shutdown_connections 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8fb00 0x559dedda6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559deddb08f0 0x559deddb2ce0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8d0c0 0x559dedda5630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 --2- 172.21.15.33:0/2731662750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8a790 0x559dedda4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe38d600640 0 client.26416 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 >> 172.21.15.33:0/2731662750 conn(0x559dedd858e0 msgr2=0x559dedd84a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 shutdown_connections 2024-09-11T00:08:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.301+0000 7fe3a987f740 1 -- 172.21.15.33:0/2731662750 wait complete. 2024-09-11T00:08:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.302+0000 7fe3a987f740 20 client.26416 trim_cache size 0 max 16384 2024-09-11T00:08:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.330+0000 7fe3a987f740 1 Processor -- start 2024-09-11T00:08:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.330+0000 7fe3a987f740 1 -- start start 2024-09-11T00:08:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.330+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.330+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 0x559dedd86140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 0x559dedd86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe3a987f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01abbf0 con 0x559dedd8d0c0 2024-09-11T00:08:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe3a987f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a94c0 con 0x559dedd8a790 2024-09-11T00:08:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe3a987f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0110700 con 0x559dedd8fb00 2024-09-11T00:08:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe39f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe39f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52014/0 (socket says 172.21.15.33:52014) 2024-09-11T00:08:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.331+0000 7fe39f400640 1 -- 172.21.15.33:0/1735786497 learned_addr learned my addr 172.21.15.33:0/1735786497 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.332+0000 7fe39fe00640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 0x559dedd86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.332+0000 7fe39ea00640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 0x559dedd86140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.333+0000 7fe39f400640 1 -- 172.21.15.33:0/1735786497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 msgr2=0x559dedd86680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.333+0000 7fe39f400640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 0x559dedd86680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.333+0000 7fe39f400640 1 -- 172.21.15.33:0/1735786497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 msgr2=0x559dedd86140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.333+0000 7fe39f400640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 0x559dedd86140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.333+0000 7fe39f400640 1 -- 172.21.15.33:0/1735786497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dedda39d0 con 0x559dedd8a790 2024-09-11T00:08:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.334+0000 7fe39fe00640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 0x559dedd86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.334+0000 7fe39ea00640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 0x559dedd86140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.334+0000 7fe39f400640 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe388005ab0 tx=0x7fe388000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=badde63c10f80e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.335+0000 7fe38fe00640 1 -- 172.21.15.33:0/1735786497 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388049070 con 0x559dedd8a790 2024-09-11T00:08:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.335+0000 7fe38fe00640 1 -- 172.21.15.33:0/1735786497 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe388031b90 con 0x559dedd8a790 2024-09-11T00:08:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.335+0000 7fe38fe00640 1 -- 172.21.15.33:0/1735786497 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388035040 con 0x559dedd8a790 2024-09-11T00:08:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.337+0000 7fe3a987f740 1 -- 172.21.15.33:0/1735786497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 msgr2=0x559dedd905f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.337+0000 7fe3a987f740 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe388005ab0 tx=0x7fe388000bc0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 -- 172.21.15.33:0/1735786497 shutdown_connections 2024-09-11T00:08:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8fb00 0x559dedd86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8d0c0 0x559dedd86140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 --2- 172.21.15.33:0/1735786497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8a790 0x559dedd905f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 -- 172.21.15.33:0/1735786497 >> 172.21.15.33:0/1735786497 conn(0x559dedd858e0 msgr2=0x559dedd8fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.338+0000 7fe3a987f740 1 -- 172.21.15.33:0/1735786497 shutdown_connections 2024-09-11T00:08:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.339+0000 7fe3a987f740 1 -- 172.21.15.33:0/1735786497 wait complete. 2024-09-11T00:08:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.339+0000 7fe3a987f740 1 -- start start 2024-09-11T00:08:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 Processor -- start 2024-09-11T00:08:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 0x559deddac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8fb00 0x559deddaa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a79b0 con 0x559dedd8fb00 2024-09-11T00:08:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a8df0 con 0x559dedd8d0c0 2024-09-11T00:08:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01a8050 con 0x559dedd8a790 2024-09-11T00:08:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.340+0000 7fe3a987f740 10 client.0 _ll_register_callbacks cb 0x7fe390005750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42238/0 (socket says 172.21.15.33:42238) 2024-09-11T00:08:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 -- 172.21.15.33:0/612666857 learned_addr learned my addr 172.21.15.33:0/612666857 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39ea00640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 0x559deddac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39fe00640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8fb00 0x559deddaa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 -- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 msgr2=0x559deddac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 0x559deddac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 -- 172.21.15.33:0/612666857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8fb00 msgr2=0x559deddaa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.341+0000 7fe39f400640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8fb00 0x559deddaa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.342+0000 7fe39f400640 1 -- 172.21.15.33:0/612666857 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dedda3bd0 con 0x559dedd8a790 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.342+0000 7fe39ea00640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 0x559deddac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.342+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe388031b90 con 0x559dedd8a790 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.342+0000 7fe39f400640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe388005940 tx=0x7fe38802ab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5e29c73899984e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.342+0000 7fe38d600640 10 client.26422 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.343+0000 7fe38d600640 1 -- 172.21.15.33:0/612666857 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38805f050 con 0x559dedd8a790 2024-09-11T00:08:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.343+0000 7fe38d600640 1 -- 172.21.15.33:0/612666857 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe388003ef0 con 0x559dedd8a790 2024-09-11T00:08:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.343+0000 7fe38d600640 1 -- 172.21.15.33:0/612666857 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe388055070 con 0x559dedd8a790 2024-09-11T00:08:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.344+0000 7fe3a987f740 10 client.26422 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.344+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559dede1db40 con 0x559dedd8a790 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.344+0000 7fe38d600640 1 -- 172.21.15.33:0/612666857 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe388062020 con 0x559dedd8a790 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 10 client.26422 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 10 client.26422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 20 client.26422 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dede1e3f0 0x559dede20810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 4 client.26422 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:08:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.345+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559dedcfb0b0 con 0x559dede1e3f0 2024-09-11T00:08:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.346+0000 7fe39ea00640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dede1e3f0 0x559dede20810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.347+0000 7fe39ea00640 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dede1e3f0 0x559dede20810 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18079721d4887021 server_cookie=20e439a9cb7b0c88 in_seq=0 out_seq=0 2024-09-11T00:08:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:00.347+0000 7fe38d600640 10 client.26422 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:00.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:00 smithi052 ceph-mon[33526]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.6 MiB/s wr, 710 op/s 2024-09-11T00:08:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:00 smithi033 ceph-mon[30593]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.6 MiB/s wr, 710 op/s 2024-09-11T00:08:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:00 smithi189 ceph-mon[34000]: pgmap v773: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.6 MiB/s wr, 710 op/s 2024-09-11T00:08:02.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:02 smithi052 ceph-mon[33526]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-09-11T00:08:03.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:02 smithi033 ceph-mon[30593]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-09-11T00:08:03.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:02 smithi189 ceph-mon[34000]: pgmap v774: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 721 op/s 2024-09-11T00:08:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 495.0 s, 722.2 tps, lat 138.464 ms stddev 38.574 2024-09-11T00:08:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.716+0000 7fe38d600640 1 -- 172.21.15.33:0/612666857 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559dedcfb0b0 con 0x559dede1e3f0 2024-09-11T00:08:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.716+0000 7fe38d600640 10 client.26422 handle_command_reply: tid=0 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.716+0000 7fe3a987f740 1 client.26422 shutdown 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.716+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 msgr2=0x559deddabcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.716+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe388005940 tx=0x7fe38802ab70 comp rx=0 tx=0).stop 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 shutdown_connections 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559dedd8fb00 0x559deddaa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559dedd8d0c0 0x559deddac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x559dede1e3f0 0x559dede20810 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 --2- 172.21.15.33:0/612666857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559dedd8a790 0x559deddabcc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 >> 172.21.15.33:0/612666857 conn(0x559dedd858e0 msgr2=0x559dedd86140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.717+0000 7fe38d600640 0 client.26422 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.718+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 shutdown_connections 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.718+0000 7fe3a987f740 1 -- 172.21.15.33:0/612666857 wait complete. 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.718+0000 7fe3a987f740 20 client.26422 trim_cache size 0 max 16384 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:08:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 msgr2=0x7fe3840b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 0x7fe3840b7970 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe398009fd0 tx=0x7fe398014c90 comp rx=0 tx=0).stop 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 msgr2=0x7fe3a019f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d950 tx=0x7fe39000de10 comp rx=0 tx=0).stop 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 shutdown_connections 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3840b54b0 0x7fe3840b7970 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0102260 0x7fe3a01a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3a01018a0 0x7fe3a019f8d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 --2- 172.21.15.33:0/3819696875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a0100860 0x7fe3a019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.719+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 >> 172.21.15.33:0/3819696875 conn(0x7fe3a00fc440 msgr2=0x7fe3a00fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.720+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 shutdown_connections 2024-09-11T00:08:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:03.720+0000 7fe3a6800640 1 -- 172.21.15.33:0/3819696875 wait complete. 2024-09-11T00:08:04.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:04 smithi052 ceph-mon[33526]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-09-11T00:08:05.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:04 smithi033 ceph-mon[30593]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-09-11T00:08:05.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:04 smithi189 ceph-mon[34000]: pgmap v775: 129 pgs: 129 active+clean; 1.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-09-11T00:08:06.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:06 smithi052 ceph-mon[33526]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-09-11T00:08:07.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:06 smithi033 ceph-mon[30593]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-09-11T00:08:07.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:06 smithi189 ceph-mon[34000]: pgmap v776: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 9.5 MiB/s wr, 687 op/s 2024-09-11T00:08:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 500.0 s, 675.8 tps, lat 142.981 ms stddev 40.743 2024-09-11T00:08:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:08 smithi052 ceph-mon[33526]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T00:08:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:08 smithi033 ceph-mon[30593]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T00:08:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:08 smithi189 ceph-mon[34000]: pgmap v777: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 781 op/s 2024-09-11T00:08:10.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:10.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99006]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99009]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:10.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:08:09 smithi033 sudo[99009]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.205 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:09 smithi052 sudo[68720]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:09 smithi052 sudo[68720]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:09 smithi052 sudo[68720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:09 smithi052 sudo[68720]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68723]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68723]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68723]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.582 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68161]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68164]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68164]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68164]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:10 smithi033 ceph-mon[30593]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.8 MiB/s wr, 713 op/s 2024-09-11T00:08:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:10 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99012]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99012]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99012]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99015]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:10.777 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.778 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.778 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:08:10 smithi033 sudo[99015]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:10 smithi189 ceph-mon[34000]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.8 MiB/s wr, 713 op/s 2024-09-11T00:08:10.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:10 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:10 smithi052 ceph-mon[33526]: pgmap v778: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.8 MiB/s wr, 713 op/s 2024-09-11T00:08:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:10 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:10.956 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68727]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68727]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68727]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68730]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68730]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:10.957 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:10.958 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:08:10 smithi052 sudo[68730]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68167]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68167]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:10 smithi189 sudo[68167]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68170]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.527 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99018]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:11.527 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99018]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.527 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.528 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99018]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.528 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99021]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:11.528 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99021]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.528 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.528 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:08:11 smithi033 sudo[99021]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68733]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68736]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68736]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:11.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:08:11 smithi052 sudo[68736]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68173]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:08:11 smithi189 sudo[68176]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.528 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99024]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:12.528 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99024]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.528 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.529 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99024]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.529 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99027]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:12.529 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.529 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.529 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99027]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:12 smithi052 ceph-mon[33526]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 733 op/s 2024-09-11T00:08:12.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68739]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:12.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68739]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68739]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68742]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68742]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:08:12 smithi052 sudo[68742]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 ceph-mon[34000]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 733 op/s 2024-09-11T00:08:12.893 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68179]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:12.893 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68179]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68179]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:12.894 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68182]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 ceph-mon[30593]: pgmap v779: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 733 op/s 2024-09-11T00:08:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99031]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99031]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99031]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99034]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99034]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:12 smithi033 sudo[99034]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 505.0 s, 600.8 tps, lat 172.394 ms stddev 103.743 2024-09-11T00:08:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.332 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68185]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:13.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:12 smithi189 sudo[68188]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68745]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68745]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68745]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68748]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68748]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:08:13.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 sudo[68748]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:08:13.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:13.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:13.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:13.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:13.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:13 smithi052 ceph-mon[33526]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:13 smithi033 ceph-mon[30593]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:08:14.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:08:14.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:13 smithi189 ceph-mon[34000]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:08:14.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:14 smithi052 ceph-mon[33526]: pgmap v780: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-11T00:08:15.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:14 smithi033 ceph-mon[30593]: pgmap v780: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-11T00:08:15.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:14 smithi189 ceph-mon[34000]: pgmap v780: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 788 op/s 2024-09-11T00:08:15.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:15 smithi052 ceph-mon[33526]: pgmap v781: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 641 op/s 2024-09-11T00:08:16.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:15 smithi033 ceph-mon[30593]: pgmap v781: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 641 op/s 2024-09-11T00:08:16.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:15 smithi189 ceph-mon[34000]: pgmap v781: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.3 MiB/s wr, 641 op/s 2024-09-11T00:08:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.013+0000 7f4439400640 1 -- 172.21.15.33:0/1204436915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434105cf0 msgr2=0x7f4434106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.013+0000 7f4439400640 1 --2- 172.21.15.33:0/1204436915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434105cf0 0x7f4434106170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4420009930 tx=0x7f442002a480 comp rx=0 tx=0).stop 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.014+0000 7f4439400640 1 -- 172.21.15.33:0/1204436915 shutdown_connections 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.014+0000 7f4439400640 1 --2- 172.21.15.33:0/1204436915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 0x7f443410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.014+0000 7f4439400640 1 --2- 172.21.15.33:0/1204436915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434105cf0 0x7f4434106170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.014+0000 7f4439400640 1 --2- 172.21.15.33:0/1204436915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434104ba0 0x7f4434104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.014+0000 7f4439400640 1 -- 172.21.15.33:0/1204436915 >> 172.21.15.33:0/1204436915 conn(0x7f4434100440 msgr2=0x7f4434102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.015+0000 7f4439400640 1 -- 172.21.15.33:0/1204436915 shutdown_connections 2024-09-11T00:08:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.015+0000 7f4439400640 1 -- 172.21.15.33:0/1204436915 wait complete. 2024-09-11T00:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.016+0000 7f4439400640 1 Processor -- start 2024-09-11T00:08:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.016+0000 7f4439400640 1 -- start start 2024-09-11T00:08:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434105cf0 0x7f443419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 0x7f443419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4434110830 con 0x7f44341066b0 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44341106b0 con 0x7f4434105cf0 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4439400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44341109b0 con 0x7f4434104ba0 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4432800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4432800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53154/0 (socket says 172.21.15.33:53154) 2024-09-11T00:08:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.017+0000 7f4432800640 1 -- 172.21.15.33:0/2248158848 learned_addr learned my addr 172.21.15.33:0/2248158848 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4431e00640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434105cf0 0x7f443419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4433200640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 0x7f443419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4432800640 1 -- 172.21.15.33:0/2248158848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434105cf0 msgr2=0x7f443419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4432800640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434105cf0 0x7f443419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4432800640 1 -- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 msgr2=0x7f443419c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4432800640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 0x7f443419c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.018+0000 7f4432800640 1 -- 172.21.15.33:0/2248158848 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443419cbe0 con 0x7f4434104ba0 2024-09-11T00:08:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.019+0000 7f4432800640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f442400b450 tx=0x7f442400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.020+0000 7f442b400640 1 -- 172.21.15.33:0/2248158848 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424015020 con 0x7f4434104ba0 2024-09-11T00:08:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.020+0000 7f442b400640 1 -- 172.21.15.33:0/2248158848 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4424011d20 con 0x7f4434104ba0 2024-09-11T00:08:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.020+0000 7f442b400640 1 -- 172.21.15.33:0/2248158848 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424010e30 con 0x7f4434104ba0 2024-09-11T00:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.021+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443419ced0 con 0x7f4434104ba0 2024-09-11T00:08:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.021+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44340777f0 con 0x7f4434104ba0 2024-09-11T00:08:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.027+0000 7f442b400640 1 -- 172.21.15.33:0/2248158848 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4424011890 con 0x7f4434104ba0 2024-09-11T00:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.030+0000 7f443c276740 1 Processor -- start 2024-09-11T00:08:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.030+0000 7f443c276740 1 -- start start 2024-09-11T00:08:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.031+0000 7f443c276740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.032+0000 7f442b400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 0x7f44180b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.032+0000 7f442b400640 1 -- 172.21.15.33:0/2248158848 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f44240e5d00 con 0x7f4434104ba0 2024-09-11T00:08:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.032+0000 7f4433200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f4433200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53170/0 (socket says 172.21.15.33:53170) 2024-09-11T00:08:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f4433200640 1 -- 172.21.15.33:0/99087754 learned_addr learned my addr 172.21.15.33:0/99087754 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ed026b0 con 0x55ec1ed920c0 2024-09-11T00:08:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ecf1ae0 con 0x55ec1ed94b00 2024-09-11T00:08:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.033+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ecf58f0 con 0x55ec1ed8f790 2024-09-11T00:08:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.034+0000 7f4433200640 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.034+0000 7f4432800640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 0x7f44180b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.035+0000 7f4433200640 1 -- 172.21.15.33:0/99087754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 msgr2=0x55ec1ed96fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.035+0000 7f4433200640 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed96fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.035+0000 7f4433200640 1 -- 172.21.15.33:0/99087754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 msgr2=0x55ec1ed944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.035+0000 7f4433200640 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.035+0000 7f4433200640 1 -- 172.21.15.33:0/99087754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec1ecbe780 con 0x55ec1ed8f790 2024-09-11T00:08:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.036+0000 7f4433200640 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f442c00c890 tx=0x7f442c009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a0b22ea7a30bca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.036+0000 7f441f400640 1 -- 172.21.15.33:0/99087754 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c007a10 con 0x55ec1ed8f790 2024-09-11T00:08:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.037+0000 7f441f400640 1 -- 172.21.15.33:0/99087754 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c010070 con 0x55ec1ed8f790 2024-09-11T00:08:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.037+0000 7f441f400640 1 -- 172.21.15.33:0/99087754 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c01bcc0 con 0x55ec1ed8f790 2024-09-11T00:08:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.038+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 msgr2=0x55ec1ed91b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.038+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f442c00c890 tx=0x7f442c009980 comp rx=0 tx=0).stop 2024-09-11T00:08:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.038+0000 7f4432800640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 0x7f44180b7860 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f44240a8690 tx=0x7f4424004700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.039+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 shutdown_connections 2024-09-11T00:08:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.039+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed96fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.040+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.041+0000 7f443c276740 1 --2- 172.21.15.33:0/99087754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed91b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.041+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 >> 172.21.15.33:0/99087754 conn(0x55ec1ed8a8e0 msgr2=0x55ec1ed8b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.041+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 shutdown_connections 2024-09-11T00:08:17.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.042+0000 7f443c276740 1 -- 172.21.15.33:0/99087754 wait complete. 2024-09-11T00:08:17.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.043+0000 7f443c276740 1 -- start start 2024-09-11T00:08:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.043+0000 7f443c276740 1 Processor -- start 2024-09-11T00:08:17.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.046+0000 7f443c276740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f443c276740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed99620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f4433200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f4433200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53176/0 (socket says 172.21.15.33:53176) 2024-09-11T00:08:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f4433200640 1 -- 172.21.15.33:0/1521014741 learned_addr learned my addr 172.21.15.33:0/1521014741 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ec29ab0 con 0x55ec1ed920c0 2024-09-11T00:08:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ec98570 con 0x55ec1ed94b00 2024-09-11T00:08:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.047+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec1ed97ae0 con 0x55ec1ed8f790 2024-09-11T00:08:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.048+0000 7f443c276740 10 client.0 _ll_register_callbacks cb 0x55ec1eca7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 -- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 msgr2=0x55ec1ed9a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.054 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 -- 172.21.15.33:0/1521014741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 msgr2=0x55ec1ed99620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed99620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.049+0000 7f4433200640 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec1ea53790 con 0x55ec1ed8f790 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.050+0000 7f4433200640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f442c01b7a0 tx=0x7f442c00e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0863dab186ff32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.050+0000 7f4413e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.053+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c023040 con 0x55ec1ed8f790 2024-09-11T00:08:17.055 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.053+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f442c00c240 con 0x55ec1ed8f790 2024-09-11T00:08:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.053+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f442c010070 con 0x55ec1ed8f790 2024-09-11T00:08:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.054+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f442c033050 con 0x55ec1ed8f790 2024-09-11T00:08:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.054+0000 7f443c276740 10 client.26437 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:17.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.054+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ec1eacc620 con 0x55ec1ed8f790 2024-09-11T00:08:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.055+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c010070 con 0x55ec1ed8f790 2024-09-11T00:08:17.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.055+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f442c019020 con 0x55ec1ed8f790 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.055+0000 7f443c276740 10 client.26437 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.055+0000 7f443c276740 10 client.26437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.056+0000 7f443c276740 20 client.26437 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.056+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1eda44c0 0x55ec1eda68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.056+0000 7f443c276740 4 client.26437 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:17.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.056+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec1ed04600 con 0x55ec1eda44c0 2024-09-11T00:08:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.056+0000 7f4431e00640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1eda44c0 0x55ec1eda68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.057+0000 7f4431e00640 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1eda44c0 0x55ec1eda68b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=167b17ce7cc3e5e7 server_cookie=39ef4d79b3d291fe in_seq=0 out_seq=0 2024-09-11T00:08:17.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.057+0000 7f4413e00640 10 client.26437 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.058+0000 7f4413e00640 1 -- 172.21.15.33:0/1521014741 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec1ed04600 con 0x55ec1eda44c0 2024-09-11T00:08:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.059+0000 7f4413e00640 10 client.26437 handle_command_reply: tid=0 2024-09-11T00:08:17.061 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.059+0000 7f443c276740 1 client.26437 shutdown 2024-09-11T00:08:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 msgr2=0x55ec1ed98f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.062 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f442c01b7a0 tx=0x7f442c00e040 comp rx=0 tx=0).stop 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 shutdown_connections 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed99620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1eda44c0 0x55ec1eda68b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 --2- 172.21.15.33:0/1521014741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed8f790 0x55ec1ed98f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 >> 172.21.15.33:0/1521014741 conn(0x55ec1ed8a8e0 msgr2=0x55ec1ed89a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f4413e00640 0 client.26437 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.060+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 shutdown_connections 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.061+0000 7f443c276740 1 -- 172.21.15.33:0/1521014741 wait complete. 2024-09-11T00:08:17.063 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.061+0000 7f443c276740 20 client.26437 trim_cache size 0 max 16384 2024-09-11T00:08:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.091+0000 7f443c276740 1 Processor -- start 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.091+0000 7f443c276740 1 -- start start 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed8b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed94b00 0x55ec1ed97e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44341b4640 con 0x55ec1ed920c0 2024-09-11T00:08:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44341b1f10 con 0x55ec1ed8f790 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f443c276740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44341afd80 con 0x55ec1ed94b00 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f4433200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38386/0 (socket says 172.21.15.33:38386) 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 -- 172.21.15.33:0/1987473296 learned_addr learned my addr 172.21.15.33:0/1987473296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed94b00 0x55ec1ed97e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.092+0000 7f4431e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed8b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 -- 172.21.15.33:0/1987473296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed94b00 msgr2=0x55ec1ed97e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed94b00 0x55ec1ed97e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 -- 172.21.15.33:0/1987473296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 msgr2=0x55ec1ed8b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed8b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.093+0000 7f4433200640 1 -- 172.21.15.33:0/1987473296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec1ed98a80 con 0x55ec1ed8f790 2024-09-11T00:08:17.096 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.094+0000 7f4433200640 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f442c00ba30 tx=0x7f442c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1f688ddf96a88f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.094+0000 7f441ea00640 1 -- 172.21.15.33:0/1987473296 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c009990 con 0x55ec1ed8f790 2024-09-11T00:08:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.094+0000 7f441ea00640 1 -- 172.21.15.33:0/1987473296 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c010070 con 0x55ec1ed8f790 2024-09-11T00:08:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.094+0000 7f441ea00640 1 -- 172.21.15.33:0/1987473296 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c007a90 con 0x55ec1ed8f790 2024-09-11T00:08:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 -- 172.21.15.33:0/1987473296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 msgr2=0x55ec1ed8b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f442c00ba30 tx=0x7f442c00c820 comp rx=0 tx=0).stop 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 -- 172.21.15.33:0/1987473296 shutdown_connections 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed94b00 0x55ec1ed97e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed920c0 0x55ec1ed8b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 --2- 172.21.15.33:0/1987473296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed8f790 0x55ec1ed8b300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.095+0000 7f443c276740 1 -- 172.21.15.33:0/1987473296 >> 172.21.15.33:0/1987473296 conn(0x55ec1ed8a8e0 msgr2=0x55ec1ed8ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.096+0000 7f443c276740 1 -- 172.21.15.33:0/1987473296 shutdown_connections 2024-09-11T00:08:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.096+0000 7f443c276740 1 -- 172.21.15.33:0/1987473296 wait complete. 2024-09-11T00:08:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.096+0000 7f443c276740 1 -- start start 2024-09-11T00:08:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 Processor -- start 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed8f790 0x55ec1ed9de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44341b03d0 con 0x55ec1ed8f790 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44341b1840 con 0x55ec1ed94b00 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44341b0aa0 con 0x55ec1ed920c0 2024-09-11T00:08:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.097+0000 7f443c276740 10 client.0 _ll_register_callbacks cb 0x7f442c00c770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4431e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4433200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4433200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38400/0 (socket says 172.21.15.33:38400) 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4433200640 1 -- 172.21.15.33:0/1383994620 learned_addr learned my addr 172.21.15.33:0/1383994620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4431e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53200/0 (socket says 172.21.15.33:53200) 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.098+0000 7f4433200640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed8f790 0x55ec1ed9de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4431e00640 1 -- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 msgr2=0x55ec1ed9f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4431e00640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4431e00640 1 -- 172.21.15.33:0/1383994620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed8f790 msgr2=0x55ec1ed9de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4431e00640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed8f790 0x55ec1ed9de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4431e00640 1 -- 172.21.15.33:0/1383994620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec1ed8bfc0 con 0x55ec1ed920c0 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.099+0000 7f4433200640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.101+0000 7f4431e00640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4420009850 tx=0x7f44200043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21dedb9bd4ccb37d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.101+0000 7f4413e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.101+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420035050 con 0x55ec1ed920c0 2024-09-11T00:08:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.101+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4420003a00 con 0x55ec1ed920c0 2024-09-11T00:08:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.102+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f442c010070 con 0x55ec1ed920c0 2024-09-11T00:08:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f44200044e0 con 0x55ec1ed920c0 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f443c276740 10 client.26443 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ec1eda0b80 con 0x55ec1ed920c0 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f442c010070 con 0x55ec1ed920c0 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4420031c50 con 0x55ec1ed920c0 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.103+0000 7f443c276740 10 client.26443 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.104+0000 7f443c276740 10 client.26443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.104+0000 7f443c276740 20 client.26443 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.104+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1ee226c0 0x55ec1ee24ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.104+0000 7f443c276740 4 client.26443 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:08:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.104+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec1ed000b0 con 0x55ec1ee226c0 2024-09-11T00:08:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.105+0000 7f4433200640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1ee226c0 0x55ec1ee24ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.106+0000 7f4413e00640 10 client.26443 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.106+0000 7f4433200640 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1ee226c0 0x55ec1ee24ae0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98984444072b8ee server_cookie=87045565bef5f5e0 in_seq=0 out_seq=0 2024-09-11T00:08:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.144+0000 7f4413e00640 1 -- 172.21.15.33:0/1383994620 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec1ed000b0 con 0x55ec1ee226c0 2024-09-11T00:08:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.144+0000 7f4413e00640 10 client.26443 handle_command_reply: tid=0 2024-09-11T00:08:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.144+0000 7f443c276740 1 client.26443 shutdown 2024-09-11T00:08:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 msgr2=0x55ec1ed9e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4420009850 tx=0x7f44200043b0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 shutdown_connections 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec1ed94b00 0x55ec1ed9f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ec1ee226c0 0x55ec1ee24ae0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec1ed920c0 0x55ec1ed9e510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 --2- 172.21.15.33:0/1383994620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1ed8f790 0x55ec1ed9de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.145+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 >> 172.21.15.33:0/1383994620 conn(0x55ec1ed8a8e0 msgr2=0x55ec1ed8b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.146+0000 7f4413e00640 0 client.26443 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.146+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 shutdown_connections 2024-09-11T00:08:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.146+0000 7f443c276740 1 -- 172.21.15.33:0/1383994620 wait complete. 2024-09-11T00:08:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.146+0000 7f443c276740 20 client.26443 trim_cache size 0 max 16384 2024-09-11T00:08:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:08:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:08:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:08:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:08:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 msgr2=0x7f44180b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 0x7f44180b7860 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f44240a8690 tx=0x7f4424004700 comp rx=0 tx=0).stop 2024-09-11T00:08:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 msgr2=0x7f443419b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f442400b450 tx=0x7f442400b910 comp rx=0 tx=0).stop 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 shutdown_connections 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44180b53a0 0x7f44180b7860 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44341066b0 0x7f443419c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434105cf0 0x7f443419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 --2- 172.21.15.33:0/2248158848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4434104ba0 0x7f443419b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 >> 172.21.15.33:0/2248158848 conn(0x7f4434100440 msgr2=0x7f4434109160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 shutdown_connections 2024-09-11T00:08:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:17.148+0000 7f4439400640 1 -- 172.21.15.33:0/2248158848 wait complete. 2024-09-11T00:08:17.703 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:08:17.703 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.4 2024-09-11T00:08:17.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:08:18.262 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:18 smithi033 ceph-mon[30593]: pgmap v782: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.4 MiB/s wr, 722 op/s 2024-09-11T00:08:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 510.0 s, 689.7 tps, lat 143.792 ms stddev 44.108 2024-09-11T00:08:18.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:18 smithi052 ceph-mon[33526]: pgmap v782: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.4 MiB/s wr, 722 op/s 2024-09-11T00:08:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:18 smithi189 ceph-mon[34000]: pgmap v782: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.4 MiB/s wr, 722 op/s 2024-09-11T00:08:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:20 smithi052 ceph-mon[33526]: pgmap v783: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.3 MiB/s wr, 646 op/s 2024-09-11T00:08:20.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:20 smithi033 ceph-mon[30593]: pgmap v783: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.3 MiB/s wr, 646 op/s 2024-09-11T00:08:20.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:20 smithi189 ceph-mon[34000]: pgmap v783: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.3 MiB/s wr, 646 op/s 2024-09-11T00:08:22.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.008+0000 7f0006200640 1 -- 172.21.15.33:0/1961215301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010aa70 msgr2=0x7f00001154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.008+0000 7f0006200640 1 --2- 172.21.15.33:0/1961215301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010aa70 0x7f00001154d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7effec009900 tx=0x7effec02a4a0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.009+0000 7f0006200640 1 -- 172.21.15.33:0/1961215301 shutdown_connections 2024-09-11T00:08:22.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.009+0000 7f0006200640 1 --2- 172.21.15.33:0/1961215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000115a10 0x7f0000117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.009+0000 7f0006200640 1 --2- 172.21.15.33:0/1961215301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010aa70 0x7f00001154d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.009+0000 7f0006200640 1 --2- 172.21.15.33:0/1961215301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f000010a150 0x7f000010a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.009+0000 7f0006200640 1 -- 172.21.15.33:0/1961215301 >> 172.21.15.33:0/1961215301 conn(0x7f000006dfc0 msgr2=0x7f000006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.012+0000 7f0006200640 1 -- 172.21.15.33:0/1961215301 shutdown_connections 2024-09-11T00:08:22.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.012+0000 7f0006200640 1 -- 172.21.15.33:0/1961215301 wait complete. 2024-09-11T00:08:22.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.013+0000 7f0006200640 1 Processor -- start 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.014+0000 7f0006200640 1 -- start start 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.014+0000 7f0006200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.014+0000 7f0006200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000010aa70 0x7f00001126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.014+0000 7effff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7effff400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35048/0 (socket says 172.21.15.33:35048) 2024-09-11T00:08:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7f0006200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0000115a10 0x7f0000112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7effff400640 1 -- 172.21.15.33:0/250604514 learned_addr learned my addr 172.21.15.33:0/250604514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f000010ceb0 con 0x7f0000115a10 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f000010cd30 con 0x7f000010aa70 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.015+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f000010d030 con 0x7f000010a150 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effffe00640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0000115a10 0x7f0000112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effff400640 1 -- 172.21.15.33:0/250604514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000010aa70 msgr2=0x7f00001126a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effff400640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000010aa70 0x7f00001126a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effff400640 1 -- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0000115a10 msgr2=0x7f0000112e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effff400640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0000115a10 0x7f0000112e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.016+0000 7effff400640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00001b4170 con 0x7f000010a150 2024-09-11T00:08:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.017+0000 7effff400640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efff000d980 tx=0x7efff000de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.017+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0017030 con 0x7f000010a150 2024-09-11T00:08:22.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.019+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00001b4460 con 0x7f000010a150 2024-09-11T00:08:22.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.019+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001b49a0 con 0x7f000010a150 2024-09-11T00:08:22.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.019+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efff0004020 con 0x7f000010a150 2024-09-11T00:08:22.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.019+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0005540 con 0x7f000010a150 2024-09-11T00:08:22.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.021+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe00052c0 con 0x7f000010a150 2024-09-11T00:08:22.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.027+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efff0009a30 con 0x7f000010a150 2024-09-11T00:08:22.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.029+0000 7efff7e00640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 0x7effe40b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.029+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efff00e5e80 con 0x7f000010a150 2024-09-11T00:08:22.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.031+0000 7efffea00640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 0x7effe40b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.031+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efff00aca40 con 0x7f000010a150 2024-09-11T00:08:22.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.035+0000 7efffea00640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 0x7effe40b7970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7effec005ec0 tx=0x7effec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:22 smithi033 ceph-mon[30593]: pgmap v784: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 639 op/s 2024-09-11T00:08:22.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:22 smithi052 ceph-mon[33526]: pgmap v784: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 639 op/s 2024-09-11T00:08:22.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.501+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe00055b0 con 0x7f000010a150 2024-09-11T00:08:22.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.502+0000 7efff7e00640 1 -- 172.21.15.33:0/250604514 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7efff00ac340 con 0x7f000010a150 2024-09-11T00:08:22.505 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:08:22.505 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:08:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:08:22.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.506+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 msgr2=0x7effe40b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.506+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 0x7effe40b7970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7effec005ec0 tx=0x7effec005fd0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.506+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 msgr2=0x7f0000115450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.506+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efff000d980 tx=0x7efff000de40 comp rx=0 tx=0).stop 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 shutdown_connections 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7effe40b54b0 0x7effe40b7970 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0000115a10 0x7f0000112e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000010aa70 0x7f00001126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 --2- 172.21.15.33:0/250604514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f000010a150 0x7f0000115450 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.507+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 >> 172.21.15.33:0/250604514 conn(0x7f000006dfc0 msgr2=0x7f00000716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.508+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 shutdown_connections 2024-09-11T00:08:22.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:22.508+0000 7f0006200640 1 -- 172.21.15.33:0/250604514 wait complete. 2024-09-11T00:08:22.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:22 smithi189 ceph-mon[34000]: pgmap v784: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 639 op/s 2024-09-11T00:08:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 515.0 s, 639.5 tps, lat 156.751 ms stddev 51.220 2024-09-11T00:08:23.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:23 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/250604514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:23.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:23 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/250604514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:23.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:23 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/250604514' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:24.161 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0' 2024-09-11T00:08:24.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0 2024-09-11T00:08:24.355 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:24 smithi033 ceph-mon[30593]: pgmap v785: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.9 MiB/s wr, 709 op/s 2024-09-11T00:08:24.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:24 smithi052 ceph-mon[33526]: pgmap v785: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.9 MiB/s wr, 709 op/s 2024-09-11T00:08:24.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:24 smithi189 ceph-mon[34000]: pgmap v785: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.9 MiB/s wr, 709 op/s 2024-09-11T00:08:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:25.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:25 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:25.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:25 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:25.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:25 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:26.534 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:26 smithi033 ceph-mon[30593]: pgmap v786: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.1 MiB/s wr, 628 op/s 2024-09-11T00:08:26.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:26 smithi189 ceph-mon[34000]: pgmap v786: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.1 MiB/s wr, 628 op/s 2024-09-11T00:08:26.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:26 smithi052 ceph-mon[33526]: pgmap v786: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.1 MiB/s wr, 628 op/s 2024-09-11T00:08:26.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 -- 172.21.15.33:0/1017962071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10a820 msgr2=0x7fe7cc10ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:26.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 --2- 172.21.15.33:0/1017962071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10a820 0x7fe7cc10ac60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009860 tx=0x7fe7b802a340 comp rx=0 tx=0).stop 2024-09-11T00:08:26.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 -- 172.21.15.33:0/1017962071 shutdown_connections 2024-09-11T00:08:26.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 --2- 172.21.15.33:0/1017962071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc10b1a0 0x7fe7cc1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 --2- 172.21.15.33:0/1017962071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10a820 0x7fe7cc10ac60 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009860 tx=0x7fe7b802a340 comp rx=0 tx=0).stop 2024-09-11T00:08:26.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 --2- 172.21.15.33:0/1017962071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7cc104e10 0x7fe7cc1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.881+0000 7fe7d1200640 1 -- 172.21.15.33:0/1017962071 >> 172.21.15.33:0/1017962071 conn(0x7fe7cc100840 msgr2=0x7fe7cc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:26.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.883+0000 7fe7d1200640 1 -- 172.21.15.33:0/1017962071 shutdown_connections 2024-09-11T00:08:26.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.883+0000 7fe7d1200640 1 -- 172.21.15.33:0/1017962071 wait complete. 2024-09-11T00:08:26.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.884+0000 7fe7d1200640 1 Processor -- start 2024-09-11T00:08:26.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.885+0000 7fe7d1200640 1 -- start start 2024-09-11T00:08:26.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.885+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.885+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10b1a0 0x7fe7cc10eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7d1200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7cc10f260 0x7fe7cc1a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7d1200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc114ca0 con 0x7fe7cc10f260 2024-09-11T00:08:26.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7d1200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc114b20 con 0x7fe7cc10b1a0 2024-09-11T00:08:26.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7d1200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7cc114e20 con 0x7fe7cc104e10 2024-09-11T00:08:26.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7cb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7cb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35058/0 (socket says 172.21.15.33:35058) 2024-09-11T00:08:26.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7cb400640 1 -- 172.21.15.33:0/2853189179 learned_addr learned my addr 172.21.15.33:0/2853189179 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:26.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.886+0000 7fe7caa00640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10b1a0 0x7fe7cc10eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 -- 172.21.15.33:0/2853189179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10b1a0 msgr2=0x7fe7cc10eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:26.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10b1a0 0x7fe7cc10eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 -- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7cc10f260 msgr2=0x7fe7cc1a1180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:08:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7cc10f260 0x7fe7cc1a1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 -- 172.21.15.33:0/2853189179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7cc1a16c0 con 0x7fe7cc104e10 2024-09-11T00:08:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7cb400640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00d950 tx=0x7fe7bc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7c3e00640 1 -- 172.21.15.33:0/2853189179 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc017030 con 0x7fe7cc104e10 2024-09-11T00:08:26.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.887+0000 7fe7c3e00640 1 -- 172.21.15.33:0/2853189179 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7bc004020 con 0x7fe7cc104e10 2024-09-11T00:08:26.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.888+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7cc1a19b0 con 0x7fe7cc104e10 2024-09-11T00:08:26.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.888+0000 7fe7c3e00640 1 -- 172.21.15.33:0/2853189179 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc003b60 con 0x7fe7cc104e10 2024-09-11T00:08:26.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.888+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7cc1a1f40 con 0x7fe7cc104e10 2024-09-11T00:08:26.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.893+0000 7fe7d51cf740 1 Processor -- start 2024-09-11T00:08:26.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.893+0000 7fe7c3e00640 1 -- 172.21.15.33:0/2853189179 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe7bc024060 con 0x7fe7cc104e10 2024-09-11T00:08:26.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.894+0000 7fe7d51cf740 1 -- start start 2024-09-11T00:08:26.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.894+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35072/0 (socket says 172.21.15.33:35072) 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61615c10 0x557c61621660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7cbe00640 1 -- 172.21.15.33:0/3860989522 learned_addr learned my addr 172.21.15.33:0/3860989522 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61621ba0 0x557c61623f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557c6158aca0 con 0x557c61621ba0 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557c6157a0d0 con 0x557c61615c10 2024-09-11T00:08:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c6157dee0 con 0x557c616152f0 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.895+0000 7fe7caa00640 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61621ba0 0x557c61623f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 -- 172.21.15.33:0/3860989522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61615c10 msgr2=0x557c61621660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61615c10 0x557c61621660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 -- 172.21.15.33:0/3860989522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61621ba0 msgr2=0x557c61623f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61621ba0 0x557c61623f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 -- 172.21.15.33:0/3860989522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6152c400 con 0x557c616152f0 2024-09-11T00:08:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7c3e00640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 0x7fe7b00b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7c3e00640 1 -- 172.21.15.33:0/2853189179 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe7bc0e5970 con 0x7fe7cc104e10 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.896+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009f80 tx=0x7fe7c400e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3911c5ec976d420 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.897+0000 7fe7c0c00640 1 -- 172.21.15.33:0/3860989522 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4004d20 con 0x557c616152f0 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.897+0000 7fe7c0c00640 1 -- 172.21.15.33:0/3860989522 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4003e00 con 0x557c616152f0 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.897+0000 7fe7c0c00640 1 -- 172.21.15.33:0/3860989522 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400c8a0 con 0x557c616152f0 2024-09-11T00:08:26.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.897+0000 7fe7cb400640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 0x7fe7b00b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 msgr2=0x557c616156d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:26.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009f80 tx=0x7fe7c400e880 comp rx=0 tx=0).stop 2024-09-11T00:08:26.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7cb400640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 0x7fe7b00b7950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0a8fa0 tx=0x7fe7bc0a7bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 shutdown_connections 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61621ba0 0x557c61623f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61615c10 0x557c61621660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/3860989522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c616152f0 0x557c616156d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 >> 172.21.15.33:0/3860989522 conn(0x557c61613120 msgr2=0x557c616142c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 shutdown_connections 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.898+0000 7fe7d51cf740 1 -- 172.21.15.33:0/3860989522 wait complete. 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.899+0000 7fe7d51cf740 1 -- start start 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.899+0000 7fe7d51cf740 1 Processor -- start 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c616213c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557c613db7a0 con 0x557c61615c10 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557c6151fa10 con 0x557c616152f0 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557c61624820 con 0x557c61621ba0 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.900+0000 7fe7d51cf740 10 client.0 _ll_register_callbacks cb 0x557c6152fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7caa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c616213c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7caa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42360/0 (socket says 172.21.15.33:42360) 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7caa00640 1 -- 172.21.15.33:0/1617380444 learned_addr learned my addr 172.21.15.33:0/1617380444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7cbe00640 1 -- 172.21.15.33:0/1617380444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 msgr2=0x557c6161ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.901+0000 7fe7cbe00640 1 -- 172.21.15.33:0/1617380444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 msgr2=0x557c6161e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7cbe00640 1 -- 172.21.15.33:0/1617380444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c612e7b90 con 0x557c616152f0 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7caa00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c616213c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4004740 tx=0x7fe7c40097e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31605e349610ce9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7b5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:08:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c401a030 con 0x557c616152f0 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.902+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe7c400c640 con 0x557c616152f0 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.903+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c4003e00 con 0x557c616152f0 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.903+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe7c400c840 con 0x557c616152f0 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.903+0000 7fe7d51cf740 10 client.36500 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.903+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c61630120 con 0x557c616152f0 2024-09-11T00:08:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.903+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4003e00 con 0x557c616152f0 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe7c400b040 con 0x557c616152f0 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 10 client.36500 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 10 client.36500 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 20 client.36500 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c61631580 0x557c61633970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 4 client.36500 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.904+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6158cbf0 con 0x557c61631580 2024-09-11T00:08:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.905+0000 7fe7caa00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c61631580 0x557c61633970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.906+0000 7fe7caa00640 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c61631580 0x557c61633970 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2893b1c04ea74e6b server_cookie=b022f08fcb35fb7d in_seq=0 out_seq=0 2024-09-11T00:08:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.906+0000 7fe7b5600640 10 client.36500 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7b5600640 1 -- 172.21.15.33:0/1617380444 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c6158cbf0 con 0x557c61631580 2024-09-11T00:08:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7b5600640 10 client.36500 handle_command_reply: tid=0 2024-09-11T00:08:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 client.36500 shutdown 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 msgr2=0x557c616213c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c616213c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4004740 tx=0x7fe7c40097e0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 shutdown_connections 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c61631580 0x557c61633970 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7b5600640 0 client.36500 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/1617380444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c616213c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.907+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 >> 172.21.15.33:0/1617380444 conn(0x557c61613120 msgr2=0x557c61618c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.908+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 shutdown_connections 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.908+0000 7fe7d51cf740 1 -- 172.21.15.33:0/1617380444 wait complete. 2024-09-11T00:08:26.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.908+0000 7fe7d51cf740 20 client.36500 trim_cache size 0 max 16384 2024-09-11T00:08:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 Processor -- start 2024-09-11T00:08:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 -- start start 2024-09-11T00:08:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac012520 con 0x557c61615c10 2024-09-11T00:08:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00fdf0 con 0x557c616152f0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.941+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00dc40 con 0x557c61621ba0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.942+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.942+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40624/0 (socket says 172.21.15.33:40624) 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.942+0000 7fe7cbe00640 1 -- 172.21.15.33:0/850502212 learned_addr learned my addr 172.21.15.33:0/850502212 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.942+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 -- 172.21.15.33:0/850502212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 msgr2=0x557c6161bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 -- 172.21.15.33:0/850502212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 msgr2=0x557c6161ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 -- 172.21.15.33:0/850502212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6160e960 con 0x557c616152f0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.943+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098d0 tx=0x7fe7c40043a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d788f97165edb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.944+0000 7fe7b7e00640 1 -- 172.21.15.33:0/850502212 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c401a040 con 0x557c616152f0 2024-09-11T00:08:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.944+0000 7fe7b7e00640 1 -- 172.21.15.33:0/850502212 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c401b040 con 0x557c616152f0 2024-09-11T00:08:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.944+0000 7fe7b7e00640 1 -- 172.21.15.33:0/850502212 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400e0c0 con 0x557c616152f0 2024-09-11T00:08:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.946+0000 7fe7d51cf740 1 -- 172.21.15.33:0/850502212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 msgr2=0x557c6161e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.946+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098d0 tx=0x7fe7c40043a0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 -- 172.21.15.33:0/850502212 shutdown_connections 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61621ba0 0x557c6161bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c61615c10 0x557c6161ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/850502212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c616152f0 0x557c6161e0a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 -- 172.21.15.33:0/850502212 >> 172.21.15.33:0/850502212 conn(0x557c61613120 msgr2=0x557c61620660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 -- 172.21.15.33:0/850502212 shutdown_connections 2024-09-11T00:08:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.947+0000 7fe7d51cf740 1 -- 172.21.15.33:0/850502212 wait complete. 2024-09-11T00:08:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.948+0000 7fe7d51cf740 1 -- start start 2024-09-11T00:08:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.948+0000 7fe7d51cf740 1 Processor -- start 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c616152f0 0x557c61629b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 0x557c6162a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00e2b0 con 0x557c616152f0 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00f720 con 0x557c61621ba0 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00e980 con 0x557c61615c10 2024-09-11T00:08:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.949+0000 7fe7d51cf740 10 client.0 _ll_register_callbacks cb 0x7fe7c4009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.950+0000 7fe7caa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 0x557c6162a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.950+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.950+0000 7fe7cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40630/0 (socket says 172.21.15.33:40630) 2024-09-11T00:08:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.950+0000 7fe7cbe00640 1 -- 172.21.15.33:0/317444999 learned_addr learned my addr 172.21.15.33:0/317444999 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.950+0000 7fe7caa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 0x557c6162a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:35092/0 (socket says 172.21.15.33:35092) 2024-09-11T00:08:26.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c616152f0 0x557c61629b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 -- 172.21.15.33:0/317444999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 msgr2=0x557c6162a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 0x557c6162a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 -- 172.21.15.33:0/317444999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c616152f0 msgr2=0x557c61629b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:26.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c616152f0 0x557c61629b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.951+0000 7fe7cbe00640 1 -- 172.21.15.33:0/317444999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c61627080 con 0x557c61621ba0 2024-09-11T00:08:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.952+0000 7fe7cbe00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098a0 tx=0x7fe7c403b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f873b8870ba5b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.952+0000 7fe7b5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:08:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.953+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c401a040 con 0x557c61621ba0 2024-09-11T00:08:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.953+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe7c403f070 con 0x557c61621ba0 2024-09-11T00:08:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.953+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c401b040 con 0x557c61621ba0 2024-09-11T00:08:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.954+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe7c4004750 con 0x557c61621ba0 2024-09-11T00:08:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.954+0000 7fe7d51cf740 10 client.36506 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.954+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c6169eb10 con 0x557c61621ba0 2024-09-11T00:08:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c401b040 con 0x557c61621ba0 2024-09-11T00:08:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe7c4044030 con 0x557c61621ba0 2024-09-11T00:08:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 10 client.36506 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 10 client.36506 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 20 client.36506 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c6169f1c0 0x557c616a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 4 client.36506 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}] 2024-09-11T00:08:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.955+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}) -- 0x557c615886a0 con 0x557c6169f1c0 2024-09-11T00:08:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.956+0000 7fe7caa00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c6169f1c0 0x557c616a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.958+0000 7fe7caa00640 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c6169f1c0 0x557c616a15e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703f57d9dc45ae66 server_cookie=c62451ab5c4d7829 in_seq=0 out_seq=0 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:26.958+0000 7fe7b5600640 10 client.36506 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:27.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:27 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:27.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:27 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:27.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:27 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:27.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7b5600640 1 -- 172.21.15.33:0/317444999 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557c615886a0 con 0x557c6169f1c0 2024-09-11T00:08:27.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7b5600640 10 client.36506 handle_command_reply: tid=0 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 client.36506 shutdown 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 msgr2=0x557c61626b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098a0 tx=0x7fe7c403b040 comp rx=0 tx=0).stop 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 shutdown_connections 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557c61621ba0 0x557c61626b10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557c6169f1c0 0x557c616a15e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557c61615c10 0x557c6162a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 --2- 172.21.15.33:0/317444999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557c616152f0 0x557c61629b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 >> 172.21.15.33:0/317444999 conn(0x557c61613120 msgr2=0x557c61611ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.230+0000 7fe7b5600640 0 client.36506 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.231+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 shutdown_connections 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.231+0000 7fe7d51cf740 1 -- 172.21.15.33:0/317444999 wait complete. 2024-09-11T00:08:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.231+0000 7fe7d51cf740 20 client.36506 trim_cache size 0 max 16384 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 34, 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "223ad1ee": { 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 34, 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:08:27.235 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.4, 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:08:27.236 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:27.237 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:08:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 msgr2=0x7fe7b00b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 0x7fe7b00b7950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0a8fa0 tx=0x7fe7bc0a7bd0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 msgr2=0x7fe7cc111920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00d950 tx=0x7fe7bc00de10 comp rx=0 tx=0).stop 2024-09-11T00:08:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 shutdown_connections 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe7b00b5490 0x7fe7b00b7950 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7cc10f260 0x7fe7cc1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7cc10b1a0 0x7fe7cc10eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 --2- 172.21.15.33:0/2853189179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7cc104e10 0x7fe7cc111920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 >> 172.21.15.33:0/2853189179 conn(0x7fe7cc100840 msgr2=0x7fe7cc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 shutdown_connections 2024-09-11T00:08:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:27.232+0000 7fe7d1200640 1 -- 172.21.15.33:0/2853189179 wait complete. 2024-09-11T00:08:27.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:27 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:27.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:27 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:27.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:27 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:27.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:27 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:27.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:27 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:27.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:27 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:08:28.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 520.0 s, 307.7 tps, lat 238.539 ms stddev 389.839 2024-09-11T00:08:28.414 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:28 smithi033 ceph-mon[30593]: pgmap v787: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 724 op/s 2024-09-11T00:08:28.454 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '223ad1ee', quiesce took 10.8 seconds. Will release after: 14.599999999999998 2024-09-11T00:08:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:28 smithi189 ceph-mon[34000]: pgmap v787: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 724 op/s 2024-09-11T00:08:28.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:28 smithi052 ceph-mon[33526]: pgmap v787: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.8 MiB/s wr, 724 op/s 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 -- 172.21.15.33:0/2366949751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 msgr2=0x7f2adc10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 --2- 172.21.15.33:0/2366949751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc10cd80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009ca0 tx=0x7f2ad402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 -- 172.21.15.33:0/2366949751 shutdown_connections 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 --2- 172.21.15.33:0/2366949751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc10cd80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 --2- 172.21.15.33:0/2366949751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc107f00 0x7f2adc10a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 --2- 172.21.15.33:0/2366949751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc06be40 0x7f2adc1079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 -- 172.21.15.33:0/2366949751 >> 172.21.15.33:0/2366949751 conn(0x7f2adc0fd170 msgr2=0x7f2adc0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 -- 172.21.15.33:0/2366949751 shutdown_connections 2024-09-11T00:08:30.423 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.420+0000 7f2ae4400640 1 -- 172.21.15.33:0/2366949751 wait complete. 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 Processor -- start 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 -- start start 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc107f00 0x7f2adc19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc110730 con 0x7f2adc10a8c0 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1105b0 con 0x7f2adc06be40 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.421+0000 7f2ae4400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1108b0 con 0x7f2adc107f00 2024-09-11T00:08:30.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40652/0 (socket says 172.21.15.33:40652) 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42392/0 (socket says 172.21.15.33:42392) 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 -- 172.21.15.33:0/4202609836 learned_addr learned my addr 172.21.15.33:0/4202609836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc107f00 0x7f2adc19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 -- 172.21.15.33:0/4202609836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc107f00 msgr2=0x7f2adc19b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc107f00 0x7f2adc19b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 -- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 msgr2=0x7f2adc19c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae1a00640 1 -- 172.21.15.33:0/4202609836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc19c990 con 0x7f2adc06be40 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.422+0000 7f2ae2400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000e9f0 tx=0x7f2ad000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ada000640 1 -- 172.21.15.33:0/4202609836 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000cd80 con 0x7f2adc06be40 2024-09-11T00:08:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc19cc80 con 0x7f2adc06be40 2024-09-11T00:08:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ada000640 1 -- 172.21.15.33:0/4202609836 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad00054b0 con 0x7f2adc06be40 2024-09-11T00:08:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ada000640 1 -- 172.21.15.33:0/4202609836 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0010430 con 0x7f2adc06be40 2024-09-11T00:08:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.423+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc1a3350 con 0x7f2adc06be40 2024-09-11T00:08:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.427+0000 7f2ada000640 1 -- 172.21.15.33:0/4202609836 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2ad0005020 con 0x7f2adc06be40 2024-09-11T00:08:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.428+0000 7f2ada000640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 0x7f2ac40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.429+0000 7f2ada000640 1 -- 172.21.15.33:0/4202609836 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f2ad00e6310 con 0x7f2adc06be40 2024-09-11T00:08:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.429+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 0x7f2ac40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.429+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 0x7f2ac40b7820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2adc103580 tx=0x7f2ac8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 Processor -- start 2024-09-11T00:08:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 -- start start 2024-09-11T00:08:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x560087694b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x5600876974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5600876056b0 con 0x560087697b00 2024-09-11T00:08:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600875f4ae0 con 0x560087692790 2024-09-11T00:08:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae744f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5600875f88f0 con 0x5600876950c0 2024-09-11T00:08:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42400/0 (socket says 172.21.15.33:42400) 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.440+0000 7f2ae2400640 1 -- 172.21.15.33:0/3791615163 learned_addr learned my addr 172.21.15.33:0/3791615163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x560087694b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae1000640 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x5600876974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 -- 172.21.15.33:0/3791615163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 msgr2=0x5600876974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x5600876974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 -- 172.21.15.33:0/3791615163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 msgr2=0x560087694b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x560087694b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 -- 172.21.15.33:0/3791615163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600875c1780 con 0x560087697b00 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2ae2400640 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ad402aeb0 tx=0x7f2ad4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1f1db8e33805ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2acea00640 1 -- 172.21.15.33:0/3791615163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4031c80 con 0x560087697b00 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2acea00640 1 -- 172.21.15.33:0/3791615163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad4036030 con 0x560087697b00 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.441+0000 7f2acea00640 1 -- 172.21.15.33:0/3791615163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4004740 con 0x560087697b00 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 -- 172.21.15.33:0/3791615163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 msgr2=0x560087699fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ad402aeb0 tx=0x7f2ad4009a20 comp rx=0 tx=0).stop 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 -- 172.21.15.33:0/3791615163 shutdown_connections 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x560087699fc0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x5600876974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3791615163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x560087694b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 -- 172.21.15.33:0/3791615163 >> 172.21.15.33:0/3791615163 conn(0x56008768d8e0 msgr2=0x56008768e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 -- 172.21.15.33:0/3791615163 shutdown_connections 2024-09-11T00:08:30.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.442+0000 7f2ae744f740 1 -- 172.21.15.33:0/3791615163 wait complete. 2024-09-11T00:08:30.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 -- start start 2024-09-11T00:08:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 Processor -- start 2024-09-11T00:08:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x56008769c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087697b00 0x56008769cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56008752cab0 con 0x560087692790 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56008759b570 con 0x560087697b00 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56008769a900 con 0x5600876950c0 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.443+0000 7f2ae744f740 10 client.0 _ll_register_callbacks cb 0x5600875aa100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42408/0 (socket says 172.21.15.33:42408) 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 -- 172.21.15.33:0/3315947967 learned_addr learned my addr 172.21.15.33:0/3315947967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae2400640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087697b00 0x56008769cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1000640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x56008769c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 -- 172.21.15.33:0/3315947967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 msgr2=0x56008769c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x56008769c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 -- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087697b00 msgr2=0x56008769cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087697b00 0x56008769cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 -- 172.21.15.33:0/3315947967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560087356790 con 0x560087692790 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00a8ca0 tx=0x7f2ad00ac560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdd1dda1c354940 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ac3400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.444+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0093e60 con 0x560087692790 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f2ad00b59e0 con 0x560087692790 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad4036030 con 0x560087692790 2024-09-11T00:08:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ad00d3020 con 0x560087692790 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 10 client.16686 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5600873cf620 con 0x560087692790 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ad4036030 con 0x560087692790 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f2ad00a8020 con 0x560087692790 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 10 client.16686 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 10 client.16686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 20 client.16686 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600876a7600 0x5600876a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 4 client.16686 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.445+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560087607600 con 0x5600876a7600 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.446+0000 7f2ae1000640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600876a7600 0x5600876a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.446+0000 7f2ae1000640 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600876a7600 0x5600876a99f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60218780720955d9 server_cookie=96330eee0b688068 in_seq=0 out_seq=0 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.446+0000 7f2ac3400640 10 client.16686 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.447+0000 7f2ac3400640 1 -- 172.21.15.33:0/3315947967 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560087607600 con 0x5600876a7600 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.447+0000 7f2ac3400640 10 client.16686 handle_command_reply: tid=0 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.447+0000 7f2ae744f740 1 client.16686 shutdown 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.447+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 msgr2=0x56008769bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.447+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00a8ca0 tx=0x7f2ad00ac560 comp rx=0 tx=0).stop 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 shutdown_connections 2024-09-11T00:08:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087697b00 0x56008769cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600876a7600 0x5600876a99f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600876950c0 0x56008769c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 --2- 172.21.15.33:0/3315947967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087692790 0x56008769bcb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ac3400640 0 client.16686 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 >> 172.21.15.33:0/3315947967 conn(0x56008768d8e0 msgr2=0x56008768ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 shutdown_connections 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 1 -- 172.21.15.33:0/3315947967 wait complete. 2024-09-11T00:08:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.448+0000 7f2ae744f740 20 client.16686 trim_cache size 0 max 16384 2024-09-11T00:08:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.463+0000 7f2ae744f740 1 Processor -- start 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.463+0000 7f2ae744f740 1 -- start start 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x56008769ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 0x560087698420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1afff0 con 0x5600876950c0 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1ad8c0 con 0x560087692790 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae744f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1ab710 con 0x560087697b00 2024-09-11T00:08:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42424/0 (socket says 172.21.15.33:42424) 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 -- 172.21.15.33:0/4124562886 learned_addr learned my addr 172.21.15.33:0/4124562886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x56008769ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae2400640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 0x560087698420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 -- 172.21.15.33:0/4124562886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 msgr2=0x560087698420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 0x560087698420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 -- 172.21.15.33:0/4124562886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 msgr2=0x56008769ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x56008769ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae1000640 1 -- 172.21.15.33:0/4124562886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560087694ef0 con 0x5600876950c0 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.464+0000 7f2ae2400640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 0x560087698420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.465+0000 7f2ae1000640 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x5600876aa280 tx=0x7f2ac8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb27a771e440637 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.465+0000 7f2ace000640 1 -- 172.21.15.33:0/4124562886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac801f0d0 con 0x5600876950c0 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.465+0000 7f2ace000640 1 -- 172.21.15.33:0/4124562886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ac801f270 con 0x5600876950c0 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.465+0000 7f2ace000640 1 -- 172.21.15.33:0/4124562886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac801d410 con 0x5600876950c0 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- 172.21.15.33:0/4124562886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 msgr2=0x560087697ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x5600876aa280 tx=0x7f2ac8014000 comp rx=0 tx=0).stop 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- 172.21.15.33:0/4124562886 shutdown_connections 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087697b00 0x560087698420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600876950c0 0x560087697ee0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 --2- 172.21.15.33:0/4124562886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560087692790 0x56008769ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- 172.21.15.33:0/4124562886 >> 172.21.15.33:0/4124562886 conn(0x56008768d8e0 msgr2=0x560087691c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- 172.21.15.33:0/4124562886 shutdown_connections 2024-09-11T00:08:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- 172.21.15.33:0/4124562886 wait complete. 2024-09-11T00:08:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 -- start start 2024-09-11T00:08:30.472 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.466+0000 7f2ae744f740 1 Processor -- start 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087692790 0x5600876a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600876950c0 0x5600876a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1abd80 con 0x560087697b00 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1ad1f0 con 0x5600876950c0 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1ac450 con 0x560087692790 2024-09-11T00:08:30.475 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae744f740 10 client.0 _ll_register_callbacks cb 0x7f2ad0005b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42430/0 (socket says 172.21.15.33:42430) 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 -- 172.21.15.33:0/644290092 learned_addr learned my addr 172.21.15.33:0/644290092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087692790 0x5600876a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 -- 172.21.15.33:0/644290092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087692790 msgr2=0x5600876a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087692790 0x5600876a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 -- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600876950c0 msgr2=0x5600876a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600876950c0 0x5600876a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.467+0000 7f2ae2400640 1 -- 172.21.15.33:0/644290092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560087697820 con 0x560087697b00 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ae2400640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009ca0 tx=0x7f2ad4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a25de36efaaca8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ac3400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad404a040 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f2ad40305c0 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5600876030b0 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ad40307c0 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ae744f740 10 client.16692 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560087714980 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.468+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5600876030b0 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f2ad404d070 con 0x560087697b00 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 10 client.16692 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 20 client.16692 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600877150f0 0x560087717510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 4 client.16692 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:08:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600876004e0 con 0x5600877150f0 2024-09-11T00:08:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.469+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600877150f0 0x560087717510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.470+0000 7f2ae1a00640 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600877150f0 0x560087717510 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca82e9de07879463 server_cookie=8f723fb96da4b6ce in_seq=0 out_seq=0 2024-09-11T00:08:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.470+0000 7f2ac3400640 10 client.16692 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ac3400640 1 -- 172.21.15.33:0/644290092 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600876004e0 con 0x5600877150f0 2024-09-11T00:08:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ac3400640 10 client.16692 handle_command_reply: tid=0 2024-09-11T00:08:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ae744f740 1 client.16692 shutdown 2024-09-11T00:08:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 msgr2=0x5600876a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009ca0 tx=0x7f2ad4003ba0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 shutdown_connections 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.492+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560087697b00 0x5600876a1640 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600876950c0 0x5600876a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600877150f0 0x560087717510 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 --2- 172.21.15.33:0/644290092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560087692790 0x5600876a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 >> 172.21.15.33:0/644290092 conn(0x56008768d8e0 msgr2=0x560087691c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ac3400640 0 client.16692 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 shutdown_connections 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 1 -- 172.21.15.33:0/644290092 wait complete. 2024-09-11T00:08:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae744f740 20 client.16692 trim_cache size 0 max 16384 2024-09-11T00:08:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:08:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:08:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:08:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 msgr2=0x7f2ac40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 0x7f2ac40b7820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2adc103580 tx=0x7f2ac8005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 msgr2=0x7f2adc19ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.493+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000e9f0 tx=0x7f2ad000edf0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 shutdown_connections 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f2ac40b5360 0x7f2ac40b7820 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2adc10a8c0 0x7f2adc19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2adc107f00 0x7f2adc19b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 --2- 172.21.15.33:0/4202609836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc06be40 0x7f2adc19ae50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 >> 172.21.15.33:0/4202609836 conn(0x7f2adc0fd170 msgr2=0x7f2adc108b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 shutdown_connections 2024-09-11T00:08:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:30.494+0000 7f2ae4400640 1 -- 172.21.15.33:0/4202609836 wait complete. 2024-09-11T00:08:30.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:30 smithi033 ceph-mon[30593]: pgmap v788: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.5 MiB/s wr, 652 op/s 2024-09-11T00:08:30.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:30 smithi189 ceph-mon[34000]: pgmap v788: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.5 MiB/s wr, 652 op/s 2024-09-11T00:08:30.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:30 smithi052 ceph-mon[33526]: pgmap v788: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.5 MiB/s wr, 652 op/s 2024-09-11T00:08:32.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:32 smithi033 ceph-mon[30593]: pgmap v789: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.2 MiB/s wr, 572 op/s 2024-09-11T00:08:32.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:32 smithi189 ceph-mon[34000]: pgmap v789: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.2 MiB/s wr, 572 op/s 2024-09-11T00:08:32.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:32 smithi052 ceph-mon[33526]: pgmap v789: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.2 MiB/s wr, 572 op/s 2024-09-11T00:08:33.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:08:34.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:34 smithi033 ceph-mon[30593]: pgmap v790: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.7 MiB/s wr, 479 op/s 2024-09-11T00:08:34.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:34 smithi189 ceph-mon[34000]: pgmap v790: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.7 MiB/s wr, 479 op/s 2024-09-11T00:08:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:34 smithi052 ceph-mon[33526]: pgmap v790: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.7 MiB/s wr, 479 op/s 2024-09-11T00:08:36.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:36 smithi033 ceph-mon[30593]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 307 op/s 2024-09-11T00:08:36.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:36 smithi189 ceph-mon[34000]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 307 op/s 2024-09-11T00:08:36.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:36 smithi052 ceph-mon[33526]: pgmap v791: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.5 MiB/s wr, 307 op/s 2024-09-11T00:08:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:08:38.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:38 smithi033 ceph-mon[30593]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-09-11T00:08:38.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:38 smithi189 ceph-mon[34000]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-09-11T00:08:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:38 smithi052 ceph-mon[33526]: pgmap v792: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-09-11T00:08:40.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:40 smithi033 ceph-mon[30593]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-11T00:08:40.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:40 smithi189 ceph-mon[34000]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-11T00:08:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:40 smithi052 ceph-mon[33526]: pgmap v793: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-11T00:08:42.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:42 smithi033 ceph-mon[30593]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 879 KiB/s wr, 35 op/s 2024-09-11T00:08:42.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:42 smithi189 ceph-mon[34000]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 879 KiB/s wr, 35 op/s 2024-09-11T00:08:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:42 smithi052 ceph-mon[33526]: pgmap v794: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 879 KiB/s wr, 35 op/s 2024-09-11T00:08:43.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:08:43.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:08:43.449 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 -- 172.21.15.33:0/3031784545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8077a20 msgr2=0x7fd3f8077e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 --2- 172.21.15.33:0/3031784545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8077a20 0x7fd3f8077e20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009900 tx=0x7fd3e802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 -- 172.21.15.33:0/3031784545 shutdown_connections 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 --2- 172.21.15.33:0/3031784545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f8079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 --2- 172.21.15.33:0/3031784545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8078b70 0x7fd3f8078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 --2- 172.21.15.33:0/3031784545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8077a20 0x7fd3f8077e20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 -- 172.21.15.33:0/3031784545 >> 172.21.15.33:0/3031784545 conn(0x7fd3f8100440 msgr2=0x7fd3f8102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 -- 172.21.15.33:0/3031784545 shutdown_connections 2024-09-11T00:08:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.623+0000 7fd3fd000640 1 -- 172.21.15.33:0/3031784545 wait complete. 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.624+0000 7fd3fd000640 1 Processor -- start 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.624+0000 7fd3fd000640 1 -- start start 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 0x7fd3f819f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f81a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8114ab0 con 0x7fd3f8078b70 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8114930 con 0x7fd3f8079530 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3fd000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8114c30 con 0x7fd3f8077a20 2024-09-11T00:08:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46584/0 (socket says 172.21.15.33:46584) 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 -- 172.21.15.33:0/2168570045 learned_addr learned my addr 172.21.15.33:0/2168570045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3f6800640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f81a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 0x7fd3f819f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 -- 172.21.15.33:0/2168570045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 msgr2=0x7fd3f819f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 0x7fd3f819f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 -- 172.21.15.33:0/2168570045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 msgr2=0x7fd3f81a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f81a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3efe00640 1 -- 172.21.15.33:0/2168570045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f81a0e20 con 0x7fd3f8078b70 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3f6800640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f81a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.625+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 0x7fd3f819f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000e9f0 tx=0x7fd3e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3eea00640 1 -- 172.21.15.33:0/2168570045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000cd80 con 0x7fd3f8078b70 2024-09-11T00:08:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3eea00640 1 -- 172.21.15.33:0/2168570045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3e00054b0 con 0x7fd3f8078b70 2024-09-11T00:08:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f81a1110 con 0x7fd3f8078b70 2024-09-11T00:08:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3eea00640 1 -- 172.21.15.33:0/2168570045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0010430 con 0x7fd3f8078b70 2024-09-11T00:08:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.626+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f81a77e0 con 0x7fd3f8078b70 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 Processor -- start 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 -- start start 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7df0506b0 con 0x55a7df0dd790 2024-09-11T00:08:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7df03fae0 con 0x55a7df0e2b00 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd40001d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7df0438f0 con 0x55a7df0e00c0 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.629+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46586/0 (socket says 172.21.15.33:46586) 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 -- 172.21.15.33:0/4069465988 learned_addr learned my addr 172.21.15.33:0/4069465988 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3eea00640 1 -- 172.21.15.33:0/2168570045 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd3e0005020 con 0x7fd3f8078b70 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 -- 172.21.15.33:0/4069465988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 msgr2=0x55a7df0e24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0e24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 -- 172.21.15.33:0/4069465988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 msgr2=0x55a7df0e4fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0e4fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 -- 172.21.15.33:0/4069465988 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7df00c780 con 0x55a7df0dd790 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.630+0000 7fd3f6800640 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0010480 tx=0x7fd3f0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9f2645769a75da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd3e7400640 1 -- 172.21.15.33:0/4069465988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011760 con 0x55a7df0dd790 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd3e7400640 1 -- 172.21.15.33:0/4069465988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3f0011d90 con 0x55a7df0dd790 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd3e7400640 1 -- 172.21.15.33:0/4069465988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f001a380 con 0x55a7df0dd790 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 -- 172.21.15.33:0/4069465988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 msgr2=0x55a7df0dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0010480 tx=0x7fd3f0009f90 comp rx=0 tx=0).stop 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 -- 172.21.15.33:0/4069465988 shutdown_connections 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0e24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 --2- 172.21.15.33:0/4069465988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0dd790 0x55a7df0dfb80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 -- 172.21.15.33:0/4069465988 >> 172.21.15.33:0/4069465988 conn(0x55a7df0d88e0 msgr2=0x55a7df0d9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 -- 172.21.15.33:0/4069465988 shutdown_connections 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.631+0000 7fd40001d740 1 -- 172.21.15.33:0/4069465988 wait complete. 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.632+0000 7fd3eea00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 0x7fd3dc0b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.632+0000 7fd3eea00640 1 -- 172.21.15.33:0/2168570045 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd3e00e64f0 con 0x7fd3f8078b70 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.632+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 0x7fd3dc0b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.632+0000 7fd40001d740 1 -- start start 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.632+0000 7fd40001d740 1 Processor -- start 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 0x7fd3dc0b76b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8005ab0 tx=0x7fd3e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e00c0 0x55a7df0e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7def77ab0 con 0x55a7df0e2b00 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7defe6570 con 0x55a7df0e00c0 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7df0e5ae0 con 0x55a7df0dd790 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd40001d740 10 client.0 _ll_register_callbacks cb 0x55a7deff5100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46602/0 (socket says 172.21.15.33:46602) 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3f6800640 1 -- 172.21.15.33:0/1005915700 learned_addr learned my addr 172.21.15.33:0/1005915700 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3efe00640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e00c0 0x55a7df0e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.633+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 -- 172.21.15.33:0/1005915700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 msgr2=0x55a7df0e6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0e6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 -- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e00c0 msgr2=0x55a7df0e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e00c0 0x55a7df0e75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 -- 172.21.15.33:0/1005915700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7deda1790 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3f6800640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a35a8fe090292a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0004e50 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f0011d90 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.634+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd3f0011560 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd3f0034050 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 10 client.16704 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a7dee1a620 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3f0011d90 con 0x55a7df0e2b00 2024-09-11T00:08:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd3f002f030 con 0x55a7df0e2b00 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 10 client.16704 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 10 client.16704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 20 client.16704 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df0f2500 0x55a7df0f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 4 client.16704 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.635+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7df052600 con 0x55a7df0f2500 2024-09-11T00:08:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.636+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df0f2500 0x55a7df0f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.636+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df0f2500 0x55a7df0f48f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa5b724329f62a3 server_cookie=77298a0bb3a7cdf2 in_seq=0 out_seq=0 2024-09-11T00:08:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.636+0000 7fd3dbe00640 10 client.16704 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.637+0000 7fd3dbe00640 1 -- 172.21.15.33:0/1005915700 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7df052600 con 0x55a7df0f2500 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.637+0000 7fd3dbe00640 10 client.16704 handle_command_reply: tid=0 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.637+0000 7fd40001d740 1 client.16704 shutdown 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.637+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 msgr2=0x55a7df0e81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.637+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f001c730 comp rx=0 tx=0).stop 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 shutdown_connections 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0e81c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e00c0 0x55a7df0e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df0f2500 0x55a7df0f48f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 --2- 172.21.15.33:0/1005915700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0e6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd3dbe00640 0 client.16704 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 >> 172.21.15.33:0/1005915700 conn(0x55a7df0d88e0 msgr2=0x55a7df0d7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 shutdown_connections 2024-09-11T00:08:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 1 -- 172.21.15.33:0/1005915700 wait complete. 2024-09-11T00:08:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.638+0000 7fd40001d740 20 client.16704 trim_cache size 0 max 16384 2024-09-11T00:08:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.655+0000 7fd40001d740 1 Processor -- start 2024-09-11T00:08:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.655+0000 7fd40001d740 1 -- start start 2024-09-11T00:08:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0da710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0db190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b4520 con 0x55a7df0e00c0 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b1df0 con 0x55a7df0e2b00 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd40001d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81afc40 con 0x55a7df0dd790 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46614/0 (socket says 172.21.15.33:46614) 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 -- 172.21.15.33:0/2862008194 learned_addr learned my addr 172.21.15.33:0/2862008194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3f6800640 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 -- 172.21.15.33:0/2862008194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 msgr2=0x55a7df0da710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0da710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 -- 172.21.15.33:0/2862008194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 msgr2=0x55a7df0db190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0db190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.656+0000 7fd3efe00640 1 -- 172.21.15.33:0/2862008194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7df0e2820 con 0x55a7df0e00c0 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd3efe00640 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00e3bf0 tx=0x7fd3e000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395a02bf236d87fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd3e6a00640 1 -- 172.21.15.33:0/2862008194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00ac020 con 0x55a7df0e00c0 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd3e6a00640 1 -- 172.21.15.33:0/2862008194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3e00ac3c0 con 0x55a7df0e00c0 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd3e6a00640 1 -- 172.21.15.33:0/2862008194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00046c0 con 0x55a7df0e00c0 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd40001d740 1 -- 172.21.15.33:0/2862008194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 msgr2=0x55a7df0dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.657+0000 7fd40001d740 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00e3bf0 tx=0x7fd3e000cf20 comp rx=0 tx=0).stop 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 -- 172.21.15.33:0/2862008194 shutdown_connections 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0e2b00 0x55a7df0db190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e00c0 0x55a7df0dac50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 --2- 172.21.15.33:0/2862008194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0dd790 0x55a7df0da710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 -- 172.21.15.33:0/2862008194 >> 172.21.15.33:0/2862008194 conn(0x55a7df0d88e0 msgr2=0x55a7df0e2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 -- 172.21.15.33:0/2862008194 shutdown_connections 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 -- 172.21.15.33:0/2862008194 wait complete. 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 -- start start 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.658+0000 7fd40001d740 1 Processor -- start 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0dd790 0x55a7df0eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b02b0 con 0x55a7df0e2b00 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b1720 con 0x55a7df0dd790 2024-09-11T00:08:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f81b0980 con 0x55a7df0e00c0 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd40001d740 10 client.0 _ll_register_callbacks cb 0x7fd3f0009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46616/0 (socket says 172.21.15.33:46616) 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 -- 172.21.15.33:0/3285164384 learned_addr learned my addr 172.21.15.33:0/3285164384 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0dd790 0x55a7df0eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3efe00640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 -- 172.21.15.33:0/3285164384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 msgr2=0x55a7df0ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 -- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0dd790 msgr2=0x55a7df0eebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0dd790 0x55a7df0eebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 -- 172.21.15.33:0/3285164384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7df0ec460 con 0x55a7df0e2b00 2024-09-11T00:08:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3f6800640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd3f001c700 tx=0x7fd3f0009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23d0dce83ba1155 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.659+0000 7fd3dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f001c7a0 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e00ac3c0 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd3f001c940 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd3f004a050 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd40001d740 10 client.16710 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a7df15f520 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3e00ac3c0 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd3f002f040 con 0x55a7df0e2b00 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd40001d740 10 client.16710 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.660+0000 7fd40001d740 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd40001d740 20 client.16710 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df15fe70 0x55a7df162260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd40001d740 4 client.16710 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:08:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7df04e0b0 con 0x55a7df15fe70 2024-09-11T00:08:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df15fe70 0x55a7df162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd3f5e00640 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df15fe70 0x55a7df162260 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3dace4055005d8 server_cookie=bb0b52ecdcb80c8f in_seq=0 out_seq=0 2024-09-11T00:08:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.661+0000 7fd3dbe00640 10 client.16710 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd3dbe00640 1 -- 172.21.15.33:0/3285164384 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7df04e0b0 con 0x55a7df15fe70 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd3dbe00640 10 client.16710 handle_command_reply: tid=0 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 client.16710 shutdown 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 msgr2=0x55a7df0edfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd3f001c700 tx=0x7fd3f0009fc0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 shutdown_connections 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a7df0e2b00 0x55a7df0edfe0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a7df15fe70 0x55a7df162260 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a7df0e00c0 0x55a7df0ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 --2- 172.21.15.33:0/3285164384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7df0dd790 0x55a7df0eebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd3dbe00640 0 client.16710 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.677+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 >> 172.21.15.33:0/3285164384 conn(0x55a7df0d88e0 msgr2=0x55a7df0d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 shutdown_connections 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd40001d740 1 -- 172.21.15.33:0/3285164384 wait complete. 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd40001d740 20 client.16710 trim_cache size 0 max 16384 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:08:43.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:08:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:08:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:08:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 msgr2=0x7fd3dc0b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 0x7fd3dc0b76b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8005ab0 tx=0x7fd3e8005a20 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 msgr2=0x7fd3f819f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000e9f0 tx=0x7fd3e000edf0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 shutdown_connections 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd3dc0b51f0 0x7fd3dc0b76b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3f8079530 0x7fd3f81a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3f8078b70 0x7fd3f819f930 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 --2- 172.21.15.33:0/2168570045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3f8077a20 0x7fd3f819f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.678+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 >> 172.21.15.33:0/2168570045 conn(0x7fd3f8100440 msgr2=0x7fd3f8102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.679+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 shutdown_connections 2024-09-11T00:08:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:43.679+0000 7fd3fd000640 1 -- 172.21.15.33:0/2168570045 wait complete. 2024-09-11T00:08:44.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.108+0000 7f8ea6200640 1 -- 172.21.15.33:0/1536510186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 msgr2=0x7f8ea0105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:44.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.108+0000 7f8ea6200640 1 --2- 172.21.15.33:0/1536510186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea0105380 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009900 tx=0x7f8e9002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 -- 172.21.15.33:0/1536510186 shutdown_connections 2024-09-11T00:08:44.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 --2- 172.21.15.33:0/1536510186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 --2- 172.21.15.33:0/1536510186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 0x7f8ea010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 --2- 172.21.15.33:0/1536510186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea0105380 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 -- 172.21.15.33:0/1536510186 >> 172.21.15.33:0/1536510186 conn(0x7f8ea01009f0 msgr2=0x7f8ea0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 -- 172.21.15.33:0/1536510186 shutdown_connections 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.109+0000 7f8ea6200640 1 -- 172.21.15.33:0/1536510186 wait complete. 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.110+0000 7f8ea6200640 1 Processor -- start 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.110+0000 7f8ea6200640 1 -- start start 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 0x7f8ea019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea01a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0114e40 con 0x7f8ea0104fa0 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0114cc0 con 0x7f8ea010b330 2024-09-11T00:08:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8ea6200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0114fc0 con 0x7f8ea010a9b0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46638/0 (socket says 172.21.15.33:46638) 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 -- 172.21.15.33:0/3700556523 learned_addr learned my addr 172.21.15.33:0/3700556523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e96a00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 0x7f8ea019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9fe00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea01a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 -- 172.21.15.33:0/3700556523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 msgr2=0x7f8ea019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 0x7f8ea019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 -- 172.21.15.33:0/3700556523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 msgr2=0x7f8ea01a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea01a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9f400640 1 -- 172.21.15.33:0/3700556523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea01a13c0 con 0x7f8ea0104fa0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.111+0000 7f8e9fe00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea01a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8e9f400640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8e9002a910 tx=0x7f8e90003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:44.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9003f070 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e9003bd00 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea01a1650 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90035030 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.112+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01a7d70 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.113+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea0105380 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.117+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8e90031400 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.118+0000 7f8e9cc00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.119+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8e90107290 con 0x7f8ea0104fa0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.119+0000 7f8e96a00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.119+0000 7f8e96a00640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 0x7f8e840b77a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0103360 tx=0x7f8e8800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:44.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.121+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8e900cdd50 con 0x7f8ea0104fa0 2024-09-11T00:08:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.359+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ea019c440 con 0x7f8ea0104fa0 2024-09-11T00:08:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.359+0000 7f8e9cc00640 1 -- 172.21.15.33:0/3700556523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f8e900cd650 con 0x7f8ea0104fa0 2024-09-11T00:08:44.361 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:44 smithi033 ceph-mon[30593]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 174 KiB/s wr, 34 op/s 2024-09-11T00:08:44.361 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:08:44.362 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:08:44.362 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:08:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 msgr2=0x7f8e840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 0x7f8e840b77a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0103360 tx=0x7f8e8800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 msgr2=0x7f8ea019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8e9002a910 tx=0x7f8e90003d60 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 shutdown_connections 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8e840b52e0 0x7f8e840b77a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea010b330 0x7f8ea01a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ea010a9b0 0x7f8ea019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 --2- 172.21.15.33:0/3700556523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea0104fa0 0x7f8ea019b310 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.362+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 >> 172.21.15.33:0/3700556523 conn(0x7f8ea01009f0 msgr2=0x7f8ea0101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.363+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 shutdown_connections 2024-09-11T00:08:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:44.363+0000 7f8ea6200640 1 -- 172.21.15.33:0/3700556523 wait complete. 2024-09-11T00:08:44.507 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:44 smithi052 ceph-mon[33526]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 174 KiB/s wr, 34 op/s 2024-09-11T00:08:44.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:44 smithi189 ceph-mon[34000]: pgmap v795: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 174 KiB/s wr, 34 op/s 2024-09-11T00:08:45.127 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id 223ad1ee --release --await' 2024-09-11T00:08:45.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id 223ad1ee --release --await 2024-09-11T00:08:45.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:45 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3700556523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:45.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:45 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3700556523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:45.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:45 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3700556523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:46.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 -- 172.21.15.33:0/2019330265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 msgr2=0x7fe824077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 --2- 172.21.15.33:0/2019330265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe824077ab0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe814009900 tx=0x7fe81402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 -- 172.21.15.33:0/2019330265 shutdown_connections 2024-09-11T00:08:46.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 --2- 172.21.15.33:0/2019330265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8241137e0 0x7fe824115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 --2- 172.21.15.33:0/2019330265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe824077ff0 0x7fe8241132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 --2- 172.21.15.33:0/2019330265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe824077ab0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 -- 172.21.15.33:0/2019330265 >> 172.21.15.33:0/2019330265 conn(0x7fe824100840 msgr2=0x7fe824102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 -- 172.21.15.33:0/2019330265 shutdown_connections 2024-09-11T00:08:46.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.188+0000 7fe829c00640 1 -- 172.21.15.33:0/2019330265 wait complete. 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.189+0000 7fe829c00640 1 Processor -- start 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 -- start start 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe824077ff0 0x7fe82419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8241137e0 0x7fe8241a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe824119110 con 0x7fe8240776d0 2024-09-11T00:08:46.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe824118f90 con 0x7fe824077ff0 2024-09-11T00:08:46.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.190+0000 7fe829c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe824119290 con 0x7fe8241137e0 2024-09-11T00:08:46.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46648/0 (socket says 172.21.15.33:46648) 2024-09-11T00:08:46.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 -- 172.21.15.33:0/532774083 learned_addr learned my addr 172.21.15.33:0/532774083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:46.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe81b400640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe824077ff0 0x7fe82419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe829200640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8241137e0 0x7fe8241a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 -- 172.21.15.33:0/532774083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8241137e0 msgr2=0x7fe8241a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8241137e0 0x7fe8241a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 -- 172.21.15.33:0/532774083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe824077ff0 msgr2=0x7fe82419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe824077ff0 0x7fe82419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.191+0000 7fe823e00640 1 -- 172.21.15.33:0/532774083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8241a5650 con 0x7fe8240776d0 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe823e00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe814009230 tx=0x7fe814004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe821600640 1 -- 172.21.15.33:0/532774083 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81403f030 con 0x7fe8240776d0 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe821600640 1 -- 172.21.15.33:0/532774083 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe814003a80 con 0x7fe8240776d0 2024-09-11T00:08:46.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe821600640 1 -- 172.21.15.33:0/532774083 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814035070 con 0x7fe8240776d0 2024-09-11T00:08:46.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8241a58e0 con 0x7fe8240776d0 2024-09-11T00:08:46.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.192+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8241ac000 con 0x7fe8240776d0 2024-09-11T00:08:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.195+0000 7fe82dc3e740 1 Processor -- start 2024-09-11T00:08:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.195+0000 7fe82dc3e740 1 -- start start 2024-09-11T00:08:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe821600640 1 -- 172.21.15.33:0/532774083 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe81403bc30 con 0x7fe8240776d0 2024-09-11T00:08:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fee790d290 con 0x55fee7996af0 2024-09-11T00:08:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fee78fc6c0 con 0x55fee79a2a80 2024-09-11T00:08:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fee79004d0 con 0x55fee79961d0 2024-09-11T00:08:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:49320/0 (socket says 172.21.15.33:49320) 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46664/0 (socket says 172.21.15.33:46664) 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 -- 172.21.15.33:0/4161068504 learned_addr learned my addr 172.21.15.33:0/4161068504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe81b400640 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 -- 172.21.15.33:0/4161068504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 msgr2=0x55fee79a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 -- 172.21.15.33:0/4161068504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 msgr2=0x55fee79a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.196+0000 7fe829200640 1 -- 172.21.15.33:0/4161068504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee7889460 con 0x55fee79961d0 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.197+0000 7fe829200640 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00a430 tx=0x7fe81c009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e046a15ef901b900 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.197+0000 7fe819600640 1 -- 172.21.15.33:0/4161068504 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c013790 con 0x55fee79961d0 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.197+0000 7fe819600640 1 -- 172.21.15.33:0/4161068504 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81c019070 con 0x55fee79961d0 2024-09-11T00:08:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.197+0000 7fe819600640 1 -- 172.21.15.33:0/4161068504 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c014c20 con 0x55fee79961d0 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe821600640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 0x7fe8080b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe821600640 1 -- 172.21.15.33:0/532774083 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe814106900 con 0x7fe8240776d0 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe823e00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 0x7fe8080b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 -- 172.21.15.33:0/4161068504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 msgr2=0x55fee79965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00a430 tx=0x7fe81c009650 comp rx=0 tx=0).stop 2024-09-11T00:08:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 -- 172.21.15.33:0/4161068504 shutdown_connections 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/4161068504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79965b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 -- 172.21.15.33:0/4161068504 >> 172.21.15.33:0/4161068504 conn(0x55fee7994000 msgr2=0x55fee79951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 -- 172.21.15.33:0/4161068504 shutdown_connections 2024-09-11T00:08:46.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.198+0000 7fe82dc3e740 1 -- 172.21.15.33:0/4161068504 wait complete. 2024-09-11T00:08:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe823e00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 0x7fe8080b78d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8140ccd00 tx=0x7fe81410c530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe82dc3e740 1 -- start start 2024-09-11T00:08:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe82dc3e740 1 Processor -- start 2024-09-11T00:08:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee7996af0 0x55fee799ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.199+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fee775dbb0 con 0x55fee79a2a80 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fee78976c0 con 0x55fee7996af0 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fee79a5730 con 0x55fee79961d0 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe82dc3e740 10 client.0 _ll_register_callbacks cb 0x55fee78b2490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe81b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee7996af0 0x55fee799ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46676/0 (socket says 172.21.15.33:46676) 2024-09-11T00:08:46.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 -- 172.21.15.33:0/706235147 learned_addr learned my addr 172.21.15.33:0/706235147 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:46.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 -- 172.21.15.33:0/706235147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 msgr2=0x55fee799f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 -- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee7996af0 msgr2=0x55fee799ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee7996af0 0x55fee799ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.200+0000 7fe829200640 1 -- 172.21.15.33:0/706235147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee765ab00 con 0x55fee79a2a80 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe829200640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe81c014900 tx=0x7fe81c014800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c63267f515db44f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe812000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c014c20 con 0x55fee79a2a80 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe81c0137a0 con 0x55fee79a2a80 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe81c019070 con 0x55fee79a2a80 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe81c034050 con 0x55fee79a2a80 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe82dc3e740 10 client.16728 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.201+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fee76d1960 con 0x55fee79a2a80 2024-09-11T00:08:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe81c019070 con 0x55fee79a2a80 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe81c0208e0 con 0x55fee79a2a80 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 10 client.16728 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 10 client.16728 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 20 client.16728 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee79b25b0 0x55fee79b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 4 client.16728 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.202+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fee790f1e0 con 0x55fee79b25b0 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.203+0000 7fe81b400640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee79b25b0 0x55fee79b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.203+0000 7fe81b400640 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee79b25b0 0x55fee79b49a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fac3e000b8fb78 server_cookie=9fef1f3e981eb4cf in_seq=0 out_seq=0 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.203+0000 7fe812000640 10 client.16728 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe812000640 1 -- 172.21.15.33:0/706235147 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fee790f1e0 con 0x55fee79b25b0 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe812000640 10 client.16728 handle_command_reply: tid=0 2024-09-11T00:08:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 client.16728 shutdown 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 msgr2=0x55fee79a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe81c014900 tx=0x7fe81c014800 comp rx=0 tx=0).stop 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 shutdown_connections 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee79a2a80 0x55fee79a0460 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee7996af0 0x55fee799ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee79b25b0 0x55fee79b49a0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/706235147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.204+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 >> 172.21.15.33:0/706235147 conn(0x55fee7994000 msgr2=0x55fee7999ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.205+0000 7fe812000640 0 client.16728 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.205+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 shutdown_connections 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.205+0000 7fe82dc3e740 1 -- 172.21.15.33:0/706235147 wait complete. 2024-09-11T00:08:46.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.205+0000 7fe82dc3e740 20 client.16728 trim_cache size 0 max 16384 2024-09-11T00:08:46.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 Processor -- start 2024-09-11T00:08:46.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 -- start start 2024-09-11T00:08:46.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b86c0 con 0x55fee7996af0 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b5f90 con 0x55fee79a2a80 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.223+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b3de0 con 0x55fee79961d0 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46686/0 (socket says 172.21.15.33:46686) 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 -- 172.21.15.33:0/794843011 learned_addr learned my addr 172.21.15.33:0/794843011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe829200640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe829200640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 -- 172.21.15.33:0/794843011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 msgr2=0x55fee799cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 -- 172.21.15.33:0/794843011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 msgr2=0x55fee79ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 -- 172.21.15.33:0/794843011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee7994a80 con 0x55fee7996af0 2024-09-11T00:08:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe829200640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.224+0000 7fe81b400640 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b5f0 tx=0x7fe80c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463e7c0ec78c9657 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe818c00640 1 -- 172.21.15.33:0/794843011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c029070 con 0x55fee7996af0 2024-09-11T00:08:46.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe818c00640 1 -- 172.21.15.33:0/794843011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe80c003de0 con 0x55fee7996af0 2024-09-11T00:08:46.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe818c00640 1 -- 172.21.15.33:0/794843011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c011730 con 0x55fee7996af0 2024-09-11T00:08:46.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 -- 172.21.15.33:0/794843011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 msgr2=0x55fee799d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b5f0 tx=0x7fe80c00b390 comp rx=0 tx=0).stop 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 -- 172.21.15.33:0/794843011 shutdown_connections 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee799d130 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/794843011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee799cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.225+0000 7fe82dc3e740 1 -- 172.21.15.33:0/794843011 >> 172.21.15.33:0/794843011 conn(0x55fee7994000 msgr2=0x55fee79a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.226+0000 7fe82dc3e740 1 -- 172.21.15.33:0/794843011 shutdown_connections 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.226+0000 7fe82dc3e740 1 -- 172.21.15.33:0/794843011 wait complete. 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.226+0000 7fe82dc3e740 1 -- start start 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.226+0000 7fe82dc3e740 1 Processor -- start 2024-09-11T00:08:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b4450 con 0x55fee7996af0 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b58c0 con 0x55fee79a2a80 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8241b4b20 con 0x55fee79961d0 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe82dc3e740 10 client.0 _ll_register_callbacks cb 0x7fe81410c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46692/0 (socket says 172.21.15.33:46692) 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 -- 172.21.15.33:0/1381044017 learned_addr learned my addr 172.21.15.33:0/1381044017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe829200640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe829200640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 -- 172.21.15.33:0/1381044017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 msgr2=0x55fee79a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79a6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 -- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 msgr2=0x55fee79a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe81b400640 1 -- 172.21.15.33:0/1381044017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee7a1e4e0 con 0x55fee7996af0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.227+0000 7fe829200640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe81b400640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b780 tx=0x7fe80c003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3b68008f66ff17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe812000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c029040 con 0x55fee7996af0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe80c0052c0 con 0x55fee7996af0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80c003de0 con 0x55fee7996af0 2024-09-11T00:08:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe80c03b050 con 0x55fee7996af0 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe82dc3e740 10 client.16734 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.228+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fee7a1f820 con 0x55fee7996af0 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe80c003de0 con 0x55fee7996af0 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe80c02c070 con 0x55fee7996af0 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 10 client.16734 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 10 client.16734 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 20 client.16734 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee7a1fec0 0x55fee7a222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 4 client.16734 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "223ad1ee", "release": true, "await": true}] 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "223ad1ee", "release": true, "await": true}) -- 0x55fee790ac90 con 0x55fee7a1fec0 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.229+0000 7fe829200640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee7a1fec0 0x55fee7a222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.230+0000 7fe829200640 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee7a1fec0 0x55fee7a222e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d518ac073cf1f7 server_cookie=bc1484a2ddd08e3b in_seq=0 out_seq=0 2024-09-11T00:08:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.230+0000 7fe812000640 10 client.16734 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.282+0000 7fe812000640 1 -- 172.21.15.33:0/1381044017 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fee790ac90 con 0x55fee7a1fec0 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.282+0000 7fe812000640 10 client.16734 handle_command_reply: tid=0 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.282+0000 7fe82dc3e740 1 client.16734 shutdown 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.282+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 msgr2=0x55fee79a6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.282+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b780 tx=0x7fe80c003be0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 shutdown_connections 2024-09-11T00:08:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee79a2a80 0x55fee79a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fee7996af0 0x55fee79a6fa0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fee7a1fec0 0x55fee7a222e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 --2- 172.21.15.33:0/1381044017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fee79961d0 0x55fee79a6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 >> 172.21.15.33:0/1381044017 conn(0x55fee7994000 msgr2=0x55fee799f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe812000640 0 client.16734 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 shutdown_connections 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.283+0000 7fe82dc3e740 1 -- 172.21.15.33:0/1381044017 wait complete. 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.284+0000 7fe82dc3e740 20 client.16734 trim_cache size 0 max 16384 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 36, 2024-09-11T00:08:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "223ad1ee": { 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 36, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.4, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:08:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:46.288 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.284+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 msgr2=0x7fe8080b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.284+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 0x7fe8080b78d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8140ccd00 tx=0x7fe81410c530 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.284+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 msgr2=0x7fe82419f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.284+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe814009230 tx=0x7fe814004270 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 shutdown_connections 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe8080b5410 0x7fe8080b78d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8241137e0 0x7fe8241a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe824077ff0 0x7fe82419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 --2- 172.21.15.33:0/532774083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8240776d0 0x7fe82419f5a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 >> 172.21.15.33:0/532774083 conn(0x7fe824100840 msgr2=0x7fe824102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:46.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 shutdown_connections 2024-09-11T00:08:46.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:46.285+0000 7fe829c00640 1 -- 172.21.15.33:0/532774083 wait complete. 2024-09-11T00:08:46.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:46 smithi033 ceph-mon[30593]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-11T00:08:46.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:46 smithi189 ceph-mon[34000]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-11T00:08:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:46 smithi052 ceph-mon[33526]: pgmap v796: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-09-11T00:08:47.166 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '223ad1ee', total seconds elapsed: 29.5 2024-09-11T00:08:47.167 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.4 2024-09-11T00:08:47.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:08:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 540.0 s, 321.3 tps, lat 1327.671 ms stddev 4661.016 2024-09-11T00:08:48.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:48 smithi033 ceph-mon[30593]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 211 KiB/s wr, 36 op/s 2024-09-11T00:08:48.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:48 smithi189 ceph-mon[34000]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 211 KiB/s wr, 36 op/s 2024-09-11T00:08:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:48 smithi052 ceph-mon[33526]: pgmap v797: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 211 KiB/s wr, 36 op/s 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.708+0000 7f7555c00640 1 -- 172.21.15.33:0/257161648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75501093d0 msgr2=0x7f75501097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.708+0000 7f7555c00640 1 --2- 172.21.15.33:0/257161648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75501093d0 0x7f75501097b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7540009ca0 tx=0x7f754002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 -- 172.21.15.33:0/257161648 shutdown_connections 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 --2- 172.21.15.33:0/257161648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f755010f760 0x7f7550115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 --2- 172.21.15.33:0/257161648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010ede0 0x7f755010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 --2- 172.21.15.33:0/257161648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75501093d0 0x7f75501097b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 -- 172.21.15.33:0/257161648 >> 172.21.15.33:0/257161648 conn(0x7f7550078a40 msgr2=0x7f755007ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:48.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.709+0000 7f7555c00640 1 -- 172.21.15.33:0/257161648 shutdown_connections 2024-09-11T00:08:48.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.710+0000 7f7555c00640 1 -- 172.21.15.33:0/257161648 wait complete. 2024-09-11T00:08:48.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.712+0000 7f7555c00640 1 Processor -- start 2024-09-11T00:08:48.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.714+0000 7f7555c00640 1 -- start start 2024-09-11T00:08:48.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75501093d0 0x7f755019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 0x7f75501a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7550119270 con 0x7f75501093d0 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75501190f0 con 0x7f755010ede0 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f7555c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75501193f0 con 0x7f755010f760 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f754e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f754f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 0x7f75501a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f754e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:55398/0 (socket says 172.21.15.33:55398) 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f754e000640 1 -- 172.21.15.33:0/1678928780 learned_addr learned my addr 172.21.15.33:0/1678928780 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.715+0000 7f754ea00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75501093d0 0x7f755019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754e000640 1 -- 172.21.15.33:0/1678928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 msgr2=0x7f75501a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754e000640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 0x7f75501a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754e000640 1 -- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75501093d0 msgr2=0x7f755019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754e000640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75501093d0 0x7f755019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754e000640 1 -- 172.21.15.33:0/1678928780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75501a57f0 con 0x7f755010ede0 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.716+0000 7f754f400640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 0x7f75501a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.717+0000 7f754e000640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f753c00d950 tx=0x7f753c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.717+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c017030 con 0x7f755010ede0 2024-09-11T00:08:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.717+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f753c004020 con 0x7f755010ede0 2024-09-11T00:08:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.717+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c0055d0 con 0x7f755010ede0 2024-09-11T00:08:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.717+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75501a5ae0 con 0x7f755010ede0 2024-09-11T00:08:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.718+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75501ac1a0 con 0x7f755010ede0 2024-09-11T00:08:48.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.721+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75501097b0 con 0x7f755010ede0 2024-09-11T00:08:48.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.725+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f753c009a30 con 0x7f755010ede0 2024-09-11T00:08:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.728+0000 7f7547400640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 0x7f75340b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:48.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.729+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f753c0a80b0 con 0x7f755010ede0 2024-09-11T00:08:48.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.729+0000 7f754ea00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 0x7f75340b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:48.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.732+0000 7f754ea00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 0x7f75340b7860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7540009a60 tx=0x7f7540005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:48.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:48.735+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f753c0ac540 con 0x7f755010ede0 2024-09-11T00:08:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.188+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f755002e5c0 con 0x7f755010ede0 2024-09-11T00:08:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.190+0000 7f7547400640 1 -- 172.21.15.33:0/1678928780 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f753c0abe40 con 0x7f755010ede0 2024-09-11T00:08:49.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:08:49.194 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:08:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:08:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 msgr2=0x7f75340b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 0x7f75340b7860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7540009a60 tx=0x7f7540005f80 comp rx=0 tx=0).stop 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 msgr2=0x7f755019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f753c00d950 tx=0x7f753c00de10 comp rx=0 tx=0).stop 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 shutdown_connections 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f75340b53a0 0x7f75340b7860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f755010f760 0x7f75501a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f755010ede0 0x7f755019fc80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 --2- 172.21.15.33:0/1678928780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75501093d0 0x7f755019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.194+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 >> 172.21.15.33:0/1678928780 conn(0x7f7550078a40 msgr2=0x7f75500792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.196+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 shutdown_connections 2024-09-11T00:08:49.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:49.196+0000 7f7555c00640 1 -- 172.21.15.33:0/1678928780 wait complete. 2024-09-11T00:08:49.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:49 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1678928780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:49.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:49 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1678928780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:49.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:49 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1678928780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:08:50.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:50 smithi189 ceph-mon[34000]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 685 KiB/s wr, 49 op/s 2024-09-11T00:08:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:50 smithi052 ceph-mon[33526]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 685 KiB/s wr, 49 op/s 2024-09-11T00:08:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:50 smithi033 ceph-mon[30593]: pgmap v798: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 685 KiB/s wr, 49 op/s 2024-09-11T00:08:51.933 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0' 2024-09-11T00:08:51.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 145.4 --await-for 45.0 2024-09-11T00:08:52.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:52 smithi189 ceph-mon[34000]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 110 op/s 2024-09-11T00:08:52.651 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:52 smithi052 ceph-mon[33526]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 110 op/s 2024-09-11T00:08:52.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:52 smithi033 ceph-mon[30593]: pgmap v799: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 110 op/s 2024-09-11T00:08:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 545.0 s, 492.0 tps, lat 204.332 ms stddev 257.485 2024-09-11T00:08:53.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.627+0000 7f6ea3a00640 1 -- 172.21.15.33:0/978911134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c0776d0 msgr2=0x7f6e9c077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.627+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/978911134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c077ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009900 tx=0x7f6e9002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.627+0000 7f6ea3a00640 1 -- 172.21.15.33:0/978911134 shutdown_connections 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.627+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/978911134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c113990 0x7f6e9c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.627+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/978911134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c077ff0 0x7f6e9c113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.628+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/978911134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c077ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.628+0000 7f6ea3a00640 1 -- 172.21.15.33:0/978911134 >> 172.21.15.33:0/978911134 conn(0x7f6e9c100a50 msgr2=0x7f6e9c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.629+0000 7f6ea3a00640 1 -- 172.21.15.33:0/978911134 shutdown_connections 2024-09-11T00:08:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.629+0000 7f6ea3a00640 1 -- 172.21.15.33:0/978911134 wait complete. 2024-09-11T00:08:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.631+0000 7f6ea3a00640 1 Processor -- start 2024-09-11T00:08:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.631+0000 7f6ea3a00640 1 -- start start 2024-09-11T00:08:53.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c077ff0 0x7f6e9c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 0x7f6e9c1a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1192f0 con 0x7f6e9c0776d0 2024-09-11T00:08:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c119170 con 0x7f6e9c077ff0 2024-09-11T00:08:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.632+0000 7f6ea3a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c119470 con 0x7f6e9c113990 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c19f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55086/0 (socket says 172.21.15.33:55086) 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1000640 1 -- 172.21.15.33:0/1014246899 learned_addr learned my addr 172.21.15.33:0/1014246899 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 0x7f6e9c1a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6e9be00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c077ff0 0x7f6e9c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 -- 172.21.15.33:0/1014246899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c077ff0 msgr2=0x7f6e9c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c077ff0 0x7f6e9c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 -- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 msgr2=0x7f6e9c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.633+0000 7f6ea1a00640 1 -- 172.21.15.33:0/1014246899 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c1a58d0 con 0x7f6e9c113990 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 0x7f6e9c1a5100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400bdf0 tx=0x7f6e9400bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6e99600640 1 -- 172.21.15.33:0/1014246899 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94019070 con 0x7f6e9c113990 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6e99600640 1 -- 172.21.15.33:0/1014246899 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e940148d0 con 0x7f6e9c113990 2024-09-11T00:08:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6e99600640 1 -- 172.21.15.33:0/1014246899 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94012760 con 0x7f6e9c113990 2024-09-11T00:08:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c1a5bc0 con 0x7f6e9c113990 2024-09-11T00:08:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.634+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c1ac300 con 0x7f6e9c113990 2024-09-11T00:08:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.639+0000 7f6e99600640 1 -- 172.21.15.33:0/1014246899 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6e94012920 con 0x7f6e9c113990 2024-09-11T00:08:53.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.640+0000 7f6e99600640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 0x7f6e840b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.640+0000 7f6e99600640 1 -- 172.21.15.33:0/1014246899 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6e940e6750 con 0x7f6e9c113990 2024-09-11T00:08:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.641+0000 7f6ea1000640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 0x7f6e840b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.641+0000 7f6ea664b740 1 Processor -- start 2024-09-11T00:08:53.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.642+0000 7f6ea664b740 1 -- start start 2024-09-11T00:08:53.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.642+0000 7f6ea1000640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 0x7f6e840b79b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6e900096c0 tx=0x7f6e9002a8f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.643+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.643+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 0x564aeba044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 0x564aeba06e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34044/0 (socket says 172.21.15.33:34044) 2024-09-11T00:08:53.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea1000640 1 -- 172.21.15.33:0/1691881190 learned_addr learned my addr 172.21.15.33:0/1691881190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:53.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564aeb96dca0 con 0x564aeba04a30 2024-09-11T00:08:53.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564aeb95d0d0 con 0x564aeb9f8180 2024-09-11T00:08:53.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.644+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564aeb960ee0 con 0x564aeb9f8aa0 2024-09-11T00:08:53.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 0x564aeba06e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6e9be00640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 0x564aeba044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1000640 1 -- 172.21.15.33:0/1691881190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 msgr2=0x564aeba044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1000640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 0x564aeba044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1000640 1 -- 172.21.15.33:0/1691881190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 msgr2=0x564aeba06e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1000640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 0x564aeba06e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1000640 1 -- 172.21.15.33:0/1691881190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aeb90f400 con 0x564aeb9f8180 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 0x564aeba06e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.645+0000 7f6e9be00640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 0x564aeba044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.646+0000 7f6ea1000640 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e900057c0 tx=0x7f6e9003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf7ae6addd9edc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.646+0000 7f6e8e000640 1 -- 172.21.15.33:0/1691881190 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9004d070 con 0x564aeb9f8180 2024-09-11T00:08:53.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.646+0000 7f6e8e000640 1 -- 172.21.15.33:0/1691881190 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e90049ae0 con 0x564aeb9f8180 2024-09-11T00:08:53.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.646+0000 7f6e8e000640 1 -- 172.21.15.33:0/1691881190 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90035050 con 0x564aeb9f8180 2024-09-11T00:08:53.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.647+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 msgr2=0x564aeb9f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.647+0000 7f6ea664b740 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e900057c0 tx=0x7f6e9003e000 comp rx=0 tx=0).stop 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 shutdown_connections 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeba04a30 0x564aeba06e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8aa0 0x564aeba044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 --2- 172.21.15.33:0/1691881190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeb9f8560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 >> 172.21.15.33:0/1691881190 conn(0x564aeb9f5fb0 msgr2=0x564aeb9f7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 shutdown_connections 2024-09-11T00:08:53.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.648+0000 7f6ea664b740 1 -- 172.21.15.33:0/1691881190 wait complete. 2024-09-11T00:08:53.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.649+0000 7f6ea664b740 1 -- start start 2024-09-11T00:08:53.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.649+0000 7f6ea664b740 1 Processor -- start 2024-09-11T00:08:53.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba01790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba01dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564aeb7be7a0 con 0x564aeb9f8aa0 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564aeb902a10 con 0x564aeba04a30 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564aeba07650 con 0x564aeb9f8180 2024-09-11T00:08:53.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.650+0000 7f6ea664b740 10 client.0 _ll_register_callbacks cb 0x564aeb912be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:53.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.651+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.651+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33948/0 (socket says 172.21.15.33:33948) 2024-09-11T00:08:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.651+0000 7f6ea1000640 1 -- 172.21.15.33:0/2108378806 learned_addr learned my addr 172.21.15.33:0/2108378806 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba01dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6e9be00640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba01790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1000640 1 -- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 msgr2=0x564aeba01dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1000640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba01dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1000640 1 -- 172.21.15.33:0/2108378806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 msgr2=0x564aeba01790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1000640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba01790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.652+0000 7f6ea1000640 1 -- 172.21.15.33:0/2108378806 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aeb6cab90 con 0x564aeb9f8180 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.653+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba01dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.653+0000 7f6ea1000640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e90049680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae05c38340bff77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.653+0000 7f6e82a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:53.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.653+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90059070 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.654+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e90049ae0 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.654+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6e9003ca50 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.654+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e90065050 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.654+0000 7f6ea664b740 10 client.26533 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.654+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564aeba12f50 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e90049ae0 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6e90052af0 con 0x564aeb9f8180 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 10 client.26533 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 10 client.26533 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 20 client.26533 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba142a0 0x564aeba16690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 4 client.26533 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:53.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.655+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564aeb96fbf0 con 0x564aeba142a0 2024-09-11T00:08:53.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.656+0000 7f6e9be00640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba142a0 0x564aeba16690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.657+0000 7f6e9be00640 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba142a0 0x564aeba16690 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eced10f3cc4c4d4 server_cookie=b802ec57afcc2361 in_seq=0 out_seq=0 2024-09-11T00:08:53.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.657+0000 7f6e82a00640 10 client.26533 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:53.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.657+0000 7f6e82a00640 1 -- 172.21.15.33:0/2108378806 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564aeb96fbf0 con 0x564aeba142a0 2024-09-11T00:08:53.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.657+0000 7f6e82a00640 10 client.26533 handle_command_reply: tid=0 2024-09-11T00:08:53.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 client.26533 shutdown 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 msgr2=0x564aeba04340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000c00 tx=0x7f6e90049680 comp rx=0 tx=0).stop 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 shutdown_connections 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba01dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba01790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba142a0 0x564aeba16690 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 --2- 172.21.15.33:0/2108378806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba04340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6e82a00640 0 client.26533 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:53.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.658+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 >> 172.21.15.33:0/2108378806 conn(0x564aeb9f5fb0 msgr2=0x564aeb9fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.659+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 shutdown_connections 2024-09-11T00:08:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.659+0000 7f6ea664b740 1 -- 172.21.15.33:0/2108378806 wait complete. 2024-09-11T00:08:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.659+0000 7f6ea664b740 20 client.26533 trim_cache size 0 max 16384 2024-09-11T00:08:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 Processor -- start 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 -- start start 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeba10920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba05e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b89f0 con 0x564aeb9f8aa0 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b62c0 con 0x564aeb9f8180 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.697+0000 7f6ea664b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b4110 con 0x564aeba04a30 2024-09-11T00:08:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeba10920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeba10920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34072/0 (socket says 172.21.15.33:34072) 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33962/0 (socket says 172.21.15.33:33962) 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 -- 172.21.15.33:0/989466485 learned_addr learned my addr 172.21.15.33:0/989466485 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6e9be00640 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba05e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 -- 172.21.15.33:0/989466485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 msgr2=0x564aeba10920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeba10920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 -- 172.21.15.33:0/989466485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 msgr2=0x564aeba05e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba05e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.698+0000 7f6ea1a00640 1 -- 172.21.15.33:0/989466485 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aeb9f6a30 con 0x564aeba04a30 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.699+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e940e3dc0 tx=0x7f6e94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a8745dcc40319d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.699+0000 7f6e8d600640 1 -- 172.21.15.33:0/989466485 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940cfe60 con 0x564aeba04a30 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.699+0000 7f6e8d600640 1 -- 172.21.15.33:0/989466485 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e940ac6d0 con 0x564aeba04a30 2024-09-11T00:08:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.699+0000 7f6e8d600640 1 -- 172.21.15.33:0/989466485 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940a8e30 con 0x564aeba04a30 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 -- 172.21.15.33:0/989466485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 msgr2=0x564aeba06360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e940e3dc0 tx=0x7f6e94004a40 comp rx=0 tx=0).stop 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 -- 172.21.15.33:0/989466485 shutdown_connections 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeba04a30 0x564aeba06360 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba05e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 --2- 172.21.15.33:0/989466485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeb9f8180 0x564aeba10920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.700+0000 7f6ea664b740 1 -- 172.21.15.33:0/989466485 >> 172.21.15.33:0/989466485 conn(0x564aeb9f5fb0 msgr2=0x564aeba035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.701+0000 7f6ea664b740 1 -- 172.21.15.33:0/989466485 shutdown_connections 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.701+0000 7f6ea664b740 1 -- 172.21.15.33:0/989466485 wait complete. 2024-09-11T00:08:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.702+0000 7f6ea664b740 1 -- start start 2024-09-11T00:08:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.702+0000 7f6ea664b740 1 Processor -- start 2024-09-11T00:08:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba7b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33968/0 (socket says 172.21.15.33:33968) 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea1000640 1 -- 172.21.15.33:0/3001553364 learned_addr learned my addr 172.21.15.33:0/3001553364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b4780 con 0x564aeb9f8aa0 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b5bf0 con 0x564aeba04a30 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.704+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c1b4e50 con 0x564aeb9f8180 2024-09-11T00:08:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1a00640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6e9be00640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba7b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1000640 1 -- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 msgr2=0x564aeba7ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1000640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba7ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1000640 1 -- 172.21.15.33:0/3001553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 msgr2=0x564aeba7b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1000640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba7b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea1000640 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aeba18870 con 0x564aeb9f8180 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea664b740 10 client.0 _ll_register_callbacks cb 0x7f6e90003810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.705+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e940ac6d0 con 0x564aeb9f8180 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.706+0000 7f6ea1000640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e90031450 tx=0x7f6e90049b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e1cd9de981190c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.706+0000 7f6e82a00640 10 client.26539 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:08:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.707+0000 7f6e82a00640 1 -- 172.21.15.33:0/3001553364 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9006f050 con 0x564aeb9f8180 2024-09-11T00:08:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.707+0000 7f6e82a00640 1 -- 172.21.15.33:0/3001553364 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6e90031970 con 0x564aeb9f8180 2024-09-11T00:08:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.707+0000 7f6e82a00640 1 -- 172.21.15.33:0/3001553364 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e90059070 con 0x564aeb9f8180 2024-09-11T00:08:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.708+0000 7f6ea664b740 10 client.26539 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.708+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564aeba19a20 con 0x564aeb9f8180 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6e82a00640 1 -- 172.21.15.33:0/3001553364 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6e90031b70 con 0x564aeb9f8180 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 10 client.26539 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 10 client.26539 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 20 client.26539 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba1a020 0x564aeba95e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 4 client.26539 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}] 2024-09-11T00:08:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.709+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.4, "await_for": 45.0}) -- 0x564aeb96b6a0 con 0x564aeba1a020 2024-09-11T00:08:53.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.710+0000 7f6e9be00640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba1a020 0x564aeba95e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.711+0000 7f6e82a00640 10 client.26539 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:53.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:53.711+0000 7f6e9be00640 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba1a020 0x564aeba95e30 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ceca257f37a54c2 server_cookie=721667e871a7bffa in_seq=0 out_seq=0 2024-09-11T00:08:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.019+0000 7f6e82a00640 1 -- 172.21.15.33:0/3001553364 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564aeb96b6a0 con 0x564aeba1a020 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.019+0000 7f6e82a00640 10 client.26539 handle_command_reply: tid=0 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.019+0000 7f6ea664b740 1 client.26539 shutdown 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 msgr2=0x564aeba7af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e90031450 tx=0x7f6e90049b70 comp rx=0 tx=0).stop 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 shutdown_connections 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aeba04a30 0x564aeba7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564aeb9f8aa0 0x564aeba7b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564aeba1a020 0x564aeba95e30 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 --2- 172.21.15.33:0/3001553364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564aeb9f8180 0x564aeba7af90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 >> 172.21.15.33:0/3001553364 conn(0x564aeb9f5fb0 msgr2=0x564aeba035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6e82a00640 0 client.26539 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 shutdown_connections 2024-09-11T00:08:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 1 -- 172.21.15.33:0/3001553364 wait complete. 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.020+0000 7f6ea664b740 20 client.26539 trim_cache size 0 max 16384 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 38, 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:08:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "a3573d5d": { 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 38, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.4, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:08:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:08:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 msgr2=0x7f6e840b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 0x7f6e840b79b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6e900096c0 tx=0x7f6e9002a8f0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 msgr2=0x7f6e9c1a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 0x7f6e9c1a5100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400bdf0 tx=0x7f6e9400bee0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 shutdown_connections 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e840b54f0 0x7f6e840b79b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e9c113990 0x7f6e9c1a5100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e9c077ff0 0x7f6e9c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 --2- 172.21.15.33:0/1014246899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e9c0776d0 0x7f6e9c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 >> 172.21.15.33:0/1014246899 conn(0x7f6e9c100a50 msgr2=0x7f6e9c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 shutdown_connections 2024-09-11T00:08:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:08:54.021+0000 7f6ea3a00640 1 -- 172.21.15.33:0/1014246899 wait complete. 2024-09-11T00:08:54.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:54 smithi189 ceph-mon[34000]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-09-11T00:08:54.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:54 smithi052 ceph-mon[33526]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-09-11T00:08:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:54 smithi033 ceph-mon[30593]: pgmap v800: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-09-11T00:08:55.453 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a3573d5d', quiesce took 8.3 seconds. Will release after: 17.099999999999998 2024-09-11T00:08:56.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:56 smithi189 ceph-mon[34000]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 289 op/s 2024-09-11T00:08:56.680 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:56 smithi033 ceph-mon[30593]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 289 op/s 2024-09-11T00:08:56.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:56 smithi052 ceph-mon[33526]: pgmap v801: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 289 op/s 2024-09-11T00:08:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 -- 172.21.15.33:0/1891119274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c1058f0 msgr2=0x7fdb0c107d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 --2- 172.21.15.33:0/1891119274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c107d60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009900 tx=0x7fdaf402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 -- 172.21.15.33:0/1891119274 shutdown_connections 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 --2- 172.21.15.33:0/1891119274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 0x7fdb0c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 --2- 172.21.15.33:0/1891119274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c107d60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 --2- 172.21.15.33:0/1891119274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c06b470 0x7fdb0c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 -- 172.21.15.33:0/1891119274 >> 172.21.15.33:0/1891119274 conn(0x7fdb0c0fcf30 msgr2=0x7fdb0c0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 -- 172.21.15.33:0/1891119274 shutdown_connections 2024-09-11T00:08:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.798+0000 7fdb10e00640 1 -- 172.21.15.33:0/1891119274 wait complete. 2024-09-11T00:08:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 Processor -- start 2024-09-11T00:08:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 -- start start 2024-09-11T00:08:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 0x7fdb0c199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c10e280 con 0x7fdb0c06b470 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c10e100 con 0x7fdb0c1058f0 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb10e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c10e400 con 0x7fdb0c1084a0 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.799+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55142/0 (socket says 172.21.15.33:55142) 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 -- 172.21.15.33:0/2160212841 learned_addr learned my addr 172.21.15.33:0/2160212841 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0be00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 0x7fdb0c199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb02a00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 -- 172.21.15.33:0/2160212841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 msgr2=0x7fdb0c199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 0x7fdb0c199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 -- 172.21.15.33:0/2160212841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1058f0 msgr2=0x7fdb0c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 -- 172.21.15.33:0/2160212841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c19a5a0 con 0x7fdb0c06b470 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.800+0000 7fdb0b400640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e9f0 tx=0x7fdafc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.801+0000 7fdb08c00640 1 -- 172.21.15.33:0/2160212841 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00cd80 con 0x7fdb0c06b470 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.801+0000 7fdb08c00640 1 -- 172.21.15.33:0/2160212841 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdafc0108c0 con 0x7fdb0c06b470 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.801+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c19a890 con 0x7fdb0c06b470 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.801+0000 7fdb08c00640 1 -- 172.21.15.33:0/2160212841 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0187c0 con 0x7fdb0c06b470 2024-09-11T00:08:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.801+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c1a0f60 con 0x7fdb0c06b470 2024-09-11T00:08:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 Processor -- start 2024-09-11T00:08:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 -- start start 2024-09-11T00:08:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5a2a0 0x55f197a5c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb08c00640 1 -- 172.21.15.33:0/2160212841 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdafc010430 con 0x7fdb0c06b470 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a5f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f1979ca6b0 con 0x55f197a57970 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1979b9ae0 con 0x55f197a5a2a0 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.804+0000 7fdb1543b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1979bd8f0 con 0x55f197a5cce0 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55158/0 (socket says 172.21.15.33:55158) 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 -- 172.21.15.33:0/352808520 learned_addr learned my addr 172.21.15.33:0/352808520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb02a00640 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a5f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0b400640 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5a2a0 0x55f197a5c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 -- 172.21.15.33:0/352808520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 msgr2=0x55f197a5f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a5f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 -- 172.21.15.33:0/352808520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5a2a0 msgr2=0x55f197a5c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5a2a0 0x55f197a5c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.805+0000 7fdb0be00640 1 -- 172.21.15.33:0/352808520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f197986780 con 0x55f197a57970 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.806+0000 7fdb0be00640 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009fc0 tx=0x7fdb04010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82b2bfe5401c3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.806+0000 7fdb00c00640 1 -- 172.21.15.33:0/352808520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04016070 con 0x55f197a57970 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.806+0000 7fdb00c00640 1 -- 172.21.15.33:0/352808520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb04004d20 con 0x55f197a57970 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.806+0000 7fdb00c00640 1 -- 172.21.15.33:0/352808520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04005350 con 0x55f197a57970 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.806+0000 7fdb08c00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 0x7fdaf00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- 172.21.15.33:0/352808520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 msgr2=0x55f197a59d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009fc0 tx=0x7fdb04010800 comp rx=0 tx=0).stop 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- 172.21.15.33:0/352808520 shutdown_connections 2024-09-11T00:08:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a5f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5a2a0 0x55f197a5c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 --2- 172.21.15.33:0/352808520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a59d60 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- 172.21.15.33:0/352808520 >> 172.21.15.33:0/352808520 conn(0x55f197a52ac0 msgr2=0x55f197a53850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb08c00640 1 -- 172.21.15.33:0/2160212841 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdafc0e6350 con 0x7fdb0c06b470 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb0b400640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 0x7fdaf00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- 172.21.15.33:0/352808520 shutdown_connections 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- 172.21.15.33:0/352808520 wait complete. 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb1543b740 1 -- start start 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.807+0000 7fdb0b400640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 0x7fdaf00b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009230 tx=0x7fdafc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 Processor -- start 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 0x55f197a65bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a66780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f1978f1ab0 con 0x55f197a5a2a0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f197960570 con 0x55f197a57970 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f197a5fcc0 con 0x55f197a5cce0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb1543b740 10 client.0 _ll_register_callbacks cb 0x55f19796f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 0x55f197a65bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34108/0 (socket says 172.21.15.33:34108) 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.808+0000 7fdb0be00640 1 -- 172.21.15.33:0/447114005 learned_addr learned my addr 172.21.15.33:0/447114005 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb0be00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a66780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 -- 172.21.15.33:0/447114005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 msgr2=0x55f197a66780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a66780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 -- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 msgr2=0x55f197a65510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 -- 172.21.15.33:0/447114005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19771b790 con 0x55f197a5a2a0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb0be00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb02a00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 0x55f197a65bb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4005ab0 tx=0x7fdaf4031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02806d5671502b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdaf9600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4035040 con 0x55f197a5a2a0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb04004d20 con 0x55f197a5a2a0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.809+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdaf4004240 con 0x55f197a5a2a0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdaf404e050 con 0x55f197a5a2a0 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 10 client.16758 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:56.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f197794620 con 0x55f197a5a2a0 2024-09-11T00:08:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb04004d20 con 0x55f197a5a2a0 2024-09-11T00:08:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fdaf403c440 con 0x55f197a5a2a0 2024-09-11T00:08:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 10 client.16758 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 20 client.16758 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197a70e60 0x55f197a73250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 4 client.16758 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.810+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1979cc600 con 0x55f197a70e60 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.811+0000 7fdb0be00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197a70e60 0x55f197a73250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.811+0000 7fdb0be00640 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197a70e60 0x55f197a73250 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a486efde9e345d server_cookie=42017e39d807336c in_seq=0 out_seq=0 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.811+0000 7fdaf9600640 10 client.16758 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.812+0000 7fdaf9600640 1 -- 172.21.15.33:0/447114005 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1979cc600 con 0x55f197a70e60 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.812+0000 7fdaf9600640 10 client.16758 handle_command_reply: tid=0 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 client.16758 shutdown 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 msgr2=0x55f197a65bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 0x55f197a65bb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4005ab0 tx=0x7fdaf4031870 comp rx=0 tx=0).stop 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 shutdown_connections 2024-09-11T00:08:56.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197a70e60 0x55f197a73250 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5cce0 0x55f197a66780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5a2a0 0x55f197a65bb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 --2- 172.21.15.33:0/447114005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdaf9600640 0 client.16758 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 >> 172.21.15.33:0/447114005 conn(0x55f197a52ac0 msgr2=0x55f197a51bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 shutdown_connections 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 1 -- 172.21.15.33:0/447114005 wait complete. 2024-09-11T00:08:56.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.813+0000 7fdb1543b740 20 client.16758 trim_cache size 0 max 16384 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.828+0000 7fdb1543b740 1 Processor -- start 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.828+0000 7fdb1543b740 1 -- start start 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a5d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a5d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1aba90 con 0x55f197a5cce0 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1a9360 con 0x55f197a57970 2024-09-11T00:08:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb1543b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1a71b0 con 0x55f197a5a2a0 2024-09-11T00:08:56.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55172/0 (socket says 172.21.15.33:55172) 2024-09-11T00:08:56.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 -- 172.21.15.33:0/641884300 learned_addr learned my addr 172.21.15.33:0/641884300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a5d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb02a00640 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a5d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 -- 172.21.15.33:0/641884300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 msgr2=0x55f197a5d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.829+0000 7fdb0be00640 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a5d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdb0be00640 1 -- 172.21.15.33:0/641884300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 msgr2=0x55f197a5d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdb0be00640 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a5d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdb0be00640 1 -- 172.21.15.33:0/641884300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f197a5a0d0 con 0x55f197a5cce0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdb0be00640 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdb04015040 tx=0x7fdb04013fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34391bbc51ecdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdafbe00640 1 -- 172.21.15.33:0/641884300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04016040 con 0x55f197a5cce0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdafbe00640 1 -- 172.21.15.33:0/641884300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb04005570 con 0x55f197a5cce0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.830+0000 7fdafbe00640 1 -- 172.21.15.33:0/641884300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04012770 con 0x55f197a5cce0 2024-09-11T00:08:56.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- 172.21.15.33:0/641884300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 msgr2=0x55f197a65510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdb04015040 tx=0x7fdb04013fc0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- 172.21.15.33:0/641884300 shutdown_connections 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a5cce0 0x55f197a65510 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a5d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 --2- 172.21.15.33:0/641884300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a57970 0x55f197a5d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- 172.21.15.33:0/641884300 >> 172.21.15.33:0/641884300 conn(0x55f197a52ac0 msgr2=0x55f197a600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- 172.21.15.33:0/641884300 shutdown_connections 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- 172.21.15.33:0/641884300 wait complete. 2024-09-11T00:08:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 -- start start 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.831+0000 7fdb1543b740 1 Processor -- start 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a6be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5cce0 0x55f197a6c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1a7820 con 0x55f197a57970 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1a8c90 con 0x55f197a5cce0 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1a7ef0 con 0x55f197a5a2a0 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb1543b740 10 client.0 _ll_register_callbacks cb 0x7fdaf4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55184/0 (socket says 172.21.15.33:55184) 2024-09-11T00:08:56.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 -- 172.21.15.33:0/1722760188 learned_addr learned my addr 172.21.15.33:0/1722760188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 -- 172.21.15.33:0/1722760188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 msgr2=0x55f197a6be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a6be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 -- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5cce0 msgr2=0x55f197a6c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.832+0000 7fdb0be00640 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5cce0 0x55f197a6c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdb0be00640 1 -- 172.21.15.33:0/1722760188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f197a6a940 con 0x55f197a57970 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdb0be00640 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009ee0 tx=0x7fdb04004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f312c450ddf72c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdaf9600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0403f060 con 0x55f197a57970 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fdb04004f90 con 0x55f197a57970 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb04005570 con 0x55f197a57970 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdb04016070 con 0x55f197a57970 2024-09-11T00:08:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdb1543b740 10 client.16764 fetch_fsmap learned FSMap version 30 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.833+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f197addea0 con 0x55f197a57970 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb04005570 con 0x55f197a57970 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fdb0400f040 con 0x55f197a57970 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 10 client.16764 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 10 client.16764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 20 client.16764 populate_metadata read hostname 'smithi033' 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197ade690 0x55f197ae0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 4 client.16764 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1979c80b0 con 0x55f197ade690 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.834+0000 7fdb02a00640 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197ade690 0x55f197ae0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:56.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.835+0000 7fdb02a00640 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197ade690 0x55f197ae0ab0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d376f1aeff458e server_cookie=327c505fb510d130 in_seq=0 out_seq=0 2024-09-11T00:08:56.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.835+0000 7fdaf9600640 10 client.16764 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdaf9600640 1 -- 172.21.15.33:0/1722760188 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1979c80b0 con 0x55f197ade690 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdaf9600640 10 client.16764 handle_command_reply: tid=0 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 client.16764 shutdown 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 msgr2=0x55f197a6d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009ee0 tx=0x7fdb04004ac0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 shutdown_connections 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f197a5cce0 0x55f197a6c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f197ade690 0x55f197ae0ab0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f197a5a2a0 0x55f197a6be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 --2- 172.21.15.33:0/1722760188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f197a57970 0x55f197a6d120 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdaf9600640 0 client.16764 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 >> 172.21.15.33:0/1722760188 conn(0x55f197a52ac0 msgr2=0x55f197a5d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 shutdown_connections 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.860+0000 7fdb1543b740 1 -- 172.21.15.33:0/1722760188 wait complete. 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb1543b740 20 client.16764 trim_cache size 0 max 16384 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:08:56.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 msgr2=0x7fdaf00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 0x7fdaf00b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009230 tx=0x7fdafc000bc0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 msgr2=0x7fdb0c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e9f0 tx=0x7fdafc00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 shutdown_connections 2024-09-11T00:08:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fdaf00b52e0 0x7fdaf00b77a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb0c1084a0 0x7fdb0c199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1058f0 0x7fdb0c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 --2- 172.21.15.33:0/2160212841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c06b470 0x7fdb0c198a60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 >> 172.21.15.33:0/2160212841 conn(0x7fdb0c0fcf30 msgr2=0x7fdb0c103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 shutdown_connections 2024-09-11T00:08:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:08:56.861+0000 7fdb10e00640 1 -- 172.21.15.33:0/2160212841 wait complete. 2024-09-11T00:08:58.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 550.0 s, 74.3 tps, lat 133.048 ms stddev 35.414 2024-09-11T00:08:58.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:08:58 smithi189 ceph-mon[34000]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-09-11T00:08:58.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:08:58 smithi052 ceph-mon[33526]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-09-11T00:08:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:08:58 smithi033 ceph-mon[30593]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.3 MiB/s wr, 335 op/s 2024-09-11T00:09:00.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:00 smithi189 ceph-mon[34000]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.5 MiB/s wr, 339 op/s 2024-09-11T00:09:00.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:00 smithi052 ceph-mon[33526]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.5 MiB/s wr, 339 op/s 2024-09-11T00:09:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:00 smithi033 ceph-mon[30593]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.5 MiB/s wr, 339 op/s 2024-09-11T00:09:02.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:02 smithi189 ceph-mon[34000]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-09-11T00:09:02.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:02 smithi052 ceph-mon[33526]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-09-11T00:09:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:02 smithi033 ceph-mon[30593]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 321 op/s 2024-09-11T00:09:03.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 555.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:09:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:04 smithi189 ceph-mon[34000]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 267 op/s 2024-09-11T00:09:04.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:04 smithi052 ceph-mon[33526]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 267 op/s 2024-09-11T00:09:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:04 smithi033 ceph-mon[30593]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 267 op/s 2024-09-11T00:09:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:06 smithi189 ceph-mon[34000]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-09-11T00:09:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:06 smithi052 ceph-mon[33526]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-09-11T00:09:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:06 smithi033 ceph-mon[30593]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-09-11T00:09:08.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:09:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:08 smithi189 ceph-mon[34000]: pgmap v807: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2024-09-11T00:09:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:08 smithi052 ceph-mon[33526]: pgmap v807: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2024-09-11T00:09:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:08 smithi033 ceph-mon[30593]: pgmap v807: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 -- 172.21.15.33:0/995224611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41064e0 msgr2=0x7f29d410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 --2- 172.21.15.33:0/995224611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41064e0 0x7f29d410ce60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009cd0 tx=0x7f29cc02a8e0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 -- 172.21.15.33:0/995224611 shutdown_connections 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 --2- 172.21.15.33:0/995224611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41064e0 0x7f29d410ce60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 --2- 172.21.15.33:0/995224611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 0x7f29d4105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 --2- 172.21.15.33:0/995224611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41049d0 0x7f29d4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 -- 172.21.15.33:0/995224611 >> 172.21.15.33:0/995224611 conn(0x7f29d4100270 msgr2=0x7f29d41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 -- 172.21.15.33:0/995224611 shutdown_connections 2024-09-11T00:09:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.002+0000 7f29d9200640 1 -- 172.21.15.33:0/995224611 wait complete. 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.003+0000 7f29d9200640 1 Processor -- start 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 -- start start 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 0x7f29d419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41064e0 0x7f29d419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29d4110520 con 0x7f29d41049d0 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41103a0 con 0x7f29d41064e0 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d9200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41106a0 con 0x7f29d4105b20 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49254/0 (socket says 172.21.15.33:49254) 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 -- 172.21.15.33:0/3402184563 learned_addr learned my addr 172.21.15.33:0/3402184563 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:10.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 0x7f29d419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3e00640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41064e0 0x7f29d419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 -- 172.21.15.33:0/3402184563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 msgr2=0x7f29d419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 0x7f29d419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 -- 172.21.15.33:0/3402184563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41064e0 msgr2=0x7f29d419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41064e0 0x7f29d419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.004+0000 7f29d3400640 1 -- 172.21.15.33:0/3402184563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d419c7c0 con 0x7f29d41049d0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29d3400640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f29c400e9f0 tx=0x7f29c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29cbe00640 1 -- 172.21.15.33:0/3402184563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c400cd80 con 0x7f29d41049d0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29cbe00640 1 -- 172.21.15.33:0/3402184563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c40108c0 con 0x7f29d41049d0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29cbe00640 1 -- 172.21.15.33:0/3402184563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c40187c0 con 0x7f29d41049d0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d419cab0 con 0x7f29d41049d0 2024-09-11T00:09:10.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.005+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d41a3180 con 0x7f29d41049d0 2024-09-11T00:09:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 Processor -- start 2024-09-11T00:09:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 -- start start 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29cbe00640 1 -- 172.21.15.33:0/3402184563 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f29c4010430 con 0x7f29d41049d0 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f18e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f59f0fc6b0 con 0x55f59f189970 2024-09-11T00:09:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f59f0ebae0 con 0x55f59f18c2a0 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29dd80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59f0ef8f0 con 0x55f59f18ece0 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.009+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f18e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49256/0 (socket says 172.21.15.33:49256) 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 -- 172.21.15.33:0/2070081463 learned_addr learned my addr 172.21.15.33:0/2070081463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d2a00640 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 -- 172.21.15.33:0/2070081463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 msgr2=0x55f59f1911a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1911a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 -- 172.21.15.33:0/2070081463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 msgr2=0x55f59f18e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f18e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 -- 172.21.15.33:0/2070081463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59f0b8780 con 0x55f59f189970 2024-09-11T00:09:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.010+0000 7f29d3e00640 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005e30 tx=0x7f29cc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683f8a0125fe1a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29c8c00640 1 -- 172.21.15.33:0/2070081463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc031a90 con 0x55f59f189970 2024-09-11T00:09:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29c8c00640 1 -- 172.21.15.33:0/2070081463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29cc036040 con 0x55f59f189970 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29c8c00640 1 -- 172.21.15.33:0/2070081463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc004610 con 0x55f59f189970 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29cbe00640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29cbe00640 1 -- 172.21.15.33:0/3402184563 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f29c40e6410 con 0x7f29d41049d0 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.011+0000 7f29d3400640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- 172.21.15.33:0/2070081463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 msgr2=0x55f59f18bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005e30 tx=0x7f29cc005ef0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- 172.21.15.33:0/2070081463 shutdown_connections 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f18e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 --2- 172.21.15.33:0/2070081463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f18bd60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- 172.21.15.33:0/2070081463 >> 172.21.15.33:0/2070081463 conn(0x55f59f184ac0 msgr2=0x55f59f185850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- 172.21.15.33:0/2070081463 shutdown_connections 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- 172.21.15.33:0/2070081463 wait complete. 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29d3400640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29c40e66b0 tx=0x7f29c40e9e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.012+0000 7f29dd80e740 1 -- start start 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 Processor -- start 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f1930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f194310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f59f023ab0 con 0x55f59f189970 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f59f092570 con 0x55f59f18c2a0 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f59f191c60 con 0x55f59f18ece0 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29dd80e740 10 client.0 _ll_register_callbacks cb 0x55f59f0a1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f1930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f1930a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49258/0 (socket says 172.21.15.33:49258) 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.013+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47726/0 (socket says 172.21.15.33:47726) 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d3e00640 1 -- 172.21.15.33:0/3905033906 learned_addr learned my addr 172.21.15.33:0/3905033906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d3e00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f194310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 -- 172.21.15.33:0/3905033906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 msgr2=0x55f59f194310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f194310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 -- 172.21.15.33:0/3905033906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 msgr2=0x55f59f1930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f1930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 -- 172.21.15.33:0/3905033906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f59ee4d790 con 0x55f59f18c2a0 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29d2a00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d9e0 tx=0x7f29c000dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98a4e0cbfeb3c716 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.014+0000 7f29bd600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0005220 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f29c00053c0 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc036040 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f29c0023050 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29dd80e740 10 client.36593 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f59eec6620 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.015+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29cc036040 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f29c0019030 con 0x55f59f18c2a0 2024-09-11T00:09:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 10 client.36593 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 10 client.36593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 20 client.36593 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f19ea80 0x55f59f1a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 4 client.36593 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f59f0fe600 con 0x55f59f19ea80 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.016+0000 7f29d3e00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f19ea80 0x55f59f1a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.017+0000 7f29d3e00640 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f19ea80 0x55f59f1a0f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c213490ff7f9a630 server_cookie=dc8225f5d70f4dc9 in_seq=0 out_seq=0 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.017+0000 7f29bd600640 10 client.36593 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29bd600640 1 -- 172.21.15.33:0/3905033906 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f59f0fe600 con 0x55f59f19ea80 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29bd600640 10 client.36593 handle_command_reply: tid=0 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 client.36593 shutdown 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 msgr2=0x55f59f193740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d9e0 tx=0x7f29c000dea0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 shutdown_connections 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f19ea80 0x55f59f1a0f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f194310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18c2a0 0x55f59f193740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 --2- 172.21.15.33:0/3905033906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f189970 0x55f59f1930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 >> 172.21.15.33:0/3905033906 conn(0x55f59f184ac0 msgr2=0x55f59f183bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29bd600640 0 client.36593 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 shutdown_connections 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.018+0000 7f29dd80e740 1 -- 172.21.15.33:0/3905033906 wait complete. 2024-09-11T00:09:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.019+0000 7f29dd80e740 20 client.36593 trim_cache size 0 max 16384 2024-09-11T00:09:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.034+0000 7f29dd80e740 1 Processor -- start 2024-09-11T00:09:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.034+0000 7f29dd80e740 1 -- start start 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f189970 0x55f59f18f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41afef0 con 0x55f59f18c2a0 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41ad7c0 con 0x55f59f189970 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29dd80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41ab610 con 0x55f59f18ece0 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49260/0 (socket says 172.21.15.33:49260) 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 -- 172.21.15.33:0/1462042352 learned_addr learned my addr 172.21.15.33:0/1462042352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d3e00640 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f189970 0x55f59f18f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 -- 172.21.15.33:0/1462042352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 msgr2=0x55f59f1930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 -- 172.21.15.33:0/1462042352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f189970 msgr2=0x55f59f18f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f189970 0x55f59f18f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 -- 172.21.15.33:0/1462042352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59f18c0d0 con 0x55f59f18c2a0 2024-09-11T00:09:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.035+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f29c00115d0 tx=0x7f29c0004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408992e90df2fb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29bfe00640 1 -- 172.21.15.33:0/1462042352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c002b070 con 0x55f59f18c2a0 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29bfe00640 1 -- 172.21.15.33:0/1462042352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c0003e70 con 0x55f59f18c2a0 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29bfe00640 1 -- 172.21.15.33:0/1462042352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0005450 con 0x55f59f18c2a0 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 -- 172.21.15.33:0/1462042352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 msgr2=0x55f59f18f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f29c00115d0 tx=0x7f29c0004340 comp rx=0 tx=0).stop 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 -- 172.21.15.33:0/1462042352 shutdown_connections 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f18ece0 0x55f59f1930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f18f600 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1462042352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f189970 0x55f59f18f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 -- 172.21.15.33:0/1462042352 >> 172.21.15.33:0/1462042352 conn(0x55f59f184ac0 msgr2=0x55f59f185560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 -- 172.21.15.33:0/1462042352 shutdown_connections 2024-09-11T00:09:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.036+0000 7f29dd80e740 1 -- 172.21.15.33:0/1462042352 wait complete. 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 -- start start 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 Processor -- start 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f189970 0x55f59f199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18ece0 0x55f59f1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41abc80 con 0x55f59f18c2a0 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41ad0f0 con 0x55f59f18ece0 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29d41ac350 con 0x55f59f189970 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.037+0000 7f29dd80e740 10 client.0 _ll_register_callbacks cb 0x7f29c0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49276/0 (socket says 172.21.15.33:49276) 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 -- 172.21.15.33:0/1910596794 learned_addr learned my addr 172.21.15.33:0/1910596794 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d3e00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f189970 0x55f59f199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d3e00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18ece0 0x55f59f1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 -- 172.21.15.33:0/1910596794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f189970 msgr2=0x55f59f199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f189970 0x55f59f199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 -- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18ece0 msgr2=0x55f59f1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18ece0 0x55f59f1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 -- 172.21.15.33:0/1910596794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f59f19acf0 con 0x55f59f18c2a0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29d2a00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f29c00059f0 tx=0x7f29c0011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b0f203cf018054 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.038+0000 7f29bd600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0034070 con 0x55f59f18c2a0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f29c0005190 con 0x55f59f18c2a0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c0003e70 con 0x55f59f18c2a0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f29c0040050 con 0x55f59f18c2a0 2024-09-11T00:09:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29dd80e740 10 client.16782 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f59f20c040 con 0x55f59f18c2a0 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c0003e70 con 0x55f59f18c2a0 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.039+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f29c0019040 con 0x55f59f18c2a0 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 10 client.16782 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 10 client.16782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 20 client.16782 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f20ca10 0x55f59f20ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 4 client.16782 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:09:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f59f0fa0b0 con 0x55f59f20ca10 2024-09-11T00:09:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29d3e00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f20ca10 0x55f59f20ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29d3e00640 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f20ca10 0x55f59f20ee30 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78499700ed8ceceb server_cookie=88e1de1325f04271 in_seq=0 out_seq=0 2024-09-11T00:09:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.040+0000 7f29bd600640 10 client.16782 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29bd600640 1 -- 172.21.15.33:0/1910596794 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f59f0fa0b0 con 0x55f59f20ca10 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29bd600640 10 client.16782 handle_command_reply: tid=0 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 client.16782 shutdown 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 msgr2=0x55f59f19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f29c00059f0 tx=0x7f29c0011980 comp rx=0 tx=0).stop 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 shutdown_connections 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f59f18ece0 0x55f59f1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f59f18c2a0 0x55f59f19a3f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f59f20ca10 0x55f59f20ee30 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 --2- 172.21.15.33:0/1910596794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f59f189970 0x55f59f199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29bd600640 0 client.16782 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 >> 172.21.15.33:0/1910596794 conn(0x55f59f184ac0 msgr2=0x55f59f18f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.053+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 shutdown_connections 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29dd80e740 1 -- 172.21.15.33:0/1910596794 wait complete. 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29dd80e740 20 client.16782 trim_cache size 0 max 16384 2024-09-11T00:09:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:09:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:09:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:09:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:09:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 msgr2=0x7f29b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f29c40e66b0 tx=0x7f29c40e9e50 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 msgr2=0x7f29d419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f29c400e9f0 tx=0x7f29c400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 shutdown_connections 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f29b80b5360 0x7f29b80b7820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.054+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d41064e0 0x7f29d419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.055+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d4105b20 0x7f29d419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.055+0000 7f29d9200640 1 --2- 172.21.15.33:0/3402184563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29d41049d0 0x7f29d419ac80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.055+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 >> 172.21.15.33:0/3402184563 conn(0x7f29d4100270 msgr2=0x7f29d4108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.055+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 shutdown_connections 2024-09-11T00:09:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:10.055+0000 7f29d9200640 1 -- 172.21.15.33:0/3402184563 wait complete. 2024-09-11T00:09:10.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:10 smithi052 ceph-mon[33526]: pgmap v808: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 457 KiB/s wr, 45 op/s 2024-09-11T00:09:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:10 smithi033 ceph-mon[30593]: pgmap v808: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 457 KiB/s wr, 45 op/s 2024-09-11T00:09:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:10 smithi189 ceph-mon[34000]: pgmap v808: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 457 KiB/s wr, 45 op/s 2024-09-11T00:09:12.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:09:12.612 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:12 smithi033 ceph-mon[30593]: pgmap v809: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 173 KiB/s wr, 32 op/s 2024-09-11T00:09:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:12 smithi052 ceph-mon[33526]: pgmap v809: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 173 KiB/s wr, 32 op/s 2024-09-11T00:09:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:12 smithi189 ceph-mon[34000]: pgmap v809: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 173 KiB/s wr, 32 op/s 2024-09-11T00:09:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:13.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 -- 172.21.15.33:0/1029184780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 msgr2=0x7ff138105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 --2- 172.21.15.33:0/1029184780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff138105380 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff128009900 tx=0x7ff12802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 -- 172.21.15.33:0/1029184780 shutdown_connections 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 --2- 172.21.15.33:0/1029184780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810b330 0x7ff138111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 --2- 172.21.15.33:0/1029184780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810a9b0 0x7ff13810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 --2- 172.21.15.33:0/1029184780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff138105380 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 -- 172.21.15.33:0/1029184780 >> 172.21.15.33:0/1029184780 conn(0x7ff138100a50 msgr2=0x7ff138102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 -- 172.21.15.33:0/1029184780 shutdown_connections 2024-09-11T00:09:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.687+0000 7ff13f200640 1 -- 172.21.15.33:0/1029184780 wait complete. 2024-09-11T00:09:13.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 Processor -- start 2024-09-11T00:09:13.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 -- start start 2024-09-11T00:09:13.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:13.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810a9b0 0x7ff13819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 0x7ff1381a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff138114e60 con 0x7ff138104fa0 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff138114ce0 con 0x7ff13810a9b0 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.688+0000 7ff13f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff138114fe0 con 0x7ff13810b330 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53348/0 (socket says 172.21.15.33:53348) 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 -- 172.21.15.33:0/1147870960 learned_addr learned my addr 172.21.15.33:0/1147870960 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137400640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810a9b0 0x7ff13819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff13d200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 0x7ff1381a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 -- 172.21.15.33:0/1147870960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 msgr2=0x7ff1381a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 0x7ff1381a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 -- 172.21.15.33:0/1147870960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810a9b0 msgr2=0x7ff13819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810a9b0 0x7ff13819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff137e00640 1 -- 172.21.15.33:0/1147870960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1381a1500 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.689+0000 7ff13d200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 0x7ff1381a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff137e00640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff12802a910 tx=0x7ff128003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12803f070 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff128003e40 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128035030 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1381a1790 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.690+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1381a7eb0 con 0x7ff138104fa0 2024-09-11T00:09:13.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.691+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff138105380 con 0x7ff138104fa0 2024-09-11T00:09:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.694+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff128031400 con 0x7ff138104fa0 2024-09-11T00:09:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.695+0000 7ff134c00640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 0x7ff11c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:13.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.695+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7ff128106ea0 con 0x7ff138104fa0 2024-09-11T00:09:13.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.695+0000 7ff137400640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 0x7ff11c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:13.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.696+0000 7ff137400640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 0x7ff11c0b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff124005fd0 tx=0x7ff124005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:13.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.697+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1280cd960 con 0x7ff138104fa0 2024-09-11T00:09:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.952+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff13802e5c0 con 0x7ff138104fa0 2024-09-11T00:09:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.952+0000 7ff134c00640 1 -- 172.21.15.33:0/1147870960 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7ff1280cd260 con 0x7ff138104fa0 2024-09-11T00:09:13.955 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:09:13.955 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:09:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:09:13.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 msgr2=0x7ff11c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:13.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 0x7ff11c0b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff124005fd0 tx=0x7ff124005850 comp rx=0 tx=0).stop 2024-09-11T00:09:13.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 msgr2=0x7ff13819b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff12802a910 tx=0x7ff128003c20 comp rx=0 tx=0).stop 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 shutdown_connections 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7ff11c0b5360 0x7ff11c0b7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff13810b330 0x7ff1381a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff13810a9b0 0x7ff13819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 --2- 172.21.15.33:0/1147870960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff138104fa0 0x7ff13819b450 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 >> 172.21.15.33:0/1147870960 conn(0x7ff138100a50 msgr2=0x7ff138102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 shutdown_connections 2024-09-11T00:09:13.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:13.955+0000 7ff13f200640 1 -- 172.21.15.33:0/1147870960 wait complete. 2024-09-11T00:09:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:14 smithi052 ceph-mon[33526]: pgmap v810: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 213 KiB/s wr, 39 op/s 2024-09-11T00:09:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:14 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1147870960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:14 smithi033 ceph-mon[30593]: pgmap v810: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 213 KiB/s wr, 39 op/s 2024-09-11T00:09:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:14 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1147870960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:14 smithi189 ceph-mon[34000]: pgmap v810: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 213 KiB/s wr, 39 op/s 2024-09-11T00:09:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:14 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1147870960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:09:14.934 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id a3573d5d --release --await' 2024-09-11T00:09:14.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id a3573d5d --release --await 2024-09-11T00:09:15.314 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 -- 172.21.15.33:0/4223226870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61301087d0 msgr2=0x7f6130108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 --2- 172.21.15.33:0/4223226870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61301087d0 0x7f6130108c10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6118009900 tx=0x7f611802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 -- 172.21.15.33:0/4223226870 shutdown_connections 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 --2- 172.21.15.33:0/4223226870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6130109150 0x7f613010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 --2- 172.21.15.33:0/4223226870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61301087d0 0x7f6130108c10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 --2- 172.21.15.33:0/4223226870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 0x7f61301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 -- 172.21.15.33:0/4223226870 >> 172.21.15.33:0/4223226870 conn(0x7f61300fe830 msgr2=0x7f6130100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 -- 172.21.15.33:0/4223226870 shutdown_connections 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.021+0000 7f6137a00640 1 -- 172.21.15.33:0/4223226870 wait complete. 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 Processor -- start 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 -- start start 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 0x7f6130076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61301087d0 0x7f61300754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112c80 con 0x7f6130109150 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112b00 con 0x7f6130102dc0 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.022+0000 7f6137a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112e00 con 0x7f61301087d0 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 0x7f6130076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53366/0 (socket says 172.21.15.33:53366) 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 -- 172.21.15.33:0/1164485338 learned_addr learned my addr 172.21.15.33:0/1164485338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6127e00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61301087d0 0x7f61300754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 -- 172.21.15.33:0/1164485338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61301087d0 msgr2=0x7f61300754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61301087d0 0x7f61300754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 -- 172.21.15.33:0/1164485338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 msgr2=0x7f6130076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 0x7f6130076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.023+0000 7f6135a00640 1 -- 172.21.15.33:0/1164485338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301abaf0 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f6135a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f612800eaa0 tx=0x7f612800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f612e000640 1 -- 172.21.15.33:0/1164485338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612800cdb0 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f612e000640 1 -- 172.21.15.33:0/1164485338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6128005020 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f612e000640 1 -- 172.21.15.33:0/1164485338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280116d0 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61301abcc0 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.024+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301ac180 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.028+0000 7f613a3dc740 1 Processor -- start 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.028+0000 7f612e000640 1 -- 172.21.15.33:0/1164485338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f612800f040 con 0x7f6130109150 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 -- start start 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5593bb43d290 con 0x5593bb4c6910 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5593bb42c6c0 con 0x5593bb4d28a0 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f613a3dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593bb4304d0 con 0x5593bb4c5ff0 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f6135000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f6135000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53374/0 (socket says 172.21.15.33:53374) 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f6135000640 1 -- 172.21.15.33:0/3364266418 learned_addr learned my addr 172.21.15.33:0/3364266418 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.029+0000 7f6127e00640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6127e00640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 -- 172.21.15.33:0/3364266418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 msgr2=0x5593bb4c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 -- 172.21.15.33:0/3364266418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 msgr2=0x5593bb4d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 -- 172.21.15.33:0/3364266418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593bb3b9460 con 0x5593bb4c6910 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6127e00640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6135000640 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f612000bd80 tx=0x7f61200107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c211d03b3939da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f612e000640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 0x7f61140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6126000640 1 -- 172.21.15.33:0/3364266418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120005220 con 0x5593bb4c6910 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6126000640 1 -- 172.21.15.33:0/3364266418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6120004c30 con 0x5593bb4c6910 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.030+0000 7f6126000640 1 -- 172.21.15.33:0/3364266418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61200116f0 con 0x5593bb4c6910 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.031+0000 7f612e000640 1 -- 172.21.15.33:0/1164485338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f61280e5d10 con 0x7f6130109150 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.031+0000 7f6127e00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 0x7f61140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.031+0000 7f613a3dc740 1 -- 172.21.15.33:0/3364266418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 msgr2=0x5593bb4d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.031+0000 7f613a3dc740 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f612000bd80 tx=0x7f61200107a0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 -- 172.21.15.33:0/3364266418 shutdown_connections 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d2360 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 --2- 172.21.15.33:0/3364266418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 -- 172.21.15.33:0/3364266418 >> 172.21.15.33:0/3364266418 conn(0x5593bb4c3e20 msgr2=0x5593bb4c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f6127e00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 0x7f61140b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6130107500 tx=0x7f611803f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.032+0000 7f613a3dc740 1 -- 172.21.15.33:0/3364266418 shutdown_connections 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.033+0000 7f613a3dc740 1 -- 172.21.15.33:0/3364266418 wait complete. 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.033+0000 7f613a3dc740 1 -- start start 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.033+0000 7f613a3dc740 1 Processor -- start 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5593bb28dbb0 con 0x5593bb4c6910 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5593bb3c76c0 con 0x5593bb4c5ff0 2024-09-11T00:09:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593bb4d5550 con 0x5593bb4d28a0 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f613a3dc740 10 client.0 _ll_register_callbacks cb 0x5593bb3e2490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53376/0 (socket says 172.21.15.33:53376) 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 -- 172.21.15.33:0/979261922 learned_addr learned my addr 172.21.15.33:0/979261922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6135a00640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6135000640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 -- 172.21.15.33:0/979261922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 msgr2=0x5593bb4d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 -- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 msgr2=0x5593bb4cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.034+0000 7f6127e00640 1 -- 172.21.15.33:0/979261922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593bb18ab00 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f6127e00640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f61180057c0 tx=0x7f61180058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8b25c5e08ea0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f611ea00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118043030 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6120004c30 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f61180035f0 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f611805d050 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f613a3dc740 10 client.16800 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.035+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5593bb201960 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6120004c30 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f61180546a0 con 0x5593bb4c6910 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 10 client.16800 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 10 client.16800 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:09:16.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 20 client.16800 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb4e23f0 0x5593bb4e4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 4 client.16800 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.036+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593bb43f1e0 con 0x5593bb4e23f0 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.037+0000 7f6135000640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb4e23f0 0x5593bb4e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.037+0000 7f6135000640 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb4e23f0 0x5593bb4e4840 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ebb1b14611fba8 server_cookie=e22fb16049911fe5 in_seq=0 out_seq=0 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.037+0000 7f611ea00640 10 client.16800 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.038+0000 7f611ea00640 1 -- 172.21.15.33:0/979261922 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593bb43f1e0 con 0x5593bb4e23f0 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.038+0000 7f611ea00640 10 client.16800 handle_command_reply: tid=0 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 client.16800 shutdown 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 msgr2=0x5593bb4cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f61180057c0 tx=0x7f61180058d0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 shutdown_connections 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb4e23f0 0x5593bb4e4840 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4cfdf0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 --2- 172.21.15.33:0/979261922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f611ea00640 0 client.16800 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 >> 172.21.15.33:0/979261922 conn(0x5593bb4c3e20 msgr2=0x5593bb4c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 shutdown_connections 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 1 -- 172.21.15.33:0/979261922 wait complete. 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.039+0000 7f613a3dc740 20 client.16800 trim_cache size 0 max 16384 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 Processor -- start 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 -- start start 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b8850 con 0x5593bb4c6910 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b6120 con 0x5593bb4c5ff0 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.057+0000 7f613a3dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b3f70 con 0x5593bb4d28a0 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53382/0 (socket says 172.21.15.33:53382) 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 -- 172.21.15.33:0/2475653943 learned_addr learned my addr 172.21.15.33:0/2475653943 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6135000640 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6135a00640 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 -- 172.21.15.33:0/2475653943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 msgr2=0x5593bb4d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 -- 172.21.15.33:0/2475653943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 msgr2=0x5593bb4ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.058+0000 7f6127e00640 1 -- 172.21.15.33:0/2475653943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593bb4ce810 con 0x5593bb4c6910 2024-09-11T00:09:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f6127e00640 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f611802a910 tx=0x7f6118009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c305d4425c2552 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f6125600640 1 -- 172.21.15.33:0/2475653943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118066070 con 0x5593bb4c6910 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f6125600640 1 -- 172.21.15.33:0/2475653943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6118045070 con 0x5593bb4c6910 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f6125600640 1 -- 172.21.15.33:0/2475653943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118035040 con 0x5593bb4c6910 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f613a3dc740 1 -- 172.21.15.33:0/2475653943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 msgr2=0x5593bb4ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f613a3dc740 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f611802a910 tx=0x7f6118009230 comp rx=0 tx=0).stop 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.059+0000 7f613a3dc740 1 -- 172.21.15.33:0/2475653943 shutdown_connections 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4d28a0 0x5593bb4d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4ea690 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 --2- 172.21.15.33:0/2475653943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4c5ff0 0x5593bb4ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 -- 172.21.15.33:0/2475653943 >> 172.21.15.33:0/2475653943 conn(0x5593bb4c3e20 msgr2=0x5593bb4cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 -- 172.21.15.33:0/2475653943 shutdown_connections 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 -- 172.21.15.33:0/2475653943 wait complete. 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 -- start start 2024-09-11T00:09:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.060+0000 7f613a3dc740 1 Processor -- start 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b45e0 con 0x5593bb4c6910 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b5a50 con 0x5593bb4d28a0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f61301b4cb0 con 0x5593bb4c5ff0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f613a3dc740 10 client.0 _ll_register_callbacks cb 0x7f6118031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6127e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53392/0 (socket says 172.21.15.33:53392) 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6127e00640 1 -- 172.21.15.33:0/4197647995 learned_addr learned my addr 172.21.15.33:0/4197647995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6135000640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6135a00640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6127e00640 1 -- 172.21.15.33:0/4197647995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 msgr2=0x5593bb4d57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.061+0000 7f6127e00640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4d57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f6127e00640 1 -- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 msgr2=0x5593bb4d6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f6127e00640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f6127e00640 1 -- 172.21.15.33:0/4197647995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593bb4c6740 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f6127e00640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61180057c0 tx=0x7f61180098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baaccabc61d46e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f611ea00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6118066070 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6118003d00 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6118045070 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.062+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6118072050 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 10 client.16806 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5593bb550570 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6118045070 con 0x5593bb4c6910 2024-09-11T00:09:16.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f611804a910 con 0x5593bb4c6910 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 10 client.16806 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 10 client.16806 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 20 client.16806 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb550c30 0x5593bb553050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 4 client.16806 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a3573d5d", "release": true, "await": true}] 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a3573d5d", "release": true, "await": true}) -- 0x5593bb43ac90 con 0x5593bb550c30 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.063+0000 7f6135000640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb550c30 0x5593bb553050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.064+0000 7f6135000640 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb550c30 0x5593bb553050 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af16f98b5e59459d server_cookie=d6f654cab09bd0ab in_seq=0 out_seq=0 2024-09-11T00:09:16.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.064+0000 7f611ea00640 10 client.16806 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:16.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.114+0000 7f611ea00640 1 -- 172.21.15.33:0/4197647995 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5593bb43ac90 con 0x5593bb550c30 2024-09-11T00:09:16.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.114+0000 7f611ea00640 10 client.16806 handle_command_reply: tid=0 2024-09-11T00:09:16.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.114+0000 7f613a3dc740 1 client.16806 shutdown 2024-09-11T00:09:16.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.114+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 msgr2=0x5593bb4d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.114+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61180057c0 tx=0x7f61180098c0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 shutdown_connections 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593bb4d28a0 0x5593bb4d6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5593bb4c6910 0x5593bb4d5ce0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5593bb550c30 0x5593bb553050 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 --2- 172.21.15.33:0/4197647995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593bb4c5ff0 0x5593bb4d57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 >> 172.21.15.33:0/4197647995 conn(0x5593bb4c3e20 msgr2=0x5593bb4c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f611ea00640 0 client.16806 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 shutdown_connections 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 1 -- 172.21.15.33:0/4197647995 wait complete. 2024-09-11T00:09:16.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.115+0000 7f613a3dc740 20 client.16806 trim_cache size 0 max 16384 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 40, 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "a3573d5d": { 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 40, 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:09:16.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.4, 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:09:16.120 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 msgr2=0x7f61140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 0x7f61140b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6130107500 tx=0x7f611803f040 comp rx=0 tx=0).stop 2024-09-11T00:09:16.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 msgr2=0x7f6130075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f612800eaa0 tx=0x7f612800ef60 comp rx=0 tx=0).stop 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 shutdown_connections 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f61140b52e0 0x7f61140b77a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6130109150 0x7f6130075ad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61301087d0 0x7f61300754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.116+0000 7f6137a00640 1 --2- 172.21.15.33:0/1164485338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6130102dc0 0x7f6130076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.117+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 >> 172.21.15.33:0/1164485338 conn(0x7f61300fe830 msgr2=0x7f6130100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.117+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 shutdown_connections 2024-09-11T00:09:16.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:09:16.117+0000 7f6137a00640 1 -- 172.21.15.33:0/1164485338 wait complete. 2024-09-11T00:09:16.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:16 smithi033 ceph-mon[30593]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-11T00:09:16.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:16 smithi052 ceph-mon[33526]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-11T00:09:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:16 smithi189 ceph-mon[34000]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-11T00:09:17.135 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a3573d5d', total seconds elapsed: 30.0 2024-09-11T00:09:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 570.0 s, 360.3 tps, lat 1361.091 ms stddev 5103.038 2024-09-11T00:09:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:18 smithi052 ceph-mon[33526]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 375 KiB/s wr, 43 op/s 2024-09-11T00:09:18.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:18 smithi033 ceph-mon[30593]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 375 KiB/s wr, 43 op/s 2024-09-11T00:09:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:18 smithi189 ceph-mon[34000]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 375 KiB/s wr, 43 op/s 2024-09-11T00:09:20.708 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:20 smithi052 ceph-mon[33526]: pgmap v813: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-11T00:09:20.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:20 smithi033 ceph-mon[30593]: pgmap v813: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-11T00:09:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:20 smithi189 ceph-mon[34000]: pgmap v813: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-11T00:09:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:22 smithi052 ceph-mon[33526]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-11T00:09:22.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:22 smithi033 ceph-mon[30593]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-11T00:09:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:22 smithi189 ceph-mon[34000]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2024-09-11T00:09:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 575.0 s, 642.8 tps, lat 155.679 ms stddev 207.747 2024-09-11T00:09:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 -- 172.21.15.33:0/4123747731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 msgr2=0x7fd838111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 --2- 172.21.15.33:0/4123747731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd838111850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd8300076d0 tx=0x7fd83002b350 comp rx=0 tx=0).stop 2024-09-11T00:09:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 -- 172.21.15.33:0/4123747731 shutdown_connections 2024-09-11T00:09:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 --2- 172.21.15.33:0/4123747731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd838111850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 --2- 172.21.15.33:0/4123747731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd83810a510 0x7fd83810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 --2- 172.21.15.33:0/4123747731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8380745d0 0x7fd8380749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.368+0000 7fd83f800640 1 -- 172.21.15.33:0/4123747731 >> 172.21.15.33:0/4123747731 conn(0x7fd83806fe80 msgr2=0x7fd8380722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.369+0000 7fd83f800640 1 -- 172.21.15.33:0/4123747731 shutdown_connections 2024-09-11T00:09:23.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.369+0000 7fd83f800640 1 -- 172.21.15.33:0/4123747731 wait complete. 2024-09-11T00:09:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.370+0000 7fd83f800640 1 Processor -- start 2024-09-11T00:09:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.370+0000 7fd83f800640 1 -- start start 2024-09-11T00:09:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.371+0000 7fd83f800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8380745d0 0x7fd83810bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.371+0000 7fd83f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83810a510 0x7fd83810c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.371+0000 7fd83f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83f800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd838116cd0 con 0x7fd8380745d0 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd838116b50 con 0x7fd83810aed0 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd838116e50 con 0x7fd83810a510 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37088/0 (socket says 172.21.15.33:37088) 2024-09-11T00:09:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83d800640 1 -- 172.21.15.33:0/3530581134 learned_addr learned my addr 172.21.15.33:0/3530581134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd83ce00640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8380745d0 0x7fd83810bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.372+0000 7fd837e00640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83810a510 0x7fd83810c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 -- 172.21.15.33:0/3530581134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83810a510 msgr2=0x7fd83810c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83810a510 0x7fd83810c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 -- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8380745d0 msgr2=0x7fd83810bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8380745d0 0x7fd83810bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 -- 172.21.15.33:0/3530581134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83810d760 con 0x7fd83810aed0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.373+0000 7fd83d800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd83002b870 tx=0x7fd830007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.374+0000 7fd835600640 1 -- 172.21.15.33:0/3530581134 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830042070 con 0x7fd83810aed0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.374+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83810d9f0 con 0x7fd83810aed0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.374+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83810e0f0 con 0x7fd83810aed0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.374+0000 7fd835600640 1 -- 172.21.15.33:0/3530581134 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8300338e0 con 0x7fd83810aed0 2024-09-11T00:09:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.375+0000 7fd835600640 1 -- 172.21.15.33:0/3530581134 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830042070 con 0x7fd83810aed0 2024-09-11T00:09:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.381+0000 7fd842885740 1 Processor -- start 2024-09-11T00:09:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.381+0000 7fd835600640 1 -- 172.21.15.33:0/3530581134 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd83003c030 con 0x7fd83810aed0 2024-09-11T00:09:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 -- start start 2024-09-11T00:09:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c50bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 0x564c3c50e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c510fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c3c47c6b0 con 0x564c3c50c0c0 2024-09-11T00:09:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c3c46bae0 con 0x564c3c50eb00 2024-09-11T00:09:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.382+0000 7fd842885740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c3c46f8f0 con 0x564c3c509790 2024-09-11T00:09:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.383+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c50bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.383+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c50bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33310/0 (socket says 172.21.15.33:33310) 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.383+0000 7fd837e00640 1 -- 172.21.15.33:0/1108201937 learned_addr learned my addr 172.21.15.33:0/1108201937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.383+0000 7fd837e00640 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c510fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.384+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 0x564c3c50e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd835600640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 0x7fd8200b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd83ce00640 1 -- 172.21.15.33:0/1108201937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 msgr2=0x564c3c50bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c50bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd83ce00640 1 -- 172.21.15.33:0/1108201937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 msgr2=0x564c3c510fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c510fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd83ce00640 1 -- 172.21.15.33:0/1108201937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3c438780 con 0x564c3c50c0c0 2024-09-11T00:09:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.385+0000 7fd835600640 1 -- 172.21.15.33:0/3530581134 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd830105090 con 0x7fd83810aed0 2024-09-11T00:09:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.386+0000 7fd83d800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 0x7fd8200b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.387+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 0x564c3c50e4b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009b10 tx=0x7fd82c010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c37f28bc978897 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.388+0000 7fd83d800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 0x7fd8200b7a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8300c8720 tx=0x7fd830005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.388+0000 7fd82a000640 1 -- 172.21.15.33:0/1108201937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c010d70 con 0x564c3c50c0c0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.388+0000 7fd82a000640 1 -- 172.21.15.33:0/1108201937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82c02a880 con 0x564c3c50c0c0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.388+0000 7fd82a000640 1 -- 172.21.15.33:0/1108201937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0226b0 con 0x564c3c50c0c0 2024-09-11T00:09:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.389+0000 7fd842885740 1 -- 172.21.15.33:0/1108201937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 msgr2=0x564c3c50e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.389+0000 7fd842885740 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 0x564c3c50e4b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009b10 tx=0x7fd82c010370 comp rx=0 tx=0).stop 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.390+0000 7fd842885740 1 -- 172.21.15.33:0/1108201937 shutdown_connections 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.390+0000 7fd842885740 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c510fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.390+0000 7fd842885740 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50c0c0 0x564c3c50e4b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.390+0000 7fd842885740 1 --2- 172.21.15.33:0/1108201937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c50bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.390+0000 7fd842885740 1 -- 172.21.15.33:0/1108201937 >> 172.21.15.33:0/1108201937 conn(0x564c3c5048e0 msgr2=0x564c3c505670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.392+0000 7fd842885740 1 -- 172.21.15.33:0/1108201937 shutdown_connections 2024-09-11T00:09:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.394+0000 7fd842885740 1 -- 172.21.15.33:0/1108201937 wait complete. 2024-09-11T00:09:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.395+0000 7fd842885740 1 -- start start 2024-09-11T00:09:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.395+0000 7fd842885740 1 Processor -- start 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c5130a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c513740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 0x564c3c514770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c3c3a3ab0 con 0x564c3c5142f0 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c3c412570 con 0x564c3c50eb00 2024-09-11T00:09:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c3c511ae0 con 0x564c3c509790 2024-09-11T00:09:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.396+0000 7fd842885740 10 client.0 _ll_register_callbacks cb 0x564c3c421100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.397+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c5130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.397+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c5130a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33326/0 (socket says 172.21.15.33:33326) 2024-09-11T00:09:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.397+0000 7fd837e00640 1 -- 172.21.15.33:0/1854560471 learned_addr learned my addr 172.21.15.33:0/1854560471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.397+0000 7fd837e00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 0x564c3c514770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.397+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c513740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.398+0000 7fd83ce00640 1 -- 172.21.15.33:0/1854560471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 msgr2=0x564c3c5130a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.398+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c5130a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.398+0000 7fd83ce00640 1 -- 172.21.15.33:0/1854560471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 msgr2=0x564c3c514770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.399+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 0x564c3c514770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.399+0000 7fd83ce00640 1 -- 172.21.15.33:0/1854560471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3c1cd790 con 0x564c3c50eb00 2024-09-11T00:09:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.399+0000 7fd837e00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 0x564c3c514770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.400+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c513740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00d000 tx=0x7fd82c02a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac263a5d52f6f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.400+0000 7fd81ea00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:09:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.400+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c038070 con 0x564c3c50eb00 2024-09-11T00:09:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.400+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd82c005040 con 0x564c3c50eb00 2024-09-11T00:09:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.400+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c02a880 con 0x564c3c50eb00 2024-09-11T00:09:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.401+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd82c005240 con 0x564c3c50eb00 2024-09-11T00:09:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.401+0000 7fd842885740 10 client.36635 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.401+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564c3c246620 con 0x564c3c50eb00 2024-09-11T00:09:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82c02a880 con 0x564c3c50eb00 2024-09-11T00:09:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd82c00f040 con 0x564c3c50eb00 2024-09-11T00:09:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 10 client.36635 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 10 client.36635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 20 client.36635 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c51eb10 0x564c3c520f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 4 client.36635 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.402+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c3c47e600 con 0x564c3c51eb10 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.403+0000 7fd837e00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c51eb10 0x564c3c520f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.403+0000 7fd837e00640 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c51eb10 0x564c3c520f00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d020e89d0238ab server_cookie=fae6da5a287b4129 in_seq=0 out_seq=0 2024-09-11T00:09:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.403+0000 7fd81ea00640 10 client.36635 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.404+0000 7fd81ea00640 1 -- 172.21.15.33:0/1854560471 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c3c47e600 con 0x564c3c51eb10 2024-09-11T00:09:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.404+0000 7fd81ea00640 10 client.36635 handle_command_reply: tid=0 2024-09-11T00:09:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.404+0000 7fd842885740 1 client.36635 shutdown 2024-09-11T00:09:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.405+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 msgr2=0x564c3c513740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.405+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c513740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00d000 tx=0x7fd82c02a620 comp rx=0 tx=0).stop 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.405+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 shutdown_connections 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.405+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c5142f0 0x564c3c514770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.406+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c50eb00 0x564c3c513740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.406+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c51eb10 0x564c3c520f00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.406+0000 7fd842885740 1 --2- 172.21.15.33:0/1854560471 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c5130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.406+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 >> 172.21.15.33:0/1854560471 conn(0x564c3c5048e0 msgr2=0x564c3c503a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.406+0000 7fd81ea00640 0 client.36635 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.407+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 shutdown_connections 2024-09-11T00:09:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.407+0000 7fd842885740 1 -- 172.21.15.33:0/1854560471 wait complete. 2024-09-11T00:09:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.408+0000 7fd842885740 20 client.36635 trim_cache size 0 max 16384 2024-09-11T00:09:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 Processor -- start 2024-09-11T00:09:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 -- start start 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 0x564c3c51b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c50eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd818012490 con 0x564c3c50eb00 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800fd60 con 0x564c3c5142f0 2024-09-11T00:09:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.437+0000 7fd842885740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800dbb0 con 0x564c3c509790 2024-09-11T00:09:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.438+0000 7fd83ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 0x564c3c51b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.438+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.438+0000 7fd837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33330/0 (socket says 172.21.15.33:33330) 2024-09-11T00:09:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.438+0000 7fd837e00640 1 -- 172.21.15.33:0/949404598 learned_addr learned my addr 172.21.15.33:0/949404598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.438+0000 7fd837e00640 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c50eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 -- 172.21.15.33:0/949404598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 msgr2=0x564c3c520b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 -- 172.21.15.33:0/949404598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 msgr2=0x564c3c50eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c50eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 -- 172.21.15.33:0/949404598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3c508a50 con 0x564c3c50eb00 2024-09-11T00:09:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd837e00640 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.440+0000 7fd83ce00640 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 0x564c3c51b070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000c00 tx=0x7fd82c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d400e0703b1ddbf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.441+0000 7fd829600640 1 -- 172.21.15.33:0/949404598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c038040 con 0x564c3c50eb00 2024-09-11T00:09:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.441+0000 7fd829600640 1 -- 172.21.15.33:0/949404598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82c004f20 con 0x564c3c50eb00 2024-09-11T00:09:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.441+0000 7fd829600640 1 -- 172.21.15.33:0/949404598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c011210 con 0x564c3c50eb00 2024-09-11T00:09:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 -- 172.21.15.33:0/949404598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 msgr2=0x564c3c51b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 0x564c3c51b070 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000c00 tx=0x7fd82c009370 comp rx=0 tx=0).stop 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 -- 172.21.15.33:0/949404598 shutdown_connections 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c50eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c50eb00 0x564c3c51b070 secure :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000c00 tx=0x7fd82c009370 comp rx=0 tx=0).stop 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 --2- 172.21.15.33:0/949404598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c520b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 -- 172.21.15.33:0/949404598 >> 172.21.15.33:0/949404598 conn(0x564c3c5048e0 msgr2=0x564c3c5052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.442+0000 7fd842885740 1 -- 172.21.15.33:0/949404598 shutdown_connections 2024-09-11T00:09:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.443+0000 7fd842885740 1 -- 172.21.15.33:0/949404598 wait complete. 2024-09-11T00:09:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.443+0000 7fd842885740 1 -- start start 2024-09-11T00:09:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.443+0000 7fd842885740 1 Processor -- start 2024-09-11T00:09:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.445+0000 7fd842885740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c51a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.445+0000 7fd842885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c51aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.445+0000 7fd842885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c519550 0x564c3c5199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.445+0000 7fd83ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c51aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd83ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c51aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37124/0 (socket says 172.21.15.33:37124) 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd842885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800e220 con 0x564c3c519550 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd83ce00640 1 -- 172.21.15.33:0/1430798903 learned_addr learned my addr 172.21.15.33:0/1430798903 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800f690 con 0x564c3c5142f0 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800e8f0 con 0x564c3c509790 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c51a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd842885740 10 client.0 _ll_register_callbacks cb 0x7fd82c009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 -- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 msgr2=0x564c3c51aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c51aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 -- 172.21.15.33:0/1430798903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c519550 msgr2=0x564c3c5199d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c519550 0x564c3c5199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.446+0000 7fd837e00640 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3c51a200 con 0x564c3c509790 2024-09-11T00:09:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.447+0000 7fd837e00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c51a850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd82400bb00 tx=0x7fd82400bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f3ed1cb6d848b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.447+0000 7fd81ea00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:09:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.447+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82402f060 con 0x564c3c509790 2024-09-11T00:09:23.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.447+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd8240039c0 con 0x564c3c509790 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.448+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c004f20 con 0x564c3c509790 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.449+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd824003bc0 con 0x564c3c509790 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.449+0000 7fd842885740 10 client.26608 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.449+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564c3c58ba30 con 0x564c3c509790 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.449+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd82c004f20 con 0x564c3c509790 2024-09-11T00:09:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.449+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd824027040 con 0x564c3c509790 2024-09-11T00:09:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 10 client.26608 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 10 client.26608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 20 client.26608 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c58c340 0x564c3c58e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 4 client.26608 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:09:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.450+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564c3c47a0b0 con 0x564c3c58c340 2024-09-11T00:09:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.451+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c58c340 0x564c3c58e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.452+0000 7fd83ce00640 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c58c340 0x564c3c58e760 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aafff647e906c568 server_cookie=e09cc7fe27ac81f4 in_seq=0 out_seq=0 2024-09-11T00:09:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.452+0000 7fd81ea00640 10 client.26608 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.507+0000 7fd81ea00640 1 -- 172.21.15.33:0/1430798903 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564c3c47a0b0 con 0x564c3c58c340 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.507+0000 7fd81ea00640 10 client.26608 handle_command_reply: tid=0 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.507+0000 7fd842885740 1 client.26608 shutdown 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 msgr2=0x564c3c51a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c51a850 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd82400bb00 tx=0x7fd82400bde0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 shutdown_connections 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c3c519550 0x564c3c5199d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c3c5142f0 0x564c3c51aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x564c3c58c340 0x564c3c58e760 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 --2- 172.21.15.33:0/1430798903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3c509790 0x564c3c51a850 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 >> 172.21.15.33:0/1430798903 conn(0x564c3c5048e0 msgr2=0x564c3c50eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.508+0000 7fd81ea00640 0 client.26608 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.509+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 shutdown_connections 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.509+0000 7fd842885740 1 -- 172.21.15.33:0/1430798903 wait complete. 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.510+0000 7fd842885740 20 client.26608 trim_cache size 0 max 16384 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:09:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:09:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 msgr2=0x7fd8200b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 0x7fd8200b7a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8300c8720 tx=0x7fd830005f70 comp rx=0 tx=0).stop 2024-09-11T00:09:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 msgr2=0x7fd83810cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd83002b870 tx=0x7fd830007c80 comp rx=0 tx=0).stop 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 shutdown_connections 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd8200b5560 0x7fd8200b7a20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83810aed0 0x7fd83810cea0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83810a510 0x7fd83810c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 --2- 172.21.15.33:0/3530581134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8380745d0 0x7fd83810bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.512+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 >> 172.21.15.33:0/3530581134 conn(0x7fd83806fe80 msgr2=0x7fd83810fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.513+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 shutdown_connections 2024-09-11T00:09:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:23.513+0000 7fd83f800640 1 -- 172.21.15.33:0/3530581134 wait complete. 2024-09-11T00:09:24.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:24 smithi052 ceph-mon[33526]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-11T00:09:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:24 smithi033 ceph-mon[30593]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-11T00:09:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:24 smithi189 ceph-mon[34000]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-11T00:09:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:26 smithi052 ceph-mon[33526]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 MiB/s wr, 352 op/s 2024-09-11T00:09:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:26 smithi033 ceph-mon[30593]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 MiB/s wr, 352 op/s 2024-09-11T00:09:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:26 smithi189 ceph-mon[34000]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.5 MiB/s wr, 352 op/s 2024-09-11T00:09:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 580.0 s, 576.4 tps, lat 174.097 ms stddev 226.077 2024-09-11T00:09:28.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:28 smithi052 ceph-mon[33526]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 MiB/s wr, 486 op/s 2024-09-11T00:09:28.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:28 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:28.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:28 smithi033 ceph-mon[30593]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 MiB/s wr, 486 op/s 2024-09-11T00:09:28.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:28 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:28 smithi189 ceph-mon[34000]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 MiB/s wr, 486 op/s 2024-09-11T00:09:28.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:28 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:29.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:29.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:29.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:09:29.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:29.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:29.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:09:29.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:29.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:29.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:09:30.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:30 smithi052 ceph-mon[33526]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.3 MiB/s wr, 568 op/s 2024-09-11T00:09:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:30 smithi033 ceph-mon[30593]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.3 MiB/s wr, 568 op/s 2024-09-11T00:09:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:30 smithi189 ceph-mon[34000]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.3 MiB/s wr, 568 op/s 2024-09-11T00:09:32.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:32 smithi052 ceph-mon[33526]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 622 op/s 2024-09-11T00:09:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:32 smithi033 ceph-mon[30593]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 622 op/s 2024-09-11T00:09:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:32 smithi189 ceph-mon[34000]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 622 op/s 2024-09-11T00:09:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 585.0 s, 609.8 tps, lat 163.010 ms stddev 53.587 2024-09-11T00:09:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:34 smithi052 ceph-mon[33526]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-09-11T00:09:34.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:34 smithi033 ceph-mon[30593]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-09-11T00:09:34.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:34 smithi189 ceph-mon[34000]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-09-11T00:09:36.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:36 smithi052 ceph-mon[33526]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.9 MiB/s wr, 516 op/s 2024-09-11T00:09:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:36 smithi033 ceph-mon[30593]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.9 MiB/s wr, 516 op/s 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 -- 172.21.15.33:0/2485794156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1064e0 msgr2=0x7f776c10ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 --2- 172.21.15.33:0/2485794156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1064e0 0x7f776c10ce60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f775c009c10 tx=0x7f775c02a6f0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 -- 172.21.15.33:0/2485794156 shutdown_connections 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 --2- 172.21.15.33:0/2485794156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1064e0 0x7f776c10ce60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 --2- 172.21.15.33:0/2485794156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 --2- 172.21.15.33:0/2485794156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1049d0 0x7f776c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 -- 172.21.15.33:0/2485794156 >> 172.21.15.33:0/2485794156 conn(0x7f776c100270 msgr2=0x7f776c1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 -- 172.21.15.33:0/2485794156 shutdown_connections 2024-09-11T00:09:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.826+0000 7f7772600640 1 -- 172.21.15.33:0/2485794156 wait complete. 2024-09-11T00:09:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.828+0000 7f7772600640 1 Processor -- start 2024-09-11T00:09:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.828+0000 7f7772600640 1 -- start start 2024-09-11T00:09:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.828+0000 7f7772600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 0x7f776c19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7772600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7771200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 0x7f776c19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7772600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1064e0 0x7f776c19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7772600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1104d0 con 0x7f776c105b20 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7771200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 0x7f776c19acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38982/0 (socket says 172.21.15.33:38982) 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7771200640 1 -- 172.21.15.33:0/3958353844 learned_addr learned my addr 172.21.15.33:0/3958353844 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f776be00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f776c110350 con 0x7f776c1064e0 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f776c110650 con 0x7f776c1049d0 2024-09-11T00:09:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.829+0000 7f7771c00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1064e0 0x7f776c19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 -- 172.21.15.33:0/3958353844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 msgr2=0x7f776c19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 0x7f776c19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 -- 172.21.15.33:0/3958353844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1064e0 msgr2=0x7f776c19bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1064e0 0x7f776c19bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 -- 172.21.15.33:0/3958353844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c19c7f0 con 0x7f776c105b20 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.830+0000 7f776be00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c19b300 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7758005fd0 tx=0x7f775800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.831+0000 7f7769600640 1 -- 172.21.15.33:0/3958353844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775800cd00 con 0x7f776c105b20 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.831+0000 7f7769600640 1 -- 172.21.15.33:0/3958353844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77580035f0 con 0x7f776c105b20 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.831+0000 7f7769600640 1 -- 172.21.15.33:0/3958353844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758010690 con 0x7f776c105b20 2024-09-11T00:09:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.831+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c19cae0 con 0x7f776c105b20 2024-09-11T00:09:36.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:36 smithi189 ceph-mon[34000]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.9 MiB/s wr, 516 op/s 2024-09-11T00:09:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.831+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c1a31b0 con 0x7f776c105b20 2024-09-11T00:09:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.835+0000 7f7776bf6740 1 Processor -- start 2024-09-11T00:09:36.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.835+0000 7f7776bf6740 1 -- start start 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6bab0 0x55ab92b6dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6e4f0 0x55ab92b709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ab92ad36b0 con 0x55ab92b6e4f0 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab92ac2ae0 con 0x55ab92b69180 2024-09-11T00:09:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7776bf6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ab92ac68f0 con 0x55ab92b6bab0 2024-09-11T00:09:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7771c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7771200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6bab0 0x55ab92b6dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7771c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34054/0 (socket says 172.21.15.33:34054) 2024-09-11T00:09:36.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.836+0000 7f7771c00640 1 -- 172.21.15.33:0/1447969848 learned_addr learned my addr 172.21.15.33:0/1447969848 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 -- 172.21.15.33:0/1447969848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6bab0 msgr2=0x55ab92b6dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6bab0 0x55ab92b6dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 -- 172.21.15.33:0/1447969848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6e4f0 msgr2=0x55ab92b709b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6e4f0 0x55ab92b709b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 -- 172.21.15.33:0/1447969848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92a8f780 con 0x55ab92b69180 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.837+0000 7f7771c00640 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f775c006010 tx=0x7f775c030ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91bbf99d51139dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.838+0000 7f7762000640 1 -- 172.21.15.33:0/1447969848 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c040030 con 0x55ab92b69180 2024-09-11T00:09:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.838+0000 7f7762000640 1 -- 172.21.15.33:0/1447969848 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c037040 con 0x55ab92b69180 2024-09-11T00:09:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.838+0000 7f7762000640 1 -- 172.21.15.33:0/1447969848 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c036070 con 0x55ab92b69180 2024-09-11T00:09:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.838+0000 7f7769600640 1 -- 172.21.15.33:0/3958353844 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7758003a80 con 0x7f776c105b20 2024-09-11T00:09:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.839+0000 7f7776bf6740 1 -- 172.21.15.33:0/1447969848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 msgr2=0x55ab92b6b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.839+0000 7f7776bf6740 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f775c006010 tx=0x7f775c030ff0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.840+0000 7f7776bf6740 1 -- 172.21.15.33:0/1447969848 shutdown_connections 2024-09-11T00:09:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.840+0000 7f7776bf6740 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6e4f0 0x55ab92b709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.840+0000 7f7776bf6740 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6bab0 0x55ab92b6dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.840+0000 7f7776bf6740 1 --2- 172.21.15.33:0/1447969848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b6b570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.840+0000 7f7776bf6740 1 -- 172.21.15.33:0/1447969848 >> 172.21.15.33:0/1447969848 conn(0x55ab92b642d0 msgr2=0x55ab92b65060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.841+0000 7f7776bf6740 1 -- 172.21.15.33:0/1447969848 shutdown_connections 2024-09-11T00:09:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.841+0000 7f7776bf6740 1 -- 172.21.15.33:0/1447969848 wait complete. 2024-09-11T00:09:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.841+0000 7f7769600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 0x7f77500b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.841+0000 7f7776bf6740 1 -- start start 2024-09-11T00:09:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.842+0000 7f7769600640 1 -- 172.21.15.33:0/3958353844 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f77580e6290 con 0x7f776c105b20 2024-09-11T00:09:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.842+0000 7f7776bf6740 1 Processor -- start 2024-09-11T00:09:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.842+0000 7f7771c00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 0x7f77500b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7771c00640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 0x7f77500b77b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f775c003b70 tx=0x7f775c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b72920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b73bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ab929faab0 con 0x55ab92b69180 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab92a69570 con 0x55ab92b6bab0 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.844+0000 7f7776bf6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ab92b71470 con 0x55ab92b6e4f0 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34064/0 (socket says 172.21.15.33:34064) 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 -- 172.21.15.33:0/4232003231 learned_addr learned my addr 172.21.15.33:0/4232003231 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f7771200640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b72920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 -- 172.21.15.33:0/4232003231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 msgr2=0x55ab92b73bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:09:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f7776bf6740 10 client.0 _ll_register_callbacks cb 0x55ab92a78100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b73bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 -- 172.21.15.33:0/4232003231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 msgr2=0x55ab92b72920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b72920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f776be00640 1 -- 172.21.15.33:0/4232003231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab92824790 con 0x55ab92b6bab0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.845+0000 7f7771200640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b72920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c037040 con 0x55ab92b6bab0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f776be00640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77580a8c20 tx=0x7f77580abeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36c8155038f3a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7756a00640 10 client.36653 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7756a00640 1 -- 172.21.15.33:0/4232003231 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580acd50 con 0x55ab92b6bab0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7756a00640 1 -- 172.21.15.33:0/4232003231 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f77580e3aa0 con 0x55ab92b6bab0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7756a00640 1 -- 172.21.15.33:0/4232003231 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77580ac650 con 0x55ab92b6bab0 2024-09-11T00:09:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7776bf6740 10 client.36653 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.846+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ab9289d620 con 0x55ab92b6bab0 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7756a00640 1 -- 172.21.15.33:0/4232003231 <== mon.2 v2:172.21.15.52:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f77580ab8b0 con 0x55ab92b6bab0 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 10 client.36653 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 10 client.36653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 20 client.36653 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92b7e050 0x55ab92b80440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 4 client.36653 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.847+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab92ad5600 con 0x55ab92b7e050 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.848+0000 7f7771200640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92b7e050 0x55ab92b80440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.848+0000 7f7771200640 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92b7e050 0x55ab92b80440 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e255dadf5bdd0ee server_cookie=2f804a6f612d46c1 in_seq=0 out_seq=0 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.848+0000 7f7756a00640 10 client.36653 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.849+0000 7f7756a00640 1 -- 172.21.15.33:0/4232003231 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab92ad5600 con 0x55ab92b7e050 2024-09-11T00:09:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.849+0000 7f7756a00640 10 client.36653 handle_command_reply: tid=0 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.849+0000 7f7776bf6740 1 client.36653 shutdown 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 msgr2=0x55ab92b72fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77580a8c20 tx=0x7f77580abeb0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 shutdown_connections 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92b7e050 0x55ab92b80440 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b73bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b72fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 --2- 172.21.15.33:0/4232003231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b72920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7756a00640 0 client.36653 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 >> 172.21.15.33:0/4232003231 conn(0x55ab92b642d0 msgr2=0x55ab92b5abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 shutdown_connections 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 1 -- 172.21.15.33:0/4232003231 wait complete. 2024-09-11T00:09:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.850+0000 7f7776bf6740 20 client.36653 trim_cache size 0 max 16384 2024-09-11T00:09:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 Processor -- start 2024-09-11T00:09:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 -- start start 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b6eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b84cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1abaf0 con 0x55ab92b69180 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1a93c0 con 0x55ab92b6bab0 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.877+0000 7f7776bf6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1a7210 con 0x55ab92b6e4f0 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f7771200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f776be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b6eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f7771200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34188/0 (socket says 172.21.15.33:34188) 2024-09-11T00:09:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f7771200640 1 -- 172.21.15.33:0/3341692432 learned_addr learned my addr 172.21.15.33:0/3341692432 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f7771c00640 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b84cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f776be00640 1 -- 172.21.15.33:0/3341692432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 msgr2=0x55ab92b84cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.878+0000 7f776be00640 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b84cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.879+0000 7f776be00640 1 -- 172.21.15.33:0/3341692432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 msgr2=0x55ab92b6e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.879+0000 7f776be00640 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.879+0000 7f776be00640 1 -- 172.21.15.33:0/3341692432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab92b807b0 con 0x55ab92b6bab0 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.879+0000 7f7771200640 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.879+0000 7f776be00640 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b6eea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77580a8bd0 tx=0x7f77580e5000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd1e5b38739add0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.880+0000 7f7761600640 1 -- 172.21.15.33:0/3341692432 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b1180 con 0x55ab92b6bab0 2024-09-11T00:09:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.880+0000 7f7761600640 1 -- 172.21.15.33:0/3341692432 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c037040 con 0x55ab92b6bab0 2024-09-11T00:09:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.880+0000 7f7761600640 1 -- 172.21.15.33:0/3341692432 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580c73f0 con 0x55ab92b6bab0 2024-09-11T00:09:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.881+0000 7f7776bf6740 1 -- 172.21.15.33:0/3341692432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 msgr2=0x55ab92b6eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.881+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b6eea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77580a8bd0 tx=0x7f77580e5000 comp rx=0 tx=0).stop 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.881+0000 7f7776bf6740 1 -- 172.21.15.33:0/3341692432 shutdown_connections 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.881+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.881+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b6bab0 0x55ab92b6eea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.882+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3341692432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b69180 0x55ab92b6e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.882+0000 7f7776bf6740 1 -- 172.21.15.33:0/3341692432 >> 172.21.15.33:0/3341692432 conn(0x55ab92b642d0 msgr2=0x55ab92b64b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.882+0000 7f7776bf6740 1 -- 172.21.15.33:0/3341692432 shutdown_connections 2024-09-11T00:09:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.882+0000 7f7776bf6740 1 -- 172.21.15.33:0/3341692432 wait complete. 2024-09-11T00:09:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.883+0000 7f7776bf6740 1 -- start start 2024-09-11T00:09:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.883+0000 7f7776bf6740 1 Processor -- start 2024-09-11T00:09:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 0x55ab92b79fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7771200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b78400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1a7880 con 0x55ab92b6bab0 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1a8cf0 con 0x55ab92b69180 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1a7f50 con 0x55ab92b6e4f0 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7776bf6740 10 client.0 _ll_register_callbacks cb 0x7f775800cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7771200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34072/0 (socket says 172.21.15.33:34072) 2024-09-11T00:09:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.884+0000 7f7771200640 1 -- 172.21.15.33:0/3679115347 learned_addr learned my addr 172.21.15.33:0/3679115347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f7771200640 1 -- 172.21.15.33:0/3679115347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 msgr2=0x55ab92b78400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f7771200640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b78400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f7771200640 1 -- 172.21.15.33:0/3679115347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 msgr2=0x55ab92b79fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f776be00640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 0x55ab92b79fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f7771200640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 0x55ab92b79fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f7771200640 1 -- 172.21.15.33:0/3679115347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab92b789f0 con 0x55ab92b69180 2024-09-11T00:09:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.885+0000 7f776be00640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 0x55ab92b79fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.886+0000 7f7771200640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55ab92b80ca0 tx=0x7f77640208f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46706cb66421dd75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.886+0000 7f7756a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:09:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.886+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764005020 con 0x55ab92b69180 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.887+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f77640051c0 con 0x55ab92b69180 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.887+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c037040 con 0x55ab92b69180 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.887+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77640053c0 con 0x55ab92b69180 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.887+0000 7f7776bf6740 10 client.36659 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.887+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ab92beb8c0 con 0x55ab92b69180 2024-09-11T00:09:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.888+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c037040 con 0x55ab92b69180 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.888+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7764004a30 con 0x55ab92b69180 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.888+0000 7f7776bf6740 10 client.36659 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.888+0000 7f7776bf6740 10 client.36659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.888+0000 7f7776bf6740 20 client.36659 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.889+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92bec2c0 0x55ab92bee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.889+0000 7f7776bf6740 4 client.36659 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.889+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab92ad10b0 con 0x55ab92bec2c0 2024-09-11T00:09:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.889+0000 7f776be00640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92bec2c0 0x55ab92bee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.890+0000 7f776be00640 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92bec2c0 0x55ab92bee6e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da538f965ea4f571 server_cookie=401290be0570593e in_seq=0 out_seq=0 2024-09-11T00:09:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.890+0000 7f7756a00640 10 client.36659 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.929+0000 7f7756a00640 1 -- 172.21.15.33:0/3679115347 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab92ad10b0 con 0x55ab92bec2c0 2024-09-11T00:09:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.929+0000 7f7756a00640 10 client.36659 handle_command_reply: tid=0 2024-09-11T00:09:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.929+0000 7f7776bf6740 1 client.36659 shutdown 2024-09-11T00:09:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.929+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 msgr2=0x55ab92b79920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.929+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55ab92b80ca0 tx=0x7f77640208f0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 shutdown_connections 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ab92bec2c0 0x55ab92bee6e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab92b6e4f0 0x55ab92b78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ab92b6bab0 0x55ab92b79fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 --2- 172.21.15.33:0/3679115347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab92b69180 0x55ab92b79920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 >> 172.21.15.33:0/3679115347 conn(0x55ab92b642d0 msgr2=0x55ab92b64b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7756a00640 0 client.36659 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 shutdown_connections 2024-09-11T00:09:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 1 -- 172.21.15.33:0/3679115347 wait complete. 2024-09-11T00:09:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.930+0000 7f7776bf6740 20 client.36659 trim_cache size 0 max 16384 2024-09-11T00:09:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:09:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:09:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:09:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 msgr2=0x7f77500b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 0x7f77500b77b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f775c003b70 tx=0x7f775c009500 comp rx=0 tx=0).stop 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 msgr2=0x7f776c19b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c19b300 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7758005fd0 tx=0x7f775800ee50 comp rx=0 tx=0).stop 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 shutdown_connections 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f77500b52f0 0x7f77500b77b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776c1064e0 0x7f776c19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776c105b20 0x7f776c19b300 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 --2- 172.21.15.33:0/3958353844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f776c1049d0 0x7f776c19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.932+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 >> 172.21.15.33:0/3958353844 conn(0x7f776c100270 msgr2=0x7f776c108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.933+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 shutdown_connections 2024-09-11T00:09:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:36.934+0000 7f7772600640 1 -- 172.21.15.33:0/3958353844 wait complete. 2024-09-11T00:09:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 590.0 s, 620.4 tps, lat 161.358 ms stddev 218.968 2024-09-11T00:09:38.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:38 smithi052 ceph-mon[33526]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 668 op/s 2024-09-11T00:09:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:38 smithi033 ceph-mon[30593]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 668 op/s 2024-09-11T00:09:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:38 smithi189 ceph-mon[34000]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 668 op/s 2024-09-11T00:09:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:40 smithi052 ceph-mon[33526]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 606 op/s 2024-09-11T00:09:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:40 smithi033 ceph-mon[30593]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 606 op/s 2024-09-11T00:09:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:40 smithi189 ceph-mon[34000]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 606 op/s 2024-09-11T00:09:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:42 smithi052 ceph-mon[33526]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.0 MiB/s wr, 593 op/s 2024-09-11T00:09:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:42 smithi033 ceph-mon[30593]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.0 MiB/s wr, 593 op/s 2024-09-11T00:09:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:42 smithi189 ceph-mon[34000]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.0 MiB/s wr, 593 op/s 2024-09-11T00:09:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 595.0 s, 558.8 tps, lat 139.057 ms stddev 41.926 2024-09-11T00:09:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:44 smithi052 ceph-mon[33526]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-11T00:09:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:44 smithi033 ceph-mon[30593]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-11T00:09:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:44 smithi189 ceph-mon[34000]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 703 op/s 2024-09-11T00:09:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:46 smithi052 ceph-mon[33526]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 572 op/s 2024-09-11T00:09:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:46 smithi033 ceph-mon[30593]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 572 op/s 2024-09-11T00:09:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:46 smithi189 ceph-mon[34000]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 572 op/s 2024-09-11T00:09:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 600.0 s, 719.8 tps, lat 169.625 ms stddev 239.955 2024-09-11T00:09:48.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:48 smithi052 ceph-mon[33526]: pgmap v827: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T00:09:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:48 smithi033 ceph-mon[30593]: pgmap v827: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T00:09:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:48 smithi189 ceph-mon[34000]: pgmap v827: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 11 MiB/s wr, 765 op/s 2024-09-11T00:09:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 -- 172.21.15.33:0/985466199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10ab10 msgr2=0x7f4b5c1136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 --2- 172.21.15.33:0/985466199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1136b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009ca0 tx=0x7f4b5402a8d0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 -- 172.21.15.33:0/985466199 shutdown_connections 2024-09-11T00:09:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 --2- 172.21.15.33:0/985466199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1136b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 --2- 172.21.15.33:0/985466199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5c10a150 0x7f4b5c10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 --2- 172.21.15.33:0/985466199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c074440 0x7f4b5c074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 -- 172.21.15.33:0/985466199 >> 172.21.15.33:0/985466199 conn(0x7f4b5c06fe80 msgr2=0x7f4b5c0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 -- 172.21.15.33:0/985466199 shutdown_connections 2024-09-11T00:09:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.206+0000 7f4b63800640 1 -- 172.21.15.33:0/985466199 wait complete. 2024-09-11T00:09:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.208+0000 7f4b63800640 1 Processor -- start 2024-09-11T00:09:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.208+0000 7f4b63800640 1 -- start start 2024-09-11T00:09:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.208+0000 7f4b63800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5c074440 0x7f4b5c1a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.208+0000 7f4b63800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.208+0000 7f4b63800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b63800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c118f10 con 0x7f4b5c10ab10 2024-09-11T00:09:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b63800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c118d90 con 0x7f4b5c074440 2024-09-11T00:09:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b63800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c119090 con 0x7f4b5c10a150 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51248/0 (socket says 172.21.15.33:51248) 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 -- 172.21.15.33:0/2259377015 learned_addr learned my addr 172.21.15.33:0/2259377015 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b61800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 -- 172.21.15.33:0/2259377015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5c074440 msgr2=0x7f4b5c1a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5c074440 0x7f4b5c1a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 -- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c10ab10 msgr2=0x7f4b5c1a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.209+0000 7f4b5be00640 1 -- 172.21.15.33:0/2259377015 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c1a5200 con 0x7f4b5c10a150 2024-09-11T00:09:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.210+0000 7f4b5be00640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800b450 tx=0x7f4b4800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.211+0000 7f4b59600640 1 -- 172.21.15.33:0/2259377015 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48015020 con 0x7f4b5c10a150 2024-09-11T00:09:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.211+0000 7f4b59600640 1 -- 172.21.15.33:0/2259377015 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b48011d20 con 0x7f4b5c10a150 2024-09-11T00:09:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.211+0000 7f4b59600640 1 -- 172.21.15.33:0/2259377015 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800f340 con 0x7f4b5c10a150 2024-09-11T00:09:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.211+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c1a54f0 con 0x7f4b5c10a150 2024-09-11T00:09:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.211+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c1abbc0 con 0x7f4b5c10a150 2024-09-11T00:09:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.215+0000 7f4b66644740 1 Processor -- start 2024-09-11T00:09:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.215+0000 7f4b66644740 1 -- start start 2024-09-11T00:09:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.216+0000 7f4b66644740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b66644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a248d0 0x5625d0a26cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b66644740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a297d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b66644740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625d098c6b0 con 0x5625d0a27310 2024-09-11T00:09:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b66644740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625d097bae0 con 0x5625d0a21fa0 2024-09-11T00:09:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b66644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625d097f8f0 con 0x5625d0a248d0 2024-09-11T00:09:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b61800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b61800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47004/0 (socket says 172.21.15.33:47004) 2024-09-11T00:09:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b61800640 1 -- 172.21.15.33:0/1867111302 learned_addr learned my addr 172.21.15.33:0/1867111302 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:50.219 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.217+0000 7f4b60e00640 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a248d0 0x5625d0a26cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.218+0000 7f4b61800640 1 -- 172.21.15.33:0/1867111302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a248d0 msgr2=0x5625d0a26cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.218+0000 7f4b61800640 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a248d0 0x5625d0a26cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.218+0000 7f4b61800640 1 -- 172.21.15.33:0/1867111302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 msgr2=0x5625d0a297d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:09:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.218+0000 7f4b61800640 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a297d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.218+0000 7f4b61800640 1 -- 172.21.15.33:0/1867111302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d0948780 con 0x5625d0a21fa0 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.219+0000 7f4b61800640 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009ca0 tx=0x7f4b54009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb75b4d7eb939bea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.219+0000 7f4b59600640 1 -- 172.21.15.33:0/2259377015 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4b48011890 con 0x7f4b5c10a150 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.219+0000 7f4b4e000640 1 -- 172.21.15.33:0/1867111302 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54031a90 con 0x5625d0a21fa0 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.219+0000 7f4b4e000640 1 -- 172.21.15.33:0/1867111302 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b54036030 con 0x5625d0a21fa0 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.219+0000 7f4b4e000640 1 -- 172.21.15.33:0/1867111302 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54004420 con 0x5625d0a21fa0 2024-09-11T00:09:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.220+0000 7f4b66644740 1 -- 172.21.15.33:0/1867111302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 msgr2=0x5625d0a24390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.222 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.220+0000 7f4b66644740 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009ca0 tx=0x7f4b54009900 comp rx=0 tx=0).stop 2024-09-11T00:09:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.221+0000 7f4b59600640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 0x7f4b440b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.221+0000 7f4b59600640 1 -- 172.21.15.33:0/2259377015 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4b480e5c50 con 0x7f4b5c10a150 2024-09-11T00:09:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.222+0000 7f4b61800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 0x7f4b440b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 -- 172.21.15.33:0/1867111302 shutdown_connections 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a297d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a248d0 0x5625d0a26cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 --2- 172.21.15.33:0/1867111302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a24390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 -- 172.21.15.33:0/1867111302 >> 172.21.15.33:0/1867111302 conn(0x5625d0a148e0 msgr2=0x5625d0a15670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b61800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 0x7f4b440b78a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009410 tx=0x7f4b54009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.223+0000 7f4b66644740 1 -- 172.21.15.33:0/1867111302 shutdown_connections 2024-09-11T00:09:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.224+0000 7f4b66644740 1 -- 172.21.15.33:0/1867111302 wait complete. 2024-09-11T00:09:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.224+0000 7f4b66644740 1 -- start start 2024-09-11T00:09:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.225+0000 7f4b66644740 1 Processor -- start 2024-09-11T00:09:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a2bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a2c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625d08b3ab0 con 0x5625d0a27310 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625d0922570 con 0x5625d0a248d0 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625d0a2a290 con 0x5625d0a21fa0 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.226+0000 7f4b66644740 10 client.0 _ll_register_callbacks cb 0x5625d0931100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51278/0 (socket says 172.21.15.33:51278) 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 -- 172.21.15.33:0/737066816 learned_addr learned my addr 172.21.15.33:0/737066816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 -- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 msgr2=0x5625d0a2bd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a2bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.227+0000 7f4b60e00640 1 -- 172.21.15.33:0/737066816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 msgr2=0x5625d0a2c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:09:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.228+0000 7f4b61800640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a2c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.228+0000 7f4b60e00640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a2c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.228+0000 7f4b60e00640 1 -- 172.21.15.33:0/737066816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d06dd790 con 0x5625d0a21fa0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b42a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b60e00640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000bdd0 tx=0x7f4b5000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516433374d2d8ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50015070 con 0x5625d0a21fa0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b54036030 con 0x5625d0a21fa0 2024-09-11T00:09:50.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4b5000fe40 con 0x5625d0a21fa0 2024-09-11T00:09:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.229+0000 7f4b61800640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a2c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.230+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b50015070 con 0x5625d0a21fa0 2024-09-11T00:09:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.230+0000 7f4b66644740 10 client.26632 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.230+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625d0756620 con 0x5625d0a21fa0 2024-09-11T00:09:50.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.230+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b54036030 con 0x5625d0a21fa0 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4b50024790 con 0x5625d0a21fa0 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 10 client.26632 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 10 client.26632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 20 client.26632 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0a36fe0 0x5625d0a39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 4 client.26632 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:09:50.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625d098e600 con 0x5625d0a36fe0 2024-09-11T00:09:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.231+0000 7f4b5be00640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0a36fe0 0x5625d0a39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.232+0000 7f4b42a00640 10 client.26632 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.232+0000 7f4b5be00640 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0a36fe0 0x5625d0a39450 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84363e4af990b5d7 server_cookie=72a7905d63515161 in_seq=0 out_seq=0 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.233+0000 7f4b42a00640 1 -- 172.21.15.33:0/737066816 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625d098e600 con 0x5625d0a36fe0 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.233+0000 7f4b42a00640 10 client.26632 handle_command_reply: tid=0 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.233+0000 7f4b66644740 1 client.26632 shutdown 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.234+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 msgr2=0x5625d0a2b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.234+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000bdd0 tx=0x7f4b5000f730 comp rx=0 tx=0).stop 2024-09-11T00:09:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.234+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 shutdown_connections 2024-09-11T00:09:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.234+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a27310 0x5625d0a2c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a2bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0a36fe0 0x5625d0a39450 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 --2- 172.21.15.33:0/737066816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b6a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 >> 172.21.15.33:0/737066816 conn(0x5625d0a148e0 msgr2=0x5625d0a13a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b42a00640 0 client.26632 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 shutdown_connections 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.235+0000 7f4b66644740 1 -- 172.21.15.33:0/737066816 wait complete. 2024-09-11T00:09:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.236+0000 7f4b66644740 20 client.26632 trim_cache size 0 max 16384 2024-09-11T00:09:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.277+0000 7f4b66644740 1 Processor -- start 2024-09-11T00:09:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 -- start start 2024-09-11T00:09:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 0x5625d0a27780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1b44f0 con 0x5625d0a248d0 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1b1dc0 con 0x5625d0a21fa0 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b66644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1afbb0 con 0x5625d0a27310 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b61800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b61800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51288/0 (socket says 172.21.15.33:51288) 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.278+0000 7f4b61800640 1 -- 172.21.15.33:0/4058233694 learned_addr learned my addr 172.21.15.33:0/4058233694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b61800640 1 -- 172.21.15.33:0/4058233694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 msgr2=0x5625d0a2b410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b5be00640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 0x5625d0a27780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b60e00640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b61800640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b61800640 1 -- 172.21.15.33:0/4058233694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 msgr2=0x5625d0a27780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b61800640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 0x5625d0a27780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b61800640 1 -- 172.21.15.33:0/4058233694 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d0a24700 con 0x5625d0a27310 2024-09-11T00:09:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.279+0000 7f4b5be00640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 0x5625d0a27780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:50.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.280+0000 7f4b61800640 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b54005e30 tx=0x7f4b5404c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262c6d5d44cede56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.280+0000 7f4b4d600640 1 -- 172.21.15.33:0/4058233694 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b540040b0 con 0x5625d0a27310 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.280+0000 7f4b4d600640 1 -- 172.21.15.33:0/4058233694 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b5405d070 con 0x5625d0a27310 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.280+0000 7f4b4d600640 1 -- 172.21.15.33:0/4058233694 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b540305d0 con 0x5625d0a27310 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 -- 172.21.15.33:0/4058233694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 msgr2=0x5625d0a27cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b54005e30 tx=0x7f4b5404c000 comp rx=0 tx=0).stop 2024-09-11T00:09:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 -- 172.21.15.33:0/4058233694 shutdown_connections 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a27cc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a248d0 0x5625d0a27780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.281+0000 7f4b66644740 1 --2- 172.21.15.33:0/4058233694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a21fa0 0x5625d0a2b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.282+0000 7f4b66644740 1 -- 172.21.15.33:0/4058233694 >> 172.21.15.33:0/4058233694 conn(0x5625d0a148e0 msgr2=0x5625d0a2a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.282+0000 7f4b66644740 1 -- 172.21.15.33:0/4058233694 shutdown_connections 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.282+0000 7f4b66644740 1 -- 172.21.15.33:0/4058233694 wait complete. 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.282+0000 7f4b66644740 1 -- start start 2024-09-11T00:09:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.282+0000 7f4b66644740 1 Processor -- start 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.283+0000 7f4b66644740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 0x5625d0a333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a32180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1b0280 con 0x5625d0a21fa0 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1b16f0 con 0x5625d0a248d0 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1b0950 con 0x5625d0a27310 2024-09-11T00:09:50.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b66644740 10 client.0 _ll_register_callbacks cb 0x7f4b5000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b61800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b61800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:51302/0 (socket says 172.21.15.33:51302) 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b61800640 1 -- 172.21.15.33:0/1831303852 learned_addr learned my addr 172.21.15.33:0/1831303852 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.284+0000 7f4b5be00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a32180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b5be00640 1 -- 172.21.15.33:0/1831303852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 msgr2=0x5625d0a328c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b5be00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a328c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b5be00640 1 -- 172.21.15.33:0/1831303852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 msgr2=0x5625d0a333e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b60e00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 0x5625d0a333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b5be00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 0x5625d0a333e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b5be00640 1 -- 172.21.15.33:0/1831303852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d0a30c00 con 0x5625d0a248d0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.285+0000 7f4b60e00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 0x5625d0a333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b5be00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a32180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b480a85e0 tx=0x7f4b48010850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a7cf750fae2ced server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b42a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b480ab780 con 0x5625d0a248d0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b5405d070 con 0x5625d0a248d0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4b480ab470 con 0x5625d0a248d0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b480abb20 con 0x5625d0a248d0 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b66644740 10 client.36665 fetch_fsmap learned FSMap version 30 2024-09-11T00:09:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.286+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625d0aa41e0 con 0x5625d0a248d0 2024-09-11T00:09:50.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b5405d070 con 0x5625d0a248d0 2024-09-11T00:09:50.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4b480971a0 con 0x5625d0a248d0 2024-09-11T00:09:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 10 client.36665 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:09:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 10 client.36665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:09:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 20 client.36665 populate_metadata read hostname 'smithi033' 2024-09-11T00:09:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0aa4be0 0x5625d0aa7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 4 client.36665 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:09:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.287+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625d098a0b0 con 0x5625d0aa4be0 2024-09-11T00:09:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.288+0000 7f4b60e00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0aa4be0 0x5625d0aa7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.289+0000 7f4b60e00640 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0aa4be0 0x5625d0aa7000 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf47f5171d442db server_cookie=904c1408244041de in_seq=0 out_seq=0 2024-09-11T00:09:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.289+0000 7f4b42a00640 10 client.36665 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.313+0000 7f4b42a00640 1 -- 172.21.15.33:0/1831303852 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625d098a0b0 con 0x5625d0aa4be0 2024-09-11T00:09:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.313+0000 7f4b42a00640 10 client.36665 handle_command_reply: tid=0 2024-09-11T00:09:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.313+0000 7f4b66644740 1 client.36665 shutdown 2024-09-11T00:09:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.313+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 msgr2=0x5625d0a32180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.313+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a32180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b480a85e0 tx=0x7f4b48010850 comp rx=0 tx=0).stop 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 shutdown_connections 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625d0aa4be0 0x5625d0aa7000 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625d0a27310 0x5625d0a328c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d0a248d0 0x5625d0a32180 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 --2- 172.21.15.33:0/1831303852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625d0a21fa0 0x5625d0a333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 >> 172.21.15.33:0/1831303852 conn(0x5625d0a148e0 msgr2=0x5625d0a18b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b42a00640 0 client.36665 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:09:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 shutdown_connections 2024-09-11T00:09:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 1 -- 172.21.15.33:0/1831303852 wait complete. 2024-09-11T00:09:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.314+0000 7f4b66644740 20 client.36665 trim_cache size 0 max 16384 2024-09-11T00:09:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:09:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:09:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:09:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:09:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 msgr2=0x7f4b440b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 0x7f4b440b78a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009410 tx=0x7f4b54009360 comp rx=0 tx=0).stop 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 msgr2=0x7f4b5c1a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800b450 tx=0x7f4b4800b910 comp rx=0 tx=0).stop 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 shutdown_connections 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4b440b53e0 0x7f4b440b78a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b5c10ab10 0x7f4b5c1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b5c10a150 0x7f4b5c1a3d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 --2- 172.21.15.33:0/2259377015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5c074440 0x7f4b5c1a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.315+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 >> 172.21.15.33:0/2259377015 conn(0x7f4b5c06fe80 msgr2=0x7f4b5c10f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.316+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 shutdown_connections 2024-09-11T00:09:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:09:50.316+0000 7f4b63800640 1 -- 172.21.15.33:0/2259377015 wait complete. 2024-09-11T00:09:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:50 smithi033 ceph-mon[30593]: pgmap v828: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-09-11T00:09:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:50 smithi189 ceph-mon[34000]: pgmap v828: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-09-11T00:09:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:50 smithi052 ceph-mon[33526]: pgmap v828: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.9 MiB/s wr, 640 op/s 2024-09-11T00:09:52.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:52 smithi033 ceph-mon[30593]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 653 op/s 2024-09-11T00:09:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:52 smithi189 ceph-mon[34000]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 653 op/s 2024-09-11T00:09:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:52 smithi052 ceph-mon[33526]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 653 op/s 2024-09-11T00:09:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 605.0 s, 662.2 tps, lat 151.788 ms stddev 213.866 2024-09-11T00:09:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:54 smithi033 ceph-mon[30593]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 10 MiB/s wr, 778 op/s 2024-09-11T00:09:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:54 smithi189 ceph-mon[34000]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 10 MiB/s wr, 778 op/s 2024-09-11T00:09:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:54 smithi052 ceph-mon[33526]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 10 MiB/s wr, 778 op/s 2024-09-11T00:09:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:56 smithi033 ceph-mon[30593]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.3 MiB/s wr, 628 op/s 2024-09-11T00:09:56.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:56 smithi189 ceph-mon[34000]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.3 MiB/s wr, 628 op/s 2024-09-11T00:09:56.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:56 smithi052 ceph-mon[33526]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.3 MiB/s wr, 628 op/s 2024-09-11T00:09:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 610.0 s, 721.2 tps, lat 138.756 ms stddev 62.550 2024-09-11T00:09:58.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:09:58 smithi033 ceph-mon[30593]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-11T00:09:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:09:58 smithi189 ceph-mon[34000]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-11T00:09:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:09:58 smithi052 ceph-mon[33526]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-11T00:10:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:00 smithi033 ceph-mon[30593]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.8 MiB/s wr, 657 op/s 2024-09-11T00:10:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:00 smithi033 ceph-mon[30593]: overall HEALTH_OK 2024-09-11T00:10:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:00 smithi189 ceph-mon[34000]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.8 MiB/s wr, 657 op/s 2024-09-11T00:10:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:00 smithi189 ceph-mon[34000]: overall HEALTH_OK 2024-09-11T00:10:00.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:00 smithi052 ceph-mon[33526]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.8 MiB/s wr, 657 op/s 2024-09-11T00:10:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:00 smithi052 ceph-mon[33526]: overall HEALTH_OK 2024-09-11T00:10:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:02 smithi033 ceph-mon[30593]: pgmap v834: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2024-09-11T00:10:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:02 smithi189 ceph-mon[34000]: pgmap v834: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2024-09-11T00:10:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:02 smithi052 ceph-mon[33526]: pgmap v834: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.2 MiB/s wr, 660 op/s 2024-09-11T00:10:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 615.0 s, 689.0 tps, lat 143.745 ms stddev 48.025 2024-09-11T00:10:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 -- 172.21.15.33:0/1881792439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10aac0 msgr2=0x7fa68c111420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 --2- 172.21.15.33:0/1881792439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10aac0 0x7fa68c111420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa678009890 tx=0x7fa67802a360 comp rx=0 tx=0).stop 2024-09-11T00:10:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 -- 172.21.15.33:0/1881792439 shutdown_connections 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 --2- 172.21.15.33:0/1881792439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10aac0 0x7fa68c111420 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 --2- 172.21.15.33:0/1881792439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10a100 0x7fa68c10a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 --2- 172.21.15.33:0/1881792439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 -- 172.21.15.33:0/1881792439 >> 172.21.15.33:0/1881792439 conn(0x7fa68c0783d0 msgr2=0x7fa68c07a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 -- 172.21.15.33:0/1881792439 shutdown_connections 2024-09-11T00:10:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.104+0000 7fa691600640 1 -- 172.21.15.33:0/1881792439 wait complete. 2024-09-11T00:10:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 Processor -- start 2024-09-11T00:10:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 -- start start 2024-09-11T00:10:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 0x7fa68c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 0x7fa68c1a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c114ad0 con 0x7fa68c10a100 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c114950 con 0x7fa68c109230 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.106+0000 7fa691600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c114c50 con 0x7fa68c10aac0 2024-09-11T00:10:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 0x7fa68c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 0x7fa68c19f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51784/0 (socket says 172.21.15.33:51784) 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68a000640 1 -- 172.21.15.33:0/2241121434 learned_addr learned my addr 172.21.15.33:0/2241121434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:44086/0 (socket says 172.21.15.33:44086) 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.107+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 0x7fa68c1a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.108+0000 7fa68b400640 1 -- 172.21.15.33:0/2241121434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 msgr2=0x7fa68c19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.108+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.108+0000 7fa68b400640 1 -- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 msgr2=0x7fa68c19f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.108+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 0x7fa68c19f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.108+0000 7fa68b400640 1 -- 172.21.15.33:0/2241121434 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c1a0dd0 con 0x7fa68c10aac0 2024-09-11T00:10:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.109+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 0x7fa68c1a0510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa678009780 tx=0x7fa67802ae30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.110+0000 7fa683400640 1 -- 172.21.15.33:0/2241121434 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678037040 con 0x7fa68c10aac0 2024-09-11T00:10:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.110+0000 7fa683400640 1 -- 172.21.15.33:0/2241121434 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa678030ab0 con 0x7fa68c10aac0 2024-09-11T00:10:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.110+0000 7fa683400640 1 -- 172.21.15.33:0/2241121434 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678003850 con 0x7fa68c10aac0 2024-09-11T00:10:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.110+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c1a1060 con 0x7fa68c10aac0 2024-09-11T00:10:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.110+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1a75b0 con 0x7fa68c10aac0 2024-09-11T00:10:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.112+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:04.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.122+0000 7fa683400640 1 -- 172.21.15.33:0/2241121434 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa678030c60 con 0x7fa68c10aac0 2024-09-11T00:10:04.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.125+0000 7fa69442c740 1 Processor -- start 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.125+0000 7fa69442c740 1 -- start start 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.125+0000 7fa69442c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.125+0000 7fa69442c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350eb74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.125+0000 7fa69442c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350eb9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa69442c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558350e146b0 con 0x558350eb50d0 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa69442c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558350e03ae0 con 0x558350eb7b10 2024-09-11T00:10:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa69442c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558350e078f0 con 0x558350eb27a0 2024-09-11T00:10:04.128 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa683400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 0x7fa6700b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350eb74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa683400640 1 -- 172.21.15.33:0/2241121434 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa678105390 con 0x7fa68c10aac0 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa68a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa68a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:37542/0 (socket says 172.21.15.33:37542) 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa68a000640 1 -- 172.21.15.33:0/2747669025 learned_addr learned my addr 172.21.15.33:0/2747669025 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.126+0000 7fa68a000640 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350eb9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 -- 172.21.15.33:0/2747669025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 msgr2=0x558350eb9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350eb9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 -- 172.21.15.33:0/2747669025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 msgr2=0x558350eb74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350eb74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 -- 172.21.15.33:0/2747669025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558350dd0780 con 0x558350eb27a0 2024-09-11T00:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.127+0000 7fa68a000640 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa684013cd0 tx=0x7fa684009c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155451fb5053bcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.128+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350eb74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.128+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 0x7fa6700b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.128+0000 7fa677400640 1 -- 172.21.15.33:0/2747669025 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684013dc0 con 0x558350eb27a0 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.128+0000 7fa677400640 1 -- 172.21.15.33:0/2747669025 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa684011c70 con 0x558350eb27a0 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.128+0000 7fa677400640 1 -- 172.21.15.33:0/2747669025 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684020dd0 con 0x558350eb27a0 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.129+0000 7fa69442c740 1 -- 172.21.15.33:0/2747669025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 msgr2=0x558350eb4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.129+0000 7fa69442c740 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa684013cd0 tx=0x7fa684009c40 comp rx=0 tx=0).stop 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.130+0000 7fa69442c740 1 -- 172.21.15.33:0/2747669025 shutdown_connections 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.130+0000 7fa69442c740 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350eb9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.130+0000 7fa69442c740 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350eb74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.130+0000 7fa69442c740 1 --2- 172.21.15.33:0/2747669025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350eb4b90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.130+0000 7fa69442c740 1 -- 172.21.15.33:0/2747669025 >> 172.21.15.33:0/2747669025 conn(0x558350e9c8e0 msgr2=0x558350e9d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.131+0000 7fa68b400640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 0x7fa6700b7930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa678102af0 tx=0x7fa67802a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.131+0000 7fa69442c740 1 -- 172.21.15.33:0/2747669025 shutdown_connections 2024-09-11T00:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.131+0000 7fa69442c740 1 -- 172.21.15.33:0/2747669025 wait complete. 2024-09-11T00:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.132+0000 7fa69442c740 1 -- start start 2024-09-11T00:10:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.133+0000 7fa69442c740 1 Processor -- start 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.133+0000 7fa69442c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350ebbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350ebc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350ebd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558350d3bab0 con 0x558350eb50d0 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558350daa570 con 0x558350eb7b10 2024-09-11T00:10:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558350ebaaf0 con 0x558350eb27a0 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa69442c740 10 client.0 _ll_register_callbacks cb 0x558350db9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350ebc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350ebc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51814/0 (socket says 172.21.15.33:51814) 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.134+0000 7fa68a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350ebbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68aa00640 1 -- 172.21.15.33:0/3979660745 learned_addr learned my addr 172.21.15.33:0/3979660745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350ebd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 -- 172.21.15.33:0/3979660745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 msgr2=0x558350ebbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350ebbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 -- 172.21.15.33:0/3979660745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 msgr2=0x558350ebc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350ebc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.135+0000 7fa68a000640 1 -- 172.21.15.33:0/3979660745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558350b65790 con 0x558350eb7b10 2024-09-11T00:10:04.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.136+0000 7fa68a000640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350ebd260 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa684009270 tx=0x7fa684009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a25e40d52a7e569 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.137+0000 7fa66be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:10:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.137+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684004a40 con 0x558350eb7b10 2024-09-11T00:10:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.137+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa684004be0 con 0x558350eb7b10 2024-09-11T00:10:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.138+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa684011c70 con 0x558350eb7b10 2024-09-11T00:10:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.138+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa684004de0 con 0x558350eb7b10 2024-09-11T00:10:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.138+0000 7fa69442c740 10 client.36677 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.138+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558350bde620 con 0x558350eb7b10 2024-09-11T00:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.139+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa684011c70 con 0x558350eb7b10 2024-09-11T00:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa68402c420 con 0x558350eb7b10 2024-09-11T00:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 10 client.36677 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 10 client.36677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 20 client.36677 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350ed8560 0x558350eda980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 4 client.36677 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.140+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558350e16600 con 0x558350ed8560 2024-09-11T00:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.141+0000 7fa68aa00640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350ed8560 0x558350eda980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.142+0000 7fa66be00640 10 client.36677 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.142+0000 7fa68aa00640 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350ed8560 0x558350eda980 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ce0ad67f206be server_cookie=bf35566290a272f1 in_seq=0 out_seq=0 2024-09-11T00:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.143+0000 7fa66be00640 1 -- 172.21.15.33:0/3979660745 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558350e16600 con 0x558350ed8560 2024-09-11T00:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.143+0000 7fa66be00640 10 client.36677 handle_command_reply: tid=0 2024-09-11T00:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.143+0000 7fa69442c740 1 client.36677 shutdown 2024-09-11T00:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.143+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 msgr2=0x558350ebd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.143+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350ebd260 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa684009270 tx=0x7fa684009c40 comp rx=0 tx=0).stop 2024-09-11T00:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 shutdown_connections 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb7b10 0x558350ebd260 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350ebc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350ed8560 0x558350eda980 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 --2- 172.21.15.33:0/3979660745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb27a0 0x558350ebbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa66be00640 0 client.36677 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 >> 172.21.15.33:0/3979660745 conn(0x558350e9c8e0 msgr2=0x558350e9ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 shutdown_connections 2024-09-11T00:10:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 1 -- 172.21.15.33:0/3979660745 wait complete. 2024-09-11T00:10:04.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.144+0000 7fa69442c740 20 client.36677 trim_cache size 0 max 16384 2024-09-11T00:10:04.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.182+0000 7fa69442c740 1 Processor -- start 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 -- start start 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350e9d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb7b10 0x558350ea0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0123d0 con 0x558350eb50d0 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c00fca0 con 0x558350eb27a0 2024-09-11T00:10:04.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.183+0000 7fa69442c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c00dba0 con 0x558350eb7b10 2024-09-11T00:10:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.184+0000 7fa68a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.184+0000 7fa68a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:44118/0 (socket says 172.21.15.33:44118) 2024-09-11T00:10:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.184+0000 7fa68a000640 1 -- 172.21.15.33:0/2975096162 learned_addr learned my addr 172.21.15.33:0/2975096162 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:04.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.184+0000 7fa68a000640 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb7b10 0x558350ea0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350e9d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68a000640 1 -- 172.21.15.33:0/2975096162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb7b10 msgr2=0x558350ea0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68a000640 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb7b10 0x558350ea0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68a000640 1 -- 172.21.15.33:0/2975096162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 msgr2=0x558350e9d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68a000640 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350e9d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.185+0000 7fa68a000640 1 -- 172.21.15.33:0/2975096162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558350edacf0 con 0x558350eb27a0 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.186+0000 7fa68a000640 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa68402c930 tx=0x7fa684013ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9364c572ac2d0d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.187+0000 7fa676a00640 1 -- 172.21.15.33:0/2975096162 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68402c400 con 0x558350eb27a0 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.187+0000 7fa676a00640 1 -- 172.21.15.33:0/2975096162 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa68402ce50 con 0x558350eb27a0 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.187+0000 7fa676a00640 1 -- 172.21.15.33:0/2975096162 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684011e80 con 0x558350eb27a0 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.187+0000 7fa69442c740 1 -- 172.21.15.33:0/2975096162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 msgr2=0x558350e9c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.187+0000 7fa69442c740 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa68402c930 tx=0x7fa684013ec0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.188+0000 7fa69442c740 1 -- 172.21.15.33:0/2975096162 shutdown_connections 2024-09-11T00:10:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.188+0000 7fa69442c740 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb7b10 0x558350ea0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.188+0000 7fa69442c740 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb50d0 0x558350e9d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.188+0000 7fa69442c740 1 --2- 172.21.15.33:0/2975096162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350e9c250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.188+0000 7fa69442c740 1 -- 172.21.15.33:0/2975096162 >> 172.21.15.33:0/2975096162 conn(0x558350e9c8e0 msgr2=0x558350ebb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.189+0000 7fa69442c740 1 -- 172.21.15.33:0/2975096162 shutdown_connections 2024-09-11T00:10:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.189+0000 7fa69442c740 1 -- 172.21.15.33:0/2975096162 wait complete. 2024-09-11T00:10:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.189+0000 7fa69442c740 1 -- start start 2024-09-11T00:10:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.190+0000 7fa69442c740 1 Processor -- start 2024-09-11T00:10:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.191+0000 7fa69442c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.191+0000 7fa69442c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb50d0 0x558350ec16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa68a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa68a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:44124/0 (socket says 172.21.15.33:44124) 2024-09-11T00:10:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa68a000640 1 -- 172.21.15.33:0/2060578462 learned_addr learned my addr 172.21.15.33:0/2060578462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb7b10 0x558350ec2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c00e160 con 0x558350eb7b10 2024-09-11T00:10:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c00f5d0 con 0x558350eb27a0 2024-09-11T00:10:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c00e830 con 0x558350eb50d0 2024-09-11T00:10:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa69442c740 10 client.0 _ll_register_callbacks cb 0x7fa684013ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.192+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb50d0 0x558350ec16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb7b10 0x558350ec2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 -- 172.21.15.33:0/2060578462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb50d0 msgr2=0x558350ec16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb50d0 0x558350ec16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 -- 172.21.15.33:0/2060578462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb7b10 msgr2=0x558350ec2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb7b10 0x558350ec2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa68a000640 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558350ec2aa0 con 0x558350eb27a0 2024-09-11T00:10:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.193+0000 7fa66be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:10:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.194+0000 7fa68a000640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6840092f0 tx=0x7fa684013a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5feab00651eb9e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.194+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684003d80 con 0x558350eb27a0 2024-09-11T00:10:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.194+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa684004f80 con 0x558350eb27a0 2024-09-11T00:10:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.195+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa68402ce50 con 0x558350eb27a0 2024-09-11T00:10:04.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.196+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa684011e50 con 0x558350eb27a0 2024-09-11T00:10:04.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.196+0000 7fa69442c740 10 client.36683 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:04.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.196+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558350ec3df0 con 0x558350eb27a0 2024-09-11T00:10:04.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.197+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa68402ce50 con 0x558350eb27a0 2024-09-11T00:10:04.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa68403e4c0 con 0x558350eb27a0 2024-09-11T00:10:04.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 10 client.36683 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 10 client.36683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 20 client.36683 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350f45660 0x558350f47a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 4 client.36683 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.199+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558350e120b0 con 0x558350f45660 2024-09-11T00:10:04.201 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.200+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350f45660 0x558350f47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:04.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.201+0000 7fa68aa00640 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350f45660 0x558350f47a50 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb119ddff6e50602 server_cookie=9e5ed28dcd29f50a in_seq=0 out_seq=0 2024-09-11T00:10:04.202 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.201+0000 7fa66be00640 10 client.36683 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.323+0000 7fa66be00640 1 -- 172.21.15.33:0/2060578462 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558350e120b0 con 0x558350f45660 2024-09-11T00:10:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.323+0000 7fa66be00640 10 client.36683 handle_command_reply: tid=0 2024-09-11T00:10:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.324+0000 7fa69442c740 1 client.36683 shutdown 2024-09-11T00:10:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.326+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 msgr2=0x558350ec1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.326+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6840092f0 tx=0x7fa684013a70 comp rx=0 tx=0).stop 2024-09-11T00:10:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 shutdown_connections 2024-09-11T00:10:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558350eb7b10 0x558350ec2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558350f45660 0x558350f47a50 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558350eb50d0 0x558350ec16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 --2- 172.21.15.33:0/2060578462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558350eb27a0 0x558350ec1000 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6840092f0 tx=0x7fa684013a70 comp rx=0 tx=0).stop 2024-09-11T00:10:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 >> 172.21.15.33:0/2060578462 conn(0x558350e9c8e0 msgr2=0x558350eb7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa66be00640 0 client.36683 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 shutdown_connections 2024-09-11T00:10:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.327+0000 7fa69442c740 1 -- 172.21.15.33:0/2060578462 wait complete. 2024-09-11T00:10:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.328+0000 7fa69442c740 20 client.36683 trim_cache size 0 max 16384 2024-09-11T00:10:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:10:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:10:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:10:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:10:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 msgr2=0x7fa6700b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 0x7fa6700b7930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa678102af0 tx=0x7fa67802a360 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 msgr2=0x7fa68c1a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 0x7fa68c1a0510 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa678009780 tx=0x7fa67802ae30 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 shutdown_connections 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa6700b5470 0x7fa6700b7930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa68c10aac0 0x7fa68c1a0510 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa68c10a100 0x7fa68c19f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 --2- 172.21.15.33:0/2241121434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa68c109230 0x7fa68c19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.329+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 >> 172.21.15.33:0/2241121434 conn(0x7fa68c0783d0 msgr2=0x7fa68c10d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.330+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 shutdown_connections 2024-09-11T00:10:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:04.330+0000 7fa691600640 1 -- 172.21.15.33:0/2241121434 wait complete. 2024-09-11T00:10:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:04 smithi033 ceph-mon[30593]: pgmap v835: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-11T00:10:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:04 smithi189 ceph-mon[34000]: pgmap v835: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-11T00:10:04.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:04 smithi052 ceph-mon[33526]: pgmap v835: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.6 MiB/s wr, 764 op/s 2024-09-11T00:10:06.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:06 smithi033 ceph-mon[30593]: pgmap v836: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.8 MiB/s wr, 569 op/s 2024-09-11T00:10:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:06 smithi189 ceph-mon[34000]: pgmap v836: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.8 MiB/s wr, 569 op/s 2024-09-11T00:10:06.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:06 smithi052 ceph-mon[33526]: pgmap v836: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.8 MiB/s wr, 569 op/s 2024-09-11T00:10:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 620.0 s, 675.6 tps, lat 148.388 ms stddev 43.032 2024-09-11T00:10:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:08 smithi189 ceph-mon[34000]: pgmap v837: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-09-11T00:10:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:08 smithi052 ceph-mon[33526]: pgmap v837: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-09-11T00:10:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:08 smithi033 ceph-mon[30593]: pgmap v837: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-09-11T00:10:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:10 smithi189 ceph-mon[34000]: pgmap v838: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2024-09-11T00:10:10.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:10 smithi052 ceph-mon[33526]: pgmap v838: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2024-09-11T00:10:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:10 smithi033 ceph-mon[30593]: pgmap v838: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.7 MiB/s wr, 646 op/s 2024-09-11T00:10:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:12 smithi189 ceph-mon[34000]: pgmap v839: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.5 MiB/s wr, 656 op/s 2024-09-11T00:10:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:12 smithi052 ceph-mon[33526]: pgmap v839: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.5 MiB/s wr, 656 op/s 2024-09-11T00:10:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:12 smithi033 ceph-mon[30593]: pgmap v839: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.5 MiB/s wr, 656 op/s 2024-09-11T00:10:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 625.0 s, 669.4 tps, lat 149.792 ms stddev 47.476 2024-09-11T00:10:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:14 smithi189 ceph-mon[34000]: pgmap v840: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-11T00:10:14.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:14 smithi052 ceph-mon[33526]: pgmap v840: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-11T00:10:15.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:14 smithi033 ceph-mon[30593]: pgmap v840: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.6 MiB/s wr, 735 op/s 2024-09-11T00:10:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:16 smithi189 ceph-mon[34000]: pgmap v841: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2024-09-11T00:10:16.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:16 smithi052 ceph-mon[33526]: pgmap v841: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2024-09-11T00:10:17.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:16 smithi033 ceph-mon[30593]: pgmap v841: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 571 op/s 2024-09-11T00:10:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 -- 172.21.15.33:0/3185958773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 msgr2=0x7f962410ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 --2- 172.21.15.33:0/3185958773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f962410ab70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f961c009be0 tx=0x7f961c02a6c0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 -- 172.21.15.33:0/3185958773 shutdown_connections 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 --2- 172.21.15.33:0/3185958773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f962410ab70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 --2- 172.21.15.33:0/3185958773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624100fb0 0x7f9624108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 --2- 172.21.15.33:0/3185958773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9624100670 0x7f9624100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.695+0000 7f962ba00640 1 -- 172.21.15.33:0/3185958773 >> 172.21.15.33:0/3185958773 conn(0x7f96240fc440 msgr2=0x7f96240fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.697+0000 7f962ba00640 1 -- 172.21.15.33:0/3185958773 shutdown_connections 2024-09-11T00:10:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.697+0000 7f962ba00640 1 -- 172.21.15.33:0/3185958773 wait complete. 2024-09-11T00:10:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 Processor -- start 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 -- start start 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624100670 0x7f9624196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9624100fb0 0x7f96241967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96241106f0 con 0x7f9624100670 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9624110570 con 0x7f9624100fb0 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.699+0000 7f962ba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9624110870 con 0x7f9624108780 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.700+0000 7f9629a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.700+0000 7f9629a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:38890/0 (socket says 172.21.15.33:38890) 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.700+0000 7f9629a00640 1 -- 172.21.15.33:0/2951937892 learned_addr learned my addr 172.21.15.33:0/2951937892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 -- 172.21.15.33:0/2951937892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9624100fb0 msgr2=0x7f96241967c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9624100fb0 0x7f96241967c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 -- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624100670 msgr2=0x7f9624196170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624100670 0x7f9624196170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 -- 172.21.15.33:0/2951937892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9624197c10 con 0x7f9624108780 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.701+0000 7f9629a00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f961c030cb0 tx=0x7f961c030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.702+0000 7f9621600640 1 -- 172.21.15.33:0/2951937892 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c062070 con 0x7f9624108780 2024-09-11T00:10:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.702+0000 7f9621600640 1 -- 172.21.15.33:0/2951937892 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f961c058070 con 0x7f9624108780 2024-09-11T00:10:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.702+0000 7f9621600640 1 -- 172.21.15.33:0/2951937892 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c004700 con 0x7f9624108780 2024-09-11T00:10:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.702+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9624197ea0 con 0x7f9624108780 2024-09-11T00:10:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.702+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962419ee00 con 0x7f9624108780 2024-09-11T00:10:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.707+0000 7f962ea19740 1 Processor -- start 2024-09-11T00:10:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 -- start start 2024-09-11T00:10:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f9621600640 1 -- 172.21.15.33:0/2951937892 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f961c05d070 con 0x7f9624108780 2024-09-11T00:10:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a428bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4290fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625a41fc6b0 con 0x5625a428eb00 2024-09-11T00:10:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625a41ebae0 con 0x5625a428c0c0 2024-09-11T00:10:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.709+0000 7f962ea19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625a41ef8f0 con 0x5625a4289790 2024-09-11T00:10:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.711+0000 7f9629000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.711+0000 7f9623e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4290fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:45270/0 (socket says 172.21.15.33:45270) 2024-09-11T00:10:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 -- 172.21.15.33:0/2923353140 learned_addr learned my addr 172.21.15.33:0/2923353140 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 -- 172.21.15.33:0/2923353140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 msgr2=0x5625a428bb80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a428bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 -- 172.21.15.33:0/2923353140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 msgr2=0x5625a4290fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4290fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.712+0000 7f9629000640 1 -- 172.21.15.33:0/2923353140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a41b8780 con 0x5625a428c0c0 2024-09-11T00:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.713+0000 7f9629000640 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9618009ac0 tx=0x7f9618009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7d599f1d188d43f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.714+0000 7f9616000640 1 -- 172.21.15.33:0/2923353140 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961800ed10 con 0x5625a428c0c0 2024-09-11T00:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.714+0000 7f9616000640 1 -- 172.21.15.33:0/2923353140 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96180054b0 con 0x5625a428c0c0 2024-09-11T00:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.714+0000 7f9616000640 1 -- 172.21.15.33:0/2923353140 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618010430 con 0x5625a428c0c0 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 -- 172.21.15.33:0/2923353140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 msgr2=0x5625a428e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9618009ac0 tx=0x7f9618009f80 comp rx=0 tx=0).stop 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 -- 172.21.15.33:0/2923353140 shutdown_connections 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4290fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a428e4b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 --2- 172.21.15.33:0/2923353140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a428bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.715+0000 7f962ea19740 1 -- 172.21.15.33:0/2923353140 >> 172.21.15.33:0/2923353140 conn(0x5625a42848e0 msgr2=0x5625a4285670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.716+0000 7f962ea19740 1 -- 172.21.15.33:0/2923353140 shutdown_connections 2024-09-11T00:10:17.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.716+0000 7f962ea19740 1 -- 172.21.15.33:0/2923353140 wait complete. 2024-09-11T00:10:17.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.716+0000 7f962ea19740 1 -- start start 2024-09-11T00:10:17.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.717+0000 7f962ea19740 1 Processor -- start 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4292fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428c0c0 0x5625a4293660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 0x5625a42941c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625a4123ab0 con 0x5625a428c0c0 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625a4192570 con 0x5625a428eb00 2024-09-11T00:10:17.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625a4291ae0 con 0x5625a4289790 2024-09-11T00:10:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f962ea19740 10 client.0 _ll_register_callbacks cb 0x5625a41a1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f9623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 0x5625a42941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f9623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 0x5625a42941c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:45280/0 (socket says 172.21.15.33:45280) 2024-09-11T00:10:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.718+0000 7f9623e00640 1 -- 172.21.15.33:0/2565640599 learned_addr learned my addr 172.21.15.33:0/2565640599 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:17.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.719+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4292fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.720+0000 7f9623e00640 1 -- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 msgr2=0x5625a42941c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.720+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 0x5625a42941c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.720+0000 7f9623e00640 1 -- 172.21.15.33:0/2565640599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428c0c0 msgr2=0x5625a4293660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.720+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428c0c0 0x5625a4293660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.720+0000 7f9623e00640 1 -- 172.21.15.33:0/2565640599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a3f4d790 con 0x5625a4289790 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.722+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4292fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9610012b00 tx=0x7f9610005a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10ec5898d5a83a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.722+0000 7f9621600640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 0x7f960c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.723+0000 7f960aa00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.724+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961000dcd0 con 0x5625a4289790 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.724+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9610004020 con 0x5625a4289790 2024-09-11T00:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.724+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96180054b0 con 0x5625a4289790 2024-09-11T00:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.725+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9610023050 con 0x5625a4289790 2024-09-11T00:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.725+0000 7f962ea19740 10 client.26665 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.725+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625a3fc6620 con 0x5625a4289790 2024-09-11T00:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.726+0000 7f9629000640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 0x7f960c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.725+0000 7f9621600640 1 -- 172.21.15.33:0/2951937892 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f961c128430 con 0x7f9624108780 2024-09-11T00:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.727+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96100054b0 con 0x5625a4289790 2024-09-11T00:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.727+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f96100047a0 con 0x5625a4289790 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 10 client.26665 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 10 client.26665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 20 client.26665 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a429e8c0 0x5625a42a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 4 client.26665 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f96180054b0 con 0x5625a429e8c0 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.728+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a429e8c0 0x5625a42a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.729+0000 7f9629000640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 0x7f960c0b78c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9618009a90 tx=0x7f9618004a70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.732+0000 7f9623e00640 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a429e8c0 0x5625a42a0cb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9662474cc2e7690f server_cookie=1871eb015c33218 in_seq=0 out_seq=0 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.732+0000 7f960aa00640 10 client.26665 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.733+0000 7f960aa00640 1 -- 172.21.15.33:0/2565640599 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f96180054b0 con 0x5625a429e8c0 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.733+0000 7f960aa00640 10 client.26665 handle_command_reply: tid=0 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.733+0000 7f962ea19740 1 client.26665 shutdown 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 msgr2=0x5625a4292fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4292fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9610012b00 tx=0x7f9610005a60 comp rx=0 tx=0).stop 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 shutdown_connections 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428eb00 0x5625a42941c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428c0c0 0x5625a4293660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a429e8c0 0x5625a42a0cb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 --2- 172.21.15.33:0/2565640599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4292fc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.734+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 >> 172.21.15.33:0/2565640599 conn(0x5625a42848e0 msgr2=0x5625a4283a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.735+0000 7f960aa00640 0 client.26665 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.735+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 shutdown_connections 2024-09-11T00:10:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.738+0000 7f962ea19740 1 -- 172.21.15.33:0/2565640599 wait complete. 2024-09-11T00:10:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.738+0000 7f962ea19740 20 client.26665 trim_cache size 0 max 16384 2024-09-11T00:10:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.778+0000 7f962ea19740 1 Processor -- start 2024-09-11T00:10:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.778+0000 7f962ea19740 1 -- start start 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a428c0c0 0x5625a4292890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4292dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96241abcf0 con 0x5625a428eb00 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96241a95c0 con 0x5625a4289790 2024-09-11T00:10:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f962ea19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96241a7410 con 0x5625a428c0c0 2024-09-11T00:10:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f9629000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f9629000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:45290/0 (socket says 172.21.15.33:45290) 2024-09-11T00:10:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f9629000640 1 -- 172.21.15.33:0/2431798672 learned_addr learned my addr 172.21.15.33:0/2431798672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:17.782 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.779+0000 7f9629a00640 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4292dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9623e00640 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a428c0c0 0x5625a4292890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9629000640 1 -- 172.21.15.33:0/2431798672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a428c0c0 msgr2=0x5625a4292890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9629000640 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a428c0c0 0x5625a4292890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9629000640 1 -- 172.21.15.33:0/2431798672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 msgr2=0x5625a4292dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9629000640 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4292dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.780+0000 7f9629000640 1 -- 172.21.15.33:0/2431798672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a428e820 con 0x5625a4289790 2024-09-11T00:10:17.783 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.781+0000 7f9629000640 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9618009a60 tx=0x7f9618021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9adcbbcdb820b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.781+0000 7f9615600640 1 -- 172.21.15.33:0/2431798672 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961802a040 con 0x5625a4289790 2024-09-11T00:10:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.781+0000 7f9615600640 1 -- 172.21.15.33:0/2431798672 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9618033070 con 0x5625a4289790 2024-09-11T00:10:17.784 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.781+0000 7f9615600640 1 -- 172.21.15.33:0/2431798672 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961801d040 con 0x5625a4289790 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 -- 172.21.15.33:0/2431798672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 msgr2=0x5625a4284250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9618009a60 tx=0x7f9618021000 comp rx=0 tx=0).stop 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 -- 172.21.15.33:0/2431798672 shutdown_connections 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a4292dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a428c0c0 0x5625a4292890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 --2- 172.21.15.33:0/2431798672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a4289790 0x5625a4284250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.785 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.782+0000 7f962ea19740 1 -- 172.21.15.33:0/2431798672 >> 172.21.15.33:0/2431798672 conn(0x5625a42848e0 msgr2=0x5625a4292180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.783+0000 7f962ea19740 1 -- 172.21.15.33:0/2431798672 shutdown_connections 2024-09-11T00:10:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.783+0000 7f962ea19740 1 -- 172.21.15.33:0/2431798672 wait complete. 2024-09-11T00:10:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.784+0000 7f962ea19740 1 -- start start 2024-09-11T00:10:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.784+0000 7f962ea19740 1 Processor -- start 2024-09-11T00:10:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.785+0000 7f962ea19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4299d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.785+0000 7f962ea19740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.787 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.785+0000 7f962ea19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a42988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f962ea19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96241a7a80 con 0x5625a428eb00 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f962ea19740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96241a8ef0 con 0x5625a428c0c0 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f962ea19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96241a8150 con 0x5625a4289790 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f962ea19740 10 client.0 _ll_register_callbacks cb 0x7f961000f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9629000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4299d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:45298/0 (socket says 172.21.15.33:45298) 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 -- 172.21.15.33:0/3347504566 learned_addr learned my addr 172.21.15.33:0/3347504566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9629a00640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a42988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 -- 172.21.15.33:0/3347504566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 msgr2=0x5625a4299d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4299d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.786+0000 7f9623e00640 1 -- 172.21.15.33:0/3347504566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 msgr2=0x5625a42988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.787+0000 7f9623e00640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a42988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.787+0000 7f9623e00640 1 -- 172.21.15.33:0/3347504566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a4298de0 con 0x5625a428c0c0 2024-09-11T00:10:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.787+0000 7f9629a00640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a42988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.788+0000 7f9623e00640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9610004fd0 tx=0x7f9610004f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4ec67c1e578497 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.788+0000 7f960aa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:10:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.788+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610012230 con 0x5625a428c0c0 2024-09-11T00:10:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.789+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9610012030 con 0x5625a428c0c0 2024-09-11T00:10:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.789+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9618033070 con 0x5625a428c0c0 2024-09-11T00:10:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.789+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f961003b050 con 0x5625a428c0c0 2024-09-11T00:10:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.790+0000 7f962ea19740 10 client.36698 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.790+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625a430bf30 con 0x5625a428c0c0 2024-09-11T00:10:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.790+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9618033070 con 0x5625a428c0c0 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.791+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f96100046c0 con 0x5625a428c0c0 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.791+0000 7f962ea19740 10 client.36698 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f962ea19740 10 client.36698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f962ea19740 20 client.36698 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a430c820 0x5625a430ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f962ea19740 4 client.36698 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625a41fe600 con 0x5625a430c820 2024-09-11T00:10:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.792+0000 7f9629000640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a430c820 0x5625a430ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.793+0000 7f9629000640 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a430c820 0x5625a430ec40 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9560c4abb29f427d server_cookie=2026a1580fbb4fb7 in_seq=0 out_seq=0 2024-09-11T00:10:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.793+0000 7f960aa00640 10 client.36698 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.814+0000 7f960aa00640 1 -- 172.21.15.33:0/3347504566 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625a41fe600 con 0x5625a430c820 2024-09-11T00:10:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.814+0000 7f960aa00640 10 client.36698 handle_command_reply: tid=0 2024-09-11T00:10:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.814+0000 7f962ea19740 1 client.36698 shutdown 2024-09-11T00:10:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.815+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 msgr2=0x5625a429a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.815+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9610004fd0 tx=0x7f9610004f10 comp rx=0 tx=0).stop 2024-09-11T00:10:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.815+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 shutdown_connections 2024-09-11T00:10:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625a428eb00 0x5625a42988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625a428c0c0 0x5625a429a2c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5625a430c820 0x5625a430ec40 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 --2- 172.21.15.33:0/3347504566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625a4289790 0x5625a4299d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 >> 172.21.15.33:0/3347504566 conn(0x5625a42848e0 msgr2=0x5625a42929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f960aa00640 0 client.36698 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 shutdown_connections 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 1 -- 172.21.15.33:0/3347504566 wait complete. 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.816+0000 7f962ea19740 20 client.36698 trim_cache size 0 max 16384 2024-09-11T00:10:17.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 msgr2=0x7f960c0b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 0x7f960c0b78c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9618009a90 tx=0x7f9618004a70 comp rx=0 tx=0).stop 2024-09-11T00:10:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 msgr2=0x7f96241973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f961c030cb0 tx=0x7f961c030ce0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 shutdown_connections 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f960c0b5400 0x7f960c0b78c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624108780 0x7f96241973f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9624100fb0 0x7f96241967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 --2- 172.21.15.33:0/2951937892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9624100670 0x7f9624196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.817+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 >> 172.21.15.33:0/2951937892 conn(0x7f96240fc440 msgr2=0x7f96240fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.818+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 shutdown_connections 2024-09-11T00:10:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:17.818+0000 7f962ba00640 1 -- 172.21.15.33:0/2951937892 wait complete. 2024-09-11T00:10:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 630.0 s, 665.6 tps, lat 149.648 ms stddev 42.817 2024-09-11T00:10:18.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:18 smithi189 ceph-mon[34000]: pgmap v842: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 749 op/s 2024-09-11T00:10:18.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:18 smithi052 ceph-mon[33526]: pgmap v842: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 749 op/s 2024-09-11T00:10:19.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:18 smithi033 ceph-mon[30593]: pgmap v842: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 749 op/s 2024-09-11T00:10:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:20 smithi189 ceph-mon[34000]: pgmap v843: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2024-09-11T00:10:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:20 smithi052 ceph-mon[33526]: pgmap v843: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2024-09-11T00:10:21.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:20 smithi033 ceph-mon[30593]: pgmap v843: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2024-09-11T00:10:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:22 smithi189 ceph-mon[34000]: pgmap v844: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-11T00:10:22.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:22 smithi052 ceph-mon[33526]: pgmap v844: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-11T00:10:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:22 smithi033 ceph-mon[30593]: pgmap v844: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-11T00:10:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 635.0 s, 666.2 tps, lat 150.436 ms stddev 45.593 2024-09-11T00:10:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:24 smithi189 ceph-mon[34000]: pgmap v845: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-11T00:10:24.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:24 smithi052 ceph-mon[33526]: pgmap v845: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-11T00:10:25.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:24 smithi033 ceph-mon[30593]: pgmap v845: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 729 op/s 2024-09-11T00:10:26.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:26 smithi033 ceph-mon[30593]: pgmap v846: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-09-11T00:10:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:26 smithi189 ceph-mon[34000]: pgmap v846: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-09-11T00:10:26.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:26 smithi052 ceph-mon[33526]: pgmap v846: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-09-11T00:10:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 640.0 s, 610.8 tps, lat 162.940 ms stddev 59.140 2024-09-11T00:10:28.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:28 smithi052 ceph-mon[33526]: pgmap v847: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 731 op/s 2024-09-11T00:10:29.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:28 smithi033 ceph-mon[30593]: pgmap v847: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 731 op/s 2024-09-11T00:10:29.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:28 smithi189 ceph-mon[34000]: pgmap v847: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 731 op/s 2024-09-11T00:10:29.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:29 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:30.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:29 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:30.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:29 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:30 smithi052 ceph-mon[33526]: pgmap v848: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-09-11T00:10:31.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:30 smithi033 ceph-mon[30593]: pgmap v848: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-09-11T00:10:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:30 smithi189 ceph-mon[34000]: pgmap v848: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-09-11T00:10:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.629+0000 7f4bc9800640 1 -- 172.21.15.33:0/785136413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 msgr2=0x7f4bc4105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.629+0000 7f4bc9800640 1 --2- 172.21.15.33:0/785136413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc4105530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009900 tx=0x7f4bb402a420 comp rx=0 tx=0).stop 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 -- 172.21.15.33:0/785136413 shutdown_connections 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 --2- 172.21.15.33:0/785136413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4108670 0x7f4bc410ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 --2- 172.21.15.33:0/785136413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4105ac0 0x7f4bc4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 --2- 172.21.15.33:0/785136413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc4105530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 -- 172.21.15.33:0/785136413 >> 172.21.15.33:0/785136413 conn(0x7f4bc40fd140 msgr2=0x7f4bc40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 -- 172.21.15.33:0/785136413 shutdown_connections 2024-09-11T00:10:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.630+0000 7f4bc9800640 1 -- 172.21.15.33:0/785136413 wait complete. 2024-09-11T00:10:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.631+0000 7f4bc9800640 1 Processor -- start 2024-09-11T00:10:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc9800640 1 -- start start 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc9800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 0x7f4bc419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc9800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 0x7f4bc41a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.632+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33102/0 (socket says 172.21.15.33:33102) 2024-09-11T00:10:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 0x7f4bc419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 0x7f4bc419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46312/0 (socket says 172.21.15.33:46312) 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4102cf0 con 0x7f4bc4108670 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4102b70 con 0x7f4bc406b470 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4102e70 con 0x7f4bc4105ac0 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc2a00640 1 -- 172.21.15.33:0/1194671693 learned_addr learned my addr 172.21.15.33:0/1194671693 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.633+0000 7f4bc3400640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 0x7f4bc41a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc2a00640 1 -- 172.21.15.33:0/1194671693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 msgr2=0x7f4bc419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 0x7f4bc419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc2a00640 1 -- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 msgr2=0x7f4bc41a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 0x7f4bc41a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc2a00640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc41a0f60 con 0x7f4bc406b470 2024-09-11T00:10:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.634+0000 7f4bc3400640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 0x7f4bc41a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.635+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bb402a940 tx=0x7f4bb4003d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.635+0000 7f4bbb400640 1 -- 172.21.15.33:0/1194671693 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb403f070 con 0x7f4bc406b470 2024-09-11T00:10:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.635+0000 7f4bbb400640 1 -- 172.21.15.33:0/1194671693 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bb4031da0 con 0x7f4bc406b470 2024-09-11T00:10:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.635+0000 7f4bbb400640 1 -- 172.21.15.33:0/1194671693 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4035030 con 0x7f4bc406b470 2024-09-11T00:10:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.636+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc41a11f0 con 0x7f4bc406b470 2024-09-11T00:10:31.637 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.636+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc41a77c0 con 0x7f4bc406b470 2024-09-11T00:10:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.641+0000 7f4bcc7f2740 1 Processor -- start 2024-09-11T00:10:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.641+0000 7f4bcc7f2740 1 -- start start 2024-09-11T00:10:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.641+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 0x560307f0eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 0x560307f13fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560307e7f6b0 con 0x560307f11b00 2024-09-11T00:10:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560307e6eae0 con 0x560307f0f0c0 2024-09-11T00:10:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560307e728f0 con 0x560307f0c790 2024-09-11T00:10:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.642+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 0x560307f0eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.643+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 0x560307f0eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46324/0 (socket says 172.21.15.33:46324) 2024-09-11T00:10:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.643+0000 7f4bc3400640 1 -- 172.21.15.33:0/3472295826 learned_addr learned my addr 172.21.15.33:0/3472295826 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.643+0000 7f4bc2000640 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 0x560307f13fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.644+0000 7f4bbb400640 1 -- 172.21.15.33:0/1194671693 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4bb403b610 con 0x7f4bc406b470 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.645+0000 7f4bc2000640 1 -- 172.21.15.33:0/3472295826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 msgr2=0x560307f0eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.645+0000 7f4bc2000640 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 0x560307f0eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.645+0000 7f4bc2000640 1 -- 172.21.15.33:0/3472295826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 msgr2=0x560307f114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.645+0000 7f4bc2000640 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f114b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.645+0000 7f4bc2000640 1 -- 172.21.15.33:0/3472295826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560307e3b780 con 0x560307f11b00 2024-09-11T00:10:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.646+0000 7f4bc2000640 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 0x560307f13fc0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00099a0 tx=0x7f4bb0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2547acea746e57c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.647+0000 7f4bafe00640 1 -- 172.21.15.33:0/3472295826 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0017070 con 0x560307f11b00 2024-09-11T00:10:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.647+0000 7f4bafe00640 1 -- 172.21.15.33:0/3472295826 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bb0013470 con 0x560307f11b00 2024-09-11T00:10:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.647+0000 7f4bafe00640 1 -- 172.21.15.33:0/3472295826 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0012630 con 0x560307f11b00 2024-09-11T00:10:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.648+0000 7f4bbb400640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 0x7f4ba80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.648+0000 7f4bbb400640 1 -- 172.21.15.33:0/1194671693 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4bb4106d10 con 0x7f4bc406b470 2024-09-11T00:10:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.648+0000 7f4bc3400640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 0x7f4ba80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.649+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3472295826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 msgr2=0x560307f13fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.649+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 0x560307f13fc0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00099a0 tx=0x7f4bb0009e60 comp rx=0 tx=0).stop 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bc3400640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 0x7f4ba80b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00f5a0 tx=0x7f4bbc0077d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3472295826 shutdown_connections 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f11b00 0x560307f13fc0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3472295826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f0c790 0x560307f0eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3472295826 >> 172.21.15.33:0/3472295826 conn(0x560307f078e0 msgr2=0x560307f08670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3472295826 shutdown_connections 2024-09-11T00:10:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.650+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3472295826 wait complete. 2024-09-11T00:10:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.651+0000 7f4bcc7f2740 1 -- start start 2024-09-11T00:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.651+0000 7f4bcc7f2740 1 Processor -- start 2024-09-11T00:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0f0c0 0x560307f16650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f171b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560307da6ab0 con 0x560307f0f0c0 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560307e15570 con 0x560307f0c790 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560307f14ae0 con 0x560307f11b00 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.652+0000 7f4bcc7f2740 10 client.0 _ll_register_callbacks cb 0x560307e24100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.653+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.653+0000 7f4bc2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:33116/0 (socket says 172.21.15.33:33116) 2024-09-11T00:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.653+0000 7f4bc2a00640 1 -- 172.21.15.33:0/2302020398 learned_addr learned my addr 172.21.15.33:0/2302020398 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.653+0000 7f4bc3400640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f171b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.654+0000 7f4bc2a00640 1 -- 172.21.15.33:0/2302020398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 msgr2=0x560307f171b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.654+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f171b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.654+0000 7f4bc2a00640 1 -- 172.21.15.33:0/2302020398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0f0c0 msgr2=0x560307f16650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.654+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0f0c0 0x560307f16650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.654+0000 7f4bc2a00640 1 -- 172.21.15.33:0/2302020398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560307bd0790 con 0x560307f0c790 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.655+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40ccdd0 tx=0x7f4bb40c97e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67af75e4c20db426 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.655+0000 7f4bacc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.655+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4049070 con 0x560307f0c790 2024-09-11T00:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.655+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4bb40c9340 con 0x560307f0c790 2024-09-11T00:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.656+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb0013470 con 0x560307f0c790 2024-09-11T00:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.656+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4bb40cc840 con 0x560307f0c790 2024-09-11T00:10:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.656+0000 7f4bcc7f2740 10 client.36707 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.656+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560307c49620 con 0x560307f0c790 2024-09-11T00:10:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bb0013470 con 0x560307f0c790 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4bb40d61d0 con 0x560307f0c790 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 10 client.36707 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 10 client.36707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 20 client.36707 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307f21860 0x560307f23ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 4 client.36707 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.657+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560307e81600 con 0x560307f21860 2024-09-11T00:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.658+0000 7f4bc2000640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307f21860 0x560307f23ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.658+0000 7f4bacc00640 10 client.36707 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.658+0000 7f4bc2000640 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307f21860 0x560307f23ce0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b2b03c6bd63ddf server_cookie=881e90c67cedc40c in_seq=0 out_seq=0 2024-09-11T00:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.659+0000 7f4bacc00640 1 -- 172.21.15.33:0/2302020398 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560307e81600 con 0x560307f21860 2024-09-11T00:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.659+0000 7f4bacc00640 10 client.36707 handle_command_reply: tid=0 2024-09-11T00:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.660+0000 7f4bcc7f2740 1 client.36707 shutdown 2024-09-11T00:10:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.661+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 msgr2=0x560307f15fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.662 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.661+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40ccdd0 tx=0x7f4bb40c97e0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 shutdown_connections 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307f21860 0x560307f23ce0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f171b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0f0c0 0x560307f16650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/2302020398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0c790 0x560307f15fb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bacc00640 0 client.36707 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 >> 172.21.15.33:0/2302020398 conn(0x560307f078e0 msgr2=0x560307f06a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.662+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 shutdown_connections 2024-09-11T00:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.663+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/2302020398 wait complete. 2024-09-11T00:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.663+0000 7f4bcc7f2740 20 client.36707 trim_cache size 0 max 16384 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.692+0000 7f4bcc7f2740 1 Processor -- start 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 -- start start 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f15d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f11ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41b4600 con 0x560307f0c790 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41b1ed0 con 0x560307f0f0c0 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.693+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41afce0 con 0x560307f11b00 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.694+0000 7f4bc2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f11ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.694+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.694+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46350/0 (socket says 172.21.15.33:46350) 2024-09-11T00:10:31.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.694+0000 7f4bc3400640 1 -- 172.21.15.33:0/469590420 learned_addr learned my addr 172.21.15.33:0/469590420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.695+0000 7f4bc3400640 1 -- 172.21.15.33:0/469590420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 msgr2=0x560307f11ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.695+0000 7f4bc3400640 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f11ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.695+0000 7f4bc3400640 1 -- 172.21.15.33:0/469590420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 msgr2=0x560307f15d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.695+0000 7f4bc3400640 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f15d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.695+0000 7f4bc3400640 1 -- 172.21.15.33:0/469590420 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560307f15ab0 con 0x560307f11b00 2024-09-11T00:10:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.696+0000 7f4bc3400640 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc010970 tx=0x7f4bbc012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e673f5fff46c22d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.696+0000 7f4baf400640 1 -- 172.21.15.33:0/469590420 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc01edc0 con 0x560307f11b00 2024-09-11T00:10:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.696+0000 7f4baf400640 1 -- 172.21.15.33:0/469590420 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bbc026870 con 0x560307f11b00 2024-09-11T00:10:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.696+0000 7f4baf400640 1 -- 172.21.15.33:0/469590420 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0197a0 con 0x560307f11b00 2024-09-11T00:10:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.697+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/469590420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 msgr2=0x560307f12420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.697+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc010970 tx=0x7f4bbc012000 comp rx=0 tx=0).stop 2024-09-11T00:10:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/469590420 shutdown_connections 2024-09-11T00:10:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f12420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f11ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/469590420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f15d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/469590420 >> 172.21.15.33:0/469590420 conn(0x560307f078e0 msgr2=0x560307f0bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/469590420 shutdown_connections 2024-09-11T00:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/469590420 wait complete. 2024-09-11T00:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.698+0000 7f4bcc7f2740 1 -- start start 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.699+0000 7f4bcc7f2740 1 Processor -- start 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.699+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f1da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.699+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f19920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.699+0000 7f4bcc7f2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41b0390 con 0x560307f0c790 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41b1800 con 0x560307f0f0c0 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bcc7f2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41b0a60 con 0x560307f11b00 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bcc7f2740 10 client.0 _ll_register_callbacks cb 0x7f4bb4005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46354/0 (socket says 172.21.15.33:46354) 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bc3400640 1 -- 172.21.15.33:0/3968969956 learned_addr learned my addr 172.21.15.33:0/3968969956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f1da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.700+0000 7f4bc2000640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f19920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.701+0000 7f4bc3400640 1 -- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 msgr2=0x560307f19920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.701+0000 7f4bc3400640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f19920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.701+0000 7f4bc3400640 1 -- 172.21.15.33:0/3968969956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 msgr2=0x560307f1da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.701+0000 7f4bc3400640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f1da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.701+0000 7f4bc3400640 1 -- 172.21.15.33:0/3968969956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560307f12960 con 0x560307f11b00 2024-09-11T00:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.702+0000 7f4bc3400640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00fe30 tx=0x7f4bbc0105d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c4eaa4670168b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.702+0000 7f4bacc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc036020 con 0x560307f11b00 2024-09-11T00:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4bbc026670 con 0x560307f11b00 2024-09-11T00:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bbc026870 con 0x560307f11b00 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4bbc041050 con 0x560307f11b00 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bcc7f2740 10 client.26683 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.705+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560307f9f9b0 con 0x560307f11b00 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bbc026870 con 0x560307f11b00 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4bbc025070 con 0x560307f11b00 2024-09-11T00:10:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 10 client.26683 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 10 client.26683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 20 client.26683 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307fa0330 0x560307fa2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 4 client.26683 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.706+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560307e7d0b0 con 0x560307fa0330 2024-09-11T00:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.707+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307fa0330 0x560307fa2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.708+0000 7f4bc2a00640 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307fa0330 0x560307fa2750 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23428569bb803476 server_cookie=1270b3548058687e in_seq=0 out_seq=0 2024-09-11T00:10:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.708+0000 7f4bacc00640 10 client.26683 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.755+0000 7f4bacc00640 1 -- 172.21.15.33:0/3968969956 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560307e7d0b0 con 0x560307fa0330 2024-09-11T00:10:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.755+0000 7f4bacc00640 10 client.26683 handle_command_reply: tid=0 2024-09-11T00:10:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.755+0000 7f4bcc7f2740 1 client.26683 shutdown 2024-09-11T00:10:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.757+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 msgr2=0x560307f19ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.757+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00fe30 tx=0x7f4bbc0105d0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 shutdown_connections 2024-09-11T00:10:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x560307fa0330 0x560307fa2750 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560307f11b00 0x560307f19ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560307f0f0c0 0x560307f19920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 --2- 172.21.15.33:0/3968969956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560307f0c790 0x560307f1da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bacc00640 0 client.26683 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 >> 172.21.15.33:0/3968969956 conn(0x560307f078e0 msgr2=0x560307f08140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 shutdown_connections 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 1 -- 172.21.15.33:0/3968969956 wait complete. 2024-09-11T00:10:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.758+0000 7f4bcc7f2740 20 client.26683 trim_cache size 0 max 16384 2024-09-11T00:10:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:10:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:10:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:10:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.759+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 msgr2=0x7f4ba80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.759+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 0x7f4ba80b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00f5a0 tx=0x7f4bbc0077d0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.759+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 msgr2=0x7f4bc419f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.759+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4bb402a940 tx=0x7f4bb4003d30 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 shutdown_connections 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ba80b5360 0x7f4ba80b7820 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bc4108670 0x7f4bc41a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bc4105ac0 0x7f4bc419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 --2- 172.21.15.33:0/1194671693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc406b470 0x7f4bc419f420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.760+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 >> 172.21.15.33:0/1194671693 conn(0x7f4bc40fd140 msgr2=0x7f4bc41093c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.761+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 shutdown_connections 2024-09-11T00:10:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:31.763+0000 7f4bc9800640 1 -- 172.21.15.33:0/1194671693 wait complete. 2024-09-11T00:10:32.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:32 smithi052 ceph-mon[33526]: pgmap v849: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 621 op/s 2024-09-11T00:10:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:32 smithi033 ceph-mon[30593]: pgmap v849: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 621 op/s 2024-09-11T00:10:33.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:32 smithi189 ceph-mon[34000]: pgmap v849: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 621 op/s 2024-09-11T00:10:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 645.0 s, 566.8 tps, lat 174.079 ms stddev 59.029 2024-09-11T00:10:33.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:33.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:33.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:10:34.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:34.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:34.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:10:34.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:34.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:34.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:10:34.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:34 smithi052 ceph-mon[33526]: pgmap v850: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 706 op/s 2024-09-11T00:10:35.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:34 smithi033 ceph-mon[30593]: pgmap v850: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 706 op/s 2024-09-11T00:10:35.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:34 smithi189 ceph-mon[34000]: pgmap v850: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 706 op/s 2024-09-11T00:10:36.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:36 smithi189 ceph-mon[34000]: pgmap v851: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-09-11T00:10:36.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:36 smithi052 ceph-mon[33526]: pgmap v851: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-09-11T00:10:37.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:36 smithi033 ceph-mon[30593]: pgmap v851: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-09-11T00:10:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 650.0 s, 605.4 tps, lat 166.699 ms stddev 82.478 2024-09-11T00:10:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:38 smithi052 ceph-mon[33526]: pgmap v852: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-11T00:10:39.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:38 smithi033 ceph-mon[30593]: pgmap v852: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-11T00:10:39.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:38 smithi189 ceph-mon[34000]: pgmap v852: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.8 MiB/s wr, 696 op/s 2024-09-11T00:10:40.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:40 smithi052 ceph-mon[33526]: pgmap v853: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-11T00:10:41.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:40 smithi033 ceph-mon[30593]: pgmap v853: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-11T00:10:41.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:40 smithi189 ceph-mon[34000]: pgmap v853: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-11T00:10:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:42 smithi052 ceph-mon[33526]: pgmap v854: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 594 op/s 2024-09-11T00:10:43.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:42 smithi033 ceph-mon[30593]: pgmap v854: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 594 op/s 2024-09-11T00:10:43.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:42 smithi189 ceph-mon[34000]: pgmap v854: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 594 op/s 2024-09-11T00:10:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 655.0 s, 658.2 tps, lat 153.687 ms stddev 59.917 2024-09-11T00:10:44.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:44 smithi052 ceph-mon[33526]: pgmap v855: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 678 op/s 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 -- 172.21.15.33:0/2250687076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c8105cf0 msgr2=0x7f80c8106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 --2- 172.21.15.33:0/2250687076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c8105cf0 0x7f80c8106170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009900 tx=0x7f80b402a400 comp rx=0 tx=0).stop 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 -- 172.21.15.33:0/2250687076 shutdown_connections 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 --2- 172.21.15.33:0/2250687076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c81066b0 0x7f80c8111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 --2- 172.21.15.33:0/2250687076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c8105cf0 0x7f80c8106170 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 --2- 172.21.15.33:0/2250687076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c8104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.990+0000 7f80cce00640 1 -- 172.21.15.33:0/2250687076 >> 172.21.15.33:0/2250687076 conn(0x7f80c8100440 msgr2=0x7f80c8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.991+0000 7f80cce00640 1 -- 172.21.15.33:0/2250687076 shutdown_connections 2024-09-11T00:10:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.991+0000 7f80cce00640 1 -- 172.21.15.33:0/2250687076 wait complete. 2024-09-11T00:10:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.992+0000 7f80cce00640 1 Processor -- start 2024-09-11T00:10:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.992+0000 7f80cce00640 1 -- start start 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c81066b0 0x7f80c81a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8114b50 con 0x7f80c8104ba0 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81149d0 con 0x7f80c8105cf0 2024-09-11T00:10:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80cce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8114cd0 con 0x7f80c81066b0 2024-09-11T00:10:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.993+0000 7f80c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35830/0 (socket says 172.21.15.33:35830) 2024-09-11T00:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.994+0000 7f80c5400640 1 -- 172.21.15.33:0/4052510817 learned_addr learned my addr 172.21.15.33:0/4052510817 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.994+0000 7f80c6800640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c81066b0 0x7f80c81a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.994+0000 7f80c5400640 1 -- 172.21.15.33:0/4052510817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c81066b0 msgr2=0x7f80c81a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.994+0000 7f80c5e00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5400640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c81066b0 0x7f80c81a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5400640 1 -- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 msgr2=0x7f80c819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5400640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5400640 1 -- 172.21.15.33:0/4052510817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c81a0e00 con 0x7f80c8105cf0 2024-09-11T00:10:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5e00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.995+0000 7f80c5400640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80b402a970 tx=0x7f80b4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.996+0000 7f80bea00640 1 -- 172.21.15.33:0/4052510817 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b403f070 con 0x7f80c8105cf0 2024-09-11T00:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.996+0000 7f80bea00640 1 -- 172.21.15.33:0/4052510817 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b4031b00 con 0x7f80c8105cf0 2024-09-11T00:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.996+0000 7f80bea00640 1 -- 172.21.15.33:0/4052510817 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4035030 con 0x7f80c8105cf0 2024-09-11T00:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.997+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c81a1090 con 0x7f80c8105cf0 2024-09-11T00:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:44.997+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c81a75e0 con 0x7f80c8105cf0 2024-09-11T00:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.005+0000 7f80cfe1e740 1 Processor -- start 2024-09-11T00:10:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 -- start start 2024-09-11T00:10:45.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca695b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca6066b0 con 0x55d7ca693790 2024-09-11T00:10:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca5f5ae0 con 0x55d7ca6960c0 2024-09-11T00:10:45.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.007+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca5f98f0 con 0x55d7ca698b00 2024-09-11T00:10:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.008+0000 7f80bea00640 1 -- 172.21.15.33:0/4052510817 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f80b4031670 con 0x7f80c8105cf0 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.008+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.008+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35844/0 (socket says 172.21.15.33:35844) 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.008+0000 7f80c5e00640 1 -- 172.21.15.33:0/3298061981 learned_addr learned my addr 172.21.15.33:0/3298061981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.008+0000 7f80c6800640 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca695b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5400640 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5e00640 1 -- 172.21.15.33:0/3298061981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 msgr2=0x55d7ca69afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5e00640 1 -- 172.21.15.33:0/3298061981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 msgr2=0x55d7ca695b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca695b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.009+0000 7f80c5e00640 1 -- 172.21.15.33:0/3298061981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ca5c2780 con 0x55d7ca6960c0 2024-09-11T00:10:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.010+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009c30 tx=0x7f80b8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab73218379ad7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.010+0000 7f80b3400640 1 -- 172.21.15.33:0/3298061981 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8004030 con 0x55d7ca6960c0 2024-09-11T00:10:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.010+0000 7f80b3400640 1 -- 172.21.15.33:0/3298061981 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b80035f0 con 0x55d7ca6960c0 2024-09-11T00:10:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.010+0000 7f80b3400640 1 -- 172.21.15.33:0/3298061981 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80126b0 con 0x55d7ca6960c0 2024-09-11T00:10:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.011+0000 7f80bea00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 0x7f80ac0b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.012+0000 7f80bea00640 1 -- 172.21.15.33:0/4052510817 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f80b41067f0 con 0x7f80c8105cf0 2024-09-11T00:10:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.012+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3298061981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 msgr2=0x55d7ca6984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.012+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009c30 tx=0x7f80b8010740 comp rx=0 tx=0).stop 2024-09-11T00:10:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.013+0000 7f80c6800640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 0x7f80ac0b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.014+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3298061981 shutdown_connections 2024-09-11T00:10:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.014+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.014+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca6984b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.014+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3298061981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca695b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.014+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3298061981 >> 172.21.15.33:0/3298061981 conn(0x55d7ca68e8e0 msgr2=0x55d7ca68f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.015+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3298061981 shutdown_connections 2024-09-11T00:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.016+0000 7f80c6800640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 0x7f80ac0b7930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f80c81a0040 tx=0x7f80c0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.016+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3298061981 wait complete. 2024-09-11T00:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.017+0000 7f80cfe1e740 1 -- start start 2024-09-11T00:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.017+0000 7f80cfe1e740 1 Processor -- start 2024-09-11T00:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.018+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca69cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.018+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca69d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.018+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca69d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca69d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35846/0 (socket says 172.21.15.33:35846) 2024-09-11T00:10:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80c5400640 1 -- 172.21.15.33:0/561532420 learned_addr learned my addr 172.21.15.33:0/561532420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80c6800640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca52dab0 con 0x55d7ca693790 2024-09-11T00:10:45.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.019+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca59c570 con 0x55d7ca6960c0 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.020+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7ca69bae0 con 0x55d7ca698b00 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.020+0000 7f80cfe1e740 10 client.0 _ll_register_callbacks cb 0x55d7ca5ab100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.020+0000 7f80c5e00640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca69cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c6800640 1 -- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 msgr2=0x55d7ca69d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c6800640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca69d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c6800640 1 -- 172.21.15.33:0/561532420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 msgr2=0x55d7ca69cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c6800640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca69cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c6800640 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ca357790 con 0x55d7ca698b00 2024-09-11T00:10:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.021+0000 7f80c5e00640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca69cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.022+0000 7f80c6800640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69e120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f80c0004010 tx=0x7f80c0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c52256338e117f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:45.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.022+0000 7f80a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:10:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.022+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0010d40 con 0x55d7ca698b00 2024-09-11T00:10:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.023+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f80c001b460 con 0x55d7ca698b00 2024-09-11T00:10:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.023+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b80035f0 con 0x55d7ca698b00 2024-09-11T00:10:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.023+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f80c001b660 con 0x55d7ca698b00 2024-09-11T00:10:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.023+0000 7f80cfe1e740 10 client.26695 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.023+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7ca3d0620 con 0x55d7ca698b00 2024-09-11T00:10:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b80035f0 con 0x55d7ca698b00 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f80c0024070 con 0x55d7ca698b00 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 10 client.26695 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 10 client.26695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 20 client.26695 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca6a8810 0x55d7ca6aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 4 client.26695 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:45.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:44 smithi033 ceph-mon[30593]: pgmap v855: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 678 op/s 2024-09-11T00:10:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.024+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7ca608600 con 0x55d7ca6a8810 2024-09-11T00:10:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.025+0000 7f80c5e00640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca6a8810 0x55d7ca6aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.027+0000 7f80c5e00640 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca6a8810 0x55d7ca6aac40 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b66338097e7ff2d server_cookie=b9b71b8e620aae61 in_seq=0 out_seq=0 2024-09-11T00:10:45.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.027+0000 7f80a7e00640 10 client.26695 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.029+0000 7f80a7e00640 1 -- 172.21.15.33:0/561532420 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7ca608600 con 0x55d7ca6a8810 2024-09-11T00:10:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.029+0000 7f80a7e00640 10 client.26695 handle_command_reply: tid=0 2024-09-11T00:10:45.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.029+0000 7f80cfe1e740 1 client.26695 shutdown 2024-09-11T00:10:45.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 msgr2=0x55d7ca69e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69e120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f80c0004010 tx=0x7f80c0004a40 comp rx=0 tx=0).stop 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 shutdown_connections 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca6a8810 0x55d7ca6aac40 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca69e120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca69d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80a7e00640 0 client.26695 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/561532420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca69cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.030+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 >> 172.21.15.33:0/561532420 conn(0x55d7ca68e8e0 msgr2=0x55d7ca68da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:45.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.031+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 shutdown_connections 2024-09-11T00:10:45.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.031+0000 7f80cfe1e740 1 -- 172.21.15.33:0/561532420 wait complete. 2024-09-11T00:10:45.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.032+0000 7f80cfe1e740 20 client.26695 trim_cache size 0 max 16384 2024-09-11T00:10:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.063+0000 7f80cfe1e740 1 Processor -- start 2024-09-11T00:10:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.063+0000 7f80cfe1e740 1 -- start start 2024-09-11T00:10:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.065 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca698ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca699420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81b4530 con 0x55d7ca693790 2024-09-11T00:10:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81b1e00 con 0x55d7ca6960c0 2024-09-11T00:10:45.066 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.064+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81afc50 con 0x55d7ca698b00 2024-09-11T00:10:45.067 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.067 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54404/0 (socket says 172.21.15.33:54404) 2024-09-11T00:10:45.067 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 -- 172.21.15.33:0/2966644289 learned_addr learned my addr 172.21.15.33:0/2966644289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:45.067 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5400640 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca698ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.067 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c6800640 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca699420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 -- 172.21.15.33:0/2966644289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 msgr2=0x55d7ca699420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca699420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 -- 172.21.15.33:0/2966644289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 msgr2=0x55d7ca698ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca698ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.065+0000 7f80c5e00640 1 -- 172.21.15.33:0/2966644289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ca695ef0 con 0x55d7ca693790 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.066+0000 7f80c5e00640 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f80b8010c40 tx=0x7f80b80095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73547970109128eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:45.068 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.067+0000 7f80b2a00640 1 -- 172.21.15.33:0/2966644289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8032070 con 0x55d7ca693790 2024-09-11T00:10:45.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.067+0000 7f80b2a00640 1 -- 172.21.15.33:0/2966644289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b802a070 con 0x55d7ca693790 2024-09-11T00:10:45.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.067+0000 7f80b2a00640 1 -- 172.21.15.33:0/2966644289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80039f0 con 0x55d7ca693790 2024-09-11T00:10:45.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.068+0000 7f80cfe1e740 1 -- 172.21.15.33:0/2966644289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 msgr2=0x55d7ca689b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.069 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.068+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f80b8010c40 tx=0x7f80b80095f0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.068+0000 7f80cfe1e740 1 -- 172.21.15.33:0/2966644289 shutdown_connections 2024-09-11T00:10:45.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca698b00 0x55d7ca699420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca6960c0 0x55d7ca698ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/2966644289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca693790 0x55d7ca689b40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.070 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 -- 172.21.15.33:0/2966644289 >> 172.21.15.33:0/2966644289 conn(0x55d7ca68e8e0 msgr2=0x55d7ca68f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 -- 172.21.15.33:0/2966644289 shutdown_connections 2024-09-11T00:10:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 -- 172.21.15.33:0/2966644289 wait complete. 2024-09-11T00:10:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.069+0000 7f80cfe1e740 1 -- start start 2024-09-11T00:10:45.071 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 Processor -- start 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 0x55d7ca6a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca698b00 0x55d7ca6a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81b02c0 con 0x55d7ca6960c0 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81b1730 con 0x55d7ca698b00 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81b0990 con 0x55d7ca693790 2024-09-11T00:10:45.072 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.070+0000 7f80cfe1e740 10 client.0 _ll_register_callbacks cb 0x7f80c00099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.071+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.071+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:52168/0 (socket says 172.21.15.33:52168) 2024-09-11T00:10:45.073 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.071+0000 7f80c5e00640 1 -- 172.21.15.33:0/3352403024 learned_addr learned my addr 172.21.15.33:0/3352403024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.071+0000 7f80c6800640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca698b00 0x55d7ca6a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.071+0000 7f80c5400640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 0x55d7ca6a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5e00640 1 -- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca698b00 msgr2=0x55d7ca6a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca698b00 0x55d7ca6a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5e00640 1 -- 172.21.15.33:0/3352403024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 msgr2=0x55d7ca6a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 0x55d7ca6a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5e00640 1 -- 172.21.15.33:0/3352403024 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ca6a24c0 con 0x55d7ca693790 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.072+0000 7f80c5400640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 0x55d7ca6a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.073+0000 7f80a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:10:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.073+0000 7f80c5e00640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009430 tx=0x7f80b8005380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815a0a16f732be3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:45.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:44 smithi189 ceph-mon[34000]: pgmap v855: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.8 MiB/s wr, 678 op/s 2024-09-11T00:10:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.087+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8032070 con 0x55d7ca693790 2024-09-11T00:10:45.089 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.087+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f80b8003b00 con 0x55d7ca693790 2024-09-11T00:10:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.088+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80b802a070 con 0x55d7ca693790 2024-09-11T00:10:45.093 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.092+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f80b8005c50 con 0x55d7ca693790 2024-09-11T00:10:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.092+0000 7f80cfe1e740 10 client.26701 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.092+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7ca7269f0 con 0x55d7ca693790 2024-09-11T00:10:45.094 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.093+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80b802a070 con 0x55d7ca693790 2024-09-11T00:10:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.093+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f80b800f040 con 0x55d7ca693790 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 10 client.26701 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 10 client.26701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 20 client.26701 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca7270b0 0x55d7ca7294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 4 client.26701 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:10:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.095+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7ca6040b0 con 0x55d7ca7270b0 2024-09-11T00:10:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.096+0000 7f80c5400640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca7270b0 0x55d7ca7294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.097+0000 7f80c5400640 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca7270b0 0x55d7ca7294d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b00215fdf1de1727 server_cookie=a4ca206a91069482 in_seq=0 out_seq=0 2024-09-11T00:10:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.098+0000 7f80a7e00640 10 client.26701 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.133+0000 7f80a7e00640 1 -- 172.21.15.33:0/3352403024 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7ca6040b0 con 0x55d7ca7270b0 2024-09-11T00:10:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.133+0000 7f80a7e00640 10 client.26701 handle_command_reply: tid=0 2024-09-11T00:10:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.133+0000 7f80cfe1e740 1 client.26701 shutdown 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 msgr2=0x55d7ca6a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009430 tx=0x7f80b8005380 comp rx=0 tx=0).stop 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 shutdown_connections 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ca698b00 0x55d7ca6a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d7ca6960c0 0x55d7ca6a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d7ca7270b0 0x55d7ca7294d0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 --2- 172.21.15.33:0/3352403024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d7ca693790 0x55d7ca6a4be0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80a7e00640 0 client.26701 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.134+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 >> 172.21.15.33:0/3352403024 conn(0x55d7ca68e8e0 msgr2=0x55d7ca692880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.135+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 shutdown_connections 2024-09-11T00:10:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.135+0000 7f80cfe1e740 1 -- 172.21.15.33:0/3352403024 wait complete. 2024-09-11T00:10:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.136+0000 7f80cfe1e740 20 client.26701 trim_cache size 0 max 16384 2024-09-11T00:10:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:10:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:10:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:10:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:10:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.137+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 msgr2=0x7f80ac0b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.137+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 0x7f80ac0b7930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f80c81a0040 tx=0x7f80c0009500 comp rx=0 tx=0).stop 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.137+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 msgr2=0x7f80c819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.137+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f80b402a970 tx=0x7f80b4003b90 comp rx=0 tx=0).stop 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 shutdown_connections 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f80ac0b5470 0x7f80ac0b7930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80c81066b0 0x7f80c81a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80c8105cf0 0x7f80c819f910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 --2- 172.21.15.33:0/4052510817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c8104ba0 0x7f80c819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.138+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 >> 172.21.15.33:0/4052510817 conn(0x7f80c8100440 msgr2=0x7f80c8100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.139+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 shutdown_connections 2024-09-11T00:10:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:45.139+0000 7f80cce00640 1 -- 172.21.15.33:0/4052510817 wait complete. 2024-09-11T00:10:46.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:46 smithi052 ceph-mon[33526]: pgmap v856: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2024-09-11T00:10:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:46 smithi033 ceph-mon[30593]: pgmap v856: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2024-09-11T00:10:47.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:46 smithi189 ceph-mon[34000]: pgmap v856: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2024-09-11T00:10:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 660.0 s, 601.6 tps, lat 164.906 ms stddev 53.280 2024-09-11T00:10:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:48 smithi052 ceph-mon[33526]: pgmap v857: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-11T00:10:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:48 smithi033 ceph-mon[30593]: pgmap v857: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-11T00:10:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:48 smithi189 ceph-mon[34000]: pgmap v857: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-11T00:10:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:50 smithi052 ceph-mon[33526]: pgmap v858: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 591 op/s 2024-09-11T00:10:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:50 smithi033 ceph-mon[30593]: pgmap v858: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 591 op/s 2024-09-11T00:10:51.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:50 smithi189 ceph-mon[34000]: pgmap v858: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.8 MiB/s wr, 591 op/s 2024-09-11T00:10:51.479 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:10:51.479 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-11T00:10:51.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:10:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:52.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:52 smithi033 ceph-mon[30593]: pgmap v859: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-09-11T00:10:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:52 smithi052 ceph-mon[33526]: pgmap v859: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-09-11T00:10:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:52 smithi189 ceph-mon[34000]: pgmap v859: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 609 op/s 2024-09-11T00:10:53.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.224+0000 7f49a3200640 1 -- 172.21.15.33:0/1947739983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4107510 msgr2=0x7f49a4107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:53.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.224+0000 7f49a3200640 1 --2- 172.21.15.33:0/1947739983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4107510 0x7f49a4107950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4994009900 tx=0x7f499402a400 comp rx=0 tx=0).stop 2024-09-11T00:10:53.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.226+0000 7f49a3200640 1 -- 172.21.15.33:0/1947739983 shutdown_connections 2024-09-11T00:10:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.226+0000 7f49a3200640 1 --2- 172.21.15.33:0/1947739983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107e90 0x7f49a410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.226+0000 7f49a3200640 1 --2- 172.21.15.33:0/1947739983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4107510 0x7f49a4107950 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.226+0000 7f49a3200640 1 --2- 172.21.15.33:0/1947739983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4101b00 0x7f49a4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.226+0000 7f49a3200640 1 -- 172.21.15.33:0/1947739983 >> 172.21.15.33:0/1947739983 conn(0x7f49a40fd5b0 msgr2=0x7f49a40ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.228+0000 7f49a3200640 1 -- 172.21.15.33:0/1947739983 shutdown_connections 2024-09-11T00:10:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.228+0000 7f49a3200640 1 -- 172.21.15.33:0/1947739983 wait complete. 2024-09-11T00:10:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.231+0000 7f49a3200640 1 Processor -- start 2024-09-11T00:10:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.231+0000 7f49a3200640 1 -- start start 2024-09-11T00:10:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.232+0000 7f49a3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 0x7f49a419d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.233+0000 7f49a3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107510 0x7f49a419de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.233+0000 7f49a3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 0x7f49a4196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.233+0000 7f49a1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 0x7f49a419d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 0x7f49a4196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107510 0x7f49a419de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 0x7f49a419d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39750/0 (socket says 172.21.15.33:39750) 2024-09-11T00:10:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a1e00640 1 -- 172.21.15.33:0/1923399950 learned_addr learned my addr 172.21.15.33:0/1923399950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4110910 con 0x7f49a4107510 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4110790 con 0x7f49a4107e90 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.234+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4110a90 con 0x7f49a4101b00 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.236+0000 7f49a2800640 1 -- 172.21.15.33:0/1923399950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 msgr2=0x7f49a419d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.236+0000 7f49a2800640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 0x7f49a419d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.236+0000 7f49a2800640 1 -- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107510 msgr2=0x7f49a419de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:53.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.236+0000 7f49a2800640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107510 0x7f49a419de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.237+0000 7f49a2800640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a4197460 con 0x7f49a4107e90 2024-09-11T00:10:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.238+0000 7f49a2800640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 0x7f49a4196ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f499000c970 tx=0x7f499000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.238+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990007bb0 con 0x7f49a4107e90 2024-09-11T00:10:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.238+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4990007d50 con 0x7f49a4107e90 2024-09-11T00:10:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.238+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990007bb0 con 0x7f49a4107e90 2024-09-11T00:10:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.238+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a4197750 con 0x7f49a4107e90 2024-09-11T00:10:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.239+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a419c710 con 0x7f49a4107e90 2024-09-11T00:10:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.241+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a4102db0 con 0x7f49a4107e90 2024-09-11T00:10:53.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.247+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f499000f450 con 0x7f49a4107e90 2024-09-11T00:10:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.250+0000 7f499aa00640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 0x7f49880b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.251+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f49900e5ba0 con 0x7f49a4107e90 2024-09-11T00:10:53.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.253+0000 7f49a1e00640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 0x7f49880b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:53.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.253+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4990014030 con 0x7f49a4107e90 2024-09-11T00:10:53.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.257+0000 7f49a1e00640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 0x7f49880b7ac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f499c00a2b0 tx=0x7f499c00b300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 665.0 s, 573.4 tps, lat 174.088 ms stddev 67.851 2024-09-11T00:10:53.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.664+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49a419c9d0 con 0x7f49a4107e90 2024-09-11T00:10:53.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.665+0000 7f499aa00640 1 -- 172.21.15.33:0/1923399950 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f49900b3e20 con 0x7f49a4107e90 2024-09-11T00:10:53.671 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:10:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:10:53.671 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:10:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 msgr2=0x7f49880b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 0x7f49880b7ac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f499c00a2b0 tx=0x7f499c00b300 comp rx=0 tx=0).stop 2024-09-11T00:10:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 msgr2=0x7f49a4196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 0x7f49a4196ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f499000c970 tx=0x7f499000ce30 comp rx=0 tx=0).stop 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 shutdown_connections 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f49880b5600 0x7f49880b7ac0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49a4107e90 0x7f49a4196ba0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49a4107510 0x7f49a419de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 --2- 172.21.15.33:0/1923399950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49a4101b00 0x7f49a419d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.670+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 >> 172.21.15.33:0/1923399950 conn(0x7f49a40fd5b0 msgr2=0x7f49a4105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.671+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 shutdown_connections 2024-09-11T00:10:53.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:10:53.671+0000 7f49a3200640 1 -- 172.21.15.33:0/1923399950 wait complete. 2024-09-11T00:10:54.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:53 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1923399950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:54.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:53 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1923399950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:54.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:53 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1923399950' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:10:55.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:54 smithi033 ceph-mon[30593]: pgmap v860: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 666 op/s 2024-09-11T00:10:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:54 smithi189 ceph-mon[34000]: pgmap v860: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 666 op/s 2024-09-11T00:10:55.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:54 smithi052 ceph-mon[33526]: pgmap v860: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 666 op/s 2024-09-11T00:10:55.469 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-11T00:10:55.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-11T00:10:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:10:56.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:56 smithi033 ceph-mon[30593]: pgmap v861: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-11T00:10:57.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:56 smithi189 ceph-mon[34000]: pgmap v861: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-11T00:10:57.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:56 smithi052 ceph-mon[33526]: pgmap v861: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.7 MiB/s wr, 504 op/s 2024-09-11T00:10:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 670.0 s, 500.8 tps, lat 200.875 ms stddev 127.127 2024-09-11T00:10:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.569+0000 7efd7e200640 1 -- 172.21.15.33:0/2794026371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 msgr2=0x7efd78109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.569+0000 7efd7e200640 1 --2- 172.21.15.33:0/2794026371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78109630 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efd68009930 tx=0x7efd6802a420 comp rx=0 tx=0).stop 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 -- 172.21.15.33:0/2794026371 shutdown_connections 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 --2- 172.21.15.33:0/2794026371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810aac0 0x7efd78111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 --2- 172.21.15.33:0/2794026371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd7810a100 0x7efd7810a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 --2- 172.21.15.33:0/2794026371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78109630 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 -- 172.21.15.33:0/2794026371 >> 172.21.15.33:0/2794026371 conn(0x7efd780783d0 msgr2=0x7efd7807a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.570+0000 7efd7e200640 1 -- 172.21.15.33:0/2794026371 shutdown_connections 2024-09-11T00:10:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.571+0000 7efd7e200640 1 -- 172.21.15.33:0/2794026371 wait complete. 2024-09-11T00:10:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.573+0000 7efd7e200640 1 Processor -- start 2024-09-11T00:10:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.575+0000 7efd7e200640 1 -- start start 2024-09-11T00:10:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.576+0000 7efd7e200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.577+0000 7efd7e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810a100 0x7efd78083400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.577+0000 7efd7e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd7810aac0 0x7efd78081960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.577+0000 7efd77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.577+0000 7efd77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52746/0 (socket says 172.21.15.33:52746) 2024-09-11T00:10:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd7e200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd7807c100 con 0x7efd78109230 2024-09-11T00:10:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd7e200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd7807bf80 con 0x7efd7810a100 2024-09-11T00:10:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd7e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd7807c280 con 0x7efd7810aac0 2024-09-11T00:10:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 -- 172.21.15.33:0/2558059520 learned_addr learned my addr 172.21.15.33:0/2558059520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd76a00640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810a100 0x7efd78083400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 -- 172.21.15.33:0/2558059520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd7810aac0 msgr2=0x7efd78081960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:10:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd7810aac0 0x7efd78081960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 -- 172.21.15.33:0/2558059520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810a100 msgr2=0x7efd78083400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810a100 0x7efd78083400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.578+0000 7efd77400640 1 -- 172.21.15.33:0/2558059520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd78081f20 con 0x7efd78109230 2024-09-11T00:10:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.582+0000 7efd77400640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efd68031460 tx=0x7efd68003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.583+0000 7efd6fe00640 1 -- 172.21.15.33:0/2558059520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6803f070 con 0x7efd78109230 2024-09-11T00:10:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.583+0000 7efd6fe00640 1 -- 172.21.15.33:0/2558059520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd68031da0 con 0x7efd78109230 2024-09-11T00:10:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.583+0000 7efd6fe00640 1 -- 172.21.15.33:0/2558059520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68035030 con 0x7efd78109230 2024-09-11T00:10:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.584+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd780821b0 con 0x7efd78109230 2024-09-11T00:10:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.584+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd780826d0 con 0x7efd78109230 2024-09-11T00:10:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 Processor -- start 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 -- start start 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c36790 0x563716c38b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c3b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563716ba96b0 con 0x563716c390c0 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563716b98ae0 con 0x563716c3bb00 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.593+0000 7efd810c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563716b9c8f0 con 0x563716c36790 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.594+0000 7efd76a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.594+0000 7efd76a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57304/0 (socket says 172.21.15.33:57304) 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.594+0000 7efd76a00640 1 -- 172.21.15.33:0/1165754896 learned_addr learned my addr 172.21.15.33:0/1165754896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.594+0000 7efd77e00640 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c36790 0x563716c38b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.595+0000 7efd76a00640 1 -- 172.21.15.33:0/1165754896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c36790 msgr2=0x563716c38b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.595+0000 7efd76a00640 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c36790 0x563716c38b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.595+0000 7efd76a00640 1 -- 172.21.15.33:0/1165754896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 msgr2=0x563716c3b4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.595+0000 7efd76a00640 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c3b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.595+0000 7efd76a00640 1 -- 172.21.15.33:0/1165754896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563716b65780 con 0x563716c3bb00 2024-09-11T00:10:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.596+0000 7efd76a00640 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd6400bcb0 tx=0x7efd640107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72eaed956faa076 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.596+0000 7efd63e00640 1 -- 172.21.15.33:0/1165754896 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64004030 con 0x563716c3bb00 2024-09-11T00:10:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.596+0000 7efd63e00640 1 -- 172.21.15.33:0/1165754896 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd640035f0 con 0x563716c3bb00 2024-09-11T00:10:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.597+0000 7efd810c9740 1 -- 172.21.15.33:0/1165754896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 msgr2=0x563716c3dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.597+0000 7efd810c9740 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd6400bcb0 tx=0x7efd640107a0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.598+0000 7efd810c9740 1 -- 172.21.15.33:0/1165754896 shutdown_connections 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.598+0000 7efd810c9740 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c3dfc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.598+0000 7efd6fe00640 1 -- 172.21.15.33:0/2558059520 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efd6803b460 con 0x7efd78109230 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.599+0000 7efd810c9740 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c3b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.599+0000 7efd810c9740 1 --2- 172.21.15.33:0/1165754896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c36790 0x563716c38b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.600 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.599+0000 7efd810c9740 1 -- 172.21.15.33:0/1165754896 >> 172.21.15.33:0/1165754896 conn(0x563716c318e0 msgr2=0x563716c32670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.602+0000 7efd6fe00640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 0x7efd5c0b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.603+0000 7efd6fe00640 1 -- 172.21.15.33:0/2558059520 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efd68106b10 con 0x7efd78109230 2024-09-11T00:10:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.604+0000 7efd76a00640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 0x7efd5c0b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.606+0000 7efd76a00640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 0x7efd5c0b7770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd6400bc80 tx=0x7efd64013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.606+0000 7efd810c9740 1 -- 172.21.15.33:0/1165754896 shutdown_connections 2024-09-11T00:10:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.606+0000 7efd810c9740 1 -- 172.21.15.33:0/1165754896 wait complete. 2024-09-11T00:10:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.607+0000 7efd810c9740 1 -- start start 2024-09-11T00:10:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.607+0000 7efd810c9740 1 Processor -- start 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 0x563716c3ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563716ad0ab0 con 0x563716c390c0 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563716b3f570 con 0x563716c36790 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563716c3eb30 con 0x563716c3bb00 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.608+0000 7efd810c9740 10 client.0 _ll_register_callbacks cb 0x563716b4e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.609+0000 7efd77e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.609+0000 7efd77e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39774/0 (socket says 172.21.15.33:39774) 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.609+0000 7efd77e00640 1 -- 172.21.15.33:0/507803080 learned_addr learned my addr 172.21.15.33:0/507803080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.609+0000 7efd77400640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 0x563716c3ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.609+0000 7efd76a00640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd76a00640 1 -- 172.21.15.33:0/507803080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 msgr2=0x563716c411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd76a00640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd76a00640 1 -- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 msgr2=0x563716c3ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd76a00640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 0x563716c3ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd76a00640 1 -- 172.21.15.33:0/507803080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637168fa790 con 0x563716c390c0 2024-09-11T00:10:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.610+0000 7efd77400640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 0x563716c3ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.612+0000 7efd76a00640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c405d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b620 tx=0x7efd640107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ae4193cdef1258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.614+0000 7efd60c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:10:58.615 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.614+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd640039d0 con 0x563716c390c0 2024-09-11T00:10:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.615+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efd64005520 con 0x563716c390c0 2024-09-11T00:10:58.616 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.615+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd640035f0 con 0x563716c390c0 2024-09-11T00:10:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.617+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efd640039d0 con 0x563716c390c0 2024-09-11T00:10:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.618+0000 7efd810c9740 10 client.16881 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.618+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563716973620 con 0x563716c390c0 2024-09-11T00:10:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.619+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd640035f0 con 0x563716c390c0 2024-09-11T00:10:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.623+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efd64030070 con 0x563716c390c0 2024-09-11T00:10:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.623+0000 7efd810c9740 10 client.16881 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.624+0000 7efd810c9740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.624+0000 7efd810c9740 20 client.16881 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.625+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716c4b6b0 0x563716c4db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.625+0000 7efd810c9740 4 client.16881 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:10:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.625+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563716bab600 con 0x563716c4b6b0 2024-09-11T00:10:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.626+0000 7efd77400640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716c4b6b0 0x563716c4db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.628+0000 7efd77400640 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716c4b6b0 0x563716c4db10 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f4ac85e10270b0a server_cookie=18a14b7ea8422aa1 in_seq=0 out_seq=0 2024-09-11T00:10:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.628+0000 7efd60c00640 10 client.16881 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.629+0000 7efd60c00640 1 -- 172.21.15.33:0/507803080 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563716bab600 con 0x563716c4b6b0 2024-09-11T00:10:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.629+0000 7efd60c00640 10 client.16881 handle_command_reply: tid=0 2024-09-11T00:10:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.629+0000 7efd810c9740 1 client.16881 shutdown 2024-09-11T00:10:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.630+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 msgr2=0x563716c405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.630+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c405d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b620 tx=0x7efd640107a0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 shutdown_connections 2024-09-11T00:10:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716c4b6b0 0x563716c4db10 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd60c00640 0 client.16881 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c390c0 0x563716c405d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 --2- 172.21.15.33:0/507803080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c36790 0x563716c3ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 >> 172.21.15.33:0/507803080 conn(0x563716c318e0 msgr2=0x563716c30a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.631+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 shutdown_connections 2024-09-11T00:10:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.632+0000 7efd810c9740 1 -- 172.21.15.33:0/507803080 wait complete. 2024-09-11T00:10:58.634 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.632+0000 7efd810c9740 20 client.16881 trim_cache size 0 max 16384 2024-09-11T00:10:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.672+0000 7efd810c9740 1 Processor -- start 2024-09-11T00:10:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 -- start start 2024-09-11T00:10:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c4d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 0x563716c48220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c5580 con 0x563716c36790 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c2e50 con 0x563716c390c0 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.673+0000 7efd810c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c0ca0 con 0x563716c3bb00 2024-09-11T00:10:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.674+0000 7efd77e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.674+0000 7efd77e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39782/0 (socket says 172.21.15.33:39782) 2024-09-11T00:10:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.674+0000 7efd77e00640 1 -- 172.21.15.33:0/2784332227 learned_addr learned my addr 172.21.15.33:0/2784332227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.675+0000 7efd77e00640 1 -- 172.21.15.33:0/2784332227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 msgr2=0x563716c48220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:10:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.675+0000 7efd77400640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c4d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.677 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.675+0000 7efd76a00640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 0x563716c48220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77e00640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 0x563716c48220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77e00640 1 -- 172.21.15.33:0/2784332227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 msgr2=0x563716c4d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77e00640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c4d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77e00640 1 -- 172.21.15.33:0/2784332227 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563716c38ef0 con 0x563716c3bb00 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77400640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c4d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd76a00640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 0x563716c48220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.677+0000 7efd77e00640 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b410 tx=0x7efd700097c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f4e55292244018 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.678+0000 7efd63400640 1 -- 172.21.15.33:0/2784332227 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70015760 con 0x563716c3bb00 2024-09-11T00:10:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.678+0000 7efd63400640 1 -- 172.21.15.33:0/2784332227 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd7001b070 con 0x563716c3bb00 2024-09-11T00:10:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.678+0000 7efd63400640 1 -- 172.21.15.33:0/2784332227 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70016c90 con 0x563716c3bb00 2024-09-11T00:10:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.680+0000 7efd810c9740 1 -- 172.21.15.33:0/2784332227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 msgr2=0x563716c3bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.680+0000 7efd810c9740 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b410 tx=0x7efd700097c0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.680+0000 7efd810c9740 1 -- 172.21.15.33:0/2784332227 shutdown_connections 2024-09-11T00:10:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.680+0000 7efd810c9740 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c3bb00 0x563716c3bee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.680+0000 7efd810c9740 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c390c0 0x563716c48220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.681+0000 7efd810c9740 1 --2- 172.21.15.33:0/2784332227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c4d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.681+0000 7efd810c9740 1 -- 172.21.15.33:0/2784332227 >> 172.21.15.33:0/2784332227 conn(0x563716c318e0 msgr2=0x563716c35bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.681+0000 7efd810c9740 1 -- 172.21.15.33:0/2784332227 shutdown_connections 2024-09-11T00:10:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.681+0000 7efd810c9740 1 -- 172.21.15.33:0/2784332227 wait complete. 2024-09-11T00:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.685+0000 7efd810c9740 1 -- start start 2024-09-11T00:10:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.686+0000 7efd810c9740 1 Processor -- start 2024-09-11T00:10:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.688+0000 7efd810c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c47ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.688+0000 7efd810c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c390c0 0x563716c46bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd810c9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd810c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c1310 con 0x563716c36790 2024-09-11T00:10:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd810c9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c2780 con 0x563716c3bb00 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd810c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd781c19e0 con 0x563716c390c0 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd810c9740 10 client.0 _ll_register_callbacks cb 0x7efd6400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57332/0 (socket says 172.21.15.33:57332) 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd77e00640 1 -- 172.21.15.33:0/2461595148 learned_addr learned my addr 172.21.15.33:0/2461595148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:10:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.689+0000 7efd77400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c47ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77400640 1 -- 172.21.15.33:0/2461595148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c390c0 msgr2=0x563716c46bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd76a00640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c390c0 0x563716c46bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77400640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c390c0 0x563716c46bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77400640 1 -- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 msgr2=0x563716c47110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77400640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77400640 1 -- 172.21.15.33:0/2461595148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563716c41510 con 0x563716c36790 2024-09-11T00:10:58.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.691+0000 7efd77e00640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.693+0000 7efd77400640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c47ed0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd68104210 tx=0x7efd680b4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa3299bd175487b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.693+0000 7efd60c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:10:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.694+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68049040 con 0x563716c36790 2024-09-11T00:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.694+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efd680d5fd0 con 0x563716c36790 2024-09-11T00:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.694+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd7001b070 con 0x563716c36790 2024-09-11T00:10:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.697+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efd680cd5d0 con 0x563716c36790 2024-09-11T00:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.698+0000 7efd810c9740 10 client.16884 fetch_fsmap learned FSMap version 30 2024-09-11T00:10:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.698+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563716c46530 con 0x563716c36790 2024-09-11T00:10:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.699+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd7001b070 con 0x563716c36790 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efd68031910 con 0x563716c36790 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 10 client.16884 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 10 client.16884 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 20 client.16884 populate_metadata read hostname 'smithi033' 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716cb8d20 0x563716cbb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 4 client.16884 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:10:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.700+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563716ba70b0 con 0x563716cb8d20 2024-09-11T00:10:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.701+0000 7efd76a00640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716cb8d20 0x563716cbb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.703+0000 7efd76a00640 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716cb8d20 0x563716cbb140 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb828f62231ff991 server_cookie=5a33798cea15ace1 in_seq=0 out_seq=0 2024-09-11T00:10:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.703+0000 7efd60c00640 10 client.16884 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.746+0000 7efd60c00640 1 -- 172.21.15.33:0/2461595148 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563716ba70b0 con 0x563716cb8d20 2024-09-11T00:10:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.746+0000 7efd60c00640 10 client.16884 handle_command_reply: tid=0 2024-09-11T00:10:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.747+0000 7efd810c9740 1 client.16884 shutdown 2024-09-11T00:10:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.748+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 msgr2=0x563716c47ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.748+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c47ed0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd68104210 tx=0x7efd680b4040 comp rx=0 tx=0).stop 2024-09-11T00:10:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.748+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 shutdown_connections 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.748+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563716c3bb00 0x563716c47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563716cb8d20 0x563716cbb140 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563716c390c0 0x563716c46bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 --2- 172.21.15.33:0/2461595148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563716c36790 0x563716c47ed0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd60c00640 0 client.16884 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:10:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 >> 172.21.15.33:0/2461595148 conn(0x563716c318e0 msgr2=0x563716c3bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 shutdown_connections 2024-09-11T00:10:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 1 -- 172.21.15.33:0/2461595148 wait complete. 2024-09-11T00:10:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.749+0000 7efd810c9740 20 client.16884 trim_cache size 0 max 16384 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.752+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 msgr2=0x7efd5c0b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.752+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 0x7efd5c0b7770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd6400bc80 tx=0x7efd64013040 comp rx=0 tx=0).stop 2024-09-11T00:10:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.752+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 msgr2=0x7efd78082e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.752+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efd68031460 tx=0x7efd68003c80 comp rx=0 tx=0).stop 2024-09-11T00:10:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 shutdown_connections 2024-09-11T00:10:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efd5c0b52b0 0x7efd5c0b7770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd7810aac0 0x7efd78081960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd7810a100 0x7efd78083400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 --2- 172.21.15.33:0/2558059520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd78109230 0x7efd78082e40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 >> 172.21.15.33:0/2558059520 conn(0x7efd780783d0 msgr2=0x7efd7810d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.753+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 shutdown_connections 2024-09-11T00:10:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:10:58.754+0000 7efd7e200640 1 -- 172.21.15.33:0/2558059520 wait complete. 2024-09-11T00:10:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:10:58 smithi033 ceph-mon[30593]: pgmap v862: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-09-11T00:10:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:10:58 smithi189 ceph-mon[34000]: pgmap v862: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-09-11T00:10:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:10:58 smithi052 ceph-mon[33526]: pgmap v862: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 -- 172.21.15.33:0/373961871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a150 msgr2=0x7f45141111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 --2- 172.21.15.33:0/373961871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a150 0x7f45141111b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4504009900 tx=0x7f450402a4b0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 -- 172.21.15.33:0/373961871 shutdown_connections 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 --2- 172.21.15.33:0/373961871 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451411c0a0 0x7f451411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 --2- 172.21.15.33:0/373961871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451410a530 0x7f451410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 --2- 172.21.15.33:0/373961871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a150 0x7f45141111b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.277+0000 7f4519e00640 1 -- 172.21.15.33:0/373961871 >> 172.21.15.33:0/373961871 conn(0x7f451406dfc0 msgr2=0x7f451406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.278+0000 7f4519e00640 1 -- 172.21.15.33:0/373961871 shutdown_connections 2024-09-11T00:11:00.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.280+0000 7f4519e00640 1 -- 172.21.15.33:0/373961871 wait complete. 2024-09-11T00:11:00.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.282+0000 7f4519e00640 1 Processor -- start 2024-09-11T00:11:00.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.282+0000 7f4519e00640 1 -- start start 2024-09-11T00:11:00.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.283+0000 7f4519e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 0x7f45141194c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.283+0000 7f4519e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4512a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 0x7f45141194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4512a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 0x7f45141194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39804/0 (socket says 172.21.15.33:39804) 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4519e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451411c0a0 0x7f4514112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4519e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4514121a60 con 0x7f451411c0a0 2024-09-11T00:11:00.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4519e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45141218e0 con 0x7f451410a530 2024-09-11T00:11:00.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57344/0 (socket says 172.21.15.33:57344) 2024-09-11T00:11:00.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4512000640 1 -- 172.21.15.33:0/2582871493 learned_addr learned my addr 172.21.15.33:0/2582871493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4514121be0 con 0x7f451410a150 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.284+0000 7f4513400640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451411c0a0 0x7f4514112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.285+0000 7f4512000640 1 -- 172.21.15.33:0/2582871493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 msgr2=0x7f45141194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.285+0000 7f4512000640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 0x7f45141194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.285+0000 7f4512000640 1 -- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451411c0a0 msgr2=0x7f4514112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.285+0000 7f4512000640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451411c0a0 0x7f4514112890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.285+0000 7f4512000640 1 -- 172.21.15.33:0/2582871493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4514113150 con 0x7f451410a530 2024-09-11T00:11:00.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.286+0000 7f4512000640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f450000c920 tx=0x7f450000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.287+0000 7f4518a00640 1 -- 172.21.15.33:0/2582871493 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500007c70 con 0x7f451410a530 2024-09-11T00:11:00.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.287+0000 7f4518a00640 1 -- 172.21.15.33:0/2582871493 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4500007e10 con 0x7f451410a530 2024-09-11T00:11:00.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.287+0000 7f4518a00640 1 -- 172.21.15.33:0/2582871493 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500018710 con 0x7f451410a530 2024-09-11T00:11:00.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.287+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4514113440 con 0x7f451410a530 2024-09-11T00:11:00.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.287+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4514118360 con 0x7f451410a530 2024-09-11T00:11:00.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.297+0000 7f451ca4c740 1 Processor -- start 2024-09-11T00:11:00.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.297+0000 7f451ca4c740 1 -- start start 2024-09-11T00:11:00.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.298+0000 7f4518a00640 1 -- 172.21.15.33:0/2582871493 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f45000188f0 con 0x7f451410a530 2024-09-11T00:11:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.300+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.300+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a906e0 0x5647a0a90b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.300+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a9e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f451ca4c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5647a0a05a90 con 0x5647a0a9c510 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f451ca4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5647a09f4ec0 con 0x5647a0a91c40 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f451ca4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647a09f8cd0 con 0x5647a0a906e0 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f4513400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f4513400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57346/0 (socket says 172.21.15.33:57346) 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f4513400640 1 -- 172.21.15.33:0/944083808 learned_addr learned my addr 172.21.15.33:0/944083808 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f4512a00640 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a906e0 0x5647a0a90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.301+0000 7f4518a00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 0x7f44f80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.302+0000 7f4518a00640 1 -- 172.21.15.33:0/2582871493 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f45000e61d0 con 0x7f451410a530 2024-09-11T00:11:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 0x7f44f80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 -- 172.21.15.33:0/944083808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a906e0 msgr2=0x5647a0a90b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a906e0 0x5647a0a90b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 -- 172.21.15.33:0/944083808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 msgr2=0x5647a0a9e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a9e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.303+0000 7f4513400640 1 -- 172.21.15.33:0/944083808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a099a9d0 con 0x5647a0a91c40 2024-09-11T00:11:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.304+0000 7f4513400640 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f450c015ea0 tx=0x7f450c015f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2204eac7599058b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.305+0000 7f44ffe00640 1 -- 172.21.15.33:0/944083808 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c009c90 con 0x5647a0a91c40 2024-09-11T00:11:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.305+0000 7f44ffe00640 1 -- 172.21.15.33:0/944083808 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f450c015880 con 0x5647a0a91c40 2024-09-11T00:11:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.305+0000 7f44ffe00640 1 -- 172.21.15.33:0/944083808 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c01fda0 con 0x5647a0a91c40 2024-09-11T00:11:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.305+0000 7f4513400640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 0x7f44f80b78a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f450c012bf0 tx=0x7f450c00c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.306+0000 7f451ca4c740 1 -- 172.21.15.33:0/944083808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 msgr2=0x5647a0a901a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.306+0000 7f451ca4c740 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f450c015ea0 tx=0x7f450c015f90 comp rx=0 tx=0).stop 2024-09-11T00:11:00.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.307+0000 7f451ca4c740 1 -- 172.21.15.33:0/944083808 shutdown_connections 2024-09-11T00:11:00.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.307+0000 7f451ca4c740 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a9e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.307+0000 7f451ca4c740 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a906e0 0x5647a0a90b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.307+0000 7f451ca4c740 1 --2- 172.21.15.33:0/944083808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a91c40 0x5647a0a901a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.307+0000 7f451ca4c740 1 -- 172.21.15.33:0/944083808 >> 172.21.15.33:0/944083808 conn(0x5647a0a5a6f0 msgr2=0x5647a0a8dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.308+0000 7f451ca4c740 1 -- 172.21.15.33:0/944083808 shutdown_connections 2024-09-11T00:11:00.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.308+0000 7f451ca4c740 1 -- 172.21.15.33:0/944083808 wait complete. 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.308+0000 7f451ca4c740 1 -- start start 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.308+0000 7f451ca4c740 1 Processor -- start 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.311+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 0x5647a0a99520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.311+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0a99a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.311+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f451ca4c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5647a08567b0 con 0x5647a0a9c510 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f451ca4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5647a0999650 con 0x5647a0a906e0 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f451ca4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647a0a9f2d0 con 0x5647a0a91c40 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f451ca4c740 10 client.0 _ll_register_callbacks cb 0x5647a07000a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f4513400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.312+0000 7f4512a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 0x5647a0a99520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.313+0000 7f4513400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52820/0 (socket says 172.21.15.33:52820) 2024-09-11T00:11:00.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.313+0000 7f4513400640 1 -- 172.21.15.33:0/1312746764 learned_addr learned my addr 172.21.15.33:0/1312746764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:00.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.313+0000 7f4512000640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0a99a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.315+0000 7f4512a00640 1 -- 172.21.15.33:0/1312746764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 msgr2=0x5647a0a99a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.315+0000 7f4512a00640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0a99a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.316+0000 7f4512a00640 1 -- 172.21.15.33:0/1312746764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 msgr2=0x5647a0a99fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.316+0000 7f4512a00640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.316+0000 7f4512a00640 1 -- 172.21.15.33:0/1312746764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a0762ba0 con 0x5647a0a906e0 2024-09-11T00:11:00.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.316+0000 7f4513400640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:00.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.317+0000 7f4512000640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0a99a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:00.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.318+0000 7f4512a00640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 0x5647a0a99520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4504033040 tx=0x7f45040052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7b06b80404f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.318+0000 7f44fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:11:00.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.318+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504005590 con 0x5647a0a906e0 2024-09-11T00:11:00.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.319+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f45040046c0 con 0x5647a0a906e0 2024-09-11T00:11:00.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.319+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f450c015880 con 0x5647a0a906e0 2024-09-11T00:11:00.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.319+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f45040048c0 con 0x5647a0a906e0 2024-09-11T00:11:00.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.319+0000 7f451ca4c740 10 client.36761 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:00.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.319+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5647a0aaaee0 con 0x5647a0a906e0 2024-09-11T00:11:00.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45040035f0 con 0x5647a0a906e0 2024-09-11T00:11:00.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4504031440 con 0x5647a0a906e0 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 10 client.36761 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 10 client.36761 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 20 client.36761 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0aac3a0 0x5647a0aae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 4 client.36761 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:00.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.320+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f450c015880 con 0x5647a0aac3a0 2024-09-11T00:11:00.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.322+0000 7f4512000640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0aac3a0 0x5647a0aae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.323+0000 7f4512000640 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0aac3a0 0x5647a0aae790 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b272fb3e6bd05fcd server_cookie=d4af28c21c8078ba in_seq=0 out_seq=0 2024-09-11T00:11:00.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.323+0000 7f44fcc00640 10 client.36761 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.323+0000 7f44fcc00640 1 -- 172.21.15.33:0/1312746764 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f450c015880 con 0x5647a0aac3a0 2024-09-11T00:11:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.323+0000 7f44fcc00640 10 client.36761 handle_command_reply: tid=0 2024-09-11T00:11:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 client.36761 shutdown 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 msgr2=0x5647a0a99520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 0x5647a0a99520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4504033040 tx=0x7f45040052e0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 shutdown_connections 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0a99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0aac3a0 0x5647a0aae790 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0a99a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 --2- 172.21.15.33:0/1312746764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a906e0 0x5647a0a99520 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4504033040 tx=0x7f45040052e0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 >> 172.21.15.33:0/1312746764 conn(0x5647a0a5a6f0 msgr2=0x5647a0a93b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.324+0000 7f44fcc00640 0 client.36761 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.325+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 shutdown_connections 2024-09-11T00:11:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.325+0000 7f451ca4c740 1 -- 172.21.15.33:0/1312746764 wait complete. 2024-09-11T00:11:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.326+0000 7f451ca4c740 20 client.36761 trim_cache size 0 max 16384 2024-09-11T00:11:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.365+0000 7f451ca4c740 1 Processor -- start 2024-09-11T00:11:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.365+0000 7f451ca4c740 1 -- start start 2024-09-11T00:11:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.365+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 0x5647a0a8e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.365+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.366+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 0x5647a0a96730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.366+0000 7f4512a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 0x5647a0a8e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.366+0000 7f4512a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 0x5647a0a8e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52834/0 (socket says 172.21.15.33:52834) 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57370/0 (socket says 172.21.15.33:57370) 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f4513400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 0x5647a0a96730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f4513400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 0x5647a0a96730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39822/0 (socket says 172.21.15.33:39822) 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f4512a00640 1 -- 172.21.15.33:0/35764253 learned_addr learned my addr 172.21.15.33:0/35764253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:00.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c9870 con 0x5647a0a91c40 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c7140 con 0x5647a0a9c510 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.367+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c4f90 con 0x5647a0a9b7a0 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.368+0000 7f4512000640 1 -- 172.21.15.33:0/35764253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 msgr2=0x5647a0a96730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.368+0000 7f4512000640 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 0x5647a0a96730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.368+0000 7f4512000640 1 -- 172.21.15.33:0/35764253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 msgr2=0x5647a0a8e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.368+0000 7f4512000640 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 0x5647a0a8e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.368+0000 7f4512000640 1 -- 172.21.15.33:0/35764253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a0a98480 con 0x5647a0a9c510 2024-09-11T00:11:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.369+0000 7f4512000640 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f450000c8f0 tx=0x7f4500000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46ca24a1e7683d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.369+0000 7f44ff400640 1 -- 172.21.15.33:0/35764253 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45000b1070 con 0x5647a0a9c510 2024-09-11T00:11:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.370+0000 7f44ff400640 1 -- 172.21.15.33:0/35764253 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45000b5b20 con 0x5647a0a9c510 2024-09-11T00:11:00.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.370+0000 7f44ff400640 1 -- 172.21.15.33:0/35764253 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45000b1070 con 0x5647a0a9c510 2024-09-11T00:11:00.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 msgr2=0x5647a0a9b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f450000c8f0 tx=0x7f4500000bc0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 shutdown_connections 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a9b7a0 0x5647a0a96730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9c510 0x5647a0a9b260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 --2- 172.21.15.33:0/35764253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a91c40 0x5647a0a8e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.371+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 >> 172.21.15.33:0/35764253 conn(0x5647a0a5a6f0 msgr2=0x5647a0a9ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.372+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 shutdown_connections 2024-09-11T00:11:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.372+0000 7f451ca4c740 1 -- 172.21.15.33:0/35764253 wait complete. 2024-09-11T00:11:00.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.373+0000 7f451ca4c740 1 -- start start 2024-09-11T00:11:00.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.373+0000 7f451ca4c740 1 Processor -- start 2024-09-11T00:11:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.374+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0aa4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.375+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 0x5647a0aa1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.375+0000 7f451ca4c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0aa1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.375+0000 7f4513400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0aa1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.375+0000 7f4513400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0aa1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52838/0 (socket says 172.21.15.33:52838) 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f451ca4c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c5600 con 0x5647a0a9c510 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f451ca4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c6a70 con 0x5647a0a9b7a0 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f451ca4c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45141c5cd0 con 0x5647a0a91c40 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 0x5647a0aa1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f4512000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 0x5647a0aa1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:57372/0 (socket says 172.21.15.33:57372) 2024-09-11T00:11:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f4512000640 1 -- 172.21.15.33:0/2385170974 learned_addr learned my addr 172.21.15.33:0/2385170974 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f4512a00640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0aa4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.376+0000 7f451ca4c740 10 client.0 _ll_register_callbacks cb 0x7f4504004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.377+0000 7f4512a00640 1 -- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 msgr2=0x5647a0aa1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.377+0000 7f4512a00640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 0x5647a0aa1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.377+0000 7f4512a00640 1 -- 172.21.15.33:0/2385170974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 msgr2=0x5647a0aa1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.377+0000 7f4512a00640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0aa1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.377+0000 7f4512a00640 1 -- 172.21.15.33:0/2385170974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a0b192c0 con 0x5647a0a91c40 2024-09-11T00:11:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.378+0000 7f4512a00640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0aa4f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4504009900 tx=0x7f4504005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e611e285a83cecc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.379+0000 7f44fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:00.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.379+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504031440 con 0x5647a0a91c40 2024-09-11T00:11:00.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.380+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4504031a70 con 0x5647a0a91c40 2024-09-11T00:11:00.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.380+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45000b5b20 con 0x5647a0a91c40 2024-09-11T00:11:00.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.380+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f45040315e0 con 0x5647a0a91c40 2024-09-11T00:11:00.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.381+0000 7f451ca4c740 10 client.26737 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:00.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.381+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5647a0b1a520 con 0x5647a0a91c40 2024-09-11T00:11:00.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.381+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45000b5b20 con 0x5647a0a91c40 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f450405c030 con 0x5647a0a91c40 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 10 client.26737 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 10 client.26737 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 20 client.26737 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0b1ad00 0x5647a0b1d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 4 client.26737 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x5647a0a079e0 con 0x5647a0b1ad00 2024-09-11T00:11:00.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.382+0000 7f4512000640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0b1ad00 0x5647a0b1d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:00.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.383+0000 7f4512000640 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0b1ad00 0x5647a0b1d120 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f7801ffe1d1d2a server_cookie=1ed4d4e4d2771a79 in_seq=0 out_seq=0 2024-09-11T00:11:00.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.383+0000 7f44fcc00640 10 client.26737 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.716+0000 7f44fcc00640 1 -- 172.21.15.33:0/2385170974 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5647a0a079e0 con 0x5647a0b1ad00 2024-09-11T00:11:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.716+0000 7f44fcc00640 10 client.26737 handle_command_reply: tid=0 2024-09-11T00:11:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.716+0000 7f451ca4c740 1 client.26737 shutdown 2024-09-11T00:11:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.716+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 msgr2=0x5647a0aa4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.716+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0aa4f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4504009900 tx=0x7f4504005970 comp rx=0 tx=0).stop 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 shutdown_connections 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5647a0a9c510 0x5647a0aa1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5647a0a9b7a0 0x5647a0aa1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5647a0b1ad00 0x5647a0b1d120 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 --2- 172.21.15.33:0/2385170974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647a0a91c40 0x5647a0aa4f20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 >> 172.21.15.33:0/2385170974 conn(0x5647a0a5a6f0 msgr2=0x5647a0aa74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f44fcc00640 0 client.26737 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 shutdown_connections 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 1 -- 172.21.15.33:0/2385170974 wait complete. 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.717+0000 7f451ca4c740 20 client.26737 trim_cache size 0 max 16384 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:11:00.720 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 42, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "d48ed94a": { 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 42, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 142.8, 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:11:00.721 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.718+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 msgr2=0x7f44f80b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.718+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 0x7f44f80b78a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f450c012bf0 tx=0x7f450c00c000 comp rx=0 tx=0).stop 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 msgr2=0x7f4514119a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f450000c920 tx=0x7f450000cde0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 shutdown_connections 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f44f80b53e0 0x7f44f80b78a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f451411c0a0 0x7f4514112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f451410a530 0x7f4514119a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 --2- 172.21.15.33:0/2582871493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f451410a150 0x7f45141194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:00.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 >> 172.21.15.33:0/2582871493 conn(0x7f451406dfc0 msgr2=0x7f451411c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:00.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 shutdown_connections 2024-09-11T00:11:00.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:00.719+0000 7f4519e00640 1 -- 172.21.15.33:0/2582871493 wait complete. 2024-09-11T00:11:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:00 smithi033 ceph-mon[30593]: pgmap v863: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-09-11T00:11:01.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:00 smithi189 ceph-mon[34000]: pgmap v863: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-09-11T00:11:01.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:00 smithi052 ceph-mon[33526]: pgmap v863: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-09-11T00:11:01.749 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd48ed94a', quiesce took 10.3 seconds. Will release after: 12.45 2024-09-11T00:11:02.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:01 smithi033 ceph-mon[30593]: pgmap v864: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 545 op/s 2024-09-11T00:11:02.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:01 smithi189 ceph-mon[34000]: pgmap v864: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 545 op/s 2024-09-11T00:11:02.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:01 smithi052 ceph-mon[33526]: pgmap v864: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.2 MiB/s wr, 545 op/s 2024-09-11T00:11:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 675.0 s, 286.5 tps, lat 154.496 ms stddev 44.950 2024-09-11T00:11:04.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:04 smithi033 ceph-mon[30593]: pgmap v865: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T00:11:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:04 smithi189 ceph-mon[34000]: pgmap v865: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T00:11:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:04 smithi052 ceph-mon[33526]: pgmap v865: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 550 op/s 2024-09-11T00:11:06.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:06 smithi033 ceph-mon[30593]: pgmap v866: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 425 op/s 2024-09-11T00:11:06.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:06 smithi189 ceph-mon[34000]: pgmap v866: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 425 op/s 2024-09-11T00:11:06.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:06 smithi052 ceph-mon[33526]: pgmap v866: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 425 op/s 2024-09-11T00:11:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:11:08.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:08 smithi033 ceph-mon[30593]: pgmap v867: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-09-11T00:11:08.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:08 smithi189 ceph-mon[34000]: pgmap v867: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-09-11T00:11:08.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:08 smithi052 ceph-mon[33526]: pgmap v867: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-09-11T00:11:10.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:10 smithi033 ceph-mon[30593]: pgmap v868: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 271 op/s 2024-09-11T00:11:10.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:10 smithi189 ceph-mon[34000]: pgmap v868: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 271 op/s 2024-09-11T00:11:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:10 smithi052 ceph-mon[33526]: pgmap v868: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 271 op/s 2024-09-11T00:11:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.939+0000 7f075b000640 1 -- 172.21.15.33:0/4214205547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0754076f30 msgr2=0x7f0754075580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.939+0000 7f075b000640 1 --2- 172.21.15.33:0/4214205547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0754076f30 0x7f0754075580 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0744009900 tx=0x7f074402a3f0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.939+0000 7f075b000640 1 -- 172.21.15.33:0/4214205547 shutdown_connections 2024-09-11T00:11:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.939+0000 7f075b000640 1 --2- 172.21.15.33:0/4214205547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f075410a910 0x7f075410cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.939+0000 7f075b000640 1 --2- 172.21.15.33:0/4214205547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 0x7f0754075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.940+0000 7f075b000640 1 --2- 172.21.15.33:0/4214205547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0754076f30 0x7f0754075580 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.940+0000 7f075b000640 1 -- 172.21.15.33:0/4214205547 >> 172.21.15.33:0/4214205547 conn(0x7f07540fe250 msgr2=0x7f0754100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.940+0000 7f075b000640 1 -- 172.21.15.33:0/4214205547 shutdown_connections 2024-09-11T00:11:11.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.940+0000 7f075b000640 1 -- 172.21.15.33:0/4214205547 wait complete. 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.940+0000 7f075b000640 1 Processor -- start 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 -- start start 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 0x7f075419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0754076f30 0x7f075419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07541106b0 con 0x7f075410a910 2024-09-11T00:11:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0754110530 con 0x7f0754075ac0 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f075b000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0754110830 con 0x7f0754076f30 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f0759000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f0759000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54070/0 (socket says 172.21.15.33:54070) 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.941+0000 7f0759000640 1 -- 172.21.15.33:0/1724325022 learned_addr learned my addr 172.21.15.33:0/1724325022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f074be00640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0754076f30 0x7f075419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0753e00640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 0x7f075419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 -- 172.21.15.33:0/1724325022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0754076f30 msgr2=0x7f075419b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0754076f30 0x7f075419b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 -- 172.21.15.33:0/1724325022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 msgr2=0x7f075419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 0x7f075419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 -- 172.21.15.33:0/1724325022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075419c950 con 0x7f075410a910 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0759000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f074c00eaa0 tx=0x7f074c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0751600640 1 -- 172.21.15.33:0/1724325022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c004d20 con 0x7f075410a910 2024-09-11T00:11:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0751600640 1 -- 172.21.15.33:0/1724325022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c005020 con 0x7f075410a910 2024-09-11T00:11:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.942+0000 7f0751600640 1 -- 172.21.15.33:0/1724325022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c0116d0 con 0x7f075410a910 2024-09-11T00:11:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.943+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075419cc40 con 0x7f075410a910 2024-09-11T00:11:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.943+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07541a3310 con 0x7f075410a910 2024-09-11T00:11:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.946+0000 7f075dde4740 1 Processor -- start 2024-09-11T00:11:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.946+0000 7f0751600640 1 -- 172.21.15.33:0/1724325022 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f074c00f040 con 0x7f075410a910 2024-09-11T00:11:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.946+0000 7f075dde4740 1 -- start start 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x56115851eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x561158523fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56115848f6b0 con 0x56115851f0c0 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56115847eae0 con 0x561158521b00 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f075dde4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5611584828f0 con 0x56115851c790 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f0753e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f0753e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54078/0 (socket says 172.21.15.33:54078) 2024-09-11T00:11:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f0753e00640 1 -- 172.21.15.33:0/4040482235 learned_addr learned my addr 172.21.15.33:0/4040482235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f074be00640 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x56115851eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f0753e00640 1 -- 172.21.15.33:0/4040482235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 msgr2=0x56115851eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.947+0000 7f0753e00640 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x56115851eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0753e00640 1 -- 172.21.15.33:0/4040482235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 msgr2=0x561158523fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0753e00640 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x561158523fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0753e00640 1 -- 172.21.15.33:0/4040482235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56115844b780 con 0x56115851f0c0 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f074be00640 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x56115851eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0753e00640 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f074402a910 tx=0x7f0744031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa86168e885143cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0751600640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 0x7f07380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0749600640 1 -- 172.21.15.33:0/4040482235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744035030 con 0x56115851f0c0 2024-09-11T00:11:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0749600640 1 -- 172.21.15.33:0/4040482235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0744040070 con 0x56115851f0c0 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0749600640 1 -- 172.21.15.33:0/4040482235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744003a80 con 0x56115851f0c0 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f0751600640 1 -- 172.21.15.33:0/1724325022 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f074c0e5d00 con 0x7f075410a910 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.948+0000 7f074be00640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 0x7f07380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 -- 172.21.15.33:0/4040482235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 msgr2=0x5611585214b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f074be00640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 0x7f07380b7820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f073c00adc0 tx=0x7f073c00a8f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f074402a910 tx=0x7f0744031630 comp rx=0 tx=0).stop 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 -- 172.21.15.33:0/4040482235 shutdown_connections 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x561158523fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x5611585214b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 --2- 172.21.15.33:0/4040482235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x56115851eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 -- 172.21.15.33:0/4040482235 >> 172.21.15.33:0/4040482235 conn(0x5611585178e0 msgr2=0x561158518670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 -- 172.21.15.33:0/4040482235 shutdown_connections 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.949+0000 7f075dde4740 1 -- 172.21.15.33:0/4040482235 wait complete. 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 -- start start 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 Processor -- start 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x561158525e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x561158526510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x5611585270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5611583b6ab0 con 0x56115851f0c0 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561158425570 con 0x561158521b00 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561158524a80 con 0x56115851c790 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.950+0000 7f075dde4740 10 client.0 _ll_register_callbacks cb 0x561158434100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:11.956 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f074be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x561158526510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f074be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x561158526510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54086/0 (socket says 172.21.15.33:54086) 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f074be00640 1 -- 172.21.15.33:0/3626722819 learned_addr learned my addr 172.21.15.33:0/3626722819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x561158525e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0759000640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x5611585270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 -- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 msgr2=0x5611585270e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x5611585270e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 -- 172.21.15.33:0/3626722819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 msgr2=0x561158526510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x561158526510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.957 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 -- 172.21.15.33:0/3626722819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611581e0790 con 0x56115851c790 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0753e00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x561158525e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07440057c0 tx=0x7f0744031ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a07ac31f35ffac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.951+0000 7f0742000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744052060 con 0x56115851c790 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0744040070 con 0x56115851c790 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f074403c850 con 0x56115851c790 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0744059050 con 0x56115851c790 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f075dde4740 10 client.26746 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:11.958 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561158259620 con 0x56115851c790 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.952+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0744040070 con 0x56115851c790 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f074404c030 con 0x56115851c790 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 10 client.26746 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 10 client.26746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 20 client.26746 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561158531280 0x561158533670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 4 client.26746 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561158491600 con 0x561158531280 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.953+0000 7f074be00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561158531280 0x561158533670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.954+0000 7f074be00640 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561158531280 0x561158533670 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58cca55c63fea66 server_cookie=78cd061cd5665f8a in_seq=0 out_seq=0 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.954+0000 7f0742000640 10 client.26746 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f0742000640 1 -- 172.21.15.33:0/3626722819 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561158491600 con 0x561158531280 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f0742000640 10 client.26746 handle_command_reply: tid=0 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 client.26746 shutdown 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 msgr2=0x561158525e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x561158525e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07440057c0 tx=0x7f0744031ca0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 shutdown_connections 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x5611585270e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851f0c0 0x561158526510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561158531280 0x561158533670 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 --2- 172.21.15.33:0/3626722819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851c790 0x561158525e70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 >> 172.21.15.33:0/3626722819 conn(0x5611585178e0 msgr2=0x561158516a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f0742000640 0 client.26746 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 shutdown_connections 2024-09-11T00:11:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 1 -- 172.21.15.33:0/3626722819 wait complete. 2024-09-11T00:11:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.955+0000 7f075dde4740 20 client.26746 trim_cache size 0 max 16384 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 Processor -- start 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 -- start start 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56115851c790 0x56115851a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115851ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07541affe0 con 0x561158521b00 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f07541ad8b0 con 0x56115851c790 2024-09-11T00:11:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f075dde4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07541ab700 con 0x56115851f0c0 2024-09-11T00:11:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54098/0 (socket says 172.21.15.33:54098) 2024-09-11T00:11:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 -- 172.21.15.33:0/15538495 learned_addr learned my addr 172.21.15.33:0/15538495 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f074be00640 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115851ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 -- 172.21.15.33:0/15538495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 msgr2=0x56115851ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115851ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 -- 172.21.15.33:0/15538495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56115851c790 msgr2=0x56115851a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.971+0000 7f0759000640 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56115851c790 0x56115851a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.972+0000 7f0759000640 1 -- 172.21.15.33:0/15538495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561158513270 con 0x561158521b00 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.972+0000 7f0759000640 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f074c0a9330 tx=0x7f074c0a8080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82df877eb6f537da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.972+0000 7f0748c00640 1 -- 172.21.15.33:0/15538495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c01f040 con 0x561158521b00 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.972+0000 7f0748c00640 1 -- 172.21.15.33:0/15538495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c0ac7c0 con 0x561158521b00 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.972+0000 7f0748c00640 1 -- 172.21.15.33:0/15538495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c0a8330 con 0x561158521b00 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- 172.21.15.33:0/15538495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 msgr2=0x561158518140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f074c0a9330 tx=0x7f074c0a8080 comp rx=0 tx=0).stop 2024-09-11T00:11:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- 172.21.15.33:0/15538495 shutdown_connections 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561158521b00 0x561158518140 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115851ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 --2- 172.21.15.33:0/15538495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56115851c790 0x56115851a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- 172.21.15.33:0/15538495 >> 172.21.15.33:0/15538495 conn(0x5611585178e0 msgr2=0x561158525030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- 172.21.15.33:0/15538495 shutdown_connections 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- 172.21.15.33:0/15538495 wait complete. 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 -- start start 2024-09-11T00:11:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.973+0000 7f075dde4740 1 Processor -- start 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115852d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x56115852d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07541abd70 con 0x56115851c790 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f07541ad1e0 con 0x561158521b00 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07541ac440 con 0x56115851f0c0 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f075dde4740 10 client.0 _ll_register_callbacks cb 0x7f0744031500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54110/0 (socket says 172.21.15.33:54110) 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 -- 172.21.15.33:0/2071994645 learned_addr learned my addr 172.21.15.33:0/2071994645 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f074be00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115852d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0759000640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x56115852d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 -- 172.21.15.33:0/2071994645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 msgr2=0x56115852d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115852d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 -- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 msgr2=0x56115852d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x56115852d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0753e00640 1 -- 172.21.15.33:0/2071994645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56115852b9a0 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.974+0000 7f0759000640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x56115852d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0753e00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f074402abe0 tx=0x7f074402aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27467a3deaedbb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0742000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744052040 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f074c0ac7c0 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0744004230 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0744035070 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f075dde4740 10 client.16914 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56115859e6d0 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.975+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f074c0ac7c0 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f074404c040 con 0x56115851c790 2024-09-11T00:11:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 10 client.16914 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 10 client.16914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 20 client.16914 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56115859ef70 0x5611585a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 4 client.16914 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56115848d0b0 con 0x56115859ef70 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.976+0000 7f074be00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56115859ef70 0x5611585a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.977+0000 7f074be00640 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56115859ef70 0x5611585a1390 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b5b28cd6e5d5c8 server_cookie=71b2f7877267a08a in_seq=0 out_seq=0 2024-09-11T00:11:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.977+0000 7f0742000640 10 client.16914 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f0742000640 1 -- 172.21.15.33:0/2071994645 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56115848d0b0 con 0x56115859ef70 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f0742000640 10 client.16914 handle_command_reply: tid=0 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 client.16914 shutdown 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 msgr2=0x56115852cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f074402abe0 tx=0x7f074402aaf0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 shutdown_connections 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561158521b00 0x56115852d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56115859ef70 0x5611585a1390 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56115851f0c0 0x56115852d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 --2- 172.21.15.33:0/2071994645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56115851c790 0x56115852cbc0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f0742000640 0 client.16914 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 >> 172.21.15.33:0/2071994645 conn(0x5611585178e0 msgr2=0x56115851a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 shutdown_connections 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 1 -- 172.21.15.33:0/2071994645 wait complete. 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.996+0000 7f075dde4740 20 client.16914 trim_cache size 0 max 16384 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:11:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:11:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:11:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 msgr2=0x7f07380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 0x7f07380b7820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f073c00adc0 tx=0x7f073c00a8f0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 msgr2=0x7f075419c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f074c00eaa0 tx=0x7f074c00eea0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 shutdown_connections 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f07380b5360 0x7f07380b7820 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f075410a910 0x7f075419c090 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0754076f30 0x7f075419b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 --2- 172.21.15.33:0/1724325022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0754075ac0 0x7f075419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 >> 172.21.15.33:0/1724325022 conn(0x7f07540fe250 msgr2=0x7f07540fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 shutdown_connections 2024-09-11T00:11:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:11.997+0000 7f075b000640 1 -- 172.21.15.33:0/1724325022 wait complete. 2024-09-11T00:11:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:12 smithi033 ceph-mon[30593]: pgmap v869: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-11T00:11:12.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:12 smithi189 ceph-mon[34000]: pgmap v869: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-11T00:11:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:12 smithi052 ceph-mon[33526]: pgmap v869: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2024-09-11T00:11:13.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 685.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:11:14.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:11:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:14 smithi033 ceph-mon[30593]: pgmap v870: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-11T00:11:14.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:14 smithi189 ceph-mon[34000]: pgmap v870: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-11T00:11:14.620 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:14.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:14 smithi052 ceph-mon[33526]: pgmap v870: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 -- 172.21.15.33:0/2237714906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2740776d0 msgr2=0x7fb274077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 --2- 172.21.15.33:0/2237714906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2740776d0 0x7fb274077ab0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb264009900 tx=0x7fb26402a410 comp rx=0 tx=0).stop 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 -- 172.21.15.33:0/2237714906 shutdown_connections 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 --2- 172.21.15.33:0/2237714906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2741137e0 0x7fb274115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 --2- 172.21.15.33:0/2237714906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 0x7fb2741132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 --2- 172.21.15.33:0/2237714906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2740776d0 0x7fb274077ab0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 -- 172.21.15.33:0/2237714906 >> 172.21.15.33:0/2237714906 conn(0x7fb274100840 msgr2=0x7fb274102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.473+0000 7fb273200640 1 -- 172.21.15.33:0/2237714906 shutdown_connections 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.474+0000 7fb273200640 1 -- 172.21.15.33:0/2237714906 wait complete. 2024-09-11T00:11:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 Processor -- start 2024-09-11T00:11:15.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 -- start start 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2740776d0 0x7fb27419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 0x7fb27419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741190e0 con 0x7fb2741137e0 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb274118f60 con 0x7fb274077ff0 2024-09-11T00:11:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb273200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb274119260 con 0x7fb2740776d0 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.475+0000 7fb272800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb271400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 0x7fb27419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb271e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2740776d0 0x7fb27419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54136/0 (socket says 172.21.15.33:54136) 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 -- 172.21.15.33:0/514367939 learned_addr learned my addr 172.21.15.33:0/514367939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 -- 172.21.15.33:0/514367939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2740776d0 msgr2=0x7fb27419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2740776d0 0x7fb27419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 -- 172.21.15.33:0/514367939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 msgr2=0x7fb27419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 0x7fb27419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 -- 172.21.15.33:0/514367939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2741a55c0 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.476+0000 7fb272800640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00e9d0 tx=0x7fb26c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.477+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00cd80 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.477+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb26c005020 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.477+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0116d0 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.477+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2741a58b0 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.477+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2741abf70 con 0x7fb2741137e0 2024-09-11T00:11:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.478+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb274077ab0 con 0x7fb2741137e0 2024-09-11T00:11:15.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.480+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb26c00f040 con 0x7fb2741137e0 2024-09-11T00:11:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.482+0000 7fb26aa00640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 0x7fb2580b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.482+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb26c0e5c30 con 0x7fb2741137e0 2024-09-11T00:11:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.482+0000 7fb271e00640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 0x7fb2580b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:15.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.483+0000 7fb271e00640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 0x7fb2580b79a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb264006010 tx=0x7fb264005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:15.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.485+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb26c016030 con 0x7fb2741137e0 2024-09-11T00:11:15.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.720+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2741ac330 con 0x7fb2741137e0 2024-09-11T00:11:15.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.720+0000 7fb26aa00640 1 -- 172.21.15.33:0/514367939 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fb26c0ac120 con 0x7fb2741137e0 2024-09-11T00:11:15.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:11:15.723 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:11:15.724 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 msgr2=0x7fb2580b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 0x7fb2580b79a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb264006010 tx=0x7fb264005e80 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 msgr2=0x7fb2741a4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00e9d0 tx=0x7fb26c00ee90 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 shutdown_connections 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb2580b54e0 0x7fb2580b79a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2741137e0 0x7fb2741a4df0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb274077ff0 0x7fb27419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 --2- 172.21.15.33:0/514367939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2740776d0 0x7fb27419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 >> 172.21.15.33:0/514367939 conn(0x7fb274100840 msgr2=0x7fb274102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:15.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.723+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 shutdown_connections 2024-09-11T00:11:15.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:15.724+0000 7fb273200640 1 -- 172.21.15.33:0/514367939 wait complete. 2024-09-11T00:11:16.517 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:16 smithi033 ceph-mon[30593]: pgmap v871: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 181 KiB/s wr, 28 op/s 2024-09-11T00:11:16.517 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:16 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/514367939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:16.558 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id d48ed94a --release --await' 2024-09-11T00:11:16.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id d48ed94a --release --await 2024-09-11T00:11:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:16 smithi189 ceph-mon[34000]: pgmap v871: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 181 KiB/s wr, 28 op/s 2024-09-11T00:11:16.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:16 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/514367939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:16.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:16 smithi052 ceph-mon[33526]: pgmap v871: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 181 KiB/s wr, 28 op/s 2024-09-11T00:11:16.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:16 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/514367939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 -- 172.21.15.33:0/2034755556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 msgr2=0x7f346810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 --2- 172.21.15.33:0/2034755556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f346810f560 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3460009ca0 tx=0x7f346002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 -- 172.21.15.33:0/2034755556 shutdown_connections 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 --2- 172.21.15.33:0/2034755556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f346810f560 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 --2- 172.21.15.33:0/2034755556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f346810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 --2- 172.21.15.33:0/2034755556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 0x7f3468104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 -- 172.21.15.33:0/2034755556 >> 172.21.15.33:0/2034755556 conn(0x7f34680fd700 msgr2=0x7f34680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 -- 172.21.15.33:0/2034755556 shutdown_connections 2024-09-11T00:11:17.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.646+0000 7f346e800640 1 -- 172.21.15.33:0/2034755556 wait complete. 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.647+0000 7f346e800640 1 Processor -- start 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.647+0000 7f346e800640 1 -- start start 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 0x7f3468101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f3468101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3468112c70 con 0x7f346810d100 2024-09-11T00:11:17.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3468112af0 con 0x7f34681045c0 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f346e800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3468112df0 con 0x7f3468103ca0 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54154/0 (socket says 172.21.15.33:54154) 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f3467e00640 1 -- 172.21.15.33:0/2079415574 learned_addr learned my addr 172.21.15.33:0/2079415574 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f345fe00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f3468101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.648+0000 7f3467400640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 0x7f3468101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 -- 172.21.15.33:0/2079415574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 msgr2=0x7f3468101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 0x7f3468101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 -- 172.21.15.33:0/2079415574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 msgr2=0x7f3468101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f3468101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 -- 172.21.15.33:0/2079415574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34681a7580 con 0x7f346810d100 2024-09-11T00:11:17.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f345fe00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f3468101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3467e00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3460005e30 tx=0x7f3460003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3464c00640 1 -- 172.21.15.33:0/2079415574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460032c10 con 0x7f346810d100 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3464c00640 1 -- 172.21.15.33:0/2079415574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3460032db0 con 0x7f346810d100 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34681a7810 con 0x7f346810d100 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.649+0000 7f3464c00640 1 -- 172.21.15.33:0/2079415574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460030ab0 con 0x7f346810d100 2024-09-11T00:11:17.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.650+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34681a7da0 con 0x7f346810d100 2024-09-11T00:11:17.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.654+0000 7f3471297740 1 Processor -- start 2024-09-11T00:11:17.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.654+0000 7f3464c00640 1 -- 172.21.15.33:0/2079415574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3460030c50 con 0x7f346810d100 2024-09-11T00:11:17.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.654+0000 7f3471297740 1 -- start start 2024-09-11T00:11:17.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880993d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561688010290 con 0x5616880a58a0 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561687fff6c0 con 0x561688099910 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3471297740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616880034d0 con 0x561688098ff0 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f345fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f3467400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f345fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54164/0 (socket says 172.21.15.33:54164) 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f345fe00640 1 -- 172.21.15.33:0/2611392911 learned_addr learned my addr 172.21.15.33:0/2611392911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:17.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.655+0000 7f345fe00640 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 -- 172.21.15.33:0/2611392911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 msgr2=0x5616880993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 -- 172.21.15.33:0/2611392911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 msgr2=0x5616880a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 -- 172.21.15.33:0/2611392911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561687f8c460 con 0x5616880a58a0 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f3467400640 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f3464c00640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 0x7f344c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345fe00640 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3450011be0 tx=0x7f3450004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb93e3c76651bbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f3464c00640 1 -- 172.21.15.33:0/2079415574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3460106ff0 con 0x7f346810d100 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345cc00640 1 -- 172.21.15.33:0/2611392911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345000fc50 con 0x5616880a58a0 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f3467400640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 0x7f344c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345cc00640 1 -- 172.21.15.33:0/2611392911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34500044c0 con 0x5616880a58a0 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.656+0000 7f345cc00640 1 -- 172.21.15.33:0/2611392911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34500047a0 con 0x5616880a58a0 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 -- 172.21.15.33:0/2611392911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 msgr2=0x5616880a7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3450011be0 tx=0x7f3450004730 comp rx=0 tx=0).stop 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3467400640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 0x7f344c0b7820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x56168809c170 tx=0x7f3458005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 -- 172.21.15.33:0/2611392911 shutdown_connections 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a7c90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 --2- 172.21.15.33:0/2611392911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 -- 172.21.15.33:0/2611392911 >> 172.21.15.33:0/2611392911 conn(0x561688096e20 msgr2=0x561688097fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 -- 172.21.15.33:0/2611392911 shutdown_connections 2024-09-11T00:11:17.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.657+0000 7f3471297740 1 -- 172.21.15.33:0/2611392911 wait complete. 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.658+0000 7f3471297740 1 -- start start 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.658+0000 7f3471297740 1 Processor -- start 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561687e60bb0 con 0x5616880a58a0 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561687f9a6c0 con 0x561688099910 2024-09-11T00:11:17.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616880a8550 con 0x561688098ff0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3471297740 10 client.0 _ll_register_callbacks cb 0x561687fb5490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54168/0 (socket says 172.21.15.33:54168) 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 -- 172.21.15.33:0/3446160381 learned_addr learned my addr 172.21.15.33:0/3446160381 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f345fe00640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467400640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 -- 172.21.15.33:0/3446160381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 msgr2=0x5616880a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 -- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 msgr2=0x5616880a2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.659+0000 7f3467e00640 1 -- 172.21.15.33:0/3446160381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561687d5db00 con 0x5616880a58a0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3467e00640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f34600c9a10 tx=0x7f34600ccbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c8f1400b8ce63a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3455600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600cd8a0 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f34600d64b0 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616880121e0 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34600cd440 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3471297740 10 client.16932 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561687dd4960 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.660+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5616880121e0 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f34600f4160 con 0x5616880a58a0 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 10 client.16932 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 10 client.16932 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 20 client.16932 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:17.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5616880b5410 0x5616880b7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 4 client.16932 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56168800dc90 con 0x5616880b5410 2024-09-11T00:11:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.661+0000 7f3467400640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5616880b5410 0x5616880b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.662+0000 7f3467400640 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5616880b5410 0x5616880b7800 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f46599c6a69b8c server_cookie=e893ed01ed0e4948 in_seq=0 out_seq=0 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.662+0000 7f3455600640 10 client.16932 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3455600640 1 -- 172.21.15.33:0/3446160381 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56168800dc90 con 0x5616880b5410 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3455600640 10 client.16932 handle_command_reply: tid=0 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 client.16932 shutdown 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 msgr2=0x5616880a3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f34600c9a10 tx=0x7f34600ccbb0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 shutdown_connections 2024-09-11T00:11:17.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880a3300 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880a2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5616880b5410 0x5616880b7800 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 --2- 172.21.15.33:0/3446160381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 >> 172.21.15.33:0/3446160381 conn(0x561688096e20 msgr2=0x56168809c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.663+0000 7f3455600640 0 client.16932 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.664+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 shutdown_connections 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.664+0000 7f3471297740 1 -- 172.21.15.33:0/3446160381 wait complete. 2024-09-11T00:11:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.664+0000 7f3471297740 20 client.16932 trim_cache size 0 max 16384 2024-09-11T00:11:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 Processor -- start 2024-09-11T00:11:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 -- start start 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688098ff0 0x56168809fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688099910 0x56168809ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34681b43f0 con 0x5616880a58a0 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34681b1cc0 con 0x561688098ff0 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3471297740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34681afb10 con 0x561688099910 2024-09-11T00:11:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.682+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54170/0 (socket says 172.21.15.33:54170) 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 -- 172.21.15.33:0/3098365683 learned_addr learned my addr 172.21.15.33:0/3098365683 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467400640 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688098ff0 0x56168809fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f345fe00640 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688099910 0x56168809ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 -- 172.21.15.33:0/3098365683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688099910 msgr2=0x56168809ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688099910 0x56168809ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 -- 172.21.15.33:0/3098365683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688098ff0 msgr2=0x56168809fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688098ff0 0x56168809fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 -- 172.21.15.33:0/3098365683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561688099740 con 0x5616880a58a0 2024-09-11T00:11:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3467e00640 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f346002ae80 tx=0x7f34600ccce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46e8c1239a4bb1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.683+0000 7f3457e00640 1 -- 172.21.15.33:0/3098365683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600ccf50 con 0x5616880a58a0 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3457e00640 1 -- 172.21.15.33:0/3098365683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3460036070 con 0x5616880a58a0 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3457e00640 1 -- 172.21.15.33:0/3098365683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600d64b0 con 0x5616880a58a0 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 -- 172.21.15.33:0/3098365683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 msgr2=0x5616880bd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f346002ae80 tx=0x7f34600ccce0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 -- 172.21.15.33:0/3098365683 shutdown_connections 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880bd0f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688099910 0x56168809ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 --2- 172.21.15.33:0/3098365683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688098ff0 0x56168809fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 -- 172.21.15.33:0/3098365683 >> 172.21.15.33:0/3098365683 conn(0x561688096e20 msgr2=0x561688095db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 -- 172.21.15.33:0/3098365683 shutdown_connections 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.684+0000 7f3471297740 1 -- 172.21.15.33:0/3098365683 wait complete. 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.685+0000 7f3471297740 1 -- start start 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.685+0000 7f3471297740 1 Processor -- start 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34681b0180 con 0x5616880a58a0 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34681b15f0 con 0x561688099910 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34681b0850 con 0x561688098ff0 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3471297740 10 client.0 _ll_register_callbacks cb 0x7f3460032f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f345fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:43534/0 (socket says 172.21.15.33:43534) 2024-09-11T00:11:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 -- 172.21.15.33:0/4111214035 learned_addr learned my addr 172.21.15.33:0/4111214035 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54178/0 (socket says 172.21.15.33:54178) 2024-09-11T00:11:17.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 -- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 msgr2=0x5616880aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 -- 172.21.15.33:0/4111214035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 msgr2=0x5616880aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.686+0000 7f3467400640 1 -- 172.21.15.33:0/4111214035 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616880ab250 con 0x561688098ff0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.687+0000 7f3467400640 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3458009710 tx=0x7f3458017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab5099efc414caa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.687+0000 7f3455600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.687+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458003ac0 con 0x561688098ff0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.687+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3458003c60 con 0x561688098ff0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.687+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3460036070 con 0x561688098ff0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f345803b050 con 0x561688098ff0 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 10 client.26776 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:17.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561688123440 con 0x561688098ff0 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3460036070 con 0x561688098ff0 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f3458004ad0 con 0x561688098ff0 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 10 client.26776 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 10 client.26776 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 20 client.26776 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561688123c10 0x561688126030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 4 client.26776 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d48ed94a", "release": true, "await": true}] 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.688+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d48ed94a", "release": true, "await": true}) -- 0x56168800b0c0 con 0x561688123c10 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.689+0000 7f345fe00640 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561688123c10 0x561688126030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.690+0000 7f345fe00640 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561688123c10 0x561688126030 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d51d37ce8e043848 server_cookie=f8be24a8b3bce523 in_seq=0 out_seq=0 2024-09-11T00:11:17.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.690+0000 7f3455600640 10 client.26776 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:17.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.741+0000 7f3455600640 1 -- 172.21.15.33:0/4111214035 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56168800b0c0 con 0x561688123c10 2024-09-11T00:11:17.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.741+0000 7f3455600640 10 client.26776 handle_command_reply: tid=0 2024-09-11T00:11:17.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.741+0000 7f3471297740 1 client.26776 shutdown 2024-09-11T00:11:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 msgr2=0x5616880adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3458009710 tx=0x7f3458017000 comp rx=0 tx=0).stop 2024-09-11T00:11:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 shutdown_connections 2024-09-11T00:11:17.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616880a58a0 0x5616880aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561688099910 0x5616880aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561688123c10 0x561688126030 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 --2- 172.21.15.33:0/4111214035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561688098ff0 0x5616880adfc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 >> 172.21.15.33:0/4111214035 conn(0x561688096e20 msgr2=0x5616880a3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3455600640 0 client.26776 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.742+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 shutdown_connections 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.743+0000 7f3471297740 1 -- 172.21.15.33:0/4111214035 wait complete. 2024-09-11T00:11:17.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.743+0000 7f3471297740 20 client.26776 trim_cache size 0 max 16384 2024-09-11T00:11:17.746 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:11:17.746 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:11:17.746 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:11:17.746 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 44, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "d48ed94a": { 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 44, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 142.8, 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:11:17.747 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:17.748 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 msgr2=0x7f344c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 0x7f344c0b7820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x56168809c170 tx=0x7f3458005f90 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 msgr2=0x7f34681023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3460005e30 tx=0x7f3460003f30 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 shutdown_connections 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f344c0b5360 0x7f344c0b7820 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346810d100 0x7f34681023d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34681045c0 0x7f3468101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 --2- 172.21.15.33:0/2079415574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3468103ca0 0x7f3468101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:17.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.744+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 >> 172.21.15.33:0/2079415574 conn(0x7f34680fd700 msgr2=0x7f34680fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:17.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.747+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 shutdown_connections 2024-09-11T00:11:17.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:17.747+0000 7f346e800640 1 -- 172.21.15.33:0/2079415574 wait complete. 2024-09-11T00:11:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 690.0 s, 115.3 tps, lat 3086.856 ms stddev 6522.689 2024-09-11T00:11:18.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:18 smithi033 ceph-mon[30593]: pgmap v872: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 222 KiB/s wr, 38 op/s 2024-09-11T00:11:18.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:18 smithi189 ceph-mon[34000]: pgmap v872: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 222 KiB/s wr, 38 op/s 2024-09-11T00:11:18.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:18 smithi052 ceph-mon[33526]: pgmap v872: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 222 KiB/s wr, 38 op/s 2024-09-11T00:11:18.706 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd48ed94a', total seconds elapsed: 27.2 2024-09-11T00:11:18.707 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-11T00:11:18.707 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:11:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:20.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 -- 172.21.15.33:0/4101943900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c107360 msgr2=0x7f061c10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 --2- 172.21.15.33:0/4101943900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c107360 0x7f061c10db60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ca0 tx=0x7f061402a8d0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 -- 172.21.15.33:0/4101943900 shutdown_connections 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 --2- 172.21.15.33:0/4101943900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c107360 0x7f061c10db60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 --2- 172.21.15.33:0/4101943900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f061c1069e0 0x7f061c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 --2- 172.21.15.33:0/4101943900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c100fd0 0x7f061c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.278+0000 7f0622600640 1 -- 172.21.15.33:0/4101943900 >> 172.21.15.33:0/4101943900 conn(0x7f061c0fca20 msgr2=0x7f061c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:20.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.280+0000 7f0622600640 1 -- 172.21.15.33:0/4101943900 shutdown_connections 2024-09-11T00:11:20.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.280+0000 7f0622600640 1 -- 172.21.15.33:0/4101943900 wait complete. 2024-09-11T00:11:20.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.281+0000 7f0622600640 1 Processor -- start 2024-09-11T00:11:20.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.281+0000 7f0622600640 1 -- start start 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 0x7f061c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f061c107360 0x7f061c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112ca0 con 0x7f061c107360 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112b20 con 0x7f061c100fd0 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f0622600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112e20 con 0x7f061c1069e0 2024-09-11T00:11:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f061b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f061b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:53782/0 (socket says 172.21.15.33:53782) 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.282+0000 7f061b400640 1 -- 172.21.15.33:0/2497587629 learned_addr learned my addr 172.21.15.33:0/2497587629 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f0613e00640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 0x7f061c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f061b400640 1 -- 172.21.15.33:0/2497587629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 msgr2=0x7f061c19d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f061b400640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 0x7f061c19d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f061b400640 1 -- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f061c107360 msgr2=0x7f061c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f061b400640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f061c107360 0x7f061c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f061b400640 1 -- 172.21.15.33:0/2497587629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c1a03d0 con 0x7f061c100fd0 2024-09-11T00:11:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.283+0000 7f0613e00640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 0x7f061c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.284+0000 7f061b400640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f060c00b450 tx=0x7f060c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.284+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c015020 con 0x7f061c100fd0 2024-09-11T00:11:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.284+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f060c011d20 con 0x7f061c100fd0 2024-09-11T00:11:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.284+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061c1a0660 con 0x7f061c100fd0 2024-09-11T00:11:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.285+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061c10d110 con 0x7f061c100fd0 2024-09-11T00:11:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.285+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c010e30 con 0x7f061c100fd0 2024-09-11T00:11:20.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.287+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f8005290 con 0x7f061c100fd0 2024-09-11T00:11:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.296+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f060c011890 con 0x7f061c100fd0 2024-09-11T00:11:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.298+0000 7f0618c00640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 0x7f06000b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.299+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f060c0e59a0 con 0x7f061c100fd0 2024-09-11T00:11:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.299+0000 7f0613e00640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 0x7f06000b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:20.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.301+0000 7f0613e00640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 0x7f06000b7930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f061c103520 tx=0x7f0604008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:20.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.304+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f060c01f020 con 0x7f061c100fd0 2024-09-11T00:11:20.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:20 smithi033 ceph-mon[30593]: pgmap v873: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:20.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:20 smithi052 ceph-mon[33526]: pgmap v873: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:20.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.742+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05f8005580 con 0x7f061c100fd0 2024-09-11T00:11:20.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.743+0000 7f0618c00640 1 -- 172.21.15.33:0/2497587629 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f060c00d040 con 0x7f061c100fd0 2024-09-11T00:11:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:11:20.747 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:11:20.748 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:11:20.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 msgr2=0x7f06000b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:20.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 0x7f06000b7930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f061c103520 tx=0x7f0604008040 comp rx=0 tx=0).stop 2024-09-11T00:11:20.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 msgr2=0x7f061c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f060c00b450 tx=0x7f060c00b910 comp rx=0 tx=0).stop 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 shutdown_connections 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f06000b5470 0x7f06000b7930 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f061c107360 0x7f061c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f061c1069e0 0x7f061c19d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:20.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 --2- 172.21.15.33:0/2497587629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f061c100fd0 0x7f061c19ccf0 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f060c00b450 tx=0x7f060c00b910 comp rx=0 tx=0).stop 2024-09-11T00:11:20.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.750+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 >> 172.21.15.33:0/2497587629 conn(0x7f061c0fca20 msgr2=0x7f061c0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:20.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.751+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 shutdown_connections 2024-09-11T00:11:20.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:20.752+0000 7f0622600640 1 -- 172.21.15.33:0/2497587629 wait complete. 2024-09-11T00:11:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:20 smithi189 ceph-mon[34000]: pgmap v873: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:21.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:21 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2497587629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:21.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:21 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2497587629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:21.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:21 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2497587629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:22.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-11T00:11:22.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-11T00:11:22.780 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:22 smithi033 ceph-mon[30593]: pgmap v874: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 514 KiB/s wr, 71 op/s 2024-09-11T00:11:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:22 smithi189 ceph-mon[34000]: pgmap v874: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 514 KiB/s wr, 71 op/s 2024-09-11T00:11:22.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:22 smithi052 ceph-mon[33526]: pgmap v874: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 514 KiB/s wr, 71 op/s 2024-09-11T00:11:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 695.0 s, 587.6 tps, lat 168.959 ms stddev 67.957 2024-09-11T00:11:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:24.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:24 smithi033 ceph-mon[30593]: pgmap v875: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 MiB/s wr, 194 op/s 2024-09-11T00:11:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:24 smithi189 ceph-mon[34000]: pgmap v875: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 MiB/s wr, 194 op/s 2024-09-11T00:11:24.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:24 smithi052 ceph-mon[33526]: pgmap v875: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 MiB/s wr, 194 op/s 2024-09-11T00:11:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.222+0000 7fa77a200640 1 -- 172.21.15.33:0/1282672852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77410a890 msgr2=0x7fa77410cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.222+0000 7fa77a200640 1 --2- 172.21.15.33:0/1282672852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77410a890 0x7fa77410cd50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa764009ca0 tx=0x7fa76402a8d0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.223+0000 7fa77a200640 1 -- 172.21.15.33:0/1282672852 shutdown_connections 2024-09-11T00:11:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.223+0000 7fa77a200640 1 --2- 172.21.15.33:0/1282672852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77410a890 0x7fa77410cd50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.223+0000 7fa77a200640 1 --2- 172.21.15.33:0/1282672852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa77410a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.223+0000 7fa77a200640 1 --2- 172.21.15.33:0/1282672852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77406b300 0x7fa774107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.223+0000 7fa77a200640 1 -- 172.21.15.33:0/1282672852 >> 172.21.15.33:0/1282672852 conn(0x7fa7740fd140 msgr2=0x7fa7740ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.224+0000 7fa77a200640 1 -- 172.21.15.33:0/1282672852 shutdown_connections 2024-09-11T00:11:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.224+0000 7fa77a200640 1 -- 172.21.15.33:0/1282672852 wait complete. 2024-09-11T00:11:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.226+0000 7fa77a200640 1 Processor -- start 2024-09-11T00:11:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.227+0000 7fa77a200640 1 -- start start 2024-09-11T00:11:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.230+0000 7fa77a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.230+0000 7fa77a200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa774197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.230+0000 7fa773400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.230+0000 7fa773400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34806/0 (socket says 172.21.15.33:34806) 2024-09-11T00:11:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.232+0000 7fa773400640 1 -- 172.21.15.33:0/107865849 learned_addr learned my addr 172.21.15.33:0/107865849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.232+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 0x7fa774197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.232+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa774110710 con 0x7fa774107ed0 2024-09-11T00:11:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.232+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa774110590 con 0x7fa77406b300 2024-09-11T00:11:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.232+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa774110890 con 0x7fa77410a890 2024-09-11T00:11:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.233+0000 7fa772a00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa774197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773400640 1 -- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 msgr2=0x7fa774197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773e00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 0x7fa774197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773400640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 0x7fa774197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773400640 1 -- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 msgr2=0x7fa774197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773400640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa774197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773400640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7741985f0 con 0x7fa77406b300 2024-09-11T00:11:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.234+0000 7fa773e00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 0x7fa774197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:25.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.235+0000 7fa772a00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa774197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.235+0000 7fa773400640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00e9f0 tx=0x7fa76c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.236+0000 7fa76be00640 1 -- 172.21.15.33:0/107865849 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00ccc0 con 0x7fa77406b300 2024-09-11T00:11:25.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.236+0000 7fa76be00640 1 -- 172.21.15.33:0/107865849 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa76c0108c0 con 0x7fa77406b300 2024-09-11T00:11:25.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.236+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741988e0 con 0x7fa77406b300 2024-09-11T00:11:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.236+0000 7fa76be00640 1 -- 172.21.15.33:0/107865849 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c018750 con 0x7fa77406b300 2024-09-11T00:11:25.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.236+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77419d020 con 0x7fa77406b300 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.246+0000 7fa77d1e5740 1 Processor -- start 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.247+0000 7fa76be00640 1 -- 172.21.15.33:0/107865849 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa76c0188f0 con 0x7fa77406b300 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.247+0000 7fa77d1e5740 1 -- start start 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1f9790 0x556f4b1fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b200fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f4b16c6b0 con 0x556f4b1feb00 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556f4b15bae0 con 0x556f4b1f9790 2024-09-11T00:11:25.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.248+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f4b15f8f0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.249+0000 7fa773400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.249+0000 7fa773400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53644/0 (socket says 172.21.15.33:53644) 2024-09-11T00:11:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.249+0000 7fa773400640 1 -- 172.21.15.33:0/1913844272 learned_addr learned my addr 172.21.15.33:0/1913844272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.249+0000 7fa773e00640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1f9790 0x556f4b1fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.251+0000 7fa76be00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 0x7fa7580b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.252+0000 7fa76be00640 1 -- 172.21.15.33:0/107865849 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa76c0e6390 con 0x7fa77406b300 2024-09-11T00:11:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa772a00640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b200fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773400640 1 -- 172.21.15.33:0/1913844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1f9790 msgr2=0x556f4b1fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773400640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1f9790 0x556f4b1fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773400640 1 -- 172.21.15.33:0/1913844272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 msgr2=0x556f4b200fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773e00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 0x7fa7580b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773400640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b200fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa773400640 1 -- 172.21.15.33:0/1913844272 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4b128780 con 0x556f4b1fc0c0 2024-09-11T00:11:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.253+0000 7fa772a00640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b200fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.254+0000 7fa773400640 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ac910 tx=0x7fa76c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76c62771bbab872 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.255+0000 7fa75fe00640 1 -- 172.21.15.33:0/1913844272 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0ac0f0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.255+0000 7fa75fe00640 1 -- 172.21.15.33:0/1913844272 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa76c0e9960 con 0x556f4b1fc0c0 2024-09-11T00:11:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.255+0000 7fa75fe00640 1 -- 172.21.15.33:0/1913844272 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0a80f0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1913844272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 msgr2=0x556f4b1fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ac910 tx=0x7fa76c01f000 comp rx=0 tx=0).stop 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa773e00640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 0x7fa7580b78e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa764009a60 tx=0x7fa76402a8d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1913844272 shutdown_connections 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b200fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b1fe4b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1913844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1f9790 0x556f4b1fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1913844272 >> 172.21.15.33:0/1913844272 conn(0x556f4b1f48e0 msgr2=0x556f4b1f5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1913844272 shutdown_connections 2024-09-11T00:11:25.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.256+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1913844272 wait complete. 2024-09-11T00:11:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.257+0000 7fa77d1e5740 1 -- start start 2024-09-11T00:11:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.257+0000 7fa77d1e5740 1 Processor -- start 2024-09-11T00:11:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.258+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.258+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa772a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa772a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50660/0 (socket says 172.21.15.33:50660) 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa773400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa773400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53646/0 (socket says 172.21.15.33:53646) 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1feb00 0x556f4b204110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f4b093ab0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556f4b102570 con 0x556f4b1feb00 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f4b201a80 con 0x556f4b1f9790 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa77d1e5740 10 client.0 _ll_register_callbacks cb 0x556f4b111100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:25.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa772a00640 1 -- 172.21.15.33:0/996475936 learned_addr learned my addr 172.21.15.33:0/996475936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa773e00640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1feb00 0x556f4b204110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.259+0000 7fa773400640 1 -- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1feb00 msgr2=0x556f4b204110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa773400640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1feb00 0x556f4b204110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa773400640 1 -- 172.21.15.33:0/996475936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 msgr2=0x556f4b203540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa773400640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa773400640 1 -- 172.21.15.33:0/996475936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4aebd790 con 0x556f4b1f9790 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa772a00640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa773400640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0a8990 tx=0x7fa76c010be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f9dc6cf80625af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.260+0000 7fa75cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.261+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0a80f0 con 0x556f4b1f9790 2024-09-11T00:11:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.261+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa76c0adbd0 con 0x556f4b1f9790 2024-09-11T00:11:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.261+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f4b16e600 con 0x556f4b1f9790 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.262+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa76c0ac0f0 con 0x556f4b1f9790 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.262+0000 7fa77d1e5740 10 client.26788 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.262+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f4af36620 con 0x556f4b1f9790 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.262+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x556f4b16e600 con 0x556f4b1f9790 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.263+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa76c0ab850 con 0x556f4b1f9790 2024-09-11T00:11:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 10 client.26788 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 10 client.26788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 20 client.26788 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b20e340 0x556f4b210730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 4 client.26788 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f4b16a0b0 con 0x556f4b20e340 2024-09-11T00:11:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.264+0000 7fa772a00640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b20e340 0x556f4b210730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.265+0000 7fa772a00640 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b20e340 0x556f4b210730 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7547f63439cbc939 server_cookie=fe836124ccb3dae6 in_seq=0 out_seq=0 2024-09-11T00:11:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.265+0000 7fa75cc00640 10 client.26788 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.266+0000 7fa75cc00640 1 -- 172.21.15.33:0/996475936 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f4b16a0b0 con 0x556f4b20e340 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.266+0000 7fa75cc00640 10 client.26788 handle_command_reply: tid=0 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 client.26788 shutdown 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 msgr2=0x556f4b202ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0a8990 tx=0x7fa76c010be0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 shutdown_connections 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1feb00 0x556f4b204110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b203540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b20e340 0x556f4b210730 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/996475936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1f9790 0x556f4b202ea0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa75cc00640 0 client.26788 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.267+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 >> 172.21.15.33:0/996475936 conn(0x556f4b1f48e0 msgr2=0x556f4b1f3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.268+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 shutdown_connections 2024-09-11T00:11:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.268+0000 7fa77d1e5740 1 -- 172.21.15.33:0/996475936 wait complete. 2024-09-11T00:11:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.268+0000 7fa77d1e5740 20 client.26788 trim_cache size 0 max 16384 2024-09-11T00:11:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 Processor -- start 2024-09-11T00:11:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 -- start start 2024-09-11T00:11:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b202c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b20aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa754012560 con 0x556f4b1feb00 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400fe30 con 0x556f4b1ff5f0 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.305+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400dc80 con 0x556f4b1fc0c0 2024-09-11T00:11:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.306+0000 7fa773e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.306+0000 7fa773e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34828/0 (socket says 172.21.15.33:34828) 2024-09-11T00:11:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.306+0000 7fa773e00640 1 -- 172.21.15.33:0/316207044 learned_addr learned my addr 172.21.15.33:0/316207044 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.306+0000 7fa772a00640 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b20aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.306+0000 7fa773400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b202c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.307+0000 7fa773400640 1 -- 172.21.15.33:0/316207044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 msgr2=0x556f4b1f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.308+0000 7fa773400640 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.308+0000 7fa773400640 1 -- 172.21.15.33:0/316207044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 msgr2=0x556f4b20aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.308+0000 7fa773400640 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b20aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.308+0000 7fa773400640 1 -- 172.21.15.33:0/316207044 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4b1fbef0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.308+0000 7fa773e00640 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.309+0000 7fa773400640 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b202c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0a9bf0 tx=0x7fa76c0b3b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932669a2312ad14f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.310+0000 7fa75f400640 1 -- 172.21.15.33:0/316207044 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0abdf0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.310+0000 7fa75f400640 1 -- 172.21.15.33:0/316207044 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa76c0cf1d0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.310+0000 7fa75f400640 1 -- 172.21.15.33:0/316207044 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0b2470 con 0x556f4b1fc0c0 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 -- 172.21.15.33:0/316207044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 msgr2=0x556f4b202c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b202c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0a9bf0 tx=0x7fa76c0b3b80 comp rx=0 tx=0).stop 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 -- 172.21.15.33:0/316207044 shutdown_connections 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1feb00 0x556f4b20aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/316207044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1fc0c0 0x556f4b202c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.311+0000 7fa77d1e5740 1 -- 172.21.15.33:0/316207044 >> 172.21.15.33:0/316207044 conn(0x556f4b1f48e0 msgr2=0x556f4b1feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.312+0000 7fa77d1e5740 1 -- 172.21.15.33:0/316207044 shutdown_connections 2024-09-11T00:11:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.312+0000 7fa77d1e5740 1 -- 172.21.15.33:0/316207044 wait complete. 2024-09-11T00:11:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.313+0000 7fa77d1e5740 1 -- start start 2024-09-11T00:11:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.313+0000 7fa77d1e5740 1 Processor -- start 2024-09-11T00:11:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b208b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400e2f0 con 0x556f4b1fc0c0 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400f760 con 0x556f4b1ff5f0 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400e9c0 con 0x556f4b1feb00 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.314+0000 7fa77d1e5740 10 client.0 _ll_register_callbacks cb 0x7fa76c0e3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa773e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b208b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa772a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa773400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa772a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53668/0 (socket says 172.21.15.33:53668) 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa772a00640 1 -- 172.21.15.33:0/1778818936 learned_addr learned my addr 172.21.15.33:0/1778818936 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa773400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50674/0 (socket says 172.21.15.33:50674) 2024-09-11T00:11:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.315+0000 7fa773e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b208b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34832/0 (socket says 172.21.15.33:34832) 2024-09-11T00:11:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.317+0000 7fa772a00640 1 -- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 msgr2=0x556f4b208b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.317+0000 7fa772a00640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b208b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.317+0000 7fa772a00640 1 -- 172.21.15.33:0/1778818936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 msgr2=0x556f4b20a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.317+0000 7fa772a00640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.317+0000 7fa772a00640 1 -- 172.21.15.33:0/1778818936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4b2092a0 con 0x556f4b1feb00 2024-09-11T00:11:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.318+0000 7fa773400640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.318+0000 7fa772a00640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa760009300 tx=0x7fa760009110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71acd5becd58430f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.318+0000 7fa75cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.319+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600168a0 con 0x556f4b1feb00 2024-09-11T00:11:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.319+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa760016a40 con 0x556f4b1feb00 2024-09-11T00:11:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.319+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa76c0cf1d0 con 0x556f4b1feb00 2024-09-11T00:11:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.319+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa760016c40 con 0x556f4b1feb00 2024-09-11T00:11:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.320+0000 7fa77d1e5740 10 client.26794 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.320+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f4b27bc20 con 0x556f4b1feb00 2024-09-11T00:11:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa76c0cf1d0 con 0x556f4b1feb00 2024-09-11T00:11:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa760024070 con 0x556f4b1feb00 2024-09-11T00:11:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa77d1e5740 10 client.26794 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa77d1e5740 10 client.26794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa77d1e5740 20 client.26794 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.321+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b27c5d0 0x556f4b27e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.322+0000 7fa77d1e5740 4 client.26794 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.322+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f4b1674e0 con 0x556f4b27c5d0 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.322+0000 7fa773400640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b27c5d0 0x556f4b27e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.324+0000 7fa773400640 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b27c5d0 0x556f4b27e9f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c440dfcbf0ce90 server_cookie=a8572b67c46b3c48 in_seq=0 out_seq=0 2024-09-11T00:11:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.324+0000 7fa75cc00640 10 client.26794 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.346+0000 7fa75cc00640 1 -- 172.21.15.33:0/1778818936 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f4b1674e0 con 0x556f4b27c5d0 2024-09-11T00:11:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.347+0000 7fa75cc00640 10 client.26794 handle_command_reply: tid=0 2024-09-11T00:11:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.347+0000 7fa77d1e5740 1 client.26794 shutdown 2024-09-11T00:11:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 msgr2=0x556f4b20a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa760009300 tx=0x7fa760009110 comp rx=0 tx=0).stop 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 shutdown_connections 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556f4b1ff5f0 0x556f4b208b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x556f4b27c5d0 0x556f4b27e9f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f4b1feb00 0x556f4b20a830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 --2- 172.21.15.33:0/1778818936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f4b1fc0c0 0x556f4b20a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 >> 172.21.15.33:0/1778818936 conn(0x556f4b1f48e0 msgr2=0x556f4b1f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.350+0000 7fa75cc00640 0 client.26794 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.351+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 shutdown_connections 2024-09-11T00:11:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.351+0000 7fa77d1e5740 1 -- 172.21.15.33:0/1778818936 wait complete. 2024-09-11T00:11:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.351+0000 7fa77d1e5740 20 client.26794 trim_cache size 0 max 16384 2024-09-11T00:11:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:11:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:11:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:11:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:11:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.353+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 msgr2=0x7fa7580b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.353+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 0x7fa7580b78e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa764009a60 tx=0x7fa76402a8d0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.353+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 msgr2=0x7fa774196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.353+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00e9f0 tx=0x7fa76c00edf0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 shutdown_connections 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa7580b5420 0x7fa7580b78e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa77410a890 0x7fa774197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa774107ed0 0x7fa774197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 --2- 172.21.15.33:0/107865849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa77406b300 0x7fa774196ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.354+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 >> 172.21.15.33:0/107865849 conn(0x7fa7740fd140 msgr2=0x7fa774108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.355+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 shutdown_connections 2024-09-11T00:11:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:25.355+0000 7fa77a200640 1 -- 172.21.15.33:0/107865849 wait complete. 2024-09-11T00:11:25.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 -- 172.21.15.33:0/2077986014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010aa70 msgr2=0x7f00601154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 --2- 172.21.15.33:0/2077986014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010aa70 0x7f00601154d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c02a4b0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 -- 172.21.15.33:0/2077986014 shutdown_connections 2024-09-11T00:11:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 --2- 172.21.15.33:0/2077986014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 --2- 172.21.15.33:0/2077986014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010aa70 0x7f00601154d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 --2- 172.21.15.33:0/2077986014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010a150 0x7f006010a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.418+0000 7f0066a00640 1 -- 172.21.15.33:0/2077986014 >> 172.21.15.33:0/2077986014 conn(0x7f006006dfc0 msgr2=0x7f006006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.421+0000 7f0066a00640 1 -- 172.21.15.33:0/2077986014 shutdown_connections 2024-09-11T00:11:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.421+0000 7f0066a00640 1 -- 172.21.15.33:0/2077986014 wait complete. 2024-09-11T00:11:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.424+0000 7f0066a00640 1 Processor -- start 2024-09-11T00:11:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.424+0000 7f0066a00640 1 -- start start 2024-09-11T00:11:25.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.424+0000 7f0066a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010a150 0x7f0060114c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.424+0000 7f0066a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.424+0000 7f0066a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 0x7f006010c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.425+0000 7f0066a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f006011b430 con 0x7f006010c1f0 2024-09-11T00:11:25.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.425+0000 7f0066a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f006011b2b0 con 0x7f0060115a10 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.425+0000 7f0066a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f006011b5b0 con 0x7f006010a150 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.425+0000 7f0064a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 0x7f006010c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.425+0000 7f005f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.426+0000 7f005f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34848/0 (socket says 172.21.15.33:34848) 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.426+0000 7f005f400640 1 -- 172.21.15.33:0/2296067195 learned_addr learned my addr 172.21.15.33:0/2296067195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.426+0000 7f0064a00640 1 -- 172.21.15.33:0/2296067195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010a150 msgr2=0x7f0060114c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.426+0000 7f0064a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010a150 0x7f0060114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.427+0000 7f0064a00640 1 -- 172.21.15.33:0/2296067195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 msgr2=0x7f0060115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.427+0000 7f0064a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.427+0000 7f0064a00640 1 -- 172.21.15.33:0/2296067195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006010cdd0 con 0x7f006010c1f0 2024-09-11T00:11:25.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.427+0000 7f005f400640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.427+0000 7f0064a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 0x7f006010c6a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fd0 tx=0x7f005800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.428+0000 7f005cc00640 1 -- 172.21.15.33:0/2296067195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005800ce20 con 0x7f006010c1f0 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.428+0000 7f005cc00640 1 -- 172.21.15.33:0/2296067195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0058005020 con 0x7f006010c1f0 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.428+0000 7f005cc00640 1 -- 172.21.15.33:0/2296067195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058010690 con 0x7f006010c1f0 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.428+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0060111b90 con 0x7f006010c1f0 2024-09-11T00:11:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.428+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0060112050 con 0x7f006010c1f0 2024-09-11T00:11:25.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.434+0000 7f006966d740 1 Processor -- start 2024-09-11T00:11:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.434+0000 7f005cc00640 1 -- 172.21.15.33:0/2296067195 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0058010830 con 0x7f006010c1f0 2024-09-11T00:11:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 -- start start 2024-09-11T00:11:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624e7510 0x562c624e9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562c62450a90 con 0x562c624dcc40 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562c6243fec0 con 0x562c624db6e0 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.437+0000 7f006966d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c62443cd0 con 0x562c624e7510 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.438+0000 7f005f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.438+0000 7f005cc00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 0x7f00440b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.438+0000 7f005fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.438+0000 7f005fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34860/0 (socket says 172.21.15.33:34860) 2024-09-11T00:11:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.438+0000 7f005fe00640 1 -- 172.21.15.33:0/2465603134 learned_addr learned my addr 172.21.15.33:0/2465603134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.439+0000 7f005cc00640 1 -- 172.21.15.33:0/2296067195 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f00580e65d0 con 0x7f006010c1f0 2024-09-11T00:11:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.439+0000 7f0064a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 0x7f00440b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.439+0000 7f005f400640 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624e7510 0x562c624e9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005f400640 1 -- 172.21.15.33:0/2465603134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624e7510 msgr2=0x562c624e9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005f400640 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624e7510 0x562c624e9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005f400640 1 -- 172.21.15.33:0/2465603134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 msgr2=0x562c624dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005f400640 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005f400640 1 -- 172.21.15.33:0/2465603134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c623e59d0 con 0x562c624dcc40 2024-09-11T00:11:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.441+0000 7f005fe00640 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.442+0000 7f005f400640 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624db1a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f004c02aa20 tx=0x7f004c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ba466bcde51d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.443+0000 7f0055200640 1 -- 172.21.15.33:0/2465603134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004b30 con 0x562c624dcc40 2024-09-11T00:11:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.443+0000 7f0055200640 1 -- 172.21.15.33:0/2465603134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c004cd0 con 0x562c624dcc40 2024-09-11T00:11:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.444+0000 7f0055200640 1 -- 172.21.15.33:0/2465603134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c003bc0 con 0x562c624dcc40 2024-09-11T00:11:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.445+0000 7f006966d740 1 -- 172.21.15.33:0/2465603134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 msgr2=0x562c624db1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.445+0000 7f006966d740 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624db1a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f004c02aa20 tx=0x7f004c005d50 comp rx=0 tx=0).stop 2024-09-11T00:11:25.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.445+0000 7f0064a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 0x7f00440b78e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f00580ac690 tx=0x7f0058005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 -- 172.21.15.33:0/2465603134 shutdown_connections 2024-09-11T00:11:25.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624e7510 0x562c624e9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624db6e0 0x562c624dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 --2- 172.21.15.33:0/2465603134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624db1a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 -- 172.21.15.33:0/2465603134 >> 172.21.15.33:0/2465603134 conn(0x562c624a56f0 msgr2=0x562c624d8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 -- 172.21.15.33:0/2465603134 shutdown_connections 2024-09-11T00:11:25.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.447+0000 7f006966d740 1 -- 172.21.15.33:0/2465603134 wait complete. 2024-09-11T00:11:25.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.448+0000 7f006966d740 1 -- start start 2024-09-11T00:11:25.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.448+0000 7f006966d740 1 Processor -- start 2024-09-11T00:11:25.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624e4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562c622a17b0 con 0x562c624dcc40 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562c623e4650 con 0x562c624e7510 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c624ea370 con 0x562c624db6e0 2024-09-11T00:11:25.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.450+0000 7f006966d740 10 client.0 _ll_register_callbacks cb 0x562c6214b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.451+0000 7f005f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.451+0000 7f005f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53700/0 (socket says 172.21.15.33:53700) 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.451+0000 7f005f400640 1 -- 172.21.15.33:0/4160796291 learned_addr learned my addr 172.21.15.33:0/4160796291 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.451+0000 7f005fe00640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.451+0000 7f005f400640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 -- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 msgr2=0x562c624e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 -- 172.21.15.33:0/4160796291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 msgr2=0x562c624e4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624e4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 -- 172.21.15.33:0/4160796291 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c621adba0 con 0x562c624db6e0 2024-09-11T00:11:25.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005fe00640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624e4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f005f400640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f004c02abf0 tx=0x7f004c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee66a7cd71a2713 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.452+0000 7f0049600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c054060 con 0x562c624db6e0 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f004c003d50 con 0x562c624db6e0 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c004cd0 con 0x562c624db6e0 2024-09-11T00:11:25.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f004c004b30 con 0x562c624db6e0 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f006966d740 10 client.26803 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.453+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c624f5e40 con 0x562c624db6e0 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c004cd0 con 0x562c624db6e0 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f004c03d040 con 0x562c624db6e0 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 10 client.26803 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 10 client.26803 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:25.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 20 client.26803 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c624f7190 0x562c624f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 4 client.26803 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.454+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c624529e0 con 0x562c624f7190 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.455+0000 7f005fe00640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c624f7190 0x562c624f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.456+0000 7f0049600640 10 client.26803 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.456+0000 7f005fe00640 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c624f7190 0x562c624f9580 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc56dfa32590c244 server_cookie=5c1b78a0aeaca69e in_seq=0 out_seq=0 2024-09-11T00:11:25.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.457+0000 7f0049600640 1 -- 172.21.15.33:0/4160796291 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c624529e0 con 0x562c624f7190 2024-09-11T00:11:25.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.457+0000 7f0049600640 10 client.26803 handle_command_reply: tid=0 2024-09-11T00:11:25.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.457+0000 7f006966d740 1 client.26803 shutdown 2024-09-11T00:11:25.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.458+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 msgr2=0x562c624e6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.458+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f004c02abf0 tx=0x7f004c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.458+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 shutdown_connections 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624e4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c624f7190 0x562c624f9580 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f006966d740 1 --2- 172.21.15.33:0/4160796291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624e6ee0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f0049600640 0 client.26803 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.459+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 >> 172.21.15.33:0/4160796291 conn(0x562c624a56f0 msgr2=0x562c624deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.461+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 shutdown_connections 2024-09-11T00:11:25.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.461+0000 7f006966d740 1 -- 172.21.15.33:0/4160796291 wait complete. 2024-09-11T00:11:25.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.461+0000 7f006966d740 20 client.26803 trim_cache size 0 max 16384 2024-09-11T00:11:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.499+0000 7f006966d740 1 Processor -- start 2024-09-11T00:11:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.499+0000 7f006966d740 1 -- start start 2024-09-11T00:11:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.500+0000 7f006966d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 0x562c624f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.500+0000 7f006966d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f006966d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f005f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 0x562c624f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f005fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f006966d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00400124c0 con 0x562c624db6e0 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f006966d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f004000fd90 con 0x562c624e7510 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f006966d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f004000dba0 con 0x562c624dcc40 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f005f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 0x562c624f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50720/0 (socket says 172.21.15.33:50720) 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f005f400640 1 -- 172.21.15.33:0/1535181092 learned_addr learned my addr 172.21.15.33:0/1535181092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.501+0000 7f005fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53716/0 (socket says 172.21.15.33:53716) 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 -- 172.21.15.33:0/1535181092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 msgr2=0x562c624d8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 -- 172.21.15.33:0/1535181092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 msgr2=0x562c624f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 0x562c624f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 -- 172.21.15.33:0/1535181092 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c624e40e0 con 0x562c624dcc40 2024-09-11T00:11:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.502+0000 7f005fe00640 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x562c623e4770 tx=0x7f0050005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0502503fa3f544 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.505+0000 7f004be00640 1 -- 172.21.15.33:0/1535181092 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050004220 con 0x562c624dcc40 2024-09-11T00:11:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.505+0000 7f004be00640 1 -- 172.21.15.33:0/1535181092 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f005000ae70 con 0x562c624dcc40 2024-09-11T00:11:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.505+0000 7f004be00640 1 -- 172.21.15.33:0/1535181092 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005001b650 con 0x562c624dcc40 2024-09-11T00:11:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 -- 172.21.15.33:0/1535181092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 msgr2=0x562c624d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x562c623e4770 tx=0x7f0050005b50 comp rx=0 tx=0).stop 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 -- 172.21.15.33:0/1535181092 shutdown_connections 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c624d8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624dcc40 0x562c624d88a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 --2- 172.21.15.33:0/1535181092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624db6e0 0x562c624f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.506+0000 7f006966d740 1 -- 172.21.15.33:0/1535181092 >> 172.21.15.33:0/1535181092 conn(0x562c624a56f0 msgr2=0x562c624e6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.507+0000 7f006966d740 1 -- 172.21.15.33:0/1535181092 shutdown_connections 2024-09-11T00:11:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.507+0000 7f006966d740 1 -- 172.21.15.33:0/1535181092 wait complete. 2024-09-11T00:11:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.507+0000 7f006966d740 1 -- start start 2024-09-11T00:11:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 Processor -- start 2024-09-11T00:11:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624f9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c6255cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f004000e250 con 0x562c624dcc40 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f004000f6c0 con 0x562c624e7510 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f004000e920 con 0x562c624db6e0 2024-09-11T00:11:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.508+0000 7f006966d740 10 client.0 _ll_register_callbacks cb 0x7f0050005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.509+0000 7f005f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.509+0000 7f005f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53730/0 (socket says 172.21.15.33:53730) 2024-09-11T00:11:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.509+0000 7f005f400640 1 -- 172.21.15.33:0/3980352095 learned_addr learned my addr 172.21.15.33:0/3980352095 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.509+0000 7f005f400640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c6255cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.510+0000 7f005f400640 1 -- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 msgr2=0x562c6255cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.510+0000 7f005f400640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c6255cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.510+0000 7f005f400640 1 -- 172.21.15.33:0/3980352095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 msgr2=0x562c624f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.510+0000 7f005fe00640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.511+0000 7f005f400640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.511+0000 7f005f400640 1 -- 172.21.15.33:0/3980352095 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6255d520 con 0x562c624db6e0 2024-09-11T00:11:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.511+0000 7f005fe00640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.512+0000 7f005f400640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f004c0098c0 tx=0x7f004c005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7dfccde8c93089 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.512+0000 7f0049600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004b30 con 0x562c624db6e0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f004c004cd0 con 0x562c624db6e0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f005000ae70 con 0x562c624db6e0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f004c04ac50 con 0x562c624db6e0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f006966d740 10 client.26809 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.513+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c62564980 con 0x562c624db6e0 2024-09-11T00:11:25.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f005000ae70 con 0x562c624db6e0 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f004c03d040 con 0x562c624db6e0 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 10 client.26809 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 10 client.26809 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 20 client.26809 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c62565170 0x562c62567590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 4 client.26809 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-11T00:11:25.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.514+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x562c6244e490 con 0x562c62565170 2024-09-11T00:11:25.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.516+0000 7f005fe00640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c62565170 0x562c62567590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:25.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.516+0000 7f005fe00640 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c62565170 0x562c62567590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974107587f90cfc6 server_cookie=2a748c4be97c20d1 in_seq=0 out_seq=0 2024-09-11T00:11:25.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.517+0000 7f0049600640 10 client.26809 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.773+0000 7f0049600640 1 -- 172.21.15.33:0/3980352095 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562c6244e490 con 0x562c62565170 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.773+0000 7f0049600640 10 client.26809 handle_command_reply: tid=0 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.773+0000 7f006966d740 1 client.26809 shutdown 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.773+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 msgr2=0x562c624f90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.773+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f004c0098c0 tx=0x7f004c005d50 comp rx=0 tx=0).stop 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 shutdown_connections 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c624e7510 0x562c6255cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562c624dcc40 0x562c624f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x562c62565170 0x562c62567590 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 --2- 172.21.15.33:0/3980352095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c624db6e0 0x562c624f90e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 >> 172.21.15.33:0/3980352095 conn(0x562c624a56f0 msgr2=0x562c624de350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f0049600640 0 client.26809 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 shutdown_connections 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 1 -- 172.21.15.33:0/3980352095 wait complete. 2024-09-11T00:11:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.774+0000 7f006966d740 20 client.26809 trim_cache size 0 max 16384 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 46, 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "f9fa26a2": { 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 46, 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:25.778 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 142.8, 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:25.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 msgr2=0x7f00440b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 0x7f00440b78e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f00580ac690 tx=0x7f0058005f70 comp rx=0 tx=0).stop 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 msgr2=0x7f006010c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:25.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 0x7f006010c6a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fd0 tx=0x7f005800ef10 comp rx=0 tx=0).stop 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 shutdown_connections 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00440b5420 0x7f00440b78e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f006010c1f0 0x7f006010c6a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060115a10 0x7f0060115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 --2- 172.21.15.33:0/2296067195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f006010a150 0x7f0060114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 >> 172.21.15.33:0/2296067195 conn(0x7f006006dfc0 msgr2=0x7f0060071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 shutdown_connections 2024-09-11T00:11:25.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:25.775+0000 7f0066a00640 1 -- 172.21.15.33:0/2296067195 wait complete. 2024-09-11T00:11:26.639 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f9fa26a2', quiesce took 7.9 seconds. Will release after: 14.85 2024-09-11T00:11:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:26 smithi033 ceph-mon[30593]: pgmap v876: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-11T00:11:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:26 smithi189 ceph-mon[34000]: pgmap v876: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-11T00:11:26.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:26 smithi052 ceph-mon[33526]: pgmap v876: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-09-11T00:11:28.330 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 700.0 s, 236.9 tps, lat 190.087 ms stddev 65.033 2024-09-11T00:11:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:28 smithi033 ceph-mon[30593]: pgmap v877: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 MiB/s wr, 339 op/s 2024-09-11T00:11:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:28 smithi189 ceph-mon[34000]: pgmap v877: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 MiB/s wr, 339 op/s 2024-09-11T00:11:28.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:28 smithi052 ceph-mon[33526]: pgmap v877: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 MiB/s wr, 339 op/s 2024-09-11T00:11:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:30 smithi033 ceph-mon[30593]: pgmap v878: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-09-11T00:11:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:30 smithi189 ceph-mon[34000]: pgmap v878: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-09-11T00:11:30.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:30 smithi052 ceph-mon[33526]: pgmap v878: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-09-11T00:11:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:32 smithi033 ceph-mon[30593]: pgmap v879: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-09-11T00:11:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:32 smithi189 ceph-mon[34000]: pgmap v879: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-09-11T00:11:32.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:32 smithi052 ceph-mon[33526]: pgmap v879: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-09-11T00:11:33.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 705.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:11:33.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:33 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:33.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:33 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:33.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:33 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:34 smithi033 ceph-mon[30593]: pgmap v880: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.2 MiB/s wr, 335 op/s 2024-09-11T00:11:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:11:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:34 smithi189 ceph-mon[34000]: pgmap v880: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.2 MiB/s wr, 335 op/s 2024-09-11T00:11:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:11:34.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:34 smithi052 ceph-mon[33526]: pgmap v880: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.2 MiB/s wr, 335 op/s 2024-09-11T00:11:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:11:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:36 smithi033 ceph-mon[30593]: pgmap v881: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 207 op/s 2024-09-11T00:11:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:36 smithi189 ceph-mon[34000]: pgmap v881: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 207 op/s 2024-09-11T00:11:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:36 smithi052 ceph-mon[33526]: pgmap v881: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 MiB/s wr, 207 op/s 2024-09-11T00:11:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 710.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 -- 172.21.15.33:0/1470678514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c105ac0 msgr2=0x7f540c107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 --2- 172.21.15.33:0/1470678514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c105ac0 0x7f540c107f30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009900 tx=0x7f53f802a410 comp rx=0 tx=0).stop 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 -- 172.21.15.33:0/1470678514 shutdown_connections 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 --2- 172.21.15.33:0/1470678514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c108670 0x7f540c10ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 --2- 172.21.15.33:0/1470678514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c105ac0 0x7f540c107f30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 --2- 172.21.15.33:0/1470678514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c06bfb0 0x7f540c105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.502+0000 7f5412400640 1 -- 172.21.15.33:0/1470678514 >> 172.21.15.33:0/1470678514 conn(0x7f540c0fd120 msgr2=0x7f540c0ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.503+0000 7f5412400640 1 -- 172.21.15.33:0/1470678514 shutdown_connections 2024-09-11T00:11:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.503+0000 7f5412400640 1 -- 172.21.15.33:0/1470678514 wait complete. 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 Processor -- start 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 -- start start 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c06bfb0 0x7f540c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c105ac0 0x7f540c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f540c10e4a0 con 0x7f540c108670 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f540c10e320 con 0x7f540c105ac0 2024-09-11T00:11:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f5412400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f540c10e620 con 0x7f540c06bfb0 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f540be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f540be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40542/0 (socket says 172.21.15.33:40542) 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f540be00640 1 -- 172.21.15.33:0/2642068684 learned_addr learned my addr 172.21.15.33:0/2642068684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.504+0000 7f540aa00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c105ac0 0x7f540c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540b400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c06bfb0 0x7f540c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 -- 172.21.15.33:0/2642068684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c06bfb0 msgr2=0x7f540c102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c06bfb0 0x7f540c102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 -- 172.21.15.33:0/2642068684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c105ac0 msgr2=0x7f540c1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c105ac0 0x7f540c1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 -- 172.21.15.33:0/2642068684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c102280 con 0x7f540c108670 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f540be00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5404009fd0 tx=0x7f540400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f5403e00640 1 -- 172.21.15.33:0/2642068684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404017070 con 0x7f540c108670 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f5403e00640 1 -- 172.21.15.33:0/2642068684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5404003e00 con 0x7f540c108670 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f5403e00640 1 -- 172.21.15.33:0/2642068684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404010460 con 0x7f540c108670 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.505+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c1a2d90 con 0x7f540c108670 2024-09-11T00:11:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.506+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c1a3200 con 0x7f540c108670 2024-09-11T00:11:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.509+0000 7f541545f740 1 Processor -- start 2024-09-11T00:11:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.510+0000 7f5403e00640 1 -- 172.21.15.33:0/2642068684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5404003970 con 0x7f540c108670 2024-09-11T00:11:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.510+0000 7f541545f740 1 -- start start 2024-09-11T00:11:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.510+0000 7f541545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.510+0000 7f541545f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f541545f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f541545f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af4b92e6b0 con 0x55af4b9be0c0 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f541545f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af4b91dae0 con 0x55af4b9c0b00 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f541545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af4b9218f0 con 0x55af4b9bb790 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39454/0 (socket says 172.21.15.33:39454) 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540aa00640 1 -- 172.21.15.33:0/2451901427 learned_addr learned my addr 172.21.15.33:0/2451901427 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40552/0 (socket says 172.21.15.33:40552) 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540aa00640 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 -- 172.21.15.33:0/2451901427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 msgr2=0x55af4b9bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 -- 172.21.15.33:0/2451901427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 msgr2=0x55af4b9c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.511+0000 7f540b400640 1 -- 172.21.15.33:0/2451901427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4b8ea780 con 0x55af4b9be0c0 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f540b400640 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009c20 tx=0x7f53fc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2296a9159813877e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f5400c00640 1 -- 172.21.15.33:0/2451901427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004050 con 0x55af4b9be0c0 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f5403e00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 0x7f53f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f5400c00640 1 -- 172.21.15.33:0/2451901427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53fc005020 con 0x55af4b9be0c0 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f5400c00640 1 -- 172.21.15.33:0/2451901427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004bc0 con 0x55af4b9be0c0 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f5403e00640 1 -- 172.21.15.33:0/2642068684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f54040e60e0 con 0x7f540c108670 2024-09-11T00:11:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.512+0000 7f540aa00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 0x7f53f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 -- 172.21.15.33:0/2451901427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 msgr2=0x55af4b9c04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009c20 tx=0x7f53fc011810 comp rx=0 tx=0).stop 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f540aa00640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 0x7f53f00b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000c00 tx=0x7f53f8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 -- 172.21.15.33:0/2451901427 shutdown_connections 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c04b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 --2- 172.21.15.33:0/2451901427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 -- 172.21.15.33:0/2451901427 >> 172.21.15.33:0/2451901427 conn(0x55af4b9b68e0 msgr2=0x55af4b9b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 -- 172.21.15.33:0/2451901427 shutdown_connections 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.513+0000 7f541545f740 1 -- 172.21.15.33:0/2451901427 wait complete. 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 -- start start 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 Processor -- start 2024-09-11T00:11:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af4b855ab0 con 0x55af4b9be0c0 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af4b8c4570 con 0x55af4b9c0b00 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55af4b9c3ae0 con 0x55af4b9bb790 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.514+0000 7f541545f740 10 client.0 _ll_register_callbacks cb 0x55af4b8d3100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40558/0 (socket says 172.21.15.33:40558) 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:39470/0 (socket says 172.21.15.33:39470) 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 -- 172.21.15.33:0/1297533303 learned_addr learned my addr 172.21.15.33:0/1297533303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540be00640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 -- 172.21.15.33:0/1297533303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 msgr2=0x55af4b9c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 -- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 msgr2=0x55af4b9c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540aa00640 1 -- 172.21.15.33:0/1297533303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4b67f790 con 0x55af4b9be0c0 2024-09-11T00:11:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.515+0000 7f540be00640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f540aa00640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f53f8005ab0 tx=0x7f53f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08e5d54c2ebe9ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8035040 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53fc005020 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f53f8031500 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53f805d050 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f541545f740 10 client.16974 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55af4b6f8620 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53fc005020 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.516+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f53f8047030 con 0x55af4b9be0c0 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 10 client.16974 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 10 client.16974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 20 client.16974 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4b9d07c0 0x55af4b9d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 4 client.16974 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af4b930600 con 0x55af4b9d07c0 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.517+0000 7f540b400640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4b9d07c0 0x55af4b9d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.518+0000 7f540b400640 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4b9d07c0 0x55af4b9d2bb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45092ca9a682f2e8 server_cookie=84d5b21a3feb1d50 in_seq=0 out_seq=0 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.518+0000 7f53f5600640 10 client.16974 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f53f5600640 1 -- 172.21.15.33:0/1297533303 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af4b930600 con 0x55af4b9d07c0 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f53f5600640 10 client.16974 handle_command_reply: tid=0 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 client.16974 shutdown 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 msgr2=0x55af4b9c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f53f8005ab0 tx=0x7f53f8009260 comp rx=0 tx=0).stop 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 shutdown_connections 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9c5560 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4b9d07c0 0x55af4b9d2bb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 --2- 172.21.15.33:0/1297533303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f53f5600640 0 client.16974 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 >> 172.21.15.33:0/1297533303 conn(0x55af4b9b68e0 msgr2=0x55af4b9b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 shutdown_connections 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 1 -- 172.21.15.33:0/1297533303 wait complete. 2024-09-11T00:11:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.519+0000 7f541545f740 20 client.16974 trim_cache size 0 max 16384 2024-09-11T00:11:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 Processor -- start 2024-09-11T00:11:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 -- start start 2024-09-11T00:11:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9d7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9d7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1b0060 con 0x55af4b9be0c0 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1ad930 con 0x55af4b9c0b00 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.535+0000 7f541545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1ab780 con 0x55af4b9bb790 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40572/0 (socket says 172.21.15.33:40572) 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 -- 172.21.15.33:0/3209826562 learned_addr learned my addr 172.21.15.33:0/3209826562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540be00640 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9d7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540b400640 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9d7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 -- 172.21.15.33:0/3209826562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 msgr2=0x55af4b9d7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9d7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 -- 172.21.15.33:0/3209826562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 msgr2=0x55af4b9d7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9d7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 -- 172.21.15.33:0/3209826562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4b9c64a0 con 0x55af4b9be0c0 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.536+0000 7f540aa00640 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f53f8045040 tx=0x7f53f8003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf107a80a97deef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f53f7e00640 1 -- 172.21.15.33:0/3209826562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8035040 con 0x55af4b9be0c0 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f53f7e00640 1 -- 172.21.15.33:0/3209826562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53f804f070 con 0x55af4b9be0c0 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f53f7e00640 1 -- 172.21.15.33:0/3209826562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8031bf0 con 0x55af4b9be0c0 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 -- 172.21.15.33:0/3209826562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 msgr2=0x55af4b9d79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f53f8045040 tx=0x7f53f8003e40 comp rx=0 tx=0).stop 2024-09-11T00:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 -- 172.21.15.33:0/3209826562 shutdown_connections 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9c0b00 0x55af4b9d7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9be0c0 0x55af4b9d79d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 --2- 172.21.15.33:0/3209826562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9bb790 0x55af4b9d7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 -- 172.21.15.33:0/3209826562 >> 172.21.15.33:0/3209826562 conn(0x55af4b9b68e0 msgr2=0x55af4b9b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 -- 172.21.15.33:0/3209826562 shutdown_connections 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.537+0000 7f541545f740 1 -- 172.21.15.33:0/3209826562 wait complete. 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 -- start start 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 Processor -- start 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 0x55af4b9cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 0x55af4b9cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1abdf0 con 0x55af4b9bb790 2024-09-11T00:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1ad260 con 0x55af4b9be0c0 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1ac4c0 con 0x55af4b9c0b00 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.538+0000 7f541545f740 10 client.0 _ll_register_callbacks cb 0x7f53f80040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40574/0 (socket says 172.21.15.33:40574) 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 -- 172.21.15.33:0/555183058 learned_addr learned my addr 172.21.15.33:0/555183058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540be00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 0x55af4b9cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540aa00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 0x55af4b9cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 -- 172.21.15.33:0/555183058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 msgr2=0x55af4b9cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 0x55af4b9cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 -- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 msgr2=0x55af4b9cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 0x55af4b9cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 -- 172.21.15.33:0/555183058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4b9caa90 con 0x55af4b9bb790 2024-09-11T00:11:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540be00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 0x55af4b9cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540aa00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 0x55af4b9cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f540b400640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f53fc014040 tx=0x7f53fc009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c57a52a8adce9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f53f5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.539+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc005650 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f53fc005b90 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f804f070 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f53fc03a050 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 10 client.16980 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55af4ba3dca0 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53f804f070 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f53fc02e5a0 con 0x55af4b9bb790 2024-09-11T00:11:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 10 client.16980 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 20 client.16980 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4ba3e540 0x55af4ba40960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 4 client.16980 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.540+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af4b92c0b0 con 0x55af4ba3e540 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.541+0000 7f540aa00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4ba3e540 0x55af4ba40960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.541+0000 7f540aa00640 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4ba3e540 0x55af4ba40960 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1d027524ab39b server_cookie=34452f7c034ce6c2 in_seq=0 out_seq=0 2024-09-11T00:11:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.541+0000 7f53f5600640 10 client.16980 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f53f5600640 1 -- 172.21.15.33:0/555183058 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af4b92c0b0 con 0x55af4ba3e540 2024-09-11T00:11:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f53f5600640 10 client.16980 handle_command_reply: tid=0 2024-09-11T00:11:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 client.16980 shutdown 2024-09-11T00:11:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 msgr2=0x55af4b9cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f53fc014040 tx=0x7f53fc009640 comp rx=0 tx=0).stop 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 shutdown_connections 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55af4ba3e540 0x55af4ba40960 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55af4b9c0b00 0x55af4b9cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af4b9be0c0 0x55af4b9cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 --2- 172.21.15.33:0/555183058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af4b9bb790 0x55af4b9cbc30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f53f5600640 0 client.16980 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 >> 172.21.15.33:0/555183058 conn(0x55af4b9b68e0 msgr2=0x55af4b9b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 shutdown_connections 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 1 -- 172.21.15.33:0/555183058 wait complete. 2024-09-11T00:11:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.560+0000 7f541545f740 20 client.16980 trim_cache size 0 max 16384 2024-09-11T00:11:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:11:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:11:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:11:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 msgr2=0x7f53f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 0x7f53f00b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f53f8000c00 tx=0x7f53f8005a20 comp rx=0 tx=0).stop 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 msgr2=0x7f540c101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5404009fd0 tx=0x7f540400b260 comp rx=0 tx=0).stop 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 shutdown_connections 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53f00b52e0 0x7f53f00b77a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c108670 0x7f540c101a10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f540c105ac0 0x7f540c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 --2- 172.21.15.33:0/2642068684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f540c06bfb0 0x7f540c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 >> 172.21.15.33:0/2642068684 conn(0x7f540c0fd120 msgr2=0x7f540c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 shutdown_connections 2024-09-11T00:11:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:38.561+0000 7f5412400640 1 -- 172.21.15.33:0/2642068684 wait complete. 2024-09-11T00:11:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:38 smithi033 ceph-mon[30593]: pgmap v882: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:11:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:38 smithi189 ceph-mon[34000]: pgmap v882: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:11:38.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:38 smithi052 ceph-mon[33526]: pgmap v882: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-09-11T00:11:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:40 smithi033 ceph-mon[30593]: pgmap v883: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 513 KiB/s wr, 69 op/s 2024-09-11T00:11:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:40 smithi189 ceph-mon[34000]: pgmap v883: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 513 KiB/s wr, 69 op/s 2024-09-11T00:11:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:40 smithi052 ceph-mon[33526]: pgmap v883: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 513 KiB/s wr, 69 op/s 2024-09-11T00:11:41.490 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:11:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:42.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 -- 172.21.15.33:0/388023885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 msgr2=0x7fe1341119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 --2- 172.21.15.33:0/388023885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341119a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009900 tx=0x7fe12c02a400 comp rx=0 tx=0).stop 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 -- 172.21.15.33:0/388023885 shutdown_connections 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 --2- 172.21.15.33:0/388023885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341119a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 --2- 172.21.15.33:0/388023885 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe13410a820 0x7fe13410ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 --2- 172.21.15.33:0/388023885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe134104e10 0x7fe1341051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 -- 172.21.15.33:0/388023885 >> 172.21.15.33:0/388023885 conn(0x7fe134100840 msgr2=0x7fe134102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 -- 172.21.15.33:0/388023885 shutdown_connections 2024-09-11T00:11:42.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.610+0000 7fe133200640 1 -- 172.21.15.33:0/388023885 wait complete. 2024-09-11T00:11:42.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.611+0000 7fe133200640 1 Processor -- start 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 -- start start 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe134104e10 0x7fe13419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 0x7fe13419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe134114d10 con 0x7fe13410b1a0 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe134114b90 con 0x7fe13410a820 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe133200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe134114e90 con 0x7fe134104e10 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe132800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe129400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 0x7fe13419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe132800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51904/0 (socket says 172.21.15.33:51904) 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe129400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 0x7fe13419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34986/0 (socket says 172.21.15.33:34986) 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.612+0000 7fe132800640 1 -- 172.21.15.33:0/2338051993 learned_addr learned my addr 172.21.15.33:0/2338051993 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe131e00640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe134104e10 0x7fe13419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 -- 172.21.15.33:0/2338051993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe134104e10 msgr2=0x7fe13419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe134104e10 0x7fe13419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 -- 172.21.15.33:0/2338051993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 msgr2=0x7fe13419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 0x7fe13419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 -- 172.21.15.33:0/2338051993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1341a11f0 con 0x7fe13410b1a0 2024-09-11T00:11:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.613+0000 7fe132800640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe12c005ab0 tx=0x7fe12c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.614+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c03f030 con 0x7fe13410b1a0 2024-09-11T00:11:42.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.614+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe12c003a80 con 0x7fe13410b1a0 2024-09-11T00:11:42.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.614+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1341a1480 con 0x7fe13410b1a0 2024-09-11T00:11:42.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.614+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c035070 con 0x7fe13410b1a0 2024-09-11T00:11:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.614+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1341a7ba0 con 0x7fe13410b1a0 2024-09-11T00:11:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.615+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1341051f0 con 0x7fe13410b1a0 2024-09-11T00:11:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.617+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe12c0035f0 con 0x7fe13410b1a0 2024-09-11T00:11:42.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.620+0000 7fe12b400640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 0x7fe1180b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:42.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.620+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe12c106ab0 con 0x7fe13410b1a0 2024-09-11T00:11:42.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.620+0000 7fe131e00640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 0x7fe1180b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:42.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.621+0000 7fe131e00640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 0x7fe1180b78d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe12400bbe0 tx=0x7fe12400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:42.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.622+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe12c0ccf20 con 0x7fe13410b1a0 2024-09-11T00:11:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:42 smithi033 ceph-mon[30593]: pgmap v884: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 207 KiB/s wr, 34 op/s 2024-09-11T00:11:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:42 smithi189 ceph-mon[34000]: pgmap v884: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 207 KiB/s wr, 34 op/s 2024-09-11T00:11:42.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.865+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13419c270 con 0x7fe13410b1a0 2024-09-11T00:11:42.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.866+0000 7fe12b400640 1 -- 172.21.15.33:0/2338051993 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fe13419c270 con 0x7fe13410b1a0 2024-09-11T00:11:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:11:42.868 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:11:42.868 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 msgr2=0x7fe1180b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 0x7fe1180b78d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe12400bbe0 tx=0x7fe12400b390 comp rx=0 tx=0).stop 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 msgr2=0x7fe1341a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe12c005ab0 tx=0x7fe12c0040e0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 shutdown_connections 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe1180b5410 0x7fe1180b78d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe13410b1a0 0x7fe1341a0a20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe13410a820 0x7fe13419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 --2- 172.21.15.33:0/2338051993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe134104e10 0x7fe13419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:42.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.868+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 >> 172.21.15.33:0/2338051993 conn(0x7fe134100840 msgr2=0x7fe134102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:42.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.869+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 shutdown_connections 2024-09-11T00:11:42.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:42.869+0000 7fe133200640 1 -- 172.21.15.33:0/2338051993 wait complete. 2024-09-11T00:11:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:42 smithi052 ceph-mon[33526]: pgmap v884: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 207 KiB/s wr, 34 op/s 2024-09-11T00:11:43.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:11:43.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2338051993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:43.817 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id f9fa26a2 --release --await' 2024-09-11T00:11:43.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id f9fa26a2 --release --await 2024-09-11T00:11:43.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2338051993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:43.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:43 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2338051993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:11:44.204 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:44.598 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:44 smithi033 ceph-mon[30593]: pgmap v885: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 218 KiB/s wr, 38 op/s 2024-09-11T00:11:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:44 smithi189 ceph-mon[34000]: pgmap v885: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 218 KiB/s wr, 38 op/s 2024-09-11T00:11:44.857 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:44 smithi052 ceph-mon[33526]: pgmap v885: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 218 KiB/s wr, 38 op/s 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 -- 172.21.15.33:0/3305015113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c0104df0 msgr2=0x7fa8c01051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 --2- 172.21.15.33:0/3305015113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c0104df0 0x7fa8c01051d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009900 tx=0x7fa8b002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 -- 172.21.15.33:0/3305015113 shutdown_connections 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 --2- 172.21.15.33:0/3305015113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010b180 0x7fa8c0111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 --2- 172.21.15.33:0/3305015113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c010a800 0x7fa8c010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 --2- 172.21.15.33:0/3305015113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c0104df0 0x7fa8c01051d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 -- 172.21.15.33:0/3305015113 >> 172.21.15.33:0/3305015113 conn(0x7fa8c0100840 msgr2=0x7fa8c0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 -- 172.21.15.33:0/3305015113 shutdown_connections 2024-09-11T00:11:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.858+0000 7fa8c5800640 1 -- 172.21.15.33:0/3305015113 wait complete. 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 Processor -- start 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 -- start start 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c0104df0 0x7fa8c019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010a800 0x7fa8c019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0114cf0 con 0x7fa8c010b180 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0114b70 con 0x7fa8c0104df0 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.859+0000 7fa8c5800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0114e70 con 0x7fa8c010a800 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51924/0 (socket says 172.21.15.33:51924) 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 -- 172.21.15.33:0/489914024 learned_addr learned my addr 172.21.15.33:0/489914024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8b7400640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010a800 0x7fa8c019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c0104df0 0x7fa8c019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 -- 172.21.15.33:0/489914024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010a800 msgr2=0x7fa8c019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010a800 0x7fa8c019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 -- 172.21.15.33:0/489914024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c0104df0 msgr2=0x7fa8c019b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c0104df0 0x7fa8c019b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 -- 172.21.15.33:0/489914024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c01a11b0 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.860+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800eaa0 tx=0x7fa8b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.861+0000 7fa8bd600640 1 -- 172.21.15.33:0/489914024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800cdb0 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.861+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c01a14a0 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.861+0000 7fa8bd600640 1 -- 172.21.15.33:0/489914024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b8005020 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.861+0000 7fa8bd600640 1 -- 172.21.15.33:0/489914024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80116d0 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.861+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c01a7d30 con 0x7fa8c010b180 2024-09-11T00:11:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.864+0000 7fa8c9a0c740 1 Processor -- start 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.864+0000 7fa8bd600640 1 -- 172.21.15.33:0/489914024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa8b800f040 con 0x7fa8c010b180 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.864+0000 7fa8c9a0c740 1 -- start start 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5562bf219290 con 0x5562bf2aea80 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5562bf2086c0 con 0x5562bf2a2af0 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5562bf20c4d0 con 0x5562bf2a21d0 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:35002/0 (socket says 172.21.15.33:35002) 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8bfe00640 1 -- 172.21.15.33:0/2723966267 learned_addr learned my addr 172.21.15.33:0/2723966267 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51938/0 (socket says 172.21.15.33:51938) 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.865+0000 7fa8b7400640 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 -- 172.21.15.33:0/2723966267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 msgr2=0x5562bf2a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 -- 172.21.15.33:0/2723966267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 msgr2=0x5562bf2b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 -- 172.21.15.33:0/2723966267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bf195460 con 0x5562bf2a2af0 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8b7400640 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa8b002a910 tx=0x7fa8b0032b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc4267d6e66b132 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bd600640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 0x7fa8a40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8bd600640 1 -- 172.21.15.33:0/489914024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa8b80e5d90 con 0x7fa8c010b180 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8b5600640 1 -- 172.21.15.33:0/2723966267 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b003f070 con 0x5562bf2a2af0 2024-09-11T00:11:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8b7400640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 0x7fa8a40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8b5600640 1 -- 172.21.15.33:0/2723966267 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b0004030 con 0x5562bf2a2af0 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.866+0000 7fa8b5600640 1 -- 172.21.15.33:0/2723966267 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0035070 con 0x5562bf2a2af0 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/2723966267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 msgr2=0x5562bf2ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa8b002a910 tx=0x7fa8b0032b00 comp rx=0 tx=0).stop 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8b7400640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 0x7fa8a40b78d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5562bf2a2180 tx=0x7fa8a80096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/2723966267 shutdown_connections 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ae540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/2723966267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.867+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/2723966267 >> 172.21.15.33:0/2723966267 conn(0x5562bf2a0000 msgr2=0x5562bf2a11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.868+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/2723966267 shutdown_connections 2024-09-11T00:11:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.868+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/2723966267 wait complete. 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.868+0000 7fa8c9a0c740 1 -- start start 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.868+0000 7fa8c9a0c740 1 Processor -- start 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5562bf069bb0 con 0x5562bf2aea80 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5562bf1a36c0 con 0x5562bf2a2af0 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5562bf2b16d0 con 0x5562bf2a21d0 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c9a0c740 10 client.0 _ll_register_callbacks cb 0x5562bf1be490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51952/0 (socket says 172.21.15.33:51952) 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1172218905 learned_addr learned my addr 172.21.15.33:0/1172218905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:44.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8b7400640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.869+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1172218905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 msgr2=0x5562bf2aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 msgr2=0x5562bf2abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1172218905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bef66b00 con 0x5562bf2aea80 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ac0e0 tx=0x7fa8b80ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e95e0cac96f1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8ae000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b801f040 con 0x5562bf2aea80 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa8b8097490 con 0x5562bf2aea80 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8b0004030 con 0x5562bf2aea80 2024-09-11T00:11:44.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa8b80ac150 con 0x5562bf2aea80 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c9a0c740 10 client.16998 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.870+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5562befdd960 con 0x5562bf2aea80 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b0004030 con 0x5562bf2aea80 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa8b80ab3b0 con 0x5562bf2aea80 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 10 client.16998 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 10 client.16998 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 20 client.16998 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf2be610 0x5562bf2c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 4 client.16998 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562bf21b1e0 con 0x5562bf2be610 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.871+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf2be610 0x5562bf2c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.872+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf2be610 0x5562bf2c0a20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=852cb301de87d714 server_cookie=c467220c0c3f556b in_seq=0 out_seq=0 2024-09-11T00:11:44.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.872+0000 7fa8ae000640 10 client.16998 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8ae000640 1 -- 172.21.15.33:0/1172218905 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562bf21b1e0 con 0x5562bf2be610 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8ae000640 10 client.16998 handle_command_reply: tid=0 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 client.16998 shutdown 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 msgr2=0x5562bf2ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ac0e0 tx=0x7fa8b80ab980 comp rx=0 tx=0).stop 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 shutdown_connections 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2ac4b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf2be610 0x5562bf2c0a20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1172218905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 >> 172.21.15.33:0/1172218905 conn(0x5562bf2a0000 msgr2=0x5562bf2a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8ae000640 0 client.16998 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 shutdown_connections 2024-09-11T00:11:44.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.873+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1172218905 wait complete. 2024-09-11T00:11:44.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.874+0000 7fa8c9a0c740 20 client.16998 trim_cache size 0 max 16384 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 Processor -- start 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 -- start start 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01b41b0 con 0x5562bf2aea80 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01b1a80 con 0x5562bf2a2af0 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.892+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01af8d0 con 0x5562bf2a21d0 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51954/0 (socket says 172.21.15.33:51954) 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1754836753 learned_addr learned my addr 172.21.15.33:0/1754836753 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8b7400640 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1754836753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 msgr2=0x5562bf2a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1754836753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 msgr2=0x5562bf2ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 -- 172.21.15.33:0/1754836753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bf29fe30 con 0x5562bf2aea80 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.893+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ac310 tx=0x7fa8b80ab9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c9461d1912e481 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8b4c00640 1 -- 172.21.15.33:0/1754836753 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b801f070 con 0x5562bf2aea80 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8b4c00640 1 -- 172.21.15.33:0/1754836753 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b80b56e0 con 0x5562bf2aea80 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8b4c00640 1 -- 172.21.15.33:0/1754836753 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8097330 con 0x5562bf2aea80 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1754836753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 msgr2=0x5562bf2a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ac310 tx=0x7fa8b80ab9f0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1754836753 shutdown_connections 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2aea80 0x5562bf2a8c40 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2a2af0 0x5562bf2ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1754836753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a21d0 0x5562bf2a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.894+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1754836753 >> 172.21.15.33:0/1754836753 conn(0x5562bf2a0000 msgr2=0x5562bf2ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.895+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1754836753 shutdown_connections 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.895+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1754836753 wait complete. 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.895+0000 7fa8c9a0c740 1 -- start start 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.895+0000 7fa8c9a0c740 1 Processor -- start 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a2af0 0x5562bf2b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2aea80 0x5562bf2b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01aff40 con 0x5562bf2a21d0 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01b13b0 con 0x5562bf2aea80 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01b0610 con 0x5562bf2a2af0 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c9a0c740 10 client.0 _ll_register_callbacks cb 0x7fa8b8005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:44.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8bfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51962/0 (socket says 172.21.15.33:51962) 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8bfe00640 1 -- 172.21.15.33:0/1227880536 learned_addr learned my addr 172.21.15.33:0/1227880536 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8b7400640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a2af0 0x5562bf2b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.896+0000 7fa8c4e00640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2aea80 0x5562bf2b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 -- 172.21.15.33:0/1227880536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a2af0 msgr2=0x5562bf2b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a2af0 0x5562bf2b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 -- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2aea80 msgr2=0x5562bf2b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2aea80 0x5562bf2b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 -- 172.21.15.33:0/1227880536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bf2b3d20 con 0x5562bf2a21d0 2024-09-11T00:11:44.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8bfe00640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00096c0 tx=0x7fa8b0004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d2f73d71836761 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8ae000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b003f040 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa8b0031810 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.897+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8b80b56e0 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa8b0061050 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 10 client.17004 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5562bf32c2e0 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8b80b56e0 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa8b005c030 con 0x5562bf2a21d0 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 10 client.17004 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 10 client.17004 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 20 client.17004 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:44.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf32c6e0 0x5562bf32ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:44.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 4 client.17004 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f9fa26a2", "release": true, "await": true}] 2024-09-11T00:11:44.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.898+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f9fa26a2", "release": true, "await": true}) -- 0x5562bf216c90 con 0x5562bf32c6e0 2024-09-11T00:11:44.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.899+0000 7fa8b7400640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf32c6e0 0x5562bf32ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:44.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.899+0000 7fa8b7400640 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf32c6e0 0x5562bf32ead0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7104709770e7ce77 server_cookie=d4dd7a9a5dc5eaff in_seq=0 out_seq=0 2024-09-11T00:11:44.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.899+0000 7fa8ae000640 10 client.17004 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.970+0000 7fa8ae000640 1 -- 172.21.15.33:0/1227880536 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5562bf216c90 con 0x5562bf32c6e0 2024-09-11T00:11:44.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.970+0000 7fa8ae000640 10 client.17004 handle_command_reply: tid=0 2024-09-11T00:11:44.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.970+0000 7fa8c9a0c740 1 client.17004 shutdown 2024-09-11T00:11:44.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 msgr2=0x5562bf2b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00096c0 tx=0x7fa8b0004400 comp rx=0 tx=0).stop 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 shutdown_connections 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562bf2aea80 0x5562bf2b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5562bf32c6e0 0x5562bf32ead0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5562bf2a2af0 0x5562bf2b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8ae000640 0 client.17004 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 --2- 172.21.15.33:0/1227880536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bf2a21d0 0x5562bf2b6df0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.971+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 >> 172.21.15.33:0/1227880536 conn(0x5562bf2a0000 msgr2=0x5562bf2ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.972+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 shutdown_connections 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.972+0000 7fa8c9a0c740 1 -- 172.21.15.33:0/1227880536 wait complete. 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.972+0000 7fa8c9a0c740 20 client.17004 trim_cache size 0 max 16384 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 48, 2024-09-11T00:11:44.974 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "f9fa26a2": { 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 48, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 142.8, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:11:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:11:44.976 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 msgr2=0x7fa8a40b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 0x7fa8a40b78d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x5562bf2a2180 tx=0x7fa8a80096c0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 msgr2=0x7fa8c01a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800eaa0 tx=0x7fa8b800ef60 comp rx=0 tx=0).stop 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 shutdown_connections 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa8a40b5410 0x7fa8a40b78d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8c010b180 0x7fa8c01a09e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8c010a800 0x7fa8c019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 --2- 172.21.15.33:0/489914024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c0104df0 0x7fa8c019b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 >> 172.21.15.33:0/489914024 conn(0x7fa8c0100840 msgr2=0x7fa8c01020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.973+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 shutdown_connections 2024-09-11T00:11:44.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:11:44.974+0000 7fa8c5800640 1 -- 172.21.15.33:0/489914024 wait complete. 2024-09-11T00:11:46.316 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f9fa26a2', total seconds elapsed: 27.6 2024-09-11T00:11:46.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:46 smithi033 ceph-mon[30593]: pgmap v886: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:46 smithi189 ceph-mon[34000]: pgmap v886: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:46.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:46 smithi052 ceph-mon[33526]: pgmap v886: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-11T00:11:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 720.0 s, 424.2 tps, lat 1074.904 ms stddev 4117.069 2024-09-11T00:11:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:48 smithi189 ceph-mon[34000]: pgmap v887: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 584 KiB/s wr, 69 op/s 2024-09-11T00:11:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:48 smithi052 ceph-mon[33526]: pgmap v887: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 584 KiB/s wr, 69 op/s 2024-09-11T00:11:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:48 smithi033 ceph-mon[30593]: pgmap v887: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 584 KiB/s wr, 69 op/s 2024-09-11T00:11:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:50 smithi189 ceph-mon[34000]: pgmap v888: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 744 KiB/s wr, 85 op/s 2024-09-11T00:11:50.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:50 smithi052 ceph-mon[33526]: pgmap v888: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 744 KiB/s wr, 85 op/s 2024-09-11T00:11:51.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:50 smithi033 ceph-mon[30593]: pgmap v888: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 744 KiB/s wr, 85 op/s 2024-09-11T00:11:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 -- 172.21.15.33:0/1016442027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c103960 msgr2=0x7faa2c105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 --2- 172.21.15.33:0/1016442027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c103960 0x7faa2c105df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7faa14009860 tx=0x7faa1402a340 comp rx=0 tx=0).stop 2024-09-11T00:11:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 -- 172.21.15.33:0/1016442027 shutdown_connections 2024-09-11T00:11:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 --2- 172.21.15.33:0/1016442027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c106490 0x7faa2c106920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 --2- 172.21.15.33:0/1016442027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c103960 0x7faa2c105df0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 --2- 172.21.15.33:0/1016442027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c06b380 0x7faa2c103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.305+0000 7faa32200640 1 -- 172.21.15.33:0/1016442027 >> 172.21.15.33:0/1016442027 conn(0x7faa2c0fd140 msgr2=0x7faa2c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.306+0000 7faa32200640 1 -- 172.21.15.33:0/1016442027 shutdown_connections 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.306+0000 7faa32200640 1 -- 172.21.15.33:0/1016442027 wait complete. 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.307+0000 7faa32200640 1 Processor -- start 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.307+0000 7faa32200640 1 -- start start 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c06b380 0x7faa2c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 0x7faa2c1a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c114aa0 con 0x7faa2c106490 2024-09-11T00:11:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c114920 con 0x7faa2c06b380 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa32200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c114c20 con 0x7faa2c103960 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:55128/0 (socket says 172.21.15.33:55128) 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa2aa00640 1 -- 172.21.15.33:0/3801638195 learned_addr learned my addr 172.21.15.33:0/3801638195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.308+0000 7faa2b400640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c06b380 0x7faa2c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 -- 172.21.15.33:0/3801638195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c06b380 msgr2=0x7faa2c19f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c06b380 0x7faa2c19f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 -- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 msgr2=0x7faa2c1a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2be00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 0x7faa2c1a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 0x7faa2c1a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 -- 172.21.15.33:0/3801638195 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c1a0db0 con 0x7faa2c103960 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2be00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 0x7faa2c1a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.309+0000 7faa2aa00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa1402a860 tx=0x7faa1402ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.310+0000 7faa23e00640 1 -- 172.21.15.33:0/3801638195 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14037040 con 0x7faa2c103960 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.310+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c1a1040 con 0x7faa2c103960 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.310+0000 7faa23e00640 1 -- 172.21.15.33:0/3801638195 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa14041070 con 0x7faa2c103960 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.310+0000 7faa23e00640 1 -- 172.21.15.33:0/3801638195 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140052b0 con 0x7faa2c103960 2024-09-11T00:11:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.310+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c1a7770 con 0x7faa2c103960 2024-09-11T00:11:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.317+0000 7faa34fe1740 1 Processor -- start 2024-09-11T00:11:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.320+0000 7faa23e00640 1 -- 172.21.15.33:0/3801638195 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7faa14030ab0 con 0x7faa2c103960 2024-09-11T00:11:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.320+0000 7faa34fe1740 1 -- start start 2024-09-11T00:11:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.322+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.322+0000 7faa23e00640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 0x7faa100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.322+0000 7faa23e00640 1 -- 172.21.15.33:0/3801638195 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7faa14105ed0 con 0x7faa2c103960 2024-09-11T00:11:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.322+0000 7faa2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.322+0000 7faa2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54418/0 (socket says 172.21.15.33:54418) 2024-09-11T00:11:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa2be00640 1 -- 172.21.15.33:0/1336257827 learned_addr learned my addr 172.21.15.33:0/1336257827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d27fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563fd1c936b0 con 0x563fd1d230c0 2024-09-11T00:11:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563fd1c82ae0 con 0x563fd1d20790 2024-09-11T00:11:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fd1c868f0 con 0x563fd1d25b00 2024-09-11T00:11:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.323+0000 7faa2aa00640 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 -- 172.21.15.33:0/1336257827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 msgr2=0x563fd1d27fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d27fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 -- 172.21.15.33:0/1336257827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 msgr2=0x563fd1d254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d254b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 -- 172.21.15.33:0/1336257827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd1c4f780 con 0x563fd1d20790 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.324+0000 7faa2be00640 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa2400f480 tx=0x7faa2400f940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1619b08988c3bc91 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.325+0000 7faa1be00640 1 -- 172.21.15.33:0/1336257827 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24003b70 con 0x563fd1d20790 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.325+0000 7faa1be00640 1 -- 172.21.15.33:0/1336257827 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa24003d10 con 0x563fd1d20790 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.325+0000 7faa1be00640 1 -- 172.21.15.33:0/1336257827 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24011920 con 0x563fd1d20790 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.326+0000 7faa2b400640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 0x7faa100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.326+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 msgr2=0x563fd1d22b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.326+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa2400f480 tx=0x7faa2400f940 comp rx=0 tx=0).stop 2024-09-11T00:11:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.327+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 shutdown_connections 2024-09-11T00:11:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.327+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d27fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.327+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d254b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.327+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1336257827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d22b80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.328+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 >> 172.21.15.33:0/1336257827 conn(0x563fd1d1b8e0 msgr2=0x563fd1d1c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.328+0000 7faa2b400640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 0x7faa100b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005fd0 tx=0x7faa1c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.329+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 shutdown_connections 2024-09-11T00:11:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.329+0000 7faa34fe1740 1 -- 172.21.15.33:0/1336257827 wait complete. 2024-09-11T00:11:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.330+0000 7faa34fe1740 1 -- start start 2024-09-11T00:11:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.330+0000 7faa34fe1740 1 Processor -- start 2024-09-11T00:11:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.331+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d29f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.331+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d230c0 0x563fd1d2a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.331+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa34fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563fd1bbaab0 con 0x563fd1d25b00 2024-09-11T00:11:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa34fe1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563fd1c29570 con 0x563fd1d20790 2024-09-11T00:11:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa34fe1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fd1d28ae0 con 0x563fd1d230c0 2024-09-11T00:11:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa34fe1740 10 client.0 _ll_register_callbacks cb 0x563fd1c38100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa2b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d29f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa2be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d230c0 0x563fd1d2a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa2be00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45834/0 (socket says 172.21.15.33:45834) 2024-09-11T00:11:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.332+0000 7faa2be00640 1 -- 172.21.15.33:0/2363818438 learned_addr learned my addr 172.21.15.33:0/2363818438 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2b400640 1 -- 172.21.15.33:0/2363818438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d230c0 msgr2=0x563fd1d2a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2b400640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d230c0 0x563fd1d2a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2b400640 1 -- 172.21.15.33:0/2363818438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 msgr2=0x563fd1d2b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2b400640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2b400640 1 -- 172.21.15.33:0/2363818438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd19e4790 con 0x563fd1d20790 2024-09-11T00:11:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.334+0000 7faa2be00640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:11:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.335+0000 7faa2b400640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d29f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faa1c011870 tx=0x7faa1c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff0774f28903bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.336+0000 7faa18c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:11:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.336+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c012e60 con 0x563fd1d20790 2024-09-11T00:11:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.336+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7faa1c00fce0 con 0x563fd1d20790 2024-09-11T00:11:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.336+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa24003d10 con 0x563fd1d20790 2024-09-11T00:11:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.337+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa1c030050 con 0x563fd1d20790 2024-09-11T00:11:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.337+0000 7faa34fe1740 10 client.36887 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.337+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fd1a5d620 con 0x563fd1d20790 2024-09-11T00:11:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.338+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa24003d10 con 0x563fd1d20790 2024-09-11T00:11:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.338+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7faa1c027400 con 0x563fd1d20790 2024-09-11T00:11:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 10 client.36887 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 10 client.36887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 20 client.36887 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1d35870 0x563fd1d37c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 4 client.36887 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:11:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.339+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fd1c95600 con 0x563fd1d35870 2024-09-11T00:11:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.340+0000 7faa2aa00640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1d35870 0x563fd1d37c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.340+0000 7faa2aa00640 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1d35870 0x563fd1d37c60 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c599e4b05e85860d server_cookie=d6fc2b3d2f08654a in_seq=0 out_seq=0 2024-09-11T00:11:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.340+0000 7faa18c00640 10 client.36887 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa18c00640 1 -- 172.21.15.33:0/2363818438 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fd1c95600 con 0x563fd1d35870 2024-09-11T00:11:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa18c00640 10 client.36887 handle_command_reply: tid=0 2024-09-11T00:11:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa34fe1740 1 client.36887 shutdown 2024-09-11T00:11:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 msgr2=0x563fd1d29f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d29f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faa1c011870 tx=0x7faa1c004730 comp rx=0 tx=0).stop 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.342+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 shutdown_connections 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d25b00 0x563fd1d2b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1d35870 0x563fd1d37c60 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d230c0 0x563fd1d2a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 --2- 172.21.15.33:0/2363818438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d20790 0x563fd1d29f80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 >> 172.21.15.33:0/2363818438 conn(0x563fd1d1b8e0 msgr2=0x563fd1d1aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa18c00640 0 client.36887 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 shutdown_connections 2024-09-11T00:11:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 1 -- 172.21.15.33:0/2363818438 wait complete. 2024-09-11T00:11:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.343+0000 7faa34fe1740 20 client.36887 trim_cache size 0 max 16384 2024-09-11T00:11:52.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.373+0000 7faa34fe1740 1 Processor -- start 2024-09-11T00:11:52.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.374+0000 7faa34fe1740 1 -- start start 2024-09-11T00:11:52.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.374+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 0x563fd1d28e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.374+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.375+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d25ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.375+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.375+0000 7faa34fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1b4490 con 0x563fd1d20790 2024-09-11T00:11:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.375+0000 7faa34fe1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1b1d60 con 0x563fd1d230c0 2024-09-11T00:11:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.375+0000 7faa34fe1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1afbb0 con 0x563fd1d25b00 2024-09-11T00:11:52.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.376+0000 7faa2b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 0x563fd1d28e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.376+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:54424/0 (socket says 172.21.15.33:54424) 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.376+0000 7faa2aa00640 1 -- 172.21.15.33:0/4127288009 learned_addr learned my addr 172.21.15.33:0/4127288009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.376+0000 7faa2b400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 0x563fd1d28e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45842/0 (socket says 172.21.15.33:45842) 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.376+0000 7faa2be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d25ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.377+0000 7faa2aa00640 1 -- 172.21.15.33:0/4127288009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 msgr2=0x563fd1d25ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.377+0000 7faa2aa00640 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d25ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.377+0000 7faa2aa00640 1 -- 172.21.15.33:0/4127288009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 msgr2=0x563fd1d28e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.377+0000 7faa2aa00640 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 0x563fd1d28e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.377+0000 7faa2aa00640 1 -- 172.21.15.33:0/4127288009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd1d25820 con 0x563fd1d230c0 2024-09-11T00:11:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.378+0000 7faa2aa00640 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faa14005e00 tx=0x7faa140d1f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c942fdc176c253 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.378+0000 7faa1b400640 1 -- 172.21.15.33:0/4127288009 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140cba90 con 0x563fd1d230c0 2024-09-11T00:11:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.379+0000 7faa1b400640 1 -- 172.21.15.33:0/4127288009 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa140328d0 con 0x563fd1d230c0 2024-09-11T00:11:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.379+0000 7faa1b400640 1 -- 172.21.15.33:0/4127288009 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140cc320 con 0x563fd1d230c0 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.379+0000 7faa34fe1740 1 -- 172.21.15.33:0/4127288009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 msgr2=0x563fd1d293c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.379+0000 7faa34fe1740 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faa14005e00 tx=0x7faa140d1f90 comp rx=0 tx=0).stop 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.380+0000 7faa34fe1740 1 -- 172.21.15.33:0/4127288009 shutdown_connections 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.380+0000 7faa34fe1740 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d25b00 0x563fd1d25ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.380+0000 7faa34fe1740 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d230c0 0x563fd1d293c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.380+0000 7faa34fe1740 1 --2- 172.21.15.33:0/4127288009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d20790 0x563fd1d28e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.380+0000 7faa34fe1740 1 -- 172.21.15.33:0/4127288009 >> 172.21.15.33:0/4127288009 conn(0x563fd1d1b8e0 msgr2=0x563fd1d1c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.381+0000 7faa34fe1740 1 -- 172.21.15.33:0/4127288009 shutdown_connections 2024-09-11T00:11:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.381+0000 7faa34fe1740 1 -- 172.21.15.33:0/4127288009 wait complete. 2024-09-11T00:11:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.381+0000 7faa34fe1740 1 -- start start 2024-09-11T00:11:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.381+0000 7faa34fe1740 1 Processor -- start 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.382+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 0x563fd1d30b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.382+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d31070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.382+0000 7faa34fe1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d25b00 0x563fd1d315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa34fe1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1b0220 con 0x563fd1d230c0 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa34fe1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1b1690 con 0x563fd1d25b00 2024-09-11T00:11:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa34fe1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c1b08f0 con 0x563fd1d20790 2024-09-11T00:11:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa34fe1740 10 client.0 _ll_register_callbacks cb 0x7faa1c009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:11:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d31070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa2aa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d31070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45848/0 (socket says 172.21.15.33:45848) 2024-09-11T00:11:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa2aa00640 1 -- 172.21.15.33:0/1219327600 learned_addr learned my addr 172.21.15.33:0/1219327600 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:11:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d25b00 0x563fd1d315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.383+0000 7faa2b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 0x563fd1d30b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.384+0000 7faa2b400640 1 -- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d25b00 msgr2=0x563fd1d315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.384+0000 7faa2b400640 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d25b00 0x563fd1d315b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.384+0000 7faa2b400640 1 -- 172.21.15.33:0/1219327600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 msgr2=0x563fd1d31070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.384+0000 7faa2b400640 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d31070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.384+0000 7faa2b400640 1 -- 172.21.15.33:0/1219327600 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd1d2f780 con 0x563fd1d20790 2024-09-11T00:11:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.385+0000 7faa2b400640 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 0x563fd1d30b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00a010 tx=0x7faa1c0276b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb7c1fca9634dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.385+0000 7faa18c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:11:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c02d040 con 0x563fd1d20790 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7faa1c00fae0 con 0x563fd1d20790 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa140328d0 con 0x563fd1d20790 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa1c012e60 con 0x563fd1d20790 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa34fe1740 10 client.26863 fetch_fsmap learned FSMap version 30 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563fd1da2bc0 con 0x563fd1d20790 2024-09-11T00:11:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.386+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa140328d0 con 0x563fd1d20790 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7faa1c01f9d0 con 0x563fd1d20790 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 10 client.26863 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 10 client.26863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 20 client.26863 populate_metadata read hostname 'smithi033' 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1da3550 0x563fd1da5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 4 client.26863 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:11:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fd1c910b0 con 0x563fd1da3550 2024-09-11T00:11:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.387+0000 7faa2aa00640 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1da3550 0x563fd1da5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.388+0000 7faa2aa00640 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1da3550 0x563fd1da5970 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5fb906b15a1ebe9 server_cookie=e7cc789fa2d83c82 in_seq=0 out_seq=0 2024-09-11T00:11:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.388+0000 7faa18c00640 10 client.26863 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.446+0000 7faa18c00640 1 -- 172.21.15.33:0/1219327600 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fd1c910b0 con 0x563fd1da3550 2024-09-11T00:11:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.446+0000 7faa18c00640 10 client.26863 handle_command_reply: tid=0 2024-09-11T00:11:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.446+0000 7faa34fe1740 1 client.26863 shutdown 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.446+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 msgr2=0x563fd1d30b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.446+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 0x563fd1d30b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00a010 tx=0x7faa1c0276b0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 shutdown_connections 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fd1d25b00 0x563fd1d315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd1d230c0 0x563fd1d31070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x563fd1da3550 0x563fd1da5970 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 --2- 172.21.15.33:0/1219327600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fd1d20790 0x563fd1d30b30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 >> 172.21.15.33:0/1219327600 conn(0x563fd1d1b8e0 msgr2=0x563fd1d1c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa18c00640 0 client.26863 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 shutdown_connections 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 1 -- 172.21.15.33:0/1219327600 wait complete. 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.447+0000 7faa34fe1740 20 client.26863 trim_cache size 0 max 16384 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:11:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:11:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.448+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 msgr2=0x7faa100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.448+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 0x7faa100b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005fd0 tx=0x7faa1c009260 comp rx=0 tx=0).stop 2024-09-11T00:11:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.448+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 msgr2=0x7faa2c19f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.448+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa1402a860 tx=0x7faa1402ad70 comp rx=0 tx=0).stop 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 shutdown_connections 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7faa100b5360 0x7faa100b7820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2c106490 0x7faa2c1a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faa2c103960 0x7faa2c19f8c0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa1402a860 tx=0x7faa1402ad70 comp rx=0 tx=0).stop 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 --2- 172.21.15.33:0/3801638195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa2c06b380 0x7faa2c19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 >> 172.21.15.33:0/3801638195 conn(0x7faa2c0fd140 msgr2=0x7faa2c101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 shutdown_connections 2024-09-11T00:11:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:11:52.449+0000 7faa32200640 1 -- 172.21.15.33:0/3801638195 wait complete. 2024-09-11T00:11:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:52 smithi189 ceph-mon[34000]: pgmap v889: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.4 MiB/s wr, 164 op/s 2024-09-11T00:11:52.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:52 smithi052 ceph-mon[33526]: pgmap v889: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.4 MiB/s wr, 164 op/s 2024-09-11T00:11:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:52 smithi033 ceph-mon[30593]: pgmap v889: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.4 MiB/s wr, 164 op/s 2024-09-11T00:11:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 725.0 s, 600.6 tps, lat 166.539 ms stddev 53.867 2024-09-11T00:11:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:54 smithi189 ceph-mon[34000]: pgmap v890: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2024-09-11T00:11:54.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:54 smithi052 ceph-mon[33526]: pgmap v890: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2024-09-11T00:11:55.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:54 smithi033 ceph-mon[30593]: pgmap v890: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 296 op/s 2024-09-11T00:11:56.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:56 smithi033 ceph-mon[30593]: pgmap v891: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 294 op/s 2024-09-11T00:11:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:56 smithi189 ceph-mon[34000]: pgmap v891: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 294 op/s 2024-09-11T00:11:56.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:56 smithi052 ceph-mon[33526]: pgmap v891: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 294 op/s 2024-09-11T00:11:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 730.0 s, 598.8 tps, lat 164.722 ms stddev 53.438 2024-09-11T00:11:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:11:58 smithi189 ceph-mon[34000]: pgmap v892: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-11T00:11:58.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:11:58 smithi052 ceph-mon[33526]: pgmap v892: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-11T00:11:59.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:11:58 smithi033 ceph-mon[30593]: pgmap v892: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-11T00:12:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:00 smithi189 ceph-mon[34000]: pgmap v893: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-11T00:12:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:00 smithi052 ceph-mon[33526]: pgmap v893: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-11T00:12:01.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:00 smithi033 ceph-mon[30593]: pgmap v893: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.6 MiB/s wr, 508 op/s 2024-09-11T00:12:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:02 smithi189 ceph-mon[34000]: pgmap v894: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-11T00:12:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:02 smithi052 ceph-mon[33526]: pgmap v894: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-11T00:12:03.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:02 smithi033 ceph-mon[30593]: pgmap v894: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-09-11T00:12:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 735.0 s, 644.4 tps, lat 157.144 ms stddev 68.406 2024-09-11T00:12:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:04 smithi189 ceph-mon[34000]: pgmap v895: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 649 op/s 2024-09-11T00:12:04.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:04 smithi052 ceph-mon[33526]: pgmap v895: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 649 op/s 2024-09-11T00:12:05.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:04 smithi033 ceph-mon[30593]: pgmap v895: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 649 op/s 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.731+0000 7f67a7e00640 1 -- 172.21.15.33:0/3244069459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810bb20 msgr2=0x7f67a8113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.731+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3244069459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810bb20 0x7f67a8113420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009cd0 tx=0x7f67a002a910 comp rx=0 tx=0).stop 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 -- 172.21.15.33:0/3244069459 shutdown_connections 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3244069459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810bb20 0x7f67a8113420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3244069459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a810b160 0x7f67a810b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3244069459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 0x7f67a810c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 -- 172.21.15.33:0/3244069459 >> 172.21.15.33:0/3244069459 conn(0x7f67a8071aa0 msgr2=0x7f67a8073ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 -- 172.21.15.33:0/3244069459 shutdown_connections 2024-09-11T00:12:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.732+0000 7f67a7e00640 1 -- 172.21.15.33:0/3244069459 wait complete. 2024-09-11T00:12:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.733+0000 7f67a7e00640 1 Processor -- start 2024-09-11T00:12:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.733+0000 7f67a7e00640 1 -- start start 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.733+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a810bb20 0x7f67a819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 0x7f67a81a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81148b0 con 0x7f67a810bb20 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8114730 con 0x7f67a810c420 2024-09-11T00:12:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8114a30 con 0x7f67a810b160 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33830/0 (socket says 172.21.15.33:33830) 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a6a00640 1 -- 172.21.15.33:0/3128201423 learned_addr learned my addr 172.21.15.33:0/3128201423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.734+0000 7f67a7400640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 0x7f67a81a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 -- 172.21.15.33:0/3128201423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 msgr2=0x7f67a81a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 0x7f67a81a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 -- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a810bb20 msgr2=0x7f67a819f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a810bb20 0x7f67a819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 -- 172.21.15.33:0/3128201423 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81a0c80 con 0x7f67a810b160 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.735+0000 7f67a6a00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f679400e9f0 tx=0x7f679400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.736+0000 7f679f400640 1 -- 172.21.15.33:0/3128201423 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679400cd80 con 0x7f67a810b160 2024-09-11T00:12:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.736+0000 7f679f400640 1 -- 172.21.15.33:0/3128201423 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67940108c0 con 0x7f67a810b160 2024-09-11T00:12:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.736+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a81a0f70 con 0x7f67a810b160 2024-09-11T00:12:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.737+0000 7f679f400640 1 -- 172.21.15.33:0/3128201423 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794017880 con 0x7f67a810b160 2024-09-11T00:12:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.737+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81a7640 con 0x7f67a810b160 2024-09-11T00:12:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.743+0000 7f679f400640 1 -- 172.21.15.33:0/3128201423 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6794017a20 con 0x7f67a810b160 2024-09-11T00:12:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.745+0000 7f67b0a95740 1 Processor -- start 2024-09-11T00:12:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.746+0000 7f679f400640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 0x7f678c0bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.746+0000 7f679f400640 1 -- 172.21.15.33:0/3128201423 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f67940e6750 con 0x7f67a810b160 2024-09-11T00:12:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.746+0000 7f67a7400640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 0x7f678c0bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 -- start start 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf4f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4fce0 0x56471bf521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56471bebd6b0 con 0x56471bf4d2a0 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56471beacae0 con 0x56471bf4a970 2024-09-11T00:12:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.747+0000 7f67b0a95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56471beb08f0 con 0x56471bf4fce0 2024-09-11T00:12:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.748+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.748+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40952/0 (socket says 172.21.15.33:40952) 2024-09-11T00:12:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.748+0000 7f67a6a00640 1 -- 172.21.15.33:0/528452672 learned_addr learned my addr 172.21.15.33:0/528452672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.749+0000 7f67a6a00640 1 -- 172.21.15.33:0/528452672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4fce0 msgr2=0x56471bf521a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.749+0000 7f67a6a00640 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4fce0 0x56471bf521a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.749+0000 7f67a6a00640 1 -- 172.21.15.33:0/528452672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 msgr2=0x56471bf4f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.749+0000 7f67a6a00640 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf4f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.749+0000 7f67a6a00640 1 -- 172.21.15.33:0/528452672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471be79780 con 0x56471bf4a970 2024-09-11T00:12:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.750+0000 7f67a6a00640 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f67940e3d90 tx=0x7f67940ac720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a590e63b81b5b6b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.751+0000 7f6793e00640 1 -- 172.21.15.33:0/528452672 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940cfe60 con 0x56471bf4a970 2024-09-11T00:12:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.751+0000 7f6793e00640 1 -- 172.21.15.33:0/528452672 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67940acac0 con 0x56471bf4a970 2024-09-11T00:12:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.751+0000 7f6793e00640 1 -- 172.21.15.33:0/528452672 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940a9220 con 0x56471bf4a970 2024-09-11T00:12:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.751+0000 7f67a7400640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 0x7f678c0bbd40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006010 tx=0x7f67a00097c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.753+0000 7f67b0a95740 1 -- 172.21.15.33:0/528452672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 msgr2=0x56471bf4cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.753+0000 7f67b0a95740 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f67940e3d90 tx=0x7f67940ac720 comp rx=0 tx=0).stop 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 -- 172.21.15.33:0/528452672 shutdown_connections 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4fce0 0x56471bf521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf4f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 --2- 172.21.15.33:0/528452672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf4cd60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 -- 172.21.15.33:0/528452672 >> 172.21.15.33:0/528452672 conn(0x56471bf45ac0 msgr2=0x56471bf46850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 -- 172.21.15.33:0/528452672 shutdown_connections 2024-09-11T00:12:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.754+0000 7f67b0a95740 1 -- 172.21.15.33:0/528452672 wait complete. 2024-09-11T00:12:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.756+0000 7f67b0a95740 1 -- start start 2024-09-11T00:12:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.756+0000 7f67b0a95740 1 Processor -- start 2024-09-11T00:12:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.757+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.757+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33840/0 (socket says 172.21.15.33:33840) 2024-09-11T00:12:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56471bde4ab0 con 0x56471bf4d2a0 2024-09-11T00:12:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56471be53570 con 0x56471bf4fce0 2024-09-11T00:12:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56471bf52cc0 con 0x56471bf4a970 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67b0a95740 10 client.0 _ll_register_callbacks cb 0x56471be62100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.758+0000 7f67a6a00640 1 -- 172.21.15.33:0/653005927 learned_addr learned my addr 172.21.15.33:0/653005927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6000640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6a00640 1 -- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 msgr2=0x56471bf553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6a00640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6a00640 1 -- 172.21.15.33:0/653005927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 msgr2=0x56471bf547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6a00640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6a00640 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471bc0e790 con 0x56471bf4a970 2024-09-11T00:12:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.759+0000 7f67a6000640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.760+0000 7f67a6a00640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67940a8fc0 tx=0x7f67940ad030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a0fcb5a1da17aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.760+0000 7f6790c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:12:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.760+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67940c6030 con 0x56471bf4a970 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.760+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f67940a9220 con 0x56471bf4a970 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.761+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67940acac0 con 0x56471bf4a970 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.761+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f67940cfe60 con 0x56471bf4a970 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.761+0000 7f67b0a95740 10 client.26872 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.762+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56471bc87620 con 0x56471bf4a970 2024-09-11T00:12:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.762+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67940acac0 con 0x56471bf4a970 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.762+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f67940b1070 con 0x56471bf4a970 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 10 client.26872 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 10 client.26872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 20 client.26872 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bf619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 4 client.26872 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56471bebf600 con 0x56471bf5f5d0 2024-09-11T00:12:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.763+0000 7f67a6000640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bf619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.764+0000 7f67a6000640 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bf619c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53142443526261d4 server_cookie=6a7a19af4271af0c in_seq=0 out_seq=0 2024-09-11T00:12:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.764+0000 7f6790c00640 10 client.26872 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:05.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.765+0000 7f6790c00640 1 -- 172.21.15.33:0/653005927 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56471bebf600 con 0x56471bf5f5d0 2024-09-11T00:12:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.765+0000 7f6790c00640 10 client.26872 handle_command_reply: tid=0 2024-09-11T00:12:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.765+0000 7f67b0a95740 1 client.26872 shutdown 2024-09-11T00:12:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.766+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 msgr2=0x56471bf54130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.766+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67940a8fc0 tx=0x7f67940ad030 comp rx=0 tx=0).stop 2024-09-11T00:12:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 shutdown_connections 2024-09-11T00:12:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bf619c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 --2- 172.21.15.33:0/653005927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf54130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f6790c00640 0 client.26872 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.767+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 >> 172.21.15.33:0/653005927 conn(0x56471bf45ac0 msgr2=0x56471bf44bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.768+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 shutdown_connections 2024-09-11T00:12:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.769+0000 7f67b0a95740 1 -- 172.21.15.33:0/653005927 wait complete. 2024-09-11T00:12:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.769+0000 7f67b0a95740 20 client.26872 trim_cache size 0 max 16384 2024-09-11T00:12:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.814+0000 7f67b0a95740 1 Processor -- start 2024-09-11T00:12:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.814+0000 7f67b0a95740 1 -- start start 2024-09-11T00:12:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.814+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.815+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.815+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4fce0 0x56471bf46940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.815+0000 7f67b0a95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81b4500 con 0x56471bf4fce0 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.815+0000 7f67a6000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.815+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.816+0000 7f67b0a95740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81b1dd0 con 0x56471bf4a970 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.816+0000 7f67a6000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:33852/0 (socket says 172.21.15.33:33852) 2024-09-11T00:12:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.816+0000 7f67a6000640 1 -- 172.21.15.33:0/189139061 learned_addr learned my addr 172.21.15.33:0/189139061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.816+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81afc20 con 0x56471bf4d2a0 2024-09-11T00:12:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.817+0000 7f67a6000640 1 -- 172.21.15.33:0/189139061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 msgr2=0x56471bf507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.817+0000 7f67a6000640 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.817+0000 7f67a6000640 1 -- 172.21.15.33:0/189139061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4fce0 msgr2=0x56471bf46940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.818+0000 7f67a6000640 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4fce0 0x56471bf46940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.818+0000 7f67a6000640 1 -- 172.21.15.33:0/189139061 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471bf4d0d0 con 0x56471bf4d2a0 2024-09-11T00:12:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.818+0000 7f67a6a00640 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.819+0000 7f67a6000640 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f679800b620 tx=0x7f679800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6d41f54455bc298 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.821+0000 7f6793400640 1 -- 172.21.15.33:0/189139061 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798020020 con 0x56471bf4d2a0 2024-09-11T00:12:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.821+0000 7f6793400640 1 -- 172.21.15.33:0/189139061 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6798014e00 con 0x56471bf4d2a0 2024-09-11T00:12:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.821+0000 7f6793400640 1 -- 172.21.15.33:0/189139061 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798016ce0 con 0x56471bf4d2a0 2024-09-11T00:12:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.823+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 msgr2=0x56471bf46400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.823+0000 7f67b0a95740 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f679800b620 tx=0x7f679800be30 comp rx=0 tx=0).stop 2024-09-11T00:12:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.824+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 shutdown_connections 2024-09-11T00:12:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4fce0 0x56471bf46940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4d2a0 0x56471bf46400 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 --2- 172.21.15.33:0/189139061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4a970 0x56471bf507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 >> 172.21.15.33:0/189139061 conn(0x56471bf45ac0 msgr2=0x56471bf500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 shutdown_connections 2024-09-11T00:12:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.825+0000 7f67b0a95740 1 -- 172.21.15.33:0/189139061 wait complete. 2024-09-11T00:12:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.827+0000 7f67b0a95740 1 -- start start 2024-09-11T00:12:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.830+0000 7f67b0a95740 1 Processor -- start 2024-09-11T00:12:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf5bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf5a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81b0290 con 0x56471bf4d2a0 2024-09-11T00:12:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81b1700 con 0x56471bf4fce0 2024-09-11T00:12:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f67a81b0960 con 0x56471bf4a970 2024-09-11T00:12:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.831+0000 7f67b0a95740 10 client.0 _ll_register_callbacks cb 0x7f67940ace50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.832+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf5bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.832+0000 7f67a6000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf5a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.832+0000 7f67a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.832+0000 7f67a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40970/0 (socket says 172.21.15.33:40970) 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.832+0000 7f67a7400640 1 -- 172.21.15.33:0/2895977119 learned_addr learned my addr 172.21.15.33:0/2895977119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a7400640 1 -- 172.21.15.33:0/2895977119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 msgr2=0x56471bf5bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a7400640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf5bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a7400640 1 -- 172.21.15.33:0/2895977119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 msgr2=0x56471bf5a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a7400640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf5a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a7400640 1 -- 172.21.15.33:0/2895977119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471bf5b510 con 0x56471bf4fce0 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a6a00640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf5bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.834+0000 7f67a6000640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.837+0000 7f67a7400640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009cd0 tx=0x7f67a0009890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4023d39c5fa5477b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.837+0000 7f6790c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:12:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.837+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0004250 con 0x56471bf4fce0 2024-09-11T00:12:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.837+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f67a00043f0 con 0x56471bf4fce0 2024-09-11T00:12:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.837+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6798014e00 con 0x56471bf4fce0 2024-09-11T00:12:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.838+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f67a0004610 con 0x56471bf4fce0 2024-09-11T00:12:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.838+0000 7f67b0a95740 10 client.36908 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.838+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56471bfd4c60 con 0x56471bf4fce0 2024-09-11T00:12:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.840+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6798014e00 con 0x56471bf4fce0 2024-09-11T00:12:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f67a004e070 con 0x56471bf4fce0 2024-09-11T00:12:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 10 client.36908 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 10 client.36908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 20 client.36908 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bfd7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 4 client.36908 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:12:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.841+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56471bebb0b0 con 0x56471bf5f5d0 2024-09-11T00:12:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.842+0000 7f67a6a00640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bfd7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.845+0000 7f67a6a00640 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bfd7770 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b44a2c1415b06c server_cookie=919e713e2bc52c5 in_seq=0 out_seq=0 2024-09-11T00:12:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.845+0000 7f6790c00640 10 client.36908 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.864+0000 7f6790c00640 1 -- 172.21.15.33:0/2895977119 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56471bebb0b0 con 0x56471bf5f5d0 2024-09-11T00:12:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.864+0000 7f6790c00640 10 client.36908 handle_command_reply: tid=0 2024-09-11T00:12:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.864+0000 7f67b0a95740 1 client.36908 shutdown 2024-09-11T00:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 msgr2=0x56471bf5ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009cd0 tx=0x7f67a0009890 comp rx=0 tx=0).stop 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 shutdown_connections 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56471bf4fce0 0x56471bf5ad10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56471bf4d2a0 0x56471bf5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x56471bf5f5d0 0x56471bfd7770 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 --2- 172.21.15.33:0/2895977119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56471bf4a970 0x56471bf5bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 >> 172.21.15.33:0/2895977119 conn(0x56471bf45ac0 msgr2=0x56471bf49ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.865+0000 7f6790c00640 0 client.36908 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.866+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 shutdown_connections 2024-09-11T00:12:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.866+0000 7f67b0a95740 1 -- 172.21.15.33:0/2895977119 wait complete. 2024-09-11T00:12:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.867+0000 7f67b0a95740 20 client.36908 trim_cache size 0 max 16384 2024-09-11T00:12:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:12:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:12:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:12:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:12:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.870+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 msgr2=0x7f678c0bbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.870+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 0x7f678c0bbd40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006010 tx=0x7f67a00097c0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.870+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 msgr2=0x7f67a819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.870+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f679400e9f0 tx=0x7f679400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 shutdown_connections 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f678c0b9880 0x7f678c0bbd40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a810c420 0x7f67a81a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a810bb20 0x7f67a819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 --2- 172.21.15.33:0/3128201423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f67a810b160 0x7f67a819f140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.871+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 >> 172.21.15.33:0/3128201423 conn(0x7f67a8071aa0 msgr2=0x7f67a810f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.872+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 shutdown_connections 2024-09-11T00:12:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:05.872+0000 7f67a7e00640 1 -- 172.21.15.33:0/3128201423 wait complete. 2024-09-11T00:12:06.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:06 smithi052 ceph-mon[33526]: pgmap v896: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 520 op/s 2024-09-11T00:12:07.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:06 smithi033 ceph-mon[30593]: pgmap v896: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 520 op/s 2024-09-11T00:12:07.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:06 smithi189 ceph-mon[34000]: pgmap v896: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.9 MiB/s wr, 520 op/s 2024-09-11T00:12:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 740.0 s, 633.2 tps, lat 158.423 ms stddev 75.338 2024-09-11T00:12:08.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:08 smithi052 ceph-mon[33526]: pgmap v897: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-09-11T00:12:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:08 smithi033 ceph-mon[30593]: pgmap v897: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-09-11T00:12:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:08 smithi189 ceph-mon[34000]: pgmap v897: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-09-11T00:12:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:10 smithi033 ceph-mon[30593]: pgmap v898: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 MiB/s wr, 593 op/s 2024-09-11T00:12:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:10 smithi052 ceph-mon[33526]: pgmap v898: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 MiB/s wr, 593 op/s 2024-09-11T00:12:11.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:10 smithi189 ceph-mon[34000]: pgmap v898: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 MiB/s wr, 593 op/s 2024-09-11T00:12:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:12 smithi052 ceph-mon[33526]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 607 op/s 2024-09-11T00:12:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:12 smithi033 ceph-mon[30593]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 607 op/s 2024-09-11T00:12:13.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:12 smithi189 ceph-mon[34000]: pgmap v899: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 607 op/s 2024-09-11T00:12:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 745.0 s, 622.8 tps, lat 160.090 ms stddev 43.179 2024-09-11T00:12:14.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:14 smithi052 ceph-mon[33526]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 702 op/s 2024-09-11T00:12:15.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:14 smithi033 ceph-mon[30593]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 702 op/s 2024-09-11T00:12:15.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:14 smithi189 ceph-mon[34000]: pgmap v900: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 702 op/s 2024-09-11T00:12:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:16 smithi052 ceph-mon[33526]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-11T00:12:17.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:16 smithi033 ceph-mon[30593]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-11T00:12:17.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:16 smithi189 ceph-mon[34000]: pgmap v901: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.0 MiB/s wr, 541 op/s 2024-09-11T00:12:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 750.0 s, 619.6 tps, lat 160.415 ms stddev 43.426 2024-09-11T00:12:18.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:18 smithi052 ceph-mon[33526]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 684 op/s 2024-09-11T00:12:19.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:18 smithi033 ceph-mon[30593]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 684 op/s 2024-09-11T00:12:19.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:18 smithi189 ceph-mon[34000]: pgmap v902: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 684 op/s 2024-09-11T00:12:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.318+0000 7fd133e00640 1 -- 172.21.15.33:0/4028672916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341042a0 msgr2=0x7fd13410ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.318+0000 7fd133e00640 1 --2- 172.21.15.33:0/4028672916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341042a0 0x7fd13410ac20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009c10 tx=0x7fd12c02a720 comp rx=0 tx=0).stop 2024-09-11T00:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.322+0000 7fd133e00640 1 -- 172.21.15.33:0/4028672916 shutdown_connections 2024-09-11T00:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.322+0000 7fd133e00640 1 --2- 172.21.15.33:0/4028672916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341042a0 0x7fd13410ac20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.322+0000 7fd133e00640 1 --2- 172.21.15.33:0/4028672916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1341038e0 0x7fd134103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.322+0000 7fd133e00640 1 --2- 172.21.15.33:0/4028672916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd134102790 0x7fd134102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.322+0000 7fd133e00640 1 -- 172.21.15.33:0/4028672916 >> 172.21.15.33:0/4028672916 conn(0x7fd1340fe030 msgr2=0x7fd134100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.323+0000 7fd133e00640 1 -- 172.21.15.33:0/4028672916 shutdown_connections 2024-09-11T00:12:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.324+0000 7fd133e00640 1 -- 172.21.15.33:0/4028672916 wait complete. 2024-09-11T00:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 Processor -- start 2024-09-11T00:12:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 -- start start 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341038e0 0x7fd13419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1341042a0 0x7fd1341a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410c0c0 con 0x7fd1341042a0 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410bf40 con 0x7fd134102790 2024-09-11T00:12:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.326+0000 7fd133e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd13410c240 con 0x7fd1341038e0 2024-09-11T00:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.327+0000 7fd132a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.328+0000 7fd132a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43100/0 (socket says 172.21.15.33:43100) 2024-09-11T00:12:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.328+0000 7fd132a00640 1 -- 172.21.15.33:0/1482113207 learned_addr learned my addr 172.21.15.33:0/1482113207 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.328+0000 7fd133400640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1341042a0 0x7fd1341a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 -- 172.21.15.33:0/1482113207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341038e0 msgr2=0x7fd13419f710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:12:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341038e0 0x7fd13419f710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 -- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1341042a0 msgr2=0x7fd1341a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1341042a0 0x7fd1341a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 -- 172.21.15.33:0/1482113207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341a0c00 con 0x7fd134102790 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.329+0000 7fd132a00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd12400da70 tx=0x7fd12400df30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.330+0000 7fd12b400640 1 -- 172.21.15.33:0/1482113207 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12400cc40 con 0x7fd134102790 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.330+0000 7fd12b400640 1 -- 172.21.15.33:0/1482113207 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd12400cde0 con 0x7fd134102790 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.330+0000 7fd12b400640 1 -- 172.21.15.33:0/1482113207 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124004a00 con 0x7fd134102790 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.330+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341a0ef0 con 0x7fd134102790 2024-09-11T00:12:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.330+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341a75c0 con 0x7fd134102790 2024-09-11T00:12:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.338+0000 7fd12b400640 1 -- 172.21.15.33:0/1482113207 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd124004ba0 con 0x7fd134102790 2024-09-11T00:12:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.340+0000 7fd12b400640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 0x7fd1180b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.341+0000 7fd12b400640 1 -- 172.21.15.33:0/1482113207 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd1240e5820 con 0x7fd134102790 2024-09-11T00:12:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.342+0000 7fd12be00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 0x7fd1180b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.343+0000 7fd12be00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 0x7fd1180b7930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd11c005fd0 tx=0x7fd11c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.348+0000 7fd13c9f5740 1 Processor -- start 2024-09-11T00:12:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.348+0000 7fd13c9f5740 1 -- start start 2024-09-11T00:12:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.348+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.348+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.348+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558ac43156b0 con 0x558ac43a2970 2024-09-11T00:12:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558ac4304ae0 con 0x558ac43a7ce0 2024-09-11T00:12:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ac43088f0 con 0x558ac43a52a0 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd12be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd132a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd133400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd133400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43116/0 (socket says 172.21.15.33:43116) 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd133400640 1 -- 172.21.15.33:0/1822192868 learned_addr learned my addr 172.21.15.33:0/1822192868 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.349+0000 7fd12be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53054/0 (socket says 172.21.15.33:53054) 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 -- 172.21.15.33:0/1822192868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 msgr2=0x558ac43a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 -- 172.21.15.33:0/1822192868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 msgr2=0x558ac43a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 -- 172.21.15.33:0/1822192868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac42d1780 con 0x558ac43a7ce0 2024-09-11T00:12:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd132a00640 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.350+0000 7fd133400640 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009c10 tx=0x7fd12c005ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9733217f5eee53fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.351+0000 7fd123e00640 1 -- 172.21.15.33:0/1822192868 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c042070 con 0x558ac43a7ce0 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.351+0000 7fd123e00640 1 -- 172.21.15.33:0/1822192868 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd12c0304e0 con 0x558ac43a7ce0 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.351+0000 7fd123e00640 1 -- 172.21.15.33:0/1822192868 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c042070 con 0x558ac43a7ce0 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1822192868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 msgr2=0x558ac43aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009c10 tx=0x7fd12c005ea0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1822192868 shutdown_connections 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac43aa1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1822192868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.352+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1822192868 >> 172.21.15.33:0/1822192868 conn(0x558ac439dac0 msgr2=0x558ac439e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.353+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1822192868 shutdown_connections 2024-09-11T00:12:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.353+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1822192868 wait complete. 2024-09-11T00:12:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 -- start start 2024-09-11T00:12:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 Processor -- start 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a2970 0x558ac43ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a7ce0 0x558ac43ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558ac423cab0 con 0x558ac43a7ce0 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558ac42ab570 con 0x558ac43a52a0 2024-09-11T00:12:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.354+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ac43aac60 con 0x558ac43a2970 2024-09-11T00:12:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.355+0000 7fd13c9f5740 10 client.0 _ll_register_callbacks cb 0x558ac42ba100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.355+0000 7fd132a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a2970 0x558ac43ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.355+0000 7fd12be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.355+0000 7fd12be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43128/0 (socket says 172.21.15.33:43128) 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 -- 172.21.15.33:0/1401622525 learned_addr learned my addr 172.21.15.33:0/1401622525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd133400640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a7ce0 0x558ac43ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 -- 172.21.15.33:0/1401622525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a2970 msgr2=0x558ac43ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a2970 0x558ac43ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 -- 172.21.15.33:0/1401622525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a7ce0 msgr2=0x558ac43ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a7ce0 0x558ac43ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.356+0000 7fd12be00640 1 -- 172.21.15.33:0/1401622525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac4066790 con 0x558ac43a52a0 2024-09-11T00:12:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.357+0000 7fd12be00640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00ee60 tx=0x7fd11c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c5ad2cf0c2c321 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.357+0000 7fd120c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c010e40 con 0x558ac43a52a0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd11c004020 con 0x558ac43a52a0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd12c0304e0 con 0x558ac43a52a0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd11c02e050 con 0x558ac43a52a0 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd13c9f5740 10 client.36920 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.358+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558ac40df620 con 0x558ac43a52a0 2024-09-11T00:12:19.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd12c0304e0 con 0x558ac43a52a0 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd11c0035f0 con 0x558ac43a52a0 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 10 client.36920 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 10 client.36920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 20 client.36920 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac43b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 4 client.36920 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.360+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ac4317600 con 0x558ac43b79c0 2024-09-11T00:12:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.361+0000 7fd132a00640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac43b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.363+0000 7fd132a00640 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac43b9e00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0c4089ea9414ff server_cookie=84bea2fe6c856b20 in_seq=0 out_seq=0 2024-09-11T00:12:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.363+0000 7fd120c00640 10 client.36920 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:19.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.365+0000 7fd120c00640 1 -- 172.21.15.33:0/1401622525 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ac4317600 con 0x558ac43b79c0 2024-09-11T00:12:19.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.365+0000 7fd120c00640 10 client.36920 handle_command_reply: tid=0 2024-09-11T00:12:19.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.365+0000 7fd13c9f5740 1 client.36920 shutdown 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 msgr2=0x558ac43ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00ee60 tx=0x7fd11c004730 comp rx=0 tx=0).stop 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 shutdown_connections 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a7ce0 0x558ac43ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a52a0 0x558ac43ac740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac43b9e00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd120c00640 0 client.36920 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1401622525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a2970 0x558ac43ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.366+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 >> 172.21.15.33:0/1401622525 conn(0x558ac439dac0 msgr2=0x558ac439cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.367+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 shutdown_connections 2024-09-11T00:12:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.367+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1401622525 wait complete. 2024-09-11T00:12:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.368+0000 7fd13c9f5740 20 client.36920 trim_cache size 0 max 16384 2024-09-11T00:12:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.412+0000 7fd13c9f5740 1 Processor -- start 2024-09-11T00:12:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 -- start start 2024-09-11T00:12:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac439f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341b4310 con 0x558ac43a2970 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341b1be0 con 0x558ac43a7ce0 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341afa30 con 0x558ac43a52a0 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.413+0000 7fd12be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd133400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac439f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd12be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53074/0 (socket says 172.21.15.33:53074) 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd12be00640 1 -- 172.21.15.33:0/42877746 learned_addr learned my addr 172.21.15.33:0/42877746 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd132a00640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd12be00640 1 -- 172.21.15.33:0/42877746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 msgr2=0x558ac439f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.414+0000 7fd12be00640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac439f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.415+0000 7fd12be00640 1 -- 172.21.15.33:0/42877746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 msgr2=0x558ac43a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.415+0000 7fd12be00640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.415+0000 7fd12be00640 1 -- 172.21.15.33:0/42877746 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac43a50d0 con 0x558ac43a52a0 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.415+0000 7fd132a00640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.415+0000 7fd133400640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac439f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.416+0000 7fd12be00640 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd11c003a40 tx=0x7fd11c010d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210c36d4cd973c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.416+0000 7fd123400640 1 -- 172.21.15.33:0/42877746 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0035f0 con 0x558ac43a52a0 2024-09-11T00:12:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.416+0000 7fd123400640 1 -- 172.21.15.33:0/42877746 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd11c036030 con 0x558ac43a52a0 2024-09-11T00:12:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.416+0000 7fd123400640 1 -- 172.21.15.33:0/42877746 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c004a90 con 0x558ac43a52a0 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.418+0000 7fd13c9f5740 1 -- 172.21.15.33:0/42877746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 msgr2=0x558ac43a8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.418+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd11c003a40 tx=0x7fd11c010d40 comp rx=0 tx=0).stop 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 -- 172.21.15.33:0/42877746 shutdown_connections 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a7ce0 0x558ac439f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a52a0 0x558ac43a8600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/42877746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a2970 0x558ac43a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 -- 172.21.15.33:0/42877746 >> 172.21.15.33:0/42877746 conn(0x558ac439dac0 msgr2=0x558ac43ab240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 -- 172.21.15.33:0/42877746 shutdown_connections 2024-09-11T00:12:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 -- 172.21.15.33:0/42877746 wait complete. 2024-09-11T00:12:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.419+0000 7fd13c9f5740 1 -- start start 2024-09-11T00:12:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.420+0000 7fd13c9f5740 1 Processor -- start 2024-09-11T00:12:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a2970 0x558ac43b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 0x558ac43afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341b00a0 con 0x558ac43a52a0 2024-09-11T00:12:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341b1510 con 0x558ac43a2970 2024-09-11T00:12:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341b0770 con 0x558ac43a7ce0 2024-09-11T00:12:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.421+0000 7fd13c9f5740 10 client.0 _ll_register_callbacks cb 0x7fd11c014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53078/0 (socket says 172.21.15.33:53078) 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 -- 172.21.15.33:0/1176165774 learned_addr learned my addr 172.21.15.33:0/1176165774 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd132a00640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a2970 0x558ac43b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 -- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a2970 msgr2=0x558ac43b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a2970 0x558ac43b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 -- 172.21.15.33:0/1176165774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 msgr2=0x558ac43afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd12be00640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 0x558ac43afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 0x558ac43afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd133400640 1 -- 172.21.15.33:0/1176165774 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac43b0e90 con 0x558ac43a7ce0 2024-09-11T00:12:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.422+0000 7fd12be00640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 0x558ac43afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.423+0000 7fd133400640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558ac43acdf0 tx=0x7fd12c030d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07ff1a03da41e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.423+0000 7fd120c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:12:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.425+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c04b070 con 0x558ac43a7ce0 2024-09-11T00:12:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.425+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd12c03c650 con 0x558ac43a7ce0 2024-09-11T00:12:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.425+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd11c036030 con 0x558ac43a7ce0 2024-09-11T00:12:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.426+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd12c057050 con 0x558ac43a7ce0 2024-09-11T00:12:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.426+0000 7fd13c9f5740 10 client.26893 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.426+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558ac4435ec0 con 0x558ac43a7ce0 2024-09-11T00:12:19.429 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd11c036030 con 0x558ac43a7ce0 2024-09-11T00:12:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd12c047450 con 0x558ac43a7ce0 2024-09-11T00:12:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 10 client.26893 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 10 client.26893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 20 client.26893 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac44384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 4 client.26893 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.427+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ac43130b0 con 0x558ac43b79c0 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.428+0000 7fd132a00640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac44384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.428+0000 7fd132a00640 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac44384d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c98cea9b62877c server_cookie=557d2452bfc45748 in_seq=0 out_seq=0 2024-09-11T00:12:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.428+0000 7fd120c00640 10 client.26893 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.450+0000 7fd120c00640 1 -- 172.21.15.33:0/1176165774 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ac43130b0 con 0x558ac43b79c0 2024-09-11T00:12:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.450+0000 7fd120c00640 10 client.26893 handle_command_reply: tid=0 2024-09-11T00:12:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.451+0000 7fd13c9f5740 1 client.26893 shutdown 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 msgr2=0x558ac43b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558ac43acdf0 tx=0x7fd12c030d90 comp rx=0 tx=0).stop 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 shutdown_connections 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x558ac43b79c0 0x558ac44384d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ac43a7ce0 0x558ac43b0190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ac43a52a0 0x558ac43afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 --2- 172.21.15.33:0/1176165774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558ac43a2970 0x558ac43b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 >> 172.21.15.33:0/1176165774 conn(0x558ac439dac0 msgr2=0x558ac43a1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd120c00640 0 client.26893 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 shutdown_connections 2024-09-11T00:12:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.452+0000 7fd13c9f5740 1 -- 172.21.15.33:0/1176165774 wait complete. 2024-09-11T00:12:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.453+0000 7fd13c9f5740 20 client.26893 trim_cache size 0 max 16384 2024-09-11T00:12:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:12:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:12:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:12:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:12:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 msgr2=0x7fd1180b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 0x7fd1180b7930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd11c005fd0 tx=0x7fd11c009260 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 msgr2=0x7fd13419f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd12400da70 tx=0x7fd12400df30 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 shutdown_connections 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd1180b5470 0x7fd1180b7930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1341042a0 0x7fd1341a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1341038e0 0x7fd13419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 --2- 172.21.15.33:0/1482113207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd134102790 0x7fd13419f0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.456+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 >> 172.21.15.33:0/1482113207 conn(0x7fd1340fe030 msgr2=0x7fd134106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.457+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 shutdown_connections 2024-09-11T00:12:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:19.457+0000 7fd133e00640 1 -- 172.21.15.33:0/1482113207 wait complete. 2024-09-11T00:12:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:20 smithi052 ceph-mon[33526]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-09-11T00:12:21.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:20 smithi033 ceph-mon[30593]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-09-11T00:12:21.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:20 smithi189 ceph-mon[34000]: pgmap v903: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 595 op/s 2024-09-11T00:12:22.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:22 smithi052 ceph-mon[33526]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 587 op/s 2024-09-11T00:12:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:22 smithi033 ceph-mon[30593]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 587 op/s 2024-09-11T00:12:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:22 smithi189 ceph-mon[34000]: pgmap v904: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 587 op/s 2024-09-11T00:12:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 755.0 s, 597.0 tps, lat 168.387 ms stddev 53.317 2024-09-11T00:12:24.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:24 smithi052 ceph-mon[33526]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 681 op/s 2024-09-11T00:12:25.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:24 smithi033 ceph-mon[30593]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 681 op/s 2024-09-11T00:12:25.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:24 smithi189 ceph-mon[34000]: pgmap v905: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.3 MiB/s wr, 681 op/s 2024-09-11T00:12:26.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:26 smithi052 ceph-mon[33526]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T00:12:27.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:26 smithi033 ceph-mon[30593]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T00:12:27.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:26 smithi189 ceph-mon[34000]: pgmap v906: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 521 op/s 2024-09-11T00:12:28.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 760.0 s, 562.8 tps, lat 176.342 ms stddev 131.440 2024-09-11T00:12:28.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:28 smithi052 ceph-mon[33526]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 691 op/s 2024-09-11T00:12:29.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:28 smithi033 ceph-mon[30593]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 691 op/s 2024-09-11T00:12:29.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:28 smithi189 ceph-mon[34000]: pgmap v907: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 691 op/s 2024-09-11T00:12:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:30 smithi052 ceph-mon[33526]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T00:12:31.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:30 smithi033 ceph-mon[30593]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T00:12:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:30 smithi189 ceph-mon[34000]: pgmap v908: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.7 MiB/s wr, 611 op/s 2024-09-11T00:12:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.720+0000 7f0a81e00640 1 -- 172.21.15.33:0/1950876120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10a100 msgr2=0x7f0a7c10a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.720+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1950876120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10a100 0x7f0a7c10a580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009890 tx=0x7f0a6802a380 comp rx=0 tx=0).stop 2024-09-11T00:12:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.721+0000 7f0a81e00640 1 -- 172.21.15.33:0/1950876120 shutdown_connections 2024-09-11T00:12:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.721+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1950876120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10aac0 0x7f0a7c111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.721+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1950876120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10a100 0x7f0a7c10a580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.721+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1950876120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.722+0000 7f0a81e00640 1 -- 172.21.15.33:0/1950876120 >> 172.21.15.33:0/1950876120 conn(0x7f0a7c0783d0 msgr2=0x7f0a7c07a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.722+0000 7f0a81e00640 1 -- 172.21.15.33:0/1950876120 shutdown_connections 2024-09-11T00:12:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.722+0000 7f0a81e00640 1 -- 172.21.15.33:0/1950876120 wait complete. 2024-09-11T00:12:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.723+0000 7f0a81e00640 1 Processor -- start 2024-09-11T00:12:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.724+0000 7f0a81e00640 1 -- start start 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.724+0000 7f0a81e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.724+0000 7f0a81e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 0x7f0a7c0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.724+0000 7f0a81e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10aac0 0x7f0a7c072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.725+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 0x7f0a7c0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.725+0000 7f0a7aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.725+0000 7f0a7aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47492/0 (socket says 172.21.15.33:47492) 2024-09-11T00:12:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.725+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 0x7f0a7c0722f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56056/0 (socket says 172.21.15.33:56056) 2024-09-11T00:12:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.725+0000 7f0a7aa00640 1 -- 172.21.15.33:0/1463648355 learned_addr learned my addr 172.21.15.33:0/1463648355 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a7b400640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10aac0 0x7f0a7c072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c114af0 con 0x7f0a7c10a100 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c114970 con 0x7f0a7c109230 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c114c70 con 0x7f0a7c10aac0 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a7aa00640 1 -- 172.21.15.33:0/1463648355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10aac0 msgr2=0x7f0a7c072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a7aa00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10aac0 0x7f0a7c072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.726+0000 7f0a7aa00640 1 -- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 msgr2=0x7f0a7c0722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.727+0000 7f0a7aa00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 0x7f0a7c0722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.727+0000 7f0a7aa00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0737e0 con 0x7f0a7c109230 2024-09-11T00:12:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.728+0000 7f0a7aa00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9c0 tx=0x7f0a6c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.728+0000 7f0a80a00640 1 -- 172.21.15.33:0/1463648355 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ccc0 con 0x7f0a7c109230 2024-09-11T00:12:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.729+0000 7f0a80a00640 1 -- 172.21.15.33:0/1463648355 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a6c0054b0 con 0x7f0a7c109230 2024-09-11T00:12:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.729+0000 7f0a80a00640 1 -- 172.21.15.33:0/1463648355 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c010430 con 0x7f0a7c109230 2024-09-11T00:12:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.729+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c073ad0 con 0x7f0a7c109230 2024-09-11T00:12:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.729+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c074170 con 0x7f0a7c109230 2024-09-11T00:12:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.735+0000 7f0a84c1e740 1 Processor -- start 2024-09-11T00:12:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.735+0000 7f0a84c1e740 1 -- start start 2024-09-11T00:12:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d570c0 0x557792d594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557792cc76b0 con 0x557792d570c0 2024-09-11T00:12:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557792cb6ae0 con 0x557792d54790 2024-09-11T00:12:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557792cba8f0 con 0x557792d59b00 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.736+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:47498/0 (socket says 172.21.15.33:47498) 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:59546/0 (socket says 172.21.15.33:59546) 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 -- 172.21.15.33:0/564784600 learned_addr learned my addr 172.21.15.33:0/564784600 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 -- 172.21.15.33:0/564784600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 msgr2=0x557792d5bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 -- 172.21.15.33:0/564784600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d570c0 msgr2=0x557792d594b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:12:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d570c0 0x557792d594b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7b400640 1 -- 172.21.15.33:0/564784600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557792c83780 con 0x557792d54790 2024-09-11T00:12:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.737+0000 7f0a7a000640 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.738+0000 7f0a80a00640 1 -- 172.21.15.33:0/1463648355 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0a6c004eb0 con 0x7f0a7c109230 2024-09-11T00:12:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.738+0000 7f0a7b400640 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009fc0 tx=0x7f0a74010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=896dae80da028b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.738+0000 7f0a67e00640 1 -- 172.21.15.33:0/564784600 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74016070 con 0x557792d54790 2024-09-11T00:12:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.739+0000 7f0a67e00640 1 -- 172.21.15.33:0/564784600 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a74004d20 con 0x557792d54790 2024-09-11T00:12:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.739+0000 7f0a67e00640 1 -- 172.21.15.33:0/564784600 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74005350 con 0x557792d54790 2024-09-11T00:12:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.739+0000 7f0a80a00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 0x7f0a600b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.740+0000 7f0a80a00640 1 -- 172.21.15.33:0/1463648355 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0a6c0e6290 con 0x7f0a7c109230 2024-09-11T00:12:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.741+0000 7f0a7aa00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 0x7f0a600b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.741+0000 7f0a84c1e740 1 -- 172.21.15.33:0/564784600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 msgr2=0x557792d56b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.741+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009fc0 tx=0x7f0a74010800 comp rx=0 tx=0).stop 2024-09-11T00:12:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a7aa00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 0x7f0a600b79b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000c00 tx=0x7f0a6c0094c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a84c1e740 1 -- 172.21.15.33:0/564784600 shutdown_connections 2024-09-11T00:12:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d59b00 0x557792d5bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d570c0 0x557792d594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/564784600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d56b80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.742+0000 7f0a84c1e740 1 -- 172.21.15.33:0/564784600 >> 172.21.15.33:0/564784600 conn(0x557792d4f8e0 msgr2=0x557792d50670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.743+0000 7f0a84c1e740 1 -- 172.21.15.33:0/564784600 shutdown_connections 2024-09-11T00:12:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.743+0000 7f0a84c1e740 1 -- 172.21.15.33:0/564784600 wait complete. 2024-09-11T00:12:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.744+0000 7f0a84c1e740 1 -- start start 2024-09-11T00:12:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.744+0000 7f0a84c1e740 1 Processor -- start 2024-09-11T00:12:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557792beeab0 con 0x557792d59b00 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557792c5d570 con 0x557792d54790 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557792d5cae0 con 0x557792d570c0 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a84c1e740 10 client.0 _ll_register_callbacks cb 0x557792c6c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.749+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:59550/0 (socket says 172.21.15.33:59550) 2024-09-11T00:12:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.750+0000 7f0a7a000640 1 -- 172.21.15.33:0/1928843277 learned_addr learned my addr 172.21.15.33:0/1928843277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.750+0000 7f0a7b400640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7a000640 1 -- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 msgr2=0x557792d5e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7a000640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7a000640 1 -- 172.21.15.33:0/1928843277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 msgr2=0x557792d5f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7a000640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7a000640 1 -- 172.21.15.33:0/1928843277 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557792a18790 con 0x557792d570c0 2024-09-11T00:12:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.751+0000 7f0a7b400640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.752+0000 7f0a7a000640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a6802afd0 tx=0x7f0a680306e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c014c4422a0554 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.752+0000 7f0a64c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:12:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.752+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68037040 con 0x557792d570c0 2024-09-11T00:12:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.752+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0a68030ab0 con 0x557792d570c0 2024-09-11T00:12:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.753+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a74004d20 con 0x557792d570c0 2024-09-11T00:12:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.753+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a68030cb0 con 0x557792d570c0 2024-09-11T00:12:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.753+0000 7f0a84c1e740 10 client.26905 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.753+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557792a91620 con 0x557792d570c0 2024-09-11T00:12:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.754+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a74004d20 con 0x557792d570c0 2024-09-11T00:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.755+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0a6804f020 con 0x557792d570c0 2024-09-11T00:12:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.755+0000 7f0a84c1e740 10 client.26905 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a84c1e740 10 client.26905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a84c1e740 20 client.26905 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792d698c0 0x557792d6bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a84c1e740 4 client.26905 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557792cc9600 con 0x557792d698c0 2024-09-11T00:12:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.756+0000 7f0a7b400640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792d698c0 0x557792d6bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.759+0000 7f0a7b400640 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792d698c0 0x557792d6bd00 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76d1525175d7928 server_cookie=64d86fa567b36461 in_seq=0 out_seq=0 2024-09-11T00:12:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.759+0000 7f0a64c00640 10 client.26905 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.760+0000 7f0a64c00640 1 -- 172.21.15.33:0/1928843277 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557792cc9600 con 0x557792d698c0 2024-09-11T00:12:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.760+0000 7f0a64c00640 10 client.26905 handle_command_reply: tid=0 2024-09-11T00:12:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.760+0000 7f0a84c1e740 1 client.26905 shutdown 2024-09-11T00:12:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.761+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 msgr2=0x557792d5e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.761+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a6802afd0 tx=0x7f0a680306e0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 shutdown_connections 2024-09-11T00:12:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792d698c0 0x557792d6bd00 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d570c0 0x557792d5e6b0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a6802afd0 tx=0x7f0a680306e0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/1928843277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 >> 172.21.15.33:0/1928843277 conn(0x557792d4f8e0 msgr2=0x557792d4ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.762+0000 7f0a64c00640 0 client.26905 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.763+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 shutdown_connections 2024-09-11T00:12:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.763+0000 7f0a84c1e740 1 -- 172.21.15.33:0/1928843277 wait complete. 2024-09-11T00:12:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.764+0000 7f0a84c1e740 20 client.26905 trim_cache size 0 max 16384 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.800+0000 7f0a84c1e740 1 Processor -- start 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.800+0000 7f0a84c1e740 1 -- start start 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d50850 0x557792d6b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.803 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1bcc80 con 0x557792d59b00 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1ba550 con 0x557792d50850 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.801+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1b83a0 con 0x557792d54790 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:59554/0 (socket says 172.21.15.33:59554) 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 -- 172.21.15.33:0/531881858 learned_addr learned my addr 172.21.15.33:0/531881858 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d50850 0x557792d6b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.804 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7a000640 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 -- 172.21.15.33:0/531881858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d50850 msgr2=0x557792d6b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d50850 0x557792d6b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 -- 172.21.15.33:0/531881858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 msgr2=0x557792d5e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.802+0000 7f0a7b400640 1 -- 172.21.15.33:0/531881858 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557792d56ef0 con 0x557792d54790 2024-09-11T00:12:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.803+0000 7f0a7b400640 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d50 tx=0x7f0a74010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda3d2d1063fa94f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.803+0000 7f0a67400640 1 -- 172.21.15.33:0/531881858 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74016040 con 0x557792d54790 2024-09-11T00:12:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.804+0000 7f0a67400640 1 -- 172.21.15.33:0/531881858 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a74012510 con 0x557792d54790 2024-09-11T00:12:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.804+0000 7f0a67400640 1 -- 172.21.15.33:0/531881858 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74004280 con 0x557792d54790 2024-09-11T00:12:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.805+0000 7f0a84c1e740 1 -- 172.21.15.33:0/531881858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 msgr2=0x557792d5e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.805+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d50 tx=0x7f0a74010800 comp rx=0 tx=0).stop 2024-09-11T00:12:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 -- 172.21.15.33:0/531881858 shutdown_connections 2024-09-11T00:12:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d50850 0x557792d6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d59b00 0x557792d5e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/531881858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d5e010 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 -- 172.21.15.33:0/531881858 >> 172.21.15.33:0/531881858 conn(0x557792d4f8e0 msgr2=0x557792d50140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 -- 172.21.15.33:0/531881858 shutdown_connections 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.806+0000 7f0a84c1e740 1 -- 172.21.15.33:0/531881858 wait complete. 2024-09-11T00:12:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.807+0000 7f0a84c1e740 1 -- start start 2024-09-11T00:12:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.808+0000 7f0a84c1e740 1 Processor -- start 2024-09-11T00:12:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.808+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d50850 0x557792d65a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.808+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d64730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.808+0000 7f0a84c1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 0x557792d64c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1b8a10 con 0x557792d50850 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1b9e80 con 0x557792d59b00 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a84c1e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c1b90e0 con 0x557792d54790 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a84c1e740 10 client.0 _ll_register_callbacks cb 0x7f0a680096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d64730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 0x557792d64c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d64730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:59566/0 (socket says 172.21.15.33:59566) 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7a000640 1 -- 172.21.15.33:0/370596132 learned_addr learned my addr 172.21.15.33:0/370596132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 -- 172.21.15.33:0/370596132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 msgr2=0x557792d64730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d64730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 -- 172.21.15.33:0/370596132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d50850 msgr2=0x557792d65a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d50850 0x557792d65a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.809+0000 7f0a7b400640 1 -- 172.21.15.33:0/370596132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557792d654a0 con 0x557792d59b00 2024-09-11T00:12:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.810+0000 7f0a7b400640 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 0x557792d64c70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d50 tx=0x7f0a74004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8496f08b10bafcba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.810+0000 7f0a64c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.810+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7403f060 con 0x557792d59b00 2024-09-11T00:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.810+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f0a74012940 con 0x557792d59b00 2024-09-11T00:12:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.811+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a74012510 con 0x557792d59b00 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.811+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a74016070 con 0x557792d59b00 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.811+0000 7f0a84c1e740 10 client.36944 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.811+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557792dd6820 con 0x557792d59b00 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a74012510 con 0x557792d59b00 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0a7400f040 con 0x557792d59b00 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 10 client.36944 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 10 client.36944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 20 client.36944 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792dd6ee0 0x557792dd9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 4 client.36944 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.812+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557792cc50b0 con 0x557792dd6ee0 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.813+0000 7f0a7a000640 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792dd6ee0 0x557792dd9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.815+0000 7f0a7a000640 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792dd6ee0 0x557792dd9300 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb2e218b36b9c2d server_cookie=536ab854392de217 in_seq=0 out_seq=0 2024-09-11T00:12:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.815+0000 7f0a64c00640 10 client.36944 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.858+0000 7f0a64c00640 1 -- 172.21.15.33:0/370596132 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557792cc50b0 con 0x557792dd6ee0 2024-09-11T00:12:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.858+0000 7f0a64c00640 10 client.36944 handle_command_reply: tid=0 2024-09-11T00:12:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.858+0000 7f0a84c1e740 1 client.36944 shutdown 2024-09-11T00:12:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.858+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 msgr2=0x557792d64c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.858+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 0x557792d64c70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009d50 tx=0x7f0a74004ab0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 shutdown_connections 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557792d59b00 0x557792d64c70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x557792dd6ee0 0x557792dd9300 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557792d54790 0x557792d64730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 --2- 172.21.15.33:0/370596132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557792d50850 0x557792d65a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a64c00640 0 client.36944 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 >> 172.21.15.33:0/370596132 conn(0x557792d4f8e0 msgr2=0x557792d5e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 shutdown_connections 2024-09-11T00:12:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.859+0000 7f0a84c1e740 1 -- 172.21.15.33:0/370596132 wait complete. 2024-09-11T00:12:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.860+0000 7f0a84c1e740 20 client.36944 trim_cache size 0 max 16384 2024-09-11T00:12:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:12:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:12:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:12:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:12:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.861+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 msgr2=0x7f0a600b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.861+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 0x7f0a600b79b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000c00 tx=0x7f0a6c0094c0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.861+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 msgr2=0x7f0a7c071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.861+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9c0 tx=0x7f0a6c00ee80 comp rx=0 tx=0).stop 2024-09-11T00:12:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 shutdown_connections 2024-09-11T00:12:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f0a600b54f0 0x7f0a600b79b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a7c10aac0 0x7f0a7c072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a7c10a100 0x7f0a7c0722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 --2- 172.21.15.33:0/1463648355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7c109230 0x7f0a7c071ca0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.862+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 >> 172.21.15.33:0/1463648355 conn(0x7f0a7c0783d0 msgr2=0x7f0a7c10d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.863+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 shutdown_connections 2024-09-11T00:12:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:32.863+0000 7f0a81e00640 1 -- 172.21.15.33:0/1463648355 wait complete. 2024-09-11T00:12:32.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:32 smithi052 ceph-mon[33526]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 625 op/s 2024-09-11T00:12:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:32 smithi033 ceph-mon[30593]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 625 op/s 2024-09-11T00:12:33.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:32 smithi189 ceph-mon[34000]: pgmap v909: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.8 MiB/s wr, 625 op/s 2024-09-11T00:12:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 765.0 s, 665.8 tps, lat 150.731 ms stddev 47.158 2024-09-11T00:12:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:34 smithi052 ceph-mon[33526]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.2 MiB/s wr, 718 op/s 2024-09-11T00:12:34.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:34 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:35.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:34 smithi033 ceph-mon[30593]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.2 MiB/s wr, 718 op/s 2024-09-11T00:12:35.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:34 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:35.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:34 smithi189 ceph-mon[34000]: pgmap v910: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.2 MiB/s wr, 718 op/s 2024-09-11T00:12:35.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:34 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:12:37.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2024-09-11T00:12:37.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:37.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:37.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:12:37.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: pgmap v911: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:12:37.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:37 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:12:37.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:37 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:12:38.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:37 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:12:38.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:37 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:12:38.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:37 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi033 to 177.5M 2024-09-11T00:12:38.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:37 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi033 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:12:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 770.0 s, 617.2 tps, lat 162.801 ms stddev 48.092 2024-09-11T00:12:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:38 smithi052 ceph-mon[33526]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.8 MiB/s wr, 739 op/s 2024-09-11T00:12:39.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:38 smithi033 ceph-mon[30593]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.8 MiB/s wr, 739 op/s 2024-09-11T00:12:39.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:38 smithi189 ceph-mon[34000]: pgmap v912: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.8 MiB/s wr, 739 op/s 2024-09-11T00:12:41.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:40 smithi033 ceph-mon[30593]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-09-11T00:12:41.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:40 smithi189 ceph-mon[34000]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-09-11T00:12:41.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:40 smithi052 ceph-mon[33526]: pgmap v913: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 634 op/s 2024-09-11T00:12:43.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:42 smithi033 ceph-mon[30593]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-11T00:12:43.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:42 smithi189 ceph-mon[34000]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-11T00:12:43.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:42 smithi052 ceph-mon[33526]: pgmap v914: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-11T00:12:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 775.0 s, 623.6 tps, lat 159.544 ms stddev 50.253 2024-09-11T00:12:45.007 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:44 smithi052 ceph-mon[33526]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-09-11T00:12:45.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:44 smithi033 ceph-mon[30593]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-09-11T00:12:45.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:44 smithi189 ceph-mon[34000]: pgmap v915: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-09-11T00:12:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.099+0000 7f8be0000640 1 -- 172.21.15.33:0/2681166265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd8107ed0 msgr2=0x7f8bd810a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.099+0000 7f8be0000640 1 --2- 172.21.15.33:0/2681166265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd8107ed0 0x7f8bd810a2c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009860 tx=0x7f8bc402a340 comp rx=0 tx=0).stop 2024-09-11T00:12:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.100+0000 7f8be0000640 1 -- 172.21.15.33:0/2681166265 shutdown_connections 2024-09-11T00:12:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.100+0000 7f8be0000640 1 --2- 172.21.15.33:0/2681166265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd810a890 0x7f8bd810cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.100+0000 7f8be0000640 1 --2- 172.21.15.33:0/2681166265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd8107ed0 0x7f8bd810a2c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.100+0000 7f8be0000640 1 --2- 172.21.15.33:0/2681166265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd806b300 0x7f8bd8107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.100+0000 7f8be0000640 1 -- 172.21.15.33:0/2681166265 >> 172.21.15.33:0/2681166265 conn(0x7f8bd80fd140 msgr2=0x7f8bd80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.101+0000 7f8be0000640 1 -- 172.21.15.33:0/2681166265 shutdown_connections 2024-09-11T00:12:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.101+0000 7f8be0000640 1 -- 172.21.15.33:0/2681166265 wait complete. 2024-09-11T00:12:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 Processor -- start 2024-09-11T00:12:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 -- start start 2024-09-11T00:12:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 0x7f8bd819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 0x7f8bd819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd8110670 con 0x7f8bd8107ed0 2024-09-11T00:12:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81104f0 con 0x7f8bd810a890 2024-09-11T00:12:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.103+0000 7f8be0000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81107f0 con 0x7f8bd806b300 2024-09-11T00:12:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40662/0 (socket says 172.21.15.33:40662) 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 -- 172.21.15.33:0/2126324304 learned_addr learned my addr 172.21.15.33:0/2126324304 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bde000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 0x7f8bd819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 0x7f8bd819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 -- 172.21.15.33:0/2126324304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 msgr2=0x7f8bd819c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 0x7f8bd819c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 -- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 msgr2=0x7f8bd819b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 0x7f8bd819b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.104+0000 7f8bdd600640 1 -- 172.21.15.33:0/2126324304 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd819c9b0 con 0x7f8bd806b300 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.105+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 0x7f8bd819b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.105+0000 7f8bde000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 0x7f8bd819c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.105+0000 7f8bdd600640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00e9c0 tx=0x7f8bcc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.106+0000 7f8bd6000640 1 -- 172.21.15.33:0/2126324304 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00ccc0 con 0x7f8bd806b300 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.106+0000 7f8bd6000640 1 -- 172.21.15.33:0/2126324304 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bcc0054b0 con 0x7f8bd806b300 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.106+0000 7f8bd6000640 1 -- 172.21.15.33:0/2126324304 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc010430 con 0x7f8bd806b300 2024-09-11T00:12:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.106+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd819cca0 con 0x7f8bd806b300 2024-09-11T00:12:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.106+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd81a3370 con 0x7f8bd806b300 2024-09-11T00:12:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.111+0000 7f8be3066740 1 Processor -- start 2024-09-11T00:12:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.111+0000 7f8be3066740 1 -- start start 2024-09-11T00:12:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 0x55942bf4e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf4e8d0 0x55942bf50cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 0x55942bf537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55942beb66b0 con 0x55942bf4e8d0 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55942bea5ae0 con 0x55942bf4bfa0 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8be3066740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55942bea98f0 con 0x55942bf51310 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8bde000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 0x55942bf4e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8bde000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 0x55942bf4e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49272/0 (socket says 172.21.15.33:49272) 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.112+0000 7f8bde000640 1 -- 172.21.15.33:0/2697987356 learned_addr learned my addr 172.21.15.33:0/2697987356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.113+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 0x55942bf537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.114+0000 7f8bdcc00640 1 -- 172.21.15.33:0/2697987356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 msgr2=0x55942bf4e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.114+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 0x55942bf4e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.114+0000 7f8bdcc00640 1 -- 172.21.15.33:0/2697987356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf4e8d0 msgr2=0x55942bf50cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.114+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf4e8d0 0x55942bf50cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.114+0000 7f8bdcc00640 1 -- 172.21.15.33:0/2697987356 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942be72780 con 0x55942bf51310 2024-09-11T00:12:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.115+0000 7f8bd6000640 1 -- 172.21.15.33:0/2126324304 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8bcc004eb0 con 0x7f8bd806b300 2024-09-11T00:12:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.115+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 0x55942bf537d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009830 tx=0x7f8bc40095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f6e13a469fc78e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.117+0000 7f8bca600640 1 -- 172.21.15.33:0/2697987356 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4040020 con 0x55942bf51310 2024-09-11T00:12:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.117+0000 7f8bd6000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 0x7f8bc00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.117+0000 7f8bca600640 1 -- 172.21.15.33:0/2697987356 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bc40306b0 con 0x55942bf51310 2024-09-11T00:12:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.117+0000 7f8bca600640 1 -- 172.21.15.33:0/2697987356 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4037040 con 0x55942bf51310 2024-09-11T00:12:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.118+0000 7f8bde000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 0x7f8bc00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.118+0000 7f8be3066740 1 -- 172.21.15.33:0/2697987356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 msgr2=0x55942bf537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.118+0000 7f8be3066740 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 0x55942bf537d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009830 tx=0x7f8bc40095b0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.118+0000 7f8bd6000640 1 -- 172.21.15.33:0/2126324304 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8bcc0e6410 con 0x7f8bd806b300 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.121+0000 7f8bde000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 0x7f8bc00b7970 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007f90 tx=0x7f8bd0007540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 -- 172.21.15.33:0/2697987356 shutdown_connections 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf51310 0x55942bf537d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf4e8d0 0x55942bf50cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 --2- 172.21.15.33:0/2697987356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4bfa0 0x55942bf4e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 -- 172.21.15.33:0/2697987356 >> 172.21.15.33:0/2697987356 conn(0x55942bf470f0 msgr2=0x55942bf47e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 -- 172.21.15.33:0/2697987356 shutdown_connections 2024-09-11T00:12:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.122+0000 7f8be3066740 1 -- 172.21.15.33:0/2697987356 wait complete. 2024-09-11T00:12:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.125+0000 7f8be3066740 1 -- start start 2024-09-11T00:12:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.127+0000 7f8be3066740 1 Processor -- start 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf55d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf56950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55942bdddab0 con 0x55942bf51310 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55942be4c570 con 0x55942bf4e8d0 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55942bf54290 con 0x55942bf4bfa0 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.128+0000 7f8be3066740 10 client.0 _ll_register_callbacks cb 0x55942be5b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.129+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf55d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.129+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf55d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49278/0 (socket says 172.21.15.33:49278) 2024-09-11T00:12:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.129+0000 7f8bdcc00640 1 -- 172.21.15.33:0/207977927 learned_addr learned my addr 172.21.15.33:0/207977927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.129+0000 7f8bde000640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf56950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bdd600640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bde000640 1 -- 172.21.15.33:0/207977927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 msgr2=0x55942bf556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bde000640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bde000640 1 -- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 msgr2=0x55942bf55d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.132 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bde000640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf55d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.130+0000 7f8bde000640 1 -- 172.21.15.33:0/207977927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942bc07790 con 0x55942bf51310 2024-09-11T00:12:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.131+0000 7f8bde000640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf56950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0010c30 tx=0x7f8bd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d9449b9ced7a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.131+0000 7f8bbea00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:12:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.132+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd001e620 con 0x55942bf51310 2024-09-11T00:12:46.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.132+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8bd001e7c0 con 0x55942bf51310 2024-09-11T00:12:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.132+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc40306b0 con 0x55942bf51310 2024-09-11T00:12:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.133+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8bd001e9c0 con 0x55942bf51310 2024-09-11T00:12:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.133+0000 7f8be3066740 10 client.17049 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.133+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55942bc80620 con 0x55942bf51310 2024-09-11T00:12:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.135+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bc40306b0 con 0x55942bf51310 2024-09-11T00:12:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.135+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f8bd00040b0 con 0x55942bf51310 2024-09-11T00:12:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.135+0000 7f8be3066740 10 client.17049 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:46.137 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.135+0000 7f8be3066740 10 client.17049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.136+0000 7f8be3066740 20 client.17049 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.137+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf61020 0x55942bf63410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.137+0000 7f8be3066740 4 client.17049 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:12:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.137+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55942beb8600 con 0x55942bf61020 2024-09-11T00:12:46.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.139+0000 7f8bdd600640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf61020 0x55942bf63410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.141+0000 7f8bdd600640 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf61020 0x55942bf63410 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdeff068af650ff7 server_cookie=1e2d9ccb106bd5ef in_seq=0 out_seq=0 2024-09-11T00:12:46.142 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.141+0000 7f8bbea00640 10 client.17049 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.142+0000 7f8bbea00640 1 -- 172.21.15.33:0/207977927 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55942beb8600 con 0x55942bf61020 2024-09-11T00:12:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.142+0000 7f8bbea00640 10 client.17049 handle_command_reply: tid=0 2024-09-11T00:12:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.142+0000 7f8be3066740 1 client.17049 shutdown 2024-09-11T00:12:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.143+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 msgr2=0x55942bf56950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.143+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf56950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0010c30 tx=0x7f8bd0004a40 comp rx=0 tx=0).stop 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 shutdown_connections 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf56950 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf55d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf61020 0x55942bf63410 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 --2- 172.21.15.33:0/207977927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.144+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 >> 172.21.15.33:0/207977927 conn(0x55942bf470f0 msgr2=0x55942bf3da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.145+0000 7f8bbea00640 0 client.17049 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.145+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 shutdown_connections 2024-09-11T00:12:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.147+0000 7f8be3066740 1 -- 172.21.15.33:0/207977927 wait complete. 2024-09-11T00:12:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.147+0000 7f8be3066740 20 client.17049 trim_cache size 0 max 16384 2024-09-11T00:12:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.180+0000 7f8be3066740 1 Processor -- start 2024-09-11T00:12:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.180+0000 7f8be3066740 1 -- start start 2024-09-11T00:12:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf47950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf47e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81abc90 con 0x55942bf51310 2024-09-11T00:12:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81a9560 con 0x55942bf4e8d0 2024-09-11T00:12:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.181+0000 7f8be3066740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81a73d0 con 0x55942bf4bfa0 2024-09-11T00:12:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.182+0000 7f8bdd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.182+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf47950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.182+0000 7f8bdd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:40674/0 (socket says 172.21.15.33:40674) 2024-09-11T00:12:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.182+0000 7f8bdd600640 1 -- 172.21.15.33:0/1685097731 learned_addr learned my addr 172.21.15.33:0/1685097731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.182+0000 7f8bde000640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf47e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.183+0000 7f8bdcc00640 1 -- 172.21.15.33:0/1685097731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 msgr2=0x55942bf39960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bdcc00640 1 -- 172.21.15.33:0/1685097731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 msgr2=0x55942bf47e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.185 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf47e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bdcc00640 1 -- 172.21.15.33:0/1685097731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942bf51030 con 0x55942bf4e8d0 2024-09-11T00:12:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bde000640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf47e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.184+0000 7f8bdd600640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:12:46.186 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.185+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf47950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4005d00 tx=0x7f8bc4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f488a0ee99e598c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.186+0000 7f8bc9c00640 1 -- 172.21.15.33:0/1685097731 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc404a070 con 0x55942bf4e8d0 2024-09-11T00:12:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.186+0000 7f8bc9c00640 1 -- 172.21.15.33:0/1685097731 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bc4030df0 con 0x55942bf4e8d0 2024-09-11T00:12:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.186+0000 7f8bc9c00640 1 -- 172.21.15.33:0/1685097731 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4037040 con 0x55942bf4e8d0 2024-09-11T00:12:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 -- 172.21.15.33:0/1685097731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 msgr2=0x55942bf47950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf47950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4005d00 tx=0x7f8bc4005f90 comp rx=0 tx=0).stop 2024-09-11T00:12:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 -- 172.21.15.33:0/1685097731 shutdown_connections 2024-09-11T00:12:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf47e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf47950 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 --2- 172.21.15.33:0/1685097731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 -- 172.21.15.33:0/1685097731 >> 172.21.15.33:0/1685097731 conn(0x55942bf470f0 msgr2=0x55942bf516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 -- 172.21.15.33:0/1685097731 shutdown_connections 2024-09-11T00:12:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.187+0000 7f8be3066740 1 -- 172.21.15.33:0/1685097731 wait complete. 2024-09-11T00:12:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.188+0000 7f8be3066740 1 -- start start 2024-09-11T00:12:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.188+0000 7f8be3066740 1 Processor -- start 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf5aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81a7a20 con 0x55942bf51310 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81a8e90 con 0x55942bf4e8d0 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81a80f0 con 0x55942bf4bfa0 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.189+0000 7f8be3066740 10 client.0 _ll_register_callbacks cb 0x7f8bd00076d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.190+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.190+0000 7f8bdd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.190+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:49308/0 (socket says 172.21.15.33:49308) 2024-09-11T00:12:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.190+0000 7f8bdcc00640 1 -- 172.21.15.33:0/3116350510 learned_addr learned my addr 172.21.15.33:0/3116350510 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 -- 172.21.15.33:0/3116350510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 msgr2=0x55942bf597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 -- 172.21.15.33:0/3116350510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 msgr2=0x55942bf5aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf5aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 -- 172.21.15.33:0/3116350510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55942bf5b270 con 0x55942bf4e8d0 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bdcc00640 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402a860 tx=0x7f8bc4005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4106a93534bc390 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.191+0000 7f8bbea00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.192+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc404a040 con 0x55942bf4e8d0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.192+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8bc40306b0 con 0x55942bf4e8d0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.192+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55942beb40b0 con 0x55942bf4e8d0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.193+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8bc4037040 con 0x55942bf4e8d0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.193+0000 7f8be3066740 10 client.36962 fetch_fsmap learned FSMap version 30 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.193+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55942bf5c5e0 con 0x55942bf4e8d0 2024-09-11T00:12:46.195 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.194+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55942beb40b0 con 0x55942bf4e8d0 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.194+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f8bc4004910 con 0x55942bf4e8d0 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.194+0000 7f8be3066740 10 client.36962 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.194+0000 7f8be3066740 10 client.36962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.195+0000 7f8be3066740 20 client.36962 populate_metadata read hostname 'smithi033' 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.195+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf5c9e0 0x55942bf5cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.195+0000 7f8be3066740 4 client.36962 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:12:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.195+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55942beb14e0 con 0x55942bf5c9e0 2024-09-11T00:12:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.195+0000 7f8bdd600640 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf5c9e0 0x55942bf5cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.199+0000 7f8bdd600640 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf5c9e0 0x55942bf5cdf0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7535f3c47d58482 server_cookie=66a47c78d73f55dc in_seq=0 out_seq=0 2024-09-11T00:12:46.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:46.199+0000 7f8bbea00640 10 client.36962 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:46 smithi033 ceph-mon[30593]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 535 op/s 2024-09-11T00:12:47.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:46 smithi189 ceph-mon[34000]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 535 op/s 2024-09-11T00:12:47.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:46 smithi052 ceph-mon[33526]: pgmap v916: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.2 MiB/s wr, 535 op/s 2024-09-11T00:12:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 780.0 s, 627.2 tps, lat 159.635 ms stddev 83.756 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.476+0000 7f8bbea00640 1 -- 172.21.15.33:0/3116350510 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55942beb14e0 con 0x55942bf5c9e0 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.476+0000 7f8bbea00640 10 client.36962 handle_command_reply: tid=0 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.476+0000 7f8be3066740 1 client.36962 shutdown 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.476+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 msgr2=0x55942bf59e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.476+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8bc402a860 tx=0x7f8bc4005780 comp rx=0 tx=0).stop 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 shutdown_connections 2024-09-11T00:12:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55942bf51310 0x55942bf5aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55942bf4e8d0 0x55942bf59e70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55942bf5c9e0 0x55942bf5cdf0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 --2- 172.21.15.33:0/3116350510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55942bf4bfa0 0x55942bf597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 >> 172.21.15.33:0/3116350510 conn(0x55942bf470f0 msgr2=0x55942bf47950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8bbea00640 0 client.36962 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 shutdown_connections 2024-09-11T00:12:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 1 -- 172.21.15.33:0/3116350510 wait complete. 2024-09-11T00:12:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.477+0000 7f8be3066740 20 client.36962 trim_cache size 0 max 16384 2024-09-11T00:12:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:12:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:12:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:12:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:12:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.479+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 msgr2=0x7f8bc00b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.479+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 0x7f8bc00b7970 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007f90 tx=0x7f8bd0007540 comp rx=0 tx=0).stop 2024-09-11T00:12:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.479+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 msgr2=0x7f8bd819ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.479+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00e9c0 tx=0x7f8bcc00ee80 comp rx=0 tx=0).stop 2024-09-11T00:12:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 shutdown_connections 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8bc00b54b0 0x7f8bc00b7970 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bd810a890 0x7f8bd819c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bd8107ed0 0x7f8bd819b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 --2- 172.21.15.33:0/2126324304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8bd806b300 0x7f8bd819ae70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 >> 172.21.15.33:0/2126324304 conn(0x7f8bd80fd140 msgr2=0x7f8bd8108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 shutdown_connections 2024-09-11T00:12:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:12:48.480+0000 7f8be0000640 1 -- 172.21.15.33:0/2126324304 wait complete. 2024-09-11T00:12:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:48 smithi033 ceph-mon[30593]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:49.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:48 smithi189 ceph-mon[34000]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:49.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:48 smithi052 ceph-mon[33526]: pgmap v917: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:50 smithi033 ceph-mon[30593]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T00:12:51.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:50 smithi189 ceph-mon[34000]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T00:12:51.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:50 smithi052 ceph-mon[33526]: pgmap v918: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.7 MiB/s wr, 621 op/s 2024-09-11T00:12:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:52 smithi033 ceph-mon[30593]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.8 MiB/s wr, 630 op/s 2024-09-11T00:12:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:52 smithi189 ceph-mon[34000]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.8 MiB/s wr, 630 op/s 2024-09-11T00:12:53.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:52 smithi052 ceph-mon[33526]: pgmap v919: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.8 MiB/s wr, 630 op/s 2024-09-11T00:12:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 785.0 s, 629.0 tps, lat 159.392 ms stddev 48.858 2024-09-11T00:12:55.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:54 smithi033 ceph-mon[30593]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-11T00:12:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:54 smithi189 ceph-mon[34000]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-11T00:12:55.208 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:54 smithi052 ceph-mon[33526]: pgmap v920: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 692 op/s 2024-09-11T00:12:57.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:56 smithi033 ceph-mon[30593]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 555 op/s 2024-09-11T00:12:57.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:56 smithi189 ceph-mon[34000]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 555 op/s 2024-09-11T00:12:57.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:56 smithi052 ceph-mon[33526]: pgmap v921: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 555 op/s 2024-09-11T00:12:58.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:12:57 smithi189 ceph-mon[34000]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:58.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:12:57 smithi052 ceph-mon[33526]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:58.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:12:57 smithi033 ceph-mon[30593]: pgmap v922: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-09-11T00:12:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 790.0 s, 638.8 tps, lat 156.447 ms stddev 72.054 2024-09-11T00:13:00.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:00 smithi189 ceph-mon[34000]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2024-09-11T00:13:00.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:00 smithi052 ceph-mon[33526]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2024-09-11T00:13:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:00 smithi033 ceph-mon[30593]: pgmap v923: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2024-09-11T00:13:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.787+0000 7f0068c00640 1 -- 172.21.15.33:0/939795080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00641018a0 msgr2=0x7f0064101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.787+0000 7f0068c00640 1 --2- 172.21.15.33:0/939795080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00641018a0 0x7f0064101d20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c02a400 comp rx=0 tx=0).stop 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.788+0000 7f0068c00640 1 -- 172.21.15.33:0/939795080 shutdown_connections 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.788+0000 7f0068c00640 1 --2- 172.21.15.33:0/939795080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064102260 0x7f0064102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.788+0000 7f0068c00640 1 --2- 172.21.15.33:0/939795080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00641018a0 0x7f0064101d20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.789+0000 7f0068c00640 1 --2- 172.21.15.33:0/939795080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0064100920 0x7f0064100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.789+0000 7f0068c00640 1 -- 172.21.15.33:0/939795080 >> 172.21.15.33:0/939795080 conn(0x7f00640fc440 msgr2=0x7f00640fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.789+0000 7f0068c00640 1 -- 172.21.15.33:0/939795080 shutdown_connections 2024-09-11T00:13:01.791 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.790+0000 7f0068c00640 1 -- 172.21.15.33:0/939795080 wait complete. 2024-09-11T00:13:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.792+0000 7f0068c00640 1 Processor -- start 2024-09-11T00:13:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.793+0000 7f0068c00640 1 -- start start 2024-09-11T00:13:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.795+0000 7f0068c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 0x7f0064108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.795+0000 7f0068c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 0x7f0064108bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.795+0000 7f0068c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 0x7f00641097e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0068c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0064105290 con 0x7f00641018a0 2024-09-11T00:13:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 0x7f0064108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 0x7f0064108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56580/0 (socket says 172.21.15.33:56580) 2024-09-11T00:13:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0061e00640 1 -- 172.21.15.33:0/3622966179 learned_addr learned my addr 172.21.15.33:0/3622966179 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0064105110 con 0x7f0064100920 2024-09-11T00:13:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.796+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0064105410 con 0x7f0064102260 2024-09-11T00:13:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.797+0000 7f0062800640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 0x7f00641097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f0062800640 1 -- 172.21.15.33:0/3622966179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 msgr2=0x7f0064108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f0062800640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 0x7f0064108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f0062800640 1 -- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 msgr2=0x7f0064108bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f005be00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 0x7f0064108bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f0062800640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 0x7f0064108bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f0062800640 1 -- 172.21.15.33:0/3622966179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006410a0a0 con 0x7f0064102260 2024-09-11T00:13:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.798+0000 7f005be00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 0x7f0064108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.800+0000 7f0062800640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 0x7f00641097e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f005c00be20 tx=0x7f005c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.801+0000 7f005aa00640 1 -- 172.21.15.33:0/3622966179 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c019070 con 0x7f0064102260 2024-09-11T00:13:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.802+0000 7f005aa00640 1 -- 172.21.15.33:0/3622966179 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f005c0148d0 con 0x7f0064102260 2024-09-11T00:13:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.802+0000 7f005aa00640 1 -- 172.21.15.33:0/3622966179 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0127e0 con 0x7f0064102260 2024-09-11T00:13:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.802+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006410a390 con 0x7f0064102260 2024-09-11T00:13:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.802+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006410cac0 con 0x7f0064102260 2024-09-11T00:13:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.806+0000 7f006bbef740 1 Processor -- start 2024-09-11T00:13:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.806+0000 7f006bbef740 1 -- start start 2024-09-11T00:13:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbd3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 0x55660dbd64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55660db446b0 con 0x55660dbd40c0 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55660db33ae0 con 0x55660dbd1790 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.807+0000 7f006bbef740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55660db378f0 con 0x55660dbd6b00 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.808+0000 7f005be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.808+0000 7f005be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50726/0 (socket says 172.21.15.33:50726) 2024-09-11T00:13:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.808+0000 7f005be00640 1 -- 172.21.15.33:0/3157534781 learned_addr learned my addr 172.21.15.33:0/3157534781 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.808+0000 7f005be00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbd3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.808+0000 7f0061e00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 0x55660dbd64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 -- 172.21.15.33:0/3157534781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 msgr2=0x55660dbd3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbd3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 -- 172.21.15.33:0/3157534781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 msgr2=0x55660dbd64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 0x55660dbd64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 -- 172.21.15.33:0/3157534781 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660db00780 con 0x55660dbd6b00 2024-09-11T00:13:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f0061e00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 0x55660dbd64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.809+0000 7f005be00640 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f004c0045a0 tx=0x7f004c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ab306c5545f63d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.810+0000 7f0053000640 1 -- 172.21.15.33:0/3157534781 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c043020 con 0x55660dbd6b00 2024-09-11T00:13:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.810+0000 7f0053000640 1 -- 172.21.15.33:0/3157534781 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c003d80 con 0x55660dbd6b00 2024-09-11T00:13:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.810+0000 7f0053000640 1 -- 172.21.15.33:0/3157534781 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c035030 con 0x55660dbd6b00 2024-09-11T00:13:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.811+0000 7f006bbef740 1 -- 172.21.15.33:0/3157534781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 msgr2=0x55660dbd8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.811+0000 7f006bbef740 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f004c0045a0 tx=0x7f004c000bc0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.811+0000 7f005aa00640 1 -- 172.21.15.33:0/3622966179 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f005c014440 con 0x7f0064102260 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 -- 172.21.15.33:0/3157534781 shutdown_connections 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd6b00 0x55660dbd8fc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd40c0 0x55660dbd64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 --2- 172.21.15.33:0/3157534781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbd3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 -- 172.21.15.33:0/3157534781 >> 172.21.15.33:0/3157534781 conn(0x55660dbcc8e0 msgr2=0x55660dbcd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.812+0000 7f006bbef740 1 -- 172.21.15.33:0/3157534781 shutdown_connections 2024-09-11T00:13:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.813+0000 7f006bbef740 1 -- 172.21.15.33:0/3157534781 wait complete. 2024-09-11T00:13:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.813+0000 7f006bbef740 1 -- start start 2024-09-11T00:13:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.814+0000 7f006bbef740 1 Processor -- start 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f005aa00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 0x7f00480b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f005aa00640 1 -- 172.21.15.33:0/3622966179 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f005c0e5990 con 0x7f0064102260 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55660da6bab0 con 0x55660dbd6b00 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55660dada570 con 0x55660dbd1790 2024-09-11T00:13:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55660dbeaa90 con 0x55660dbd40c0 2024-09-11T00:13:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.815+0000 7f006bbef740 10 client.0 _ll_register_callbacks cb 0x55660dae9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.816+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.816+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbebf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56600/0 (socket says 172.21.15.33:56600) 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.816+0000 7f0061e00640 1 -- 172.21.15.33:0/1110479677 learned_addr learned my addr 172.21.15.33:0/1110479677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.816+0000 7f0062800640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f005be00640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f005be00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 0x7f00480b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f0062800640 1 -- 172.21.15.33:0/1110479677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 msgr2=0x55660dbec5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f0062800640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f0062800640 1 -- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 msgr2=0x55660dbebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f0062800640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.817+0000 7f0062800640 1 -- 172.21.15.33:0/1110479677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660d895790 con 0x55660dbd6b00 2024-09-11T00:13:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.818+0000 7f005be00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 0x7f00480b78c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.819+0000 7f0062800640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbed1a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f005c0e3090 tx=0x7f005c0ab4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6855ad3a00fbdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.819+0000 7f0047400640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.820+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c0abd50 con 0x55660dbd6b00 2024-09-11T00:13:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.820+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f005c0b3bb0 con 0x55660dbd6b00 2024-09-11T00:13:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.820+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c003d80 con 0x55660dbd6b00 2024-09-11T00:13:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.820+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f005c0b0830 con 0x55660dbd6b00 2024-09-11T00:13:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.821+0000 7f006bbef740 10 client.17058 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.821+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55660d90e620 con 0x55660dbd6b00 2024-09-11T00:13:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c003d80 con 0x55660dbd6b00 2024-09-11T00:13:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f005c0aaa20 con 0x55660dbd6b00 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 10 client.17058 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 10 client.17058 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 20 client.17058 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dbf7750 0x55660dbf9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 4 client.17058 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.823+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55660db46600 con 0x55660dbf7750 2024-09-11T00:13:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.824+0000 7f0061e00640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dbf7750 0x55660dbf9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.826+0000 7f0061e00640 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dbf7750 0x55660dbf9b60 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70065f33a4909a8a server_cookie=ee8bcf5d7f8a905a in_seq=0 out_seq=0 2024-09-11T00:13:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.826+0000 7f0047400640 10 client.17058 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.827+0000 7f0047400640 1 -- 172.21.15.33:0/1110479677 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55660db46600 con 0x55660dbf7750 2024-09-11T00:13:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.827+0000 7f0047400640 10 client.17058 handle_command_reply: tid=0 2024-09-11T00:13:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.827+0000 7f006bbef740 1 client.17058 shutdown 2024-09-11T00:13:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.828+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 msgr2=0x55660dbed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.828+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbed1a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f005c0e3090 tx=0x7f005c0ab4c0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 shutdown_connections 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbed1a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dbf7750 0x55660dbf9b60 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbec5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 --2- 172.21.15.33:0/1110479677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 >> 172.21.15.33:0/1110479677 conn(0x55660dbcc8e0 msgr2=0x55660dbcba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f0047400640 0 client.17058 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.829+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 shutdown_connections 2024-09-11T00:13:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.830+0000 7f006bbef740 1 -- 172.21.15.33:0/1110479677 wait complete. 2024-09-11T00:13:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.830+0000 7f006bbef740 20 client.17058 trim_cache size 0 max 16384 2024-09-11T00:13:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 Processor -- start 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 -- start start 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbcec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00641b43d0 con 0x55660dbd6b00 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00641b1ca0 con 0x55660dbd1790 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.866+0000 7f006bbef740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0064073270 con 0x55660dbd40c0 2024-09-11T00:13:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.867+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.867+0000 7f005be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.867+0000 7f005be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:50744/0 (socket says 172.21.15.33:50744) 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.867+0000 7f005be00640 1 -- 172.21.15.33:0/1233875838 learned_addr learned my addr 172.21.15.33:0/1233875838 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.867+0000 7f0062800640 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbcec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.868+0000 7f005be00640 1 -- 172.21.15.33:0/1233875838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 msgr2=0x55660dbce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.868+0000 7f005be00640 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.871 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.868+0000 7f005be00640 1 -- 172.21.15.33:0/1233875838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 msgr2=0x55660dbcec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.868+0000 7f005be00640 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbcec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.868+0000 7f005be00640 1 -- 172.21.15.33:0/1233875838 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660dbd3ef0 con 0x55660dbd40c0 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.869+0000 7f005be00640 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f004c005dc0 tx=0x7f004c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0352708226c9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.869+0000 7f0052600640 1 -- 172.21.15.33:0/1233875838 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c043030 con 0x55660dbd40c0 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.870+0000 7f0052600640 1 -- 172.21.15.33:0/1233875838 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c003c40 con 0x55660dbd40c0 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.870+0000 7f0052600640 1 -- 172.21.15.33:0/1233875838 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c050070 con 0x55660dbd40c0 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.871+0000 7f006bbef740 1 -- 172.21.15.33:0/1233875838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 msgr2=0x55660dbf4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.871+0000 7f006bbef740 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f004c005dc0 tx=0x7f004c000bc0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 -- 172.21.15.33:0/1233875838 shutdown_connections 2024-09-11T00:13:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbcec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf4220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 --2- 172.21.15.33:0/1233875838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 -- 172.21.15.33:0/1233875838 >> 172.21.15.33:0/1233875838 conn(0x55660dbcc8e0 msgr2=0x55660dbd6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.874+0000 7f006bbef740 1 -- 172.21.15.33:0/1233875838 shutdown_connections 2024-09-11T00:13:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.875+0000 7f006bbef740 1 -- 172.21.15.33:0/1233875838 wait complete. 2024-09-11T00:13:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.876+0000 7f006bbef740 1 -- start start 2024-09-11T00:13:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.876+0000 7f006bbef740 1 Processor -- start 2024-09-11T00:13:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbf1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00640738e0 con 0x55660dbd6b00 2024-09-11T00:13:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0064074d50 con 0x55660dbd1790 2024-09-11T00:13:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0064073fb0 con 0x55660dbd40c0 2024-09-11T00:13:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.877+0000 7f006bbef740 10 client.0 _ll_register_callbacks cb 0x7f005c0147e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:56620/0 (socket says 172.21.15.33:56620) 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 -- 172.21.15.33:0/687642998 learned_addr learned my addr 172.21.15.33:0/687642998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f005be00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 -- 172.21.15.33:0/687642998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 msgr2=0x55660dbf3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0062800640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbf1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.878+0000 7f0061e00640 1 -- 172.21.15.33:0/687642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 msgr2=0x55660dbf1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.879+0000 7f0061e00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbf1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.879+0000 7f0061e00640 1 -- 172.21.15.33:0/687642998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660dbf3f90 con 0x55660dbd1790 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.879+0000 7f0062800640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbf1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.879+0000 7f0061e00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55660dbfa410 tx=0x7f0054011ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cb4f3ae4501cf93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.879+0000 7f0047400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:13:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.880+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005401d740 con 0x55660dbd1790 2024-09-11T00:13:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.880+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f005401d8e0 con 0x55660dbd1790 2024-09-11T00:13:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.881+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004c003c40 con 0x55660dbd1790 2024-09-11T00:13:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.882+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f005401dae0 con 0x55660dbd1790 2024-09-11T00:13:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.882+0000 7f006bbef740 10 client.36974 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.882+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55660dc64d80 con 0x55660dbd1790 2024-09-11T00:13:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f004c003c40 con 0x55660dbd1790 2024-09-11T00:13:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f005400f420 con 0x55660dbd1790 2024-09-11T00:13:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 10 client.36974 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 10 client.36974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 20 client.36974 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dc657b0 0x55660dc67bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 4 client.36974 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:13:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.883+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55660db420b0 con 0x55660dc657b0 2024-09-11T00:13:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.885+0000 7f005be00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dc657b0 0x55660dc67bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.886+0000 7f005be00640 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dc657b0 0x55660dc67bd0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d4688960e5a0d3 server_cookie=f7dd7871faaaf756 in_seq=0 out_seq=0 2024-09-11T00:13:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.886+0000 7f0047400640 10 client.36974 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.911+0000 7f0047400640 1 -- 172.21.15.33:0/687642998 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55660db420b0 con 0x55660dc657b0 2024-09-11T00:13:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.911+0000 7f0047400640 10 client.36974 handle_command_reply: tid=0 2024-09-11T00:13:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.912+0000 7f006bbef740 1 client.36974 shutdown 2024-09-11T00:13:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.912+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 msgr2=0x55660dbf31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55660dbfa410 tx=0x7f0054011ae0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 shutdown_connections 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55660dbd6b00 0x55660dbf1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55660dc657b0 0x55660dc67bd0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55660dbd40c0 0x55660dbf3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f0047400640 0 client.36974 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 --2- 172.21.15.33:0/687642998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55660dbd1790 0x55660dbf31c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.913+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 >> 172.21.15.33:0/687642998 conn(0x55660dbcc8e0 msgr2=0x55660dbcb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.915+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 shutdown_connections 2024-09-11T00:13:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.915+0000 7f006bbef740 1 -- 172.21.15.33:0/687642998 wait complete. 2024-09-11T00:13:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.915+0000 7f006bbef740 20 client.36974 trim_cache size 0 max 16384 2024-09-11T00:13:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:13:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:13:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:13:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:13:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.917+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 msgr2=0x7f00480b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.917+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 0x7f00480b78c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f004c009900 tx=0x7f004c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.917+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 msgr2=0x7f00641097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.917+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 0x7f00641097e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f005c00be20 tx=0x7f005c00bf10 comp rx=0 tx=0).stop 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 shutdown_connections 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f00480b5400 0x7f00480b78c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064102260 0x7f00641097e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00641018a0 0x7f0064108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 --2- 172.21.15.33:0/3622966179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064100920 0x7f0064108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.918+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 >> 172.21.15.33:0/3622966179 conn(0x7f00640fc440 msgr2=0x7f00640fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.919+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 shutdown_connections 2024-09-11T00:13:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:01.919+0000 7f0068c00640 1 -- 172.21.15.33:0/3622966179 wait complete. 2024-09-11T00:13:02.584 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:02 smithi189 ceph-mon[34000]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.9 MiB/s wr, 600 op/s 2024-09-11T00:13:02.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:02 smithi052 ceph-mon[33526]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.9 MiB/s wr, 600 op/s 2024-09-11T00:13:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:02 smithi033 ceph-mon[30593]: pgmap v924: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.9 MiB/s wr, 600 op/s 2024-09-11T00:13:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 795.0 s, 665.6 tps, lat 149.782 ms stddev 42.972 2024-09-11T00:13:04.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:04 smithi189 ceph-mon[34000]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-09-11T00:13:04.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:04 smithi052 ceph-mon[33526]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-09-11T00:13:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:04 smithi033 ceph-mon[30593]: pgmap v925: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-09-11T00:13:06.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:06 smithi052 ceph-mon[33526]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2024-09-11T00:13:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:06 smithi033 ceph-mon[30593]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2024-09-11T00:13:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:06 smithi189 ceph-mon[34000]: pgmap v926: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2024-09-11T00:13:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 800.0 s, 636.6 tps, lat 157.408 ms stddev 64.652 2024-09-11T00:13:08.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:08 smithi052 ceph-mon[33526]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T00:13:08.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:08 smithi033 ceph-mon[30593]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T00:13:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:08 smithi189 ceph-mon[34000]: pgmap v927: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-11T00:13:10.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:10 smithi052 ceph-mon[33526]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:13:10.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:10 smithi033 ceph-mon[30593]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:13:10.817 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.8 2024-09-11T00:13:10.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:10.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:10 smithi189 ceph-mon[34000]: pgmap v928: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-09-11T00:13:11.649 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:12.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:12 smithi033 ceph-mon[30593]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2024-09-11T00:13:12.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:12 smithi052 ceph-mon[33526]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2024-09-11T00:13:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:12 smithi189 ceph-mon[34000]: pgmap v929: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2024-09-11T00:13:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 805.0 s, 609.4 tps, lat 163.671 ms stddev 52.325 2024-09-11T00:13:14.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:14 smithi052 ceph-mon[33526]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T00:13:14.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:14 smithi033 ceph-mon[30593]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T00:13:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:14 smithi189 ceph-mon[34000]: pgmap v930: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-11T00:13:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 -- 172.21.15.33:0/1666708613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 msgr2=0x7fa14c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 --2- 172.21.15.33:0/1666708613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c100c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa134009900 tx=0x7fa13402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 -- 172.21.15.33:0/1666708613 shutdown_connections 2024-09-11T00:13:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 --2- 172.21.15.33:0/1666708613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 0x7fa14c102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 --2- 172.21.15.33:0/1666708613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 --2- 172.21.15.33:0/1666708613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c100c60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 -- 172.21.15.33:0/1666708613 >> 172.21.15.33:0/1666708613 conn(0x7fa14c0fc440 msgr2=0x7fa14c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 -- 172.21.15.33:0/1666708613 shutdown_connections 2024-09-11T00:13:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.231+0000 7fa151600640 1 -- 172.21.15.33:0/1666708613 wait complete. 2024-09-11T00:13:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.233+0000 7fa151600640 1 Processor -- start 2024-09-11T00:13:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.233+0000 7fa151600640 1 -- start start 2024-09-11T00:13:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.233+0000 7fa151600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.233+0000 7fa151600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa14a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa14a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53148/0 (socket says 172.21.15.33:53148) 2024-09-11T00:13:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa151600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 0x7fa14c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa14a000640 1 -- 172.21.15.33:0/423101780 learned_addr learned my addr 172.21.15.33:0/423101780 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c1106e0 con 0x7fa14c100860 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c110560 con 0x7fa14c102260 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c110860 con 0x7fa14c1018a0 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.234+0000 7fa14aa00640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14b400640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 0x7fa14c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14a000640 1 -- 172.21.15.33:0/423101780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 msgr2=0x7fa14c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14a000640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 0x7fa14c072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14a000640 1 -- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 msgr2=0x7fa14c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14a000640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.235+0000 7fa14a000640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0737c0 con 0x7fa14c1018a0 2024-09-11T00:13:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.236+0000 7fa14a000640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00eb90 tx=0x7fa13c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.236+0000 7fa143400640 1 -- 172.21.15.33:0/423101780 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c017dd0 con 0x7fa14c1018a0 2024-09-11T00:13:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.237+0000 7fa143400640 1 -- 172.21.15.33:0/423101780 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa13c00ee90 con 0x7fa14c1018a0 2024-09-11T00:13:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.237+0000 7fa143400640 1 -- 172.21.15.33:0/423101780 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0059d0 con 0x7fa14c1018a0 2024-09-11T00:13:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.237+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c073ab0 con 0x7fa14c1018a0 2024-09-11T00:13:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.237+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c074150 con 0x7fa14c1018a0 2024-09-11T00:13:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.243+0000 7fa154634740 1 Processor -- start 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.243+0000 7fa154634740 1 -- start start 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a764b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a76b00 0x55a774a78fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a7749e46b0 con 0x55a774a740c0 2024-09-11T00:13:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7749d3ae0 con 0x55a774a71790 2024-09-11T00:13:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa154634740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a7749d78f0 con 0x55a774a76b00 2024-09-11T00:13:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa14b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa14b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52148/0 (socket says 172.21.15.33:52148) 2024-09-11T00:13:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.244+0000 7fa14b400640 1 -- 172.21.15.33:0/980866989 learned_addr learned my addr 172.21.15.33:0/980866989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.245+0000 7fa14aa00640 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14b400640 1 -- 172.21.15.33:0/980866989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a76b00 msgr2=0x55a774a78fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:13:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14b400640 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a76b00 0x55a774a78fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14b400640 1 -- 172.21.15.33:0/980866989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 msgr2=0x55a774a764b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14b400640 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a764b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14b400640 1 -- 172.21.15.33:0/980866989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7749a0780 con 0x55a774a71790 2024-09-11T00:13:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.246+0000 7fa14aa00640 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a764b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.247+0000 7fa14b400640 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bb0 tx=0x7fa1440117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2626beb35ac9632c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.248+0000 7fa13b400640 1 -- 172.21.15.33:0/980866989 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144012450 con 0x55a774a71790 2024-09-11T00:13:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.248+0000 7fa143400640 1 -- 172.21.15.33:0/423101780 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa13c004b20 con 0x7fa14c1018a0 2024-09-11T00:13:15.252 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.248+0000 7fa13b400640 1 -- 172.21.15.33:0/980866989 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa144012a80 con 0x55a774a71790 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.248+0000 7fa13b400640 1 -- 172.21.15.33:0/980866989 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144012450 con 0x55a774a71790 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 -- 172.21.15.33:0/980866989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 msgr2=0x55a774a73b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bb0 tx=0x7fa1440117b0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 -- 172.21.15.33:0/980866989 shutdown_connections 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a76b00 0x55a774a78fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a764b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 --2- 172.21.15.33:0/980866989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a73b80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.249+0000 7fa154634740 1 -- 172.21.15.33:0/980866989 >> 172.21.15.33:0/980866989 conn(0x55a774a6c8e0 msgr2=0x55a774a6d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.250+0000 7fa154634740 1 -- 172.21.15.33:0/980866989 shutdown_connections 2024-09-11T00:13:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.251+0000 7fa154634740 1 -- 172.21.15.33:0/980866989 wait complete. 2024-09-11T00:13:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.251+0000 7fa143400640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 0x7fa1300b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.251+0000 7fa143400640 1 -- 172.21.15.33:0/423101780 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa13c0ee870 con 0x7fa14c1018a0 2024-09-11T00:13:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.252+0000 7fa14aa00640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 0x7fa1300b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.252+0000 7fa154634740 1 -- start start 2024-09-11T00:13:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.253+0000 7fa154634740 1 Processor -- start 2024-09-11T00:13:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.254+0000 7fa14aa00640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 0x7fa1300b7800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa134006010 tx=0x7fa134005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a71790 0x55a774a7af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a7b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a7c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a77490bab0 con 0x55a774a740c0 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a77497a570 con 0x55a774a76b00 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a774a79ae0 con 0x55a774a71790 2024-09-11T00:13:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa14a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a7b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa154634740 10 client.0 _ll_register_callbacks cb 0x55a774989100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa14aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a71790 0x55a774a7af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa14a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a7b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37032/0 (socket says 172.21.15.33:37032) 2024-09-11T00:13:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa14a000640 1 -- 172.21.15.33:0/3072937270 learned_addr learned my addr 172.21.15.33:0/3072937270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.255+0000 7fa14b400640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a7c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.256+0000 7fa14b400640 1 -- 172.21.15.33:0/3072937270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a71790 msgr2=0x55a774a7af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.256+0000 7fa14b400640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a71790 0x55a774a7af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.256+0000 7fa14b400640 1 -- 172.21.15.33:0/3072937270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 msgr2=0x55a774a7b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.256+0000 7fa14b400640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a7b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.256+0000 7fa14b400640 1 -- 172.21.15.33:0/3072937270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a774735790 con 0x55a774a76b00 2024-09-11T00:13:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.257+0000 7fa14b400640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a7c1b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bb0 tx=0x7fa144012450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00fd6ffdf9b95ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.257+0000 7fa12fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:13:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.257+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144028070 con 0x55a774a76b00 2024-09-11T00:13:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.258+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa144004040 con 0x55a774a76b00 2024-09-11T00:13:15.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.258+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa144012a80 con 0x55a774a76b00 2024-09-11T00:13:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.258+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa144032050 con 0x55a774a76b00 2024-09-11T00:13:15.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.258+0000 7fa154634740 10 client.36986 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a7747ae620 con 0x55a774a76b00 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa144012a80 con 0x55a774a76b00 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa14400f590 con 0x55a774a76b00 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa154634740 10 client.36986 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa154634740 10 client.36986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.259+0000 7fa154634740 20 client.36986 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.260+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774a86580 0x55a774a88970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.260+0000 7fa154634740 4 client.36986 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.260+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7749e6600 con 0x55a774a86580 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.260+0000 7fa14aa00640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774a86580 0x55a774a88970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.261+0000 7fa14aa00640 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774a86580 0x55a774a88970 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2f81f92b41aff1 server_cookie=5061aefc38c8e1e4 in_seq=0 out_seq=0 2024-09-11T00:13:15.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.261+0000 7fa12fe00640 10 client.36986 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.262+0000 7fa12fe00640 1 -- 172.21.15.33:0/3072937270 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7749e6600 con 0x55a774a86580 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.262+0000 7fa12fe00640 10 client.36986 handle_command_reply: tid=0 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.263+0000 7fa154634740 1 client.36986 shutdown 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 msgr2=0x55a774a7c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a7c1b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa144009bb0 tx=0x7fa144012450 comp rx=0 tx=0).stop 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 shutdown_connections 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a7c1b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.268 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a740c0 0x55a774a7b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774a86580 0x55a774a88970 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 --2- 172.21.15.33:0/3072937270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a71790 0x55a774a7af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 >> 172.21.15.33:0/3072937270 conn(0x55a774a6c8e0 msgr2=0x55a774a6ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.264+0000 7fa12fe00640 0 client.36986 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.265+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 shutdown_connections 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.265+0000 7fa154634740 1 -- 172.21.15.33:0/3072937270 wait complete. 2024-09-11T00:13:15.269 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.265+0000 7fa154634740 20 client.36986 trim_cache size 0 max 16384 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.306+0000 7fa154634740 1 Processor -- start 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.306+0000 7fa154634740 1 -- start start 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 0x55a774a7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a76f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa128012550 con 0x55a774a71790 2024-09-11T00:13:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa12800fe20 con 0x55a774a76b00 2024-09-11T00:13:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa154634740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa12800dc70 con 0x55a774a740c0 2024-09-11T00:13:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa14b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa14b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52176/0 (socket says 172.21.15.33:52176) 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa14b400640 1 -- 172.21.15.33:0/4211332524 learned_addr learned my addr 172.21.15.33:0/4211332524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.307+0000 7fa14aa00640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 0x55a774a7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14a000640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a76f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14b400640 1 -- 172.21.15.33:0/4211332524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 msgr2=0x55a774a76f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14b400640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a76f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14b400640 1 -- 172.21.15.33:0/4211332524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 msgr2=0x55a774a7a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14b400640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 0x55a774a7a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.308+0000 7fa14b400640 1 -- 172.21.15.33:0/4211332524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a774a73ef0 con 0x55a774a76b00 2024-09-11T00:13:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.309+0000 7fa14a000640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a76f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.309+0000 7fa14aa00640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 0x55a774a7a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.309+0000 7fa14b400640 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa14400f930 tx=0x7fa144012540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1899ff176a0d1e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.310+0000 7fa13aa00640 1 -- 172.21.15.33:0/4211332524 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144028040 con 0x55a774a76b00 2024-09-11T00:13:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.310+0000 7fa13aa00640 1 -- 172.21.15.33:0/4211332524 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa144011cb0 con 0x55a774a76b00 2024-09-11T00:13:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.310+0000 7fa13aa00640 1 -- 172.21.15.33:0/4211332524 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144005330 con 0x55a774a76b00 2024-09-11T00:13:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 -- 172.21.15.33:0/4211332524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 msgr2=0x55a774a77470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa14400f930 tx=0x7fa144012540 comp rx=0 tx=0).stop 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 -- 172.21.15.33:0/4211332524 shutdown_connections 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a76b00 0x55a774a77470 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a76f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 --2- 172.21.15.33:0/4211332524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a71790 0x55a774a7a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 -- 172.21.15.33:0/4211332524 >> 172.21.15.33:0/4211332524 conn(0x55a774a6c8e0 msgr2=0x55a774a70cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.311+0000 7fa154634740 1 -- 172.21.15.33:0/4211332524 shutdown_connections 2024-09-11T00:13:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.312+0000 7fa154634740 1 -- 172.21.15.33:0/4211332524 wait complete. 2024-09-11T00:13:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.312+0000 7fa154634740 1 -- start start 2024-09-11T00:13:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.313+0000 7fa154634740 1 Processor -- start 2024-09-11T00:13:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a82c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 0x55a774a82090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa12800e2e0 con 0x55a774a76b00 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa12800f750 con 0x55a774a71790 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa12800e9b0 con 0x55a774a740c0 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.314+0000 7fa154634740 10 client.0 _ll_register_callbacks cb 0x7fa144009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.315+0000 7fa14a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.315+0000 7fa14a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53176/0 (socket says 172.21.15.33:53176) 2024-09-11T00:13:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.315+0000 7fa14a000640 1 -- 172.21.15.33:0/860338940 learned_addr learned my addr 172.21.15.33:0/860338940 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.315+0000 7fa14aa00640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a82c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.316+0000 7fa14a000640 1 -- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 msgr2=0x55a774a82c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.316+0000 7fa14a000640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a82c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.316+0000 7fa14a000640 1 -- 172.21.15.33:0/860338940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 msgr2=0x55a774a82090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.316+0000 7fa14b400640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 0x55a774a82090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.316+0000 7fa14a000640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 0x55a774a82090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.317+0000 7fa14a000640 1 -- 172.21.15.33:0/860338940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a774a80460 con 0x55a774a740c0 2024-09-11T00:13:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.317+0000 7fa14b400640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 0x55a774a82090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.317+0000 7fa14a000640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0049d0 tx=0x7fa13c0b51d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623205ea7b7e6241 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.317+0000 7fa12fe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:13:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.318+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0b4580 con 0x55a774a740c0 2024-09-11T00:13:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.318+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fa13c0b3e90 con 0x55a774a740c0 2024-09-11T00:13:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.319+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa144011cb0 con 0x55a774a740c0 2024-09-11T00:13:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.320+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa13c0b03a0 con 0x55a774a740c0 2024-09-11T00:13:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.320+0000 7fa154634740 10 client.26953 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.321+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a774af36f0 con 0x55a774a740c0 2024-09-11T00:13:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.321+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa13c0b4740 con 0x55a774a740c0 2024-09-11T00:13:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa13c0b0580 con 0x55a774a740c0 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 10 client.26953 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 10 client.26953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 20 client.26953 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774af4030 0x55a774af6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 4 client.26953 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.322+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa144011cb0 con 0x55a774af4030 2024-09-11T00:13:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.323+0000 7fa14aa00640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774af4030 0x55a774af6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.324+0000 7fa14aa00640 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774af4030 0x55a774af6450 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd22c569f716662 server_cookie=18ae98bffaa2c278 in_seq=0 out_seq=0 2024-09-11T00:13:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.324+0000 7fa12fe00640 10 client.26953 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.354+0000 7fa12fe00640 1 -- 172.21.15.33:0/860338940 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa144011cb0 con 0x55a774af4030 2024-09-11T00:13:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.354+0000 7fa12fe00640 10 client.26953 handle_command_reply: tid=0 2024-09-11T00:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 client.26953 shutdown 2024-09-11T00:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 msgr2=0x55a774a819a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0049d0 tx=0x7fa13c0b51d0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 shutdown_connections 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a774a76b00 0x55a774a82090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a774af4030 0x55a774af6450 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a774a740c0 0x55a774a819a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 --2- 172.21.15.33:0/860338940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a774a71790 0x55a774a82c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 >> 172.21.15.33:0/860338940 conn(0x55a774a6c8e0 msgr2=0x55a774a6d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.358 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.355+0000 7fa12fe00640 0 client.26953 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:15.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.356+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 shutdown_connections 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.357+0000 7fa154634740 1 -- 172.21.15.33:0/860338940 wait complete. 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.357+0000 7fa154634740 20 client.26953 trim_cache size 0 max 16384 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:13:15.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:13:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 msgr2=0x7fa1300b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 0x7fa1300b7800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa134006010 tx=0x7fa134005d50 comp rx=0 tx=0).stop 2024-09-11T00:13:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 msgr2=0x7fa14c0722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00eb90 tx=0x7fa13c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 shutdown_connections 2024-09-11T00:13:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fa1300b5340 0x7fa1300b7800 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa14c102260 0x7fa14c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa14c1018a0 0x7fa14c0722d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 --2- 172.21.15.33:0/423101780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c100860 0x7fa14c071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:15.362 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.360+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 >> 172.21.15.33:0/423101780 conn(0x7fa14c0fc440 msgr2=0x7fa14c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.362+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 shutdown_connections 2024-09-11T00:13:15.363 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:15.362+0000 7fa151600640 1 -- 172.21.15.33:0/423101780 wait complete. 2024-09-11T00:13:16.708 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:16 smithi052 ceph-mon[33526]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 MiB/s wr, 576 op/s 2024-09-11T00:13:16.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:16 smithi033 ceph-mon[30593]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 MiB/s wr, 576 op/s 2024-09-11T00:13:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:16 smithi189 ceph-mon[34000]: pgmap v931: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 MiB/s wr, 576 op/s 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.001+0000 7fe31f800640 1 -- 172.21.15.33:0/3181727144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe318075de0 msgr2=0x7fe31810ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.001+0000 7fe31f800640 1 --2- 172.21.15.33:0/3181727144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe318075de0 0x7fe31810ee90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe304009900 tx=0x7fe30402a400 comp rx=0 tx=0).stop 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.002+0000 7fe31f800640 1 -- 172.21.15.33:0/3181727144 shutdown_connections 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.002+0000 7fe31f800640 1 --2- 172.21.15.33:0/3181727144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31810f3d0 0x7fe3181117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.002+0000 7fe31f800640 1 --2- 172.21.15.33:0/3181727144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe318075de0 0x7fe31810ee90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.002+0000 7fe31f800640 1 --2- 172.21.15.33:0/3181727144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3180754c0 0x7fe3180758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.002+0000 7fe31f800640 1 -- 172.21.15.33:0/3181727144 >> 172.21.15.33:0/3181727144 conn(0x7fe3180fe830 msgr2=0x7fe318100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.003+0000 7fe31f800640 1 -- 172.21.15.33:0/3181727144 shutdown_connections 2024-09-11T00:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.003+0000 7fe31f800640 1 -- 172.21.15.33:0/3181727144 wait complete. 2024-09-11T00:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 Processor -- start 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 -- start start 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3180754c0 0x7fe31810e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe318075de0 0x7fe31810eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181044e0 con 0x7fe318075de0 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe318104360 con 0x7fe3180754c0 2024-09-11T00:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.005+0000 7fe31f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe318104660 con 0x7fe31810f3d0 2024-09-11T00:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.006+0000 7fe31d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.006+0000 7fe31d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:53200/0 (socket says 172.21.15.33:53200) 2024-09-11T00:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.006+0000 7fe31d800640 1 -- 172.21.15.33:0/1820532519 learned_addr learned my addr 172.21.15.33:0/1820532519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.006+0000 7fe31ce00640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3180754c0 0x7fe31810e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe317e00640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe318075de0 0x7fe31810eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe31d800640 1 -- 172.21.15.33:0/1820532519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3180754c0 msgr2=0x7fe31810e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe31d800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3180754c0 0x7fe31810e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe31d800640 1 -- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe318075de0 msgr2=0x7fe31810eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe31d800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe318075de0 0x7fe31810eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.007+0000 7fe31d800640 1 -- 172.21.15.33:0/1820532519 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe318106350 con 0x7fe31810f3d0 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.008+0000 7fe31d800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe310009fd0 tx=0x7fe31000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.009+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004d20 con 0x7fe31810f3d0 2024-09-11T00:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.009+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe310005020 con 0x7fe31810f3d0 2024-09-11T00:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.009+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100116d0 con 0x7fe31810f3d0 2024-09-11T00:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.009+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe318106640 con 0x7fe31810f3d0 2024-09-11T00:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.010+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31810b630 con 0x7fe31810f3d0 2024-09-11T00:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.011+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3180769d0 con 0x7fe31810f3d0 2024-09-11T00:13:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.015+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe31000f040 con 0x7fe31810f3d0 2024-09-11T00:13:17.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.019+0000 7fe315600640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 0x7fe3000b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:17.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.019+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3100e6040 con 0x7fe31810f3d0 2024-09-11T00:13:17.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.021+0000 7fe31ce00640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 0x7fe3000b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:17.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.023+0000 7fe31ce00640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 0x7fe3000b78f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe30c005fd0 tx=0x7fe30c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:17.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.025+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe310016030 con 0x7fe31810f3d0 2024-09-11T00:13:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.471+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31810c080 con 0x7fe31810f3d0 2024-09-11T00:13:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.473+0000 7fe315600640 1 -- 172.21.15.33:0/1820532519 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7fe3100acb60 con 0x7fe31810f3d0 2024-09-11T00:13:17.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:13:17.477 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:13:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:13:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.478+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 msgr2=0x7fe3000b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.478+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 0x7fe3000b78f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe30c005fd0 tx=0x7fe30c00b390 comp rx=0 tx=0).stop 2024-09-11T00:13:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.478+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 msgr2=0x7fe318105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.478+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe310009fd0 tx=0x7fe31000ee60 comp rx=0 tx=0).stop 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 shutdown_connections 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe3000b5430 0x7fe3000b78f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe31810f3d0 0x7fe318105b80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe318075de0 0x7fe31810eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 --2- 172.21.15.33:0/1820532519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3180754c0 0x7fe31810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.481+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 >> 172.21.15.33:0/1820532519 conn(0x7fe3180fe830 msgr2=0x7fe3180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.482+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 shutdown_connections 2024-09-11T00:13:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:17.482+0000 7fe31f800640 1 -- 172.21.15.33:0/1820532519 wait complete. 2024-09-11T00:13:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 810.0 s, 547.4 tps, lat 182.964 ms stddev 56.338 2024-09-11T00:13:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:18 smithi052 ceph-mon[33526]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:13:18.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:18 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1820532519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:18.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:18 smithi033 ceph-mon[30593]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:13:18.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:18 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1820532519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:18 smithi189 ceph-mon[34000]: pgmap v932: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 10 MiB/s wr, 737 op/s 2024-09-11T00:13:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:18 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1820532519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:18.930 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 154.8 --await-for 45.0' 2024-09-11T00:13:18.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 154.8 --await-for 45.0 2024-09-11T00:13:19.708 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:20.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:20 smithi052 ceph-mon[33526]: pgmap v933: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 629 op/s 2024-09-11T00:13:20.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:20 smithi033 ceph-mon[30593]: pgmap v933: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 629 op/s 2024-09-11T00:13:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:20 smithi189 ceph-mon[34000]: pgmap v933: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 629 op/s 2024-09-11T00:13:22.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:22 smithi052 ceph-mon[33526]: pgmap v934: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-11T00:13:22.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:22 smithi033 ceph-mon[30593]: pgmap v934: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-11T00:13:22.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:22 smithi189 ceph-mon[34000]: pgmap v934: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 618 op/s 2024-09-11T00:13:23.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 815.0 s, 536.1 tps, lat 168.006 ms stddev 77.338 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.186+0000 7f830f200640 1 -- 172.21.15.33:0/1962987079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831006f050 msgr2=0x7f831011bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.186+0000 7f830f200640 1 --2- 172.21.15.33:0/1962987079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831006f050 0x7f831011bae0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009860 tx=0x7f82f802a340 comp rx=0 tx=0).stop 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 -- 172.21.15.33:0/1962987079 shutdown_connections 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 --2- 172.21.15.33:0/1962987079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831011c020 0x7f831011e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 --2- 172.21.15.33:0/1962987079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831006f050 0x7f831011bae0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 --2- 172.21.15.33:0/1962987079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 0x7f831006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 -- 172.21.15.33:0/1962987079 >> 172.21.15.33:0/1962987079 conn(0x7f831006c950 msgr2=0x7f831006cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 -- 172.21.15.33:0/1962987079 shutdown_connections 2024-09-11T00:13:24.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.187+0000 7f830f200640 1 -- 172.21.15.33:0/1962987079 wait complete. 2024-09-11T00:13:24.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.188+0000 7f830f200640 1 Processor -- start 2024-09-11T00:13:24.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 -- start start 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 0x7f83101a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 0x7f83101ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f83101218d0 con 0x7f831011c020 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8310121750 con 0x7f831006f050 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.189+0000 7f830f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8310121a50 con 0x7f831006e730 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 0x7f83101ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 0x7f83101ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58484/0 (socket says 172.21.15.33:58484) 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40528/0 (socket says 172.21.15.33:40528) 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830e800640 1 -- 172.21.15.33:0/3777102070 learned_addr learned my addr 172.21.15.33:0/3777102070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:24.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830de00640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 0x7f83101a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 -- 172.21.15.33:0/3777102070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 msgr2=0x7f83101a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 0x7f83101a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 -- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 msgr2=0x7f83101ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 0x7f83101ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.190+0000 7f830d400640 1 -- 172.21.15.33:0/3777102070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83101adeb0 con 0x7f831006f050 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.191+0000 7f830d400640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82f8035040 tx=0x7f82f8030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.191+0000 7f8306a00640 1 -- 172.21.15.33:0/3777102070 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8037040 con 0x7f831006f050 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.192+0000 7f8306a00640 1 -- 172.21.15.33:0/3777102070 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82f8032df0 con 0x7f831006f050 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.192+0000 7f8306a00640 1 -- 172.21.15.33:0/3777102070 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80035f0 con 0x7f831006f050 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.192+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83101ae140 con 0x7f831006f050 2024-09-11T00:13:24.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.192+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101b4860 con 0x7f831006f050 2024-09-11T00:13:24.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.199+0000 7f8306a00640 1 -- 172.21.15.33:0/3777102070 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f82f8004050 con 0x7f831006f050 2024-09-11T00:13:24.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.202+0000 7f8306a00640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 0x7f82f40b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.202+0000 7f8306a00640 1 -- 172.21.15.33:0/3777102070 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f82f81050b0 con 0x7f831006f050 2024-09-11T00:13:24.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.203+0000 7f830de00640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 0x7f82f40b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.208+0000 7f830de00640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 0x7f82f40b7920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f830000bbe0 tx=0x7f830000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.214+0000 7f83178d4740 1 Processor -- start 2024-09-11T00:13:24.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 -- start start 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be9276d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be935f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5605be89cca0 con 0x5605be9272f0 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5605be88c0d0 con 0x5605be927c10 2024-09-11T00:13:24.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.215+0000 7f83178d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5605be88fee0 con 0x5605be933ba0 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.216+0000 7f830d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.216+0000 7f830d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40540/0 (socket says 172.21.15.33:40540) 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.216+0000 7f830d400640 1 -- 172.21.15.33:0/3248000609 learned_addr learned my addr 172.21.15.33:0/3248000609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.216+0000 7f830e800640 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be935f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.217+0000 7f830d400640 1 -- 172.21.15.33:0/3248000609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 msgr2=0x5605be935f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.217+0000 7f830d400640 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be935f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.217+0000 7f830d400640 1 -- 172.21.15.33:0/3248000609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 msgr2=0x5605be9276d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.217+0000 7f830d400640 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be9276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.217+0000 7f830d400640 1 -- 172.21.15.33:0/3248000609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605be83e400 con 0x5605be927c10 2024-09-11T00:13:24.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.219+0000 7f830d400640 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82f80cb1d0 tx=0x7f82f8005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ca27de8cd92459 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.220+0000 7f82ff400640 1 -- 172.21.15.33:0/3248000609 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80cac40 con 0x5605be927c10 2024-09-11T00:13:24.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.220+0000 7f82ff400640 1 -- 172.21.15.33:0/3248000609 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82f80d43b0 con 0x5605be927c10 2024-09-11T00:13:24.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.220+0000 7f82ff400640 1 -- 172.21.15.33:0/3248000609 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80cb4d0 con 0x5605be927c10 2024-09-11T00:13:24.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.221+0000 7f83178d4740 1 -- 172.21.15.33:0/3248000609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 msgr2=0x5605be933660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.221+0000 7f83178d4740 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82f80cb1d0 tx=0x7f82f8005c90 comp rx=0 tx=0).stop 2024-09-11T00:13:24.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 -- 172.21.15.33:0/3248000609 shutdown_connections 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be935f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be927c10 0x5605be933660 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 --2- 172.21.15.33:0/3248000609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be9276d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 -- 172.21.15.33:0/3248000609 >> 172.21.15.33:0/3248000609 conn(0x5605be925120 msgr2=0x5605be9262c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 -- 172.21.15.33:0/3248000609 shutdown_connections 2024-09-11T00:13:24.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.222+0000 7f83178d4740 1 -- 172.21.15.33:0/3248000609 wait complete. 2024-09-11T00:13:24.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.223+0000 7f83178d4740 1 -- start start 2024-09-11T00:13:24.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.223+0000 7f83178d4740 1 Processor -- start 2024-09-11T00:13:24.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be933580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5605be6ed7a0 con 0x5605be9272f0 2024-09-11T00:13:24.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5605be831a10 con 0x5605be933ba0 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5605be9365e0 con 0x5605be927c10 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.224+0000 7f83178d4740 10 client.0 _ll_register_callbacks cb 0x5605be841be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:40548/0 (socket says 172.21.15.33:40548) 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46922/0 (socket says 172.21.15.33:46922) 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830d400640 1 -- 172.21.15.33:0/2832593876 learned_addr learned my addr 172.21.15.33:0/2832593876 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.225+0000 7f830de00640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be933580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830d400640 1 -- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 msgr2=0x5605be9310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830d400640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830d400640 1 -- 172.21.15.33:0/2832593876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 msgr2=0x5605be933580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830d400640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be933580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830d400640 1 -- 172.21.15.33:0/2832593876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605be5f9b90 con 0x5605be927c10 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830de00640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be933580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.226+0000 7f830e800640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.227+0000 7f830d400640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82f8102810 tx=0x7f82f80cb3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c09b337a1837a552 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.227+0000 7f82f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:13:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.230+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80cac40 con 0x5605be927c10 2024-09-11T00:13:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.230+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f82f80c5de0 con 0x5605be927c10 2024-09-11T00:13:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.230+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f80d43b0 con 0x5605be927c10 2024-09-11T00:13:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.231+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f82f8030e50 con 0x5605be927c10 2024-09-11T00:13:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.232+0000 7f83178d4740 10 client.26971 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.232+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605be941f40 con 0x5605be927c10 2024-09-11T00:13:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.235+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82f80d43b0 con 0x5605be927c10 2024-09-11T00:13:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.235+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f82f80b2040 con 0x5605be927c10 2024-09-11T00:13:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 10 client.26971 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 10 client.26971 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:13:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 20 client.26971 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be943290 0x5605be945680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 4 client.26971 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.236+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605be89ebf0 con 0x5605be943290 2024-09-11T00:13:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.237+0000 7f830de00640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be943290 0x5605be945680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.239+0000 7f82f3e00640 10 client.26971 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.239+0000 7f830de00640 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be943290 0x5605be945680 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5050ab5e7f3017b server_cookie=2ee2aeae8cea7d55 in_seq=0 out_seq=0 2024-09-11T00:13:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.240+0000 7f82f3e00640 1 -- 172.21.15.33:0/2832593876 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605be89ebf0 con 0x5605be943290 2024-09-11T00:13:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.240+0000 7f82f3e00640 10 client.26971 handle_command_reply: tid=0 2024-09-11T00:13:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.240+0000 7f83178d4740 1 client.26971 shutdown 2024-09-11T00:13:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 msgr2=0x5605be9309d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82f8102810 tx=0x7f82f80cb3a0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 shutdown_connections 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be933ba0 0x5605be9310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be943290 0x5605be945680 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be927c10 0x5605be9309d0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f82f8102810 tx=0x7f82f80cb3a0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 --2- 172.21.15.33:0/2832593876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be933580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f82f3e00640 0 client.26971 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:24.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.241+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 >> 172.21.15.33:0/2832593876 conn(0x5605be925120 msgr2=0x5605be92acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.243+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 shutdown_connections 2024-09-11T00:13:24.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.243+0000 7f83178d4740 1 -- 172.21.15.33:0/2832593876 wait complete. 2024-09-11T00:13:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.243+0000 7f83178d4740 20 client.26971 trim_cache size 0 max 16384 2024-09-11T00:13:24.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.271+0000 7f83178d4740 1 Processor -- start 2024-09-11T00:13:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.271+0000 7f83178d4740 1 -- start start 2024-09-11T00:13:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be924af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 0x5605be94b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f83101c1090 con 0x5605be9272f0 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83101be960 con 0x5605be94b280 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.272+0000 7f83178d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83101bc7b0 con 0x5605be933ba0 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.273+0000 7f830d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.273+0000 7f830d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46936/0 (socket says 172.21.15.33:46936) 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.273+0000 7f830d400640 1 -- 172.21.15.33:0/2695938372 learned_addr learned my addr 172.21.15.33:0/2695938372 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.273+0000 7f830e800640 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 0x5605be94b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 -- 172.21.15.33:0/2695938372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 msgr2=0x5605be94ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 -- 172.21.15.33:0/2695938372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 msgr2=0x5605be924af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be924af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 -- 172.21.15.33:0/2695938372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605be927a40 con 0x5605be94b280 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830e800640 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 0x5605be94b710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8308010480 tx=0x7f8308010880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3635b414a6ad4654 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.274+0000 7f830d400640 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.275+0000 7f82fea00640 1 -- 172.21.15.33:0/2695938372 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308004d20 con 0x5605be94b280 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.276+0000 7f82fea00640 1 -- 172.21.15.33:0/2695938372 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83080054b0 con 0x5605be94b280 2024-09-11T00:13:24.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.276+0000 7f82fea00640 1 -- 172.21.15.33:0/2695938372 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830801c770 con 0x5605be94b280 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 -- 172.21.15.33:0/2695938372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 msgr2=0x5605be94b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 0x5605be94b710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8308010480 tx=0x7f8308010880 comp rx=0 tx=0).stop 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 -- 172.21.15.33:0/2695938372 shutdown_connections 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be94b280 0x5605be94b710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be933ba0 0x5605be94ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 --2- 172.21.15.33:0/2695938372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be9272f0 0x5605be924af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.277+0000 7f83178d4740 1 -- 172.21.15.33:0/2695938372 >> 172.21.15.33:0/2695938372 conn(0x5605be925120 msgr2=0x5605be926620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.279+0000 7f83178d4740 1 -- 172.21.15.33:0/2695938372 shutdown_connections 2024-09-11T00:13:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.279+0000 7f83178d4740 1 -- 172.21.15.33:0/2695938372 wait complete. 2024-09-11T00:13:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.279+0000 7f83178d4740 1 -- start start 2024-09-11T00:13:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.280+0000 7f83178d4740 1 Processor -- start 2024-09-11T00:13:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.284+0000 7f83178d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 0x5605be93ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.284+0000 7f83178d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 0x5605be93bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.285+0000 7f83178d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.285+0000 7f830e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.285+0000 7f830e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:46942/0 (socket says 172.21.15.33:46942) 2024-09-11T00:13:24.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.286+0000 7f830e800640 1 -- 172.21.15.33:0/3563494452 learned_addr learned my addr 172.21.15.33:0/3563494452 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.286+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f83101bce20 con 0x5605be933ba0 2024-09-11T00:13:24.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.287+0000 7f830de00640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 0x5605be93ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.288+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83101be290 con 0x5605be9272f0 2024-09-11T00:13:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.288+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f83101bd4f0 con 0x5605be94b280 2024-09-11T00:13:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.289+0000 7f830e800640 1 -- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 msgr2=0x5605be93ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.288+0000 7f830d400640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 0x5605be93bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.289+0000 7f830e800640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 0x5605be93ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.289+0000 7f830e800640 1 -- 172.21.15.33:0/3563494452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 msgr2=0x5605be93bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.290+0000 7f83178d4740 10 client.0 _ll_register_callbacks cb 0x7f82f80c7b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.290+0000 7f830e800640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 0x5605be93bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.290+0000 7f830e800640 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605be92d980 con 0x5605be94b280 2024-09-11T00:13:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.291+0000 7f830de00640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 0x5605be93ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:24.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.291+0000 7f830d400640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 0x5605be93bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.291+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83080054b0 con 0x5605be94b280 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.291+0000 7f830e800640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8308010fa0 tx=0x7f8308004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a604202e1b3da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.291+0000 7f82f3e00640 10 client.26977 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.293+0000 7f82f3e00640 1 -- 172.21.15.33:0/3563494452 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830802a060 con 0x5605be94b280 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.293+0000 7f82f3e00640 1 -- 172.21.15.33:0/3563494452 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8308005170 con 0x5605be94b280 2024-09-11T00:13:24.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.293+0000 7f82f3e00640 1 -- 172.21.15.33:0/3563494452 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f830801c4f0 con 0x5605be94b280 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.293+0000 7f83178d4740 10 client.26977 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.293+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5605be9b1870 con 0x5605be94b280 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.295+0000 7f82f3e00640 1 -- 172.21.15.33:0/3563494452 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f830801b070 con 0x5605be94b280 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.295+0000 7f83178d4740 10 client.26977 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f83178d4740 10 client.26977 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:13:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f83178d4740 20 client.26977 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be9b1e20 0x5605be9b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f83178d4740 4 client.26977 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.8, "await_for": 45.0}] 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.8, "await_for": 45.0}) -- 0x5605be89a6a0 con 0x5605be9b1e20 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.296+0000 7f830de00640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be9b1e20 0x5605be9b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.297+0000 7f82f3e00640 10 client.26977 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:24.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.297+0000 7f830de00640 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be9b1e20 0x5605be9b4240 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72cf42493ed683c2 server_cookie=1e65c72c5e57b932 in_seq=0 out_seq=0 2024-09-11T00:13:24.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:24 smithi033 ceph-mon[30593]: pgmap v935: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.5 MiB/s wr, 688 op/s 2024-09-11T00:13:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.592+0000 7f82f3e00640 1 -- 172.21.15.33:0/3563494452 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5605be89a6a0 con 0x5605be9b1e20 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.592+0000 7f82f3e00640 10 client.26977 handle_command_reply: tid=0 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.592+0000 7f83178d4740 1 client.26977 shutdown 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 msgr2=0x5605be92d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8308010fa0 tx=0x7f8308004d00 comp rx=0 tx=0).stop 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 shutdown_connections 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5605be9b1e20 0x5605be9b4240 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605be94b280 0x5605be92d240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5605be933ba0 0x5605be93bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 --2- 172.21.15.33:0/3563494452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5605be9272f0 0x5605be93ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 >> 172.21.15.33:0/3563494452 conn(0x5605be925120 msgr2=0x5605be925e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f82f3e00640 0 client.26977 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 shutdown_connections 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 1 -- 172.21.15.33:0/3563494452 wait complete. 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.593+0000 7f83178d4740 20 client.26977 trim_cache size 0 max 16384 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:13:24.597 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 50, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "e3bfb3ba": { 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 50, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:13:24.598 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 154.8, 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:24.599 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:13:24.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 msgr2=0x7f82f40b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 0x7f82f40b7920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f830000bbe0 tx=0x7f830000b390 comp rx=0 tx=0).stop 2024-09-11T00:13:24.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 msgr2=0x7f83101a8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:24.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82f8035040 tx=0x7f82f8030ce0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 shutdown_connections 2024-09-11T00:13:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f82f40b5460 0x7f82f40b7920 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f831011c020 0x7f83101ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831006f050 0x7f83101a8340 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 --2- 172.21.15.33:0/3777102070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831006e730 0x7f83101a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:24.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 >> 172.21.15.33:0/3777102070 conn(0x7f831006c950 msgr2=0x7f831011c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:24.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 shutdown_connections 2024-09-11T00:13:24.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:24.594+0000 7f830f200640 1 -- 172.21.15.33:0/3777102070 wait complete. 2024-09-11T00:13:24.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:24 smithi052 ceph-mon[33526]: pgmap v935: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.5 MiB/s wr, 688 op/s 2024-09-11T00:13:24.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:24 smithi189 ceph-mon[34000]: pgmap v935: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.5 MiB/s wr, 688 op/s 2024-09-11T00:13:25.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e3bfb3ba', quiesce took 14.9 seconds. Will release after: 19.9 2024-09-11T00:13:26.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:26 smithi052 ceph-mon[33526]: pgmap v936: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 543 op/s 2024-09-11T00:13:26.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:26 smithi033 ceph-mon[30593]: pgmap v936: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 543 op/s 2024-09-11T00:13:26.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:26 smithi189 ceph-mon[34000]: pgmap v936: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 543 op/s 2024-09-11T00:13:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 820.0 s, 105.1 tps, lat 94.437 ms stddev 35.433 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 -- 172.21.15.33:0/740206044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288078b70 msgr2=0x7f3288078ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 --2- 172.21.15.33:0/740206044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288078b70 0x7f3288078ff0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3274009900 tx=0x7f327402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 -- 172.21.15.33:0/740206044 shutdown_connections 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 --2- 172.21.15.33:0/740206044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288079530 0x7f3288079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 --2- 172.21.15.33:0/740206044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288078b70 0x7f3288078ff0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 --2- 172.21.15.33:0/740206044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 0x7f3288077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 -- 172.21.15.33:0/740206044 >> 172.21.15.33:0/740206044 conn(0x7f3288100470 msgr2=0x7f3288102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 -- 172.21.15.33:0/740206044 shutdown_connections 2024-09-11T00:13:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.503+0000 7f328da00640 1 -- 172.21.15.33:0/740206044 wait complete. 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.504+0000 7f328da00640 1 Processor -- start 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.504+0000 7f328da00640 1 -- start start 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 0x7f328819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288078b70 0x7f328819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3288114b00 con 0x7f3288079530 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3288114980 con 0x7f3288078b70 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f328da00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3288114c80 con 0x7f3288077a20 2024-09-11T00:13:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f3287400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f3286a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 0x7f328819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f3287400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58526/0 (socket says 172.21.15.33:58526) 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f3287400640 1 -- 172.21.15.33:0/2218889873 learned_addr learned my addr 172.21.15.33:0/2218889873 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.505+0000 7f3286000640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288078b70 0x7f328819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 -- 172.21.15.33:0/2218889873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 msgr2=0x7f328819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 0x7f328819f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 -- 172.21.15.33:0/2218889873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288078b70 msgr2=0x7f328819f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288078b70 0x7f328819f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 -- 172.21.15.33:0/2218889873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32881a0e30 con 0x7f3288079530 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f3287400640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f328000eb10 tx=0x7f328000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f327f400640 1 -- 172.21.15.33:0/2218889873 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280004b20 con 0x7f3288079530 2024-09-11T00:13:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f327f400640 1 -- 172.21.15.33:0/2218889873 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3280004cc0 con 0x7f3288079530 2024-09-11T00:13:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f327f400640 1 -- 172.21.15.33:0/2218889873 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280010690 con 0x7f3288079530 2024-09-11T00:13:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32881a1120 con 0x7f3288079530 2024-09-11T00:13:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.506+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32881a77f0 con 0x7f3288079530 2024-09-11T00:13:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.509+0000 7f32907dc740 1 Processor -- start 2024-09-11T00:13:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f327f400640 1 -- 172.21.15.33:0/2218889873 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3280005020 con 0x7f3288079530 2024-09-11T00:13:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 -- start start 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f571410b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f5714134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f5713816b0 con 0x55f571413b00 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f571370ae0 con 0x55f57140e790 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.510+0000 7f32907dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f5713748f0 con 0x55f5714110c0 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58530/0 (socket says 172.21.15.33:58530) 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 -- 172.21.15.33:0/23775825 learned_addr learned my addr 172.21.15.33:0/23775825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f571410b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286a00640 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f5714134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 -- 172.21.15.33:0/23775825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 msgr2=0x55f5714134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f5714134b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 -- 172.21.15.33:0/23775825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 msgr2=0x55f571410b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f571410b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.511+0000 7f3286000640 1 -- 172.21.15.33:0/23775825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57133d780 con 0x55f571413b00 2024-09-11T00:13:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f3286000640 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3274031460 tx=0x7f3274005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc342a2058d9cca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f327f400640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 0x7f326c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f3273e00640 1 -- 172.21.15.33:0/23775825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274035050 con 0x55f571413b00 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f3273e00640 1 -- 172.21.15.33:0/23775825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3274031500 con 0x55f571413b00 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f3273e00640 1 -- 172.21.15.33:0/23775825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327403c6d0 con 0x55f571413b00 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f327f400640 1 -- 172.21.15.33:0/2218889873 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f32800e6640 con 0x7f3288079530 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.512+0000 7f3286a00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 0x7f326c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 -- 172.21.15.33:0/23775825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 msgr2=0x55f571415fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3274031460 tx=0x7f3274005b70 comp rx=0 tx=0).stop 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 -- 172.21.15.33:0/23775825 shutdown_connections 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f571413b00 0x55f571415fc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f5714134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 --2- 172.21.15.33:0/23775825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f571410b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.513+0000 7f32907dc740 1 -- 172.21.15.33:0/23775825 >> 172.21.15.33:0/23775825 conn(0x55f5714098e0 msgr2=0x55f57140a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.514+0000 7f3286a00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 0x7f326c0b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3278004610 tx=0x7f327800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.514+0000 7f32907dc740 1 -- 172.21.15.33:0/23775825 shutdown_connections 2024-09-11T00:13:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.514+0000 7f32907dc740 1 -- 172.21.15.33:0/23775825 wait complete. 2024-09-11T00:13:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.514+0000 7f32907dc740 1 -- start start 2024-09-11T00:13:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.514+0000 7f32907dc740 1 Processor -- start 2024-09-11T00:13:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f571418780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f5714192c0 0x55f571419740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f5712a8ab0 con 0x55f57140e790 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f571317570 con 0x55f5714192c0 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f571416a80 con 0x55f5714110c0 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f32907dc740 10 client.0 _ll_register_callbacks cb 0x55f571326100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.515+0000 7f3286a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58546/0 (socket says 172.21.15.33:58546) 2024-09-11T00:13:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 -- 172.21.15.33:0/2429987522 learned_addr learned my addr 172.21.15.33:0/2429987522 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3287400640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f5714192c0 0x55f571419740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286000640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f571418780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 -- 172.21.15.33:0/2429987522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 msgr2=0x55f571418780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f571418780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 -- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f5714192c0 msgr2=0x55f571419740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f5714192c0 0x55f571419740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.516+0000 7f3286a00640 1 -- 172.21.15.33:0/2429987522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5710d2790 con 0x55f57140e790 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.517+0000 7f3286a00640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3278003c70 tx=0x7f3278004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2288bad9f4ec2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.517+0000 7f3270c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.517+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327802c060 con 0x55f57140e790 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.517+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f3278017030 con 0x55f57140e790 2024-09-11T00:13:28.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.517+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3274031500 con 0x55f57140e790 2024-09-11T00:13:28.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3278033050 con 0x55f57140e790 2024-09-11T00:13:28.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f32907dc740 10 client.17100 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:28.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f57114b620 con 0x55f57140e790 2024-09-11T00:13:28.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3274031500 con 0x55f57140e790 2024-09-11T00:13:28.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f327801c3f0 con 0x55f57140e790 2024-09-11T00:13:28.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f32907dc740 10 client.17100 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.518+0000 7f32907dc740 10 client.17100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.519+0000 7f32907dc740 20 client.17100 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.519+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571423d20 0x55f5714261c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.519+0000 7f32907dc740 4 client.17100 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.519+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f571383600 con 0x55f571423d20 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.519+0000 7f3286000640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571423d20 0x55f5714261c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.520+0000 7f3270c00640 10 client.17100 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.520+0000 7f3286000640 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571423d20 0x55f5714261c0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6df3eabb9d14c server_cookie=3e3b051430a9b88f in_seq=0 out_seq=0 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.521+0000 7f3270c00640 1 -- 172.21.15.33:0/2429987522 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f571383600 con 0x55f571423d20 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.521+0000 7f3270c00640 10 client.17100 handle_command_reply: tid=0 2024-09-11T00:13:28.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.521+0000 7f32907dc740 1 client.17100 shutdown 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 msgr2=0x55f5714180e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3278003c70 tx=0x7f3278004730 comp rx=0 tx=0).stop 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 shutdown_connections 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f5714192c0 0x55f571419740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571423d20 0x55f5714261c0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f571418780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 --2- 172.21.15.33:0/2429987522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f57140e790 0x55f5714180e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 >> 172.21.15.33:0/2429987522 conn(0x55f5714098e0 msgr2=0x55f571408a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f3270c00640 0 client.17100 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 shutdown_connections 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 1 -- 172.21.15.33:0/2429987522 wait complete. 2024-09-11T00:13:28.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.522+0000 7f32907dc740 20 client.17100 trim_cache size 0 max 16384 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.538+0000 7f32907dc740 1 Processor -- start 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.538+0000 7f32907dc740 1 -- start start 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57140a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714192c0 0x55f571413f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b44a0 con 0x55f5714110c0 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b1d70 con 0x55f57140e790 2024-09-11T00:13:28.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f32907dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32881afbc0 con 0x55f5714192c0 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58556/0 (socket says 172.21.15.33:58556) 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 -- 172.21.15.33:0/2580165391 learned_addr learned my addr 172.21.15.33:0/2580165391 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3287400640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714192c0 0x55f571413f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286a00640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57140a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 -- 172.21.15.33:0/2580165391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714192c0 msgr2=0x55f571413f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714192c0 0x55f571413f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 -- 172.21.15.33:0/2580165391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 msgr2=0x55f57140a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57140a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286000640 1 -- 172.21.15.33:0/2580165391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f571419ab0 con 0x55f5714110c0 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.539+0000 7f3286a00640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57140a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:28.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.540+0000 7f3286000640 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55f571413ee0 tx=0x7f327402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528468349b9a57ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.540+0000 7f3273400640 1 -- 172.21.15.33:0/2580165391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274057020 con 0x55f5714110c0 2024-09-11T00:13:28.547 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.540+0000 7f3273400640 1 -- 172.21.15.33:0/2580165391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3274031500 con 0x55f5714110c0 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.540+0000 7f3273400640 1 -- 172.21.15.33:0/2580165391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274035040 con 0x55f5714110c0 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- 172.21.15.33:0/2580165391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 msgr2=0x55f57140a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55f571413ee0 tx=0x7f327402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- 172.21.15.33:0/2580165391 shutdown_connections 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714192c0 0x55f571413f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714110c0 0x55f57140a8c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 --2- 172.21.15.33:0/2580165391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57140a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- 172.21.15.33:0/2580165391 >> 172.21.15.33:0/2580165391 conn(0x55f5714098e0 msgr2=0x55f571425d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.548 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- 172.21.15.33:0/2580165391 shutdown_connections 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- 172.21.15.33:0/2580165391 wait complete. 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.541+0000 7f32907dc740 1 -- start start 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 Processor -- start 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57141f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f57141fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b0230 con 0x55f5714192c0 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b16a0 con 0x55f57140e790 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b0900 con 0x55f5714110c0 2024-09-11T00:13:28.549 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f32907dc740 10 client.0 _ll_register_callbacks cb 0x7f3278004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f3287400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f3287400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58558/0 (socket says 172.21.15.33:58558) 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f3287400640 1 -- 172.21.15.33:0/2301712154 learned_addr learned my addr 172.21.15.33:0/2301712154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.542+0000 7f3286000640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f57141fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3286a00640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57141f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 -- 172.21.15.33:0/2301712154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 msgr2=0x55f57141fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f57141fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 -- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 msgr2=0x55f57141f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57141f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 -- 172.21.15.33:0/2301712154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57141dc60 con 0x55f5714192c0 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3286a00640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57141f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:28.550 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3287400640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f32800a9c70 tx=0x7f32800ac900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181a2eb05d762ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3270c00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800d3070 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f32800b5b00 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3274031500 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3280005540 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f32907dc740 10 client.17106 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.543+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f57141ef90 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3274031500 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f32800712a0 con 0x55f5714192c0 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 10 client.17106 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 10 client.17106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:28.551 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 20 client.17106 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571491280 0x55f5714936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 4 client.17106 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f57137f0b0 con 0x55f571491280 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.544+0000 7f3286a00640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571491280 0x55f5714936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.545+0000 7f3286a00640 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571491280 0x55f5714936a0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cacdeddb80417477 server_cookie=48d5d17177fcf09e in_seq=0 out_seq=0 2024-09-11T00:13:28.552 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.545+0000 7f3270c00640 10 client.17106 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f3270c00640 1 -- 172.21.15.33:0/2301712154 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f57137f0b0 con 0x55f571491280 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f3270c00640 10 client.17106 handle_command_reply: tid=0 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 client.17106 shutdown 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 msgr2=0x55f57141d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f32800a9c70 tx=0x7f32800ac900 comp rx=0 tx=0).stop 2024-09-11T00:13:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 shutdown_connections 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5714192c0 0x55f57141d460 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55f571491280 0x55f5714936a0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5714110c0 0x55f57141fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 --2- 172.21.15.33:0/2301712154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f57140e790 0x55f57141f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f3270c00640 0 client.17106 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 >> 172.21.15.33:0/2301712154 conn(0x55f5714098e0 msgr2=0x55f57140a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 shutdown_connections 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.563+0000 7f32907dc740 1 -- 172.21.15.33:0/2301712154 wait complete. 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f32907dc740 20 client.17106 trim_cache size 0 max 16384 2024-09-11T00:13:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 msgr2=0x7f326c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 0x7f326c0b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3278004610 tx=0x7f327800b390 comp rx=0 tx=0).stop 2024-09-11T00:13:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 msgr2=0x7f32881a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f328000eb10 tx=0x7f328000c2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 shutdown_connections 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f326c0b52e0 0x7f326c0b77a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3288079530 0x7f32881a0570 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3288078b70 0x7f328819f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 --2- 172.21.15.33:0/2218889873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3288077a20 0x7f328819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.564+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 >> 172.21.15.33:0/2218889873 conn(0x7f3288100470 msgr2=0x7f32881020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.565+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 shutdown_connections 2024-09-11T00:13:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:28.565+0000 7f328da00640 1 -- 172.21.15.33:0/2218889873 wait complete. 2024-09-11T00:13:28.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:28 smithi052 ceph-mon[33526]: pgmap v937: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.1 MiB/s wr, 665 op/s 2024-09-11T00:13:28.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:28 smithi033 ceph-mon[30593]: pgmap v937: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.1 MiB/s wr, 665 op/s 2024-09-11T00:13:28.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:28 smithi189 ceph-mon[34000]: pgmap v937: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.1 MiB/s wr, 665 op/s 2024-09-11T00:13:30.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:30 smithi052 ceph-mon[33526]: pgmap v938: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-09-11T00:13:30.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:30 smithi033 ceph-mon[30593]: pgmap v938: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-09-11T00:13:30.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:30 smithi189 ceph-mon[34000]: pgmap v938: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-09-11T00:13:32.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:32 smithi052 ceph-mon[33526]: pgmap v939: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 433 op/s 2024-09-11T00:13:32.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:32 smithi033 ceph-mon[30593]: pgmap v939: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 433 op/s 2024-09-11T00:13:32.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:32 smithi189 ceph-mon[34000]: pgmap v939: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 433 op/s 2024-09-11T00:13:33.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:13:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:34 smithi052 ceph-mon[33526]: pgmap v940: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 360 op/s 2024-09-11T00:13:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:34 smithi033 ceph-mon[30593]: pgmap v940: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 360 op/s 2024-09-11T00:13:34.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:34 smithi189 ceph-mon[34000]: pgmap v940: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 360 op/s 2024-09-11T00:13:36.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:36 smithi052 ceph-mon[33526]: pgmap v941: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.3 MiB/s wr, 195 op/s 2024-09-11T00:13:36.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:36 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:36 smithi033 ceph-mon[30593]: pgmap v941: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.3 MiB/s wr, 195 op/s 2024-09-11T00:13:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:36 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:36 smithi189 ceph-mon[34000]: pgmap v941: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.3 MiB/s wr, 195 op/s 2024-09-11T00:13:36.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:36 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:37.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:37.707 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:13:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:13:37.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:37.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:13:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:13:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:38 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:13:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:38 smithi052 ceph-mon[33526]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:13:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:38 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:13:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:38 smithi052 ceph-mon[33526]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:13:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:38 smithi052 ceph-mon[33526]: pgmap v942: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 186 op/s 2024-09-11T00:13:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:38 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:13:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:38 smithi033 ceph-mon[30593]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:13:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:38 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:13:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:38 smithi033 ceph-mon[30593]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:13:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:38 smithi033 ceph-mon[30593]: pgmap v942: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 186 op/s 2024-09-11T00:13:38.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:38 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi052 to 177.5M 2024-09-11T00:13:38.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:38 smithi189 ceph-mon[34000]: Adjusting osd_memory_target on smithi189 to 176.4M 2024-09-11T00:13:38.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:38 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi052 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-11T00:13:38.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:38 smithi189 ceph-mon[34000]: Unable to set osd_memory_target on smithi189 to 185039052: error parsing value: Value '185039052' is below minimum 939524096 2024-09-11T00:13:38.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:38 smithi189 ceph-mon[34000]: pgmap v942: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 186 op/s 2024-09-11T00:13:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:40 smithi052 ceph-mon[33526]: pgmap v943: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 445 KiB/s wr, 60 op/s 2024-09-11T00:13:40.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:40 smithi033 ceph-mon[30593]: pgmap v943: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 445 KiB/s wr, 60 op/s 2024-09-11T00:13:40.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:40 smithi189 ceph-mon[34000]: pgmap v943: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 445 KiB/s wr, 60 op/s 2024-09-11T00:13:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 -- 172.21.15.33:0/3614951894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c406b470 msgr2=0x7f12c4105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 --2- 172.21.15.33:0/3614951894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c406b470 0x7f12c4105360 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009900 tx=0x7f12b402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 -- 172.21.15.33:0/3614951894 shutdown_connections 2024-09-11T00:13:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 --2- 172.21.15.33:0/3614951894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41084a0 0x7f12c410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 --2- 172.21.15.33:0/3614951894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c41058f0 0x7f12c4107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 --2- 172.21.15.33:0/3614951894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c406b470 0x7f12c4105360 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 -- 172.21.15.33:0/3614951894 >> 172.21.15.33:0/3614951894 conn(0x7f12c40fcf30 msgr2=0x7f12c40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 -- 172.21.15.33:0/3614951894 shutdown_connections 2024-09-11T00:13:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.691+0000 7f12c3200640 1 -- 172.21.15.33:0/3614951894 wait complete. 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.692+0000 7f12c3200640 1 Processor -- start 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.692+0000 7f12c3200640 1 -- start start 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c406b470 0x7f12c4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41058f0 0x7f12c41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410e2f0 con 0x7f12c41084a0 2024-09-11T00:13:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410e170 con 0x7f12c406b470 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c3200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12c410e470 con 0x7f12c41058f0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c2800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40022/0 (socket says 172.21.15.33:40022) 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c2800640 1 -- 172.21.15.33:0/539739464 learned_addr learned my addr 172.21.15.33:0/539739464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c1e00640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c406b470 0x7f12c4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c1400640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41058f0 0x7f12c41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c2800640 1 -- 172.21.15.33:0/539739464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41058f0 msgr2=0x7f12c41990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.693+0000 7f12c2800640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41058f0 0x7f12c41990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c2800640 1 -- 172.21.15.33:0/539739464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c406b470 msgr2=0x7f12c4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c2800640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c406b470 0x7f12c4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c2800640 1 -- 172.21.15.33:0/539739464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c419a5e0 con 0x7f12c41084a0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c2800640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00eb10 tx=0x7f12bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12baa00640 1 -- 172.21.15.33:0/539739464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc004b20 con 0x7f12c41084a0 2024-09-11T00:13:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12baa00640 1 -- 172.21.15.33:0/539739464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12bc004cc0 con 0x7f12c41084a0 2024-09-11T00:13:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c419a8d0 con 0x7f12c41084a0 2024-09-11T00:13:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12baa00640 1 -- 172.21.15.33:0/539739464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc010690 con 0x7f12c41084a0 2024-09-11T00:13:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.694+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c41a0fa0 con 0x7f12c41084a0 2024-09-11T00:13:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.697+0000 7f12cc00d740 1 Processor -- start 2024-09-11T00:13:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12baa00640 1 -- 172.21.15.33:0/539739464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f12bc005020 con 0x7f12c41084a0 2024-09-11T00:13:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 -- start start 2024-09-11T00:13:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d4a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d4a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55813d40a6b0 con 0x55813d49bd80 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55813d3f9ae0 con 0x55813d49e6b0 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12cc00d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55813d3fd8f0 con 0x55813d4a10f0 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.698+0000 7f12c1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40032/0 (socket says 172.21.15.33:40032) 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 -- 172.21.15.33:0/3777536352 learned_addr learned my addr 172.21.15.33:0/3777536352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1e00640 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d4a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d4a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 -- 172.21.15.33:0/3777536352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 msgr2=0x55813d4a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d4a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 -- 172.21.15.33:0/3777536352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 msgr2=0x55813d4a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d4a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 -- 172.21.15.33:0/3777536352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55813d3c6780 con 0x55813d49bd80 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12baa00640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 0x7f12a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12baa00640 1 -- 172.21.15.33:0/539739464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f12bc0e6540 con 0x7f12c41084a0 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1400640 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f12b0013610 tx=0x7f12b0009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b0c592445e1f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.699+0000 7f12c1e00640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 0x7f12a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12af400640 1 -- 172.21.15.33:0/3777536352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b000f600 con 0x55813d49bd80 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12af400640 1 -- 172.21.15.33:0/3777536352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12b000fc30 con 0x55813d49bd80 2024-09-11T00:13:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12af400640 1 -- 172.21.15.33:0/3777536352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0010b90 con 0x55813d49bd80 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 -- 172.21.15.33:0/3777536352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 msgr2=0x55813d49e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f12b0013610 tx=0x7f12b0009890 comp rx=0 tx=0).stop 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12c1e00640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 0x7f12a80b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005ab0 tx=0x7f12b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 -- 172.21.15.33:0/3777536352 shutdown_connections 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d4a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d4a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3777536352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d49e170 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.700+0000 7f12cc00d740 1 -- 172.21.15.33:0/3777536352 >> 172.21.15.33:0/3777536352 conn(0x55813d492ac0 msgr2=0x55813d493850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.701+0000 7f12cc00d740 1 -- 172.21.15.33:0/3777536352 shutdown_connections 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.701+0000 7f12cc00d740 1 -- 172.21.15.33:0/3777536352 wait complete. 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.701+0000 7f12cc00d740 1 -- start start 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.701+0000 7f12cc00d740 1 Processor -- start 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55813d331ab0 con 0x55813d49bd80 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55813d3a0570 con 0x55813d4a10f0 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55813d4a40d0 con 0x55813d49e6b0 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12cc00d740 10 client.0 _ll_register_callbacks cb 0x55813d3af100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40046/0 (socket says 172.21.15.33:40046) 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 -- 172.21.15.33:0/3866237708 learned_addr learned my addr 172.21.15.33:0/3866237708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1400640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c2800640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 -- 172.21.15.33:0/3866237708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 msgr2=0x55813d4a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 -- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 msgr2=0x55813d4a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.702+0000 7f12c1e00640 1 -- 172.21.15.33:0/3866237708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55813d15b790 con 0x55813d49bd80 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12c1e00640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f12b4033000 tx=0x7f12b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb33911a0058708 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4035040 con 0x55813d49bd80 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b000fc30 con 0x55813d49bd80 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f12b4031500 con 0x55813d49bd80 2024-09-11T00:13:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12b4031700 con 0x55813d49bd80 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12cc00d740 10 client.17118 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.703+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55813d1d4620 con 0x55813d49bd80 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12b000fc30 con 0x55813d49bd80 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f12b4044030 con 0x55813d49bd80 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 10 client.17118 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 10 client.17118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 20 client.17118 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d4b0db0 0x55813d4b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 4 client.17118 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.704+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55813d40c600 con 0x55813d4b0db0 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.705+0000 7f12c1400640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d4b0db0 0x55813d4b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.705+0000 7f12c1400640 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d4b0db0 0x55813d4b31a0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719fe108a86022c0 server_cookie=a69186059da84623 in_seq=0 out_seq=0 2024-09-11T00:13:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.705+0000 7f12a3e00640 10 client.17118 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12a3e00640 1 -- 172.21.15.33:0/3866237708 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55813d40c600 con 0x55813d4b0db0 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12a3e00640 10 client.17118 handle_command_reply: tid=0 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 client.17118 shutdown 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 msgr2=0x55813d4a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f12b4033000 tx=0x7f12b4009260 comp rx=0 tx=0).stop 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 shutdown_connections 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d4b0db0 0x55813d4b31a0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 --2- 172.21.15.33:0/3866237708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4a5520 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.713 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12a3e00640 0 client.17118 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.706+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 >> 172.21.15.33:0/3866237708 conn(0x55813d492ac0 msgr2=0x55813d491bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.707+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 shutdown_connections 2024-09-11T00:13:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.707+0000 7f12cc00d740 1 -- 172.21.15.33:0/3866237708 wait complete. 2024-09-11T00:13:41.714 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.707+0000 7f12cc00d740 20 client.17118 trim_cache size 0 max 16384 2024-09-11T00:13:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 Processor -- start 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 -- start start 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d495900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d495e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41aba70 con 0x55813d49bd80 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41a9340 con 0x55813d49e6b0 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.722+0000 7f12cc00d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41a7190 con 0x55813d4a10f0 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40048/0 (socket says 172.21.15.33:40048) 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 -- 172.21.15.33:0/1651652933 learned_addr learned my addr 172.21.15.33:0/1651652933 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1400640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d495900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c2800640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d495e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 -- 172.21.15.33:0/1651652933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 msgr2=0x55813d495e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d495e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 -- 172.21.15.33:0/1651652933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 msgr2=0x55813d495900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d495900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 -- 172.21.15.33:0/1651652933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55813d49e4e0 con 0x55813d49bd80 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c2800640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d495e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.723+0000 7f12c1e00640 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009230 tx=0x7f12b4004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1ecdb7fa2ef96f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12aea00640 1 -- 172.21.15.33:0/1651652933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4035070 con 0x55813d49bd80 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12aea00640 1 -- 172.21.15.33:0/1651652933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12b404c070 con 0x55813d49bd80 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12aea00640 1 -- 172.21.15.33:0/1651652933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4051470 con 0x55813d49bd80 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 -- 172.21.15.33:0/1651652933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 msgr2=0x55813d493a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009230 tx=0x7f12b4004420 comp rx=0 tx=0).stop 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 -- 172.21.15.33:0/1651652933 shutdown_connections 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d4a10f0 0x55813d495e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d49e6b0 0x55813d495900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 --2- 172.21.15.33:0/1651652933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d493a30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 -- 172.21.15.33:0/1651652933 >> 172.21.15.33:0/1651652933 conn(0x55813d492ac0 msgr2=0x55813d493320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 -- 172.21.15.33:0/1651652933 shutdown_connections 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.724+0000 7f12cc00d740 1 -- 172.21.15.33:0/1651652933 wait complete. 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 -- start start 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 Processor -- start 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4acca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41a7800 con 0x55813d49bd80 2024-09-11T00:13:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41a8c70 con 0x55813d4a10f0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41a7ed0 con 0x55813d49e6b0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.725+0000 7f12cc00d740 10 client.0 _ll_register_callbacks cb 0x7f12b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40064/0 (socket says 172.21.15.33:40064) 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 -- 172.21.15.33:0/2228622900 learned_addr learned my addr 172.21.15.33:0/2228622900 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1400640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c2800640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 -- 172.21.15.33:0/2228622900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 msgr2=0x55813d4ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 -- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 msgr2=0x55813d4acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 -- 172.21.15.33:0/2228622900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55813d4aafe0 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12c1e00640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f12b4042040 tx=0x7f12b4003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef872ab967f30df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.726+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b406b060 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b404c070 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f12b4051470 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12b4035040 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 10 client.17124 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55813d51e160 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12b404c070 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f12b4044040 con 0x55813d49bd80 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 10 client.17124 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 10 client.17124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 20 client.17124 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d51e8d0 0x55813d520cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 4 client.17124 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.727+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55813d4080b0 con 0x55813d51e8d0 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.728+0000 7f12c1400640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d51e8d0 0x55813d520cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.728+0000 7f12c1400640 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d51e8d0 0x55813d520cf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b2fadd081f66fe server_cookie=160fa990644c4d8d in_seq=0 out_seq=0 2024-09-11T00:13:41.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.728+0000 7f12a3e00640 10 client.17124 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12a3e00640 1 -- 172.21.15.33:0/2228622900 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55813d4080b0 con 0x55813d51e8d0 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12a3e00640 10 client.17124 handle_command_reply: tid=0 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 client.17124 shutdown 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 msgr2=0x55813d4ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f12b4042040 tx=0x7f12b4003db0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 shutdown_connections 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55813d4a10f0 0x55813d4acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55813d51e8d0 0x55813d520cf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55813d49e6b0 0x55813d4ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 --2- 172.21.15.33:0/2228622900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55813d49bd80 0x55813d4ac220 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12a3e00640 0 client.17124 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 >> 172.21.15.33:0/2228622900 conn(0x55813d492ac0 msgr2=0x55813d4913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 shutdown_connections 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.744+0000 7f12cc00d740 1 -- 172.21.15.33:0/2228622900 wait complete. 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12cc00d740 20 client.17124 trim_cache size 0 max 16384 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:13:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 msgr2=0x7f12a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 0x7f12a80b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f12b4005ab0 tx=0x7f12b4005a20 comp rx=0 tx=0).stop 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 msgr2=0x7f12c4199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00eb10 tx=0x7f12bc00c2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 shutdown_connections 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f12a80b52e0 0x7f12a80b77a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c41084a0 0x7f12c4199d20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f12c41058f0 0x7f12c41990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 --2- 172.21.15.33:0/539739464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12c406b470 0x7f12c4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 >> 172.21.15.33:0/539739464 conn(0x7f12c40fcf30 msgr2=0x7f12c4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 shutdown_connections 2024-09-11T00:13:41.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:41.745+0000 7f12c3200640 1 -- 172.21.15.33:0/539739464 wait complete. 2024-09-11T00:13:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:42 smithi052 ceph-mon[33526]: pgmap v944: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 208 KiB/s wr, 32 op/s 2024-09-11T00:13:42.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:42 smithi033 ceph-mon[30593]: pgmap v944: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 208 KiB/s wr, 32 op/s 2024-09-11T00:13:42.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:42 smithi189 ceph-mon[34000]: pgmap v944: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 208 KiB/s wr, 32 op/s 2024-09-11T00:13:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:13:44.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:44 smithi052 ceph-mon[33526]: pgmap v945: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 KiB/s wr, 38 op/s 2024-09-11T00:13:44.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:44 smithi033 ceph-mon[30593]: pgmap v945: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 KiB/s wr, 38 op/s 2024-09-11T00:13:44.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:44 smithi189 ceph-mon[34000]: pgmap v945: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 292 KiB/s wr, 38 op/s 2024-09-11T00:13:45.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:46.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:46 smithi052 ceph-mon[33526]: pgmap v946: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 25 op/s 2024-09-11T00:13:46.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:46 smithi033 ceph-mon[30593]: pgmap v946: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 25 op/s 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 -- 172.21.15.33:0/1821822473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c109130 msgr2=0x7f781c10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 --2- 172.21.15.33:0/1821822473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c109130 0x7f781c10f930 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7814009ca0 tx=0x7f781402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 -- 172.21.15.33:0/1821822473 shutdown_connections 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 --2- 172.21.15.33:0/1821822473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c109130 0x7f781c10f930 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 --2- 172.21.15.33:0/1821822473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c1087b0 0x7f781c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 --2- 172.21.15.33:0/1821822473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c102da0 0x7f781c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 -- 172.21.15.33:0/1821822473 >> 172.21.15.33:0/1821822473 conn(0x7f781c0fe810 msgr2=0x7f781c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 -- 172.21.15.33:0/1821822473 shutdown_connections 2024-09-11T00:13:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.817+0000 7f7823e00640 1 -- 172.21.15.33:0/1821822473 wait complete. 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.818+0000 7f7823e00640 1 Processor -- start 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.818+0000 7f7823e00640 1 -- start start 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c1087b0 0x7f781c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 0x7f781c075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112cf0 con 0x7f781c102da0 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112b70 con 0x7f781c1087b0 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7823e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f781c112e70 con 0x7f781c109130 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7821400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7821400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40088/0 (socket says 172.21.15.33:40088) 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7821400640 1 -- 172.21.15.33:0/915904481 learned_addr learned my addr 172.21.15.33:0/915904481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7820a00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c1087b0 0x7f781c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.819+0000 7f7821e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 0x7f781c075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 -- 172.21.15.33:0/915904481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 msgr2=0x7f781c075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 0x7f781c075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 -- 172.21.15.33:0/915904481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c1087b0 msgr2=0x7f781c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c1087b0 0x7f781c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 -- 172.21.15.33:0/915904481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c1abaa0 con 0x7f781c102da0 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 0x7f781c075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7821400640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f781000d950 tx=0x7f781000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810017030 con 0x7f781c102da0 2024-09-11T00:13:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7810004020 con 0x7f781c102da0 2024-09-11T00:13:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100055d0 con 0x7f781c102da0 2024-09-11T00:13:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.820+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c1abc70 con 0x7f781c102da0 2024-09-11T00:13:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.821+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1ac130 con 0x7f781c102da0 2024-09-11T00:13:46.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.822+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c103180 con 0x7f781c102da0 2024-09-11T00:13:46.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.824+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7810009a30 con 0x7f781c102da0 2024-09-11T00:13:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.825+0000 7f781a000640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 0x7f78040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.825+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f78100e5a60 con 0x7f781c102da0 2024-09-11T00:13:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.825+0000 7f7820a00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 0x7f78040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.826+0000 7f7820a00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 0x7f78040b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f781c19d010 tx=0x7f780800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:46.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:46.829+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78100ac520 con 0x7f781c102da0 2024-09-11T00:13:46.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:46 smithi189 ceph-mon[34000]: pgmap v946: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 25 op/s 2024-09-11T00:13:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.061+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f781c02e5c0 con 0x7f781c102da0 2024-09-11T00:13:47.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.061+0000 7f781a000640 1 -- 172.21.15.33:0/915904481 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f78100abe20 con 0x7f781c102da0 2024-09-11T00:13:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:13:47.063 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:13:47.064 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:13:47.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 msgr2=0x7f78040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 0x7f78040b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f781c19d010 tx=0x7f780800b390 comp rx=0 tx=0).stop 2024-09-11T00:13:47.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 msgr2=0x7f781c076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f781000d950 tx=0x7f781000de10 comp rx=0 tx=0).stop 2024-09-11T00:13:47.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 shutdown_connections 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f78040b52e0 0x7f78040b77a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f781c109130 0x7f781c075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781c1087b0 0x7f781c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 --2- 172.21.15.33:0/915904481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f781c102da0 0x7f781c076f50 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 >> 172.21.15.33:0/915904481 conn(0x7f781c0fe810 msgr2=0x7f781c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 shutdown_connections 2024-09-11T00:13:47.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:47.064+0000 7f7823e00640 1 -- 172.21.15.33:0/915904481 wait complete. 2024-09-11T00:13:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:47 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/915904481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:47.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:47 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/915904481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:47.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:47 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/915904481' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:47.985 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --set-id e3bfb3ba --release --await' 2024-09-11T00:13:47.986 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --set-id e3bfb3ba --release --await 2024-09-11T00:13:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-11T00:13:48.385 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:48.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:48 smithi033 ceph-mon[30593]: pgmap v947: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 268 KiB/s wr, 36 op/s 2024-09-11T00:13:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:48 smithi189 ceph-mon[34000]: pgmap v947: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 268 KiB/s wr, 36 op/s 2024-09-11T00:13:48.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:48 smithi052 ceph-mon[33526]: pgmap v947: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 268 KiB/s wr, 36 op/s 2024-09-11T00:13:49.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 -- 172.21.15.33:0/3494322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 msgr2=0x7fc2d01117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/3494322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01117b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009900 tx=0x7fc2c802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 -- 172.21.15.33:0/3494322323 shutdown_connections 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/3494322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01117b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/3494322323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075f40 0x7fc2d010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/3494322323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075540 0x7fc2d0075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 -- 172.21.15.33:0/3494322323 >> 172.21.15.33:0/3494322323 conn(0x7fc2d00fe810 msgr2=0x7fc2d0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 -- 172.21.15.33:0/3494322323 shutdown_connections 2024-09-11T00:13:49.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.098+0000 7fc2d7e00640 1 -- 172.21.15.33:0/3494322323 wait complete. 2024-09-11T00:13:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.099+0000 7fc2d7e00640 1 Processor -- start 2024-09-11T00:13:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.099+0000 7fc2d7e00640 1 -- start start 2024-09-11T00:13:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075f40 0x7fc2d019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0114e60 con 0x7fc2d010f3c0 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0114ce0 con 0x7fc2d0075540 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0114fe0 con 0x7fc2d0075f40 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d5e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075f40 0x7fc2d019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:34164/0 (socket says 172.21.15.33:34164) 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.100+0000 7fc2d5400640 1 -- 172.21.15.33:0/884877986 learned_addr learned my addr 172.21.15.33:0/884877986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 -- 172.21.15.33:0/884877986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075f40 msgr2=0x7fc2d019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075f40 0x7fc2d019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 -- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 msgr2=0x7fc2d01a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 -- 172.21.15.33:0/884877986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d01a1460 con 0x7fc2d0075540 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d5400640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400eb90 tx=0x7fc2c400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2ce000640 1 -- 172.21.15.33:0/884877986 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4004d20 con 0x7fc2d0075540 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.101+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d01a1750 con 0x7fc2d0075540 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.102+0000 7fc2ce000640 1 -- 172.21.15.33:0/884877986 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c400ee90 con 0x7fc2d0075540 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.102+0000 7fc2ce000640 1 -- 172.21.15.33:0/884877986 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4010690 con 0x7fc2d0075540 2024-09-11T00:13:49.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.102+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d01a7e10 con 0x7fc2d0075540 2024-09-11T00:13:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.105+0000 7fc2ce000640 1 -- 172.21.15.33:0/884877986 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc2c4005020 con 0x7fc2d0075540 2024-09-11T00:13:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.107+0000 7fc2ce000640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 0x7fc2b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.107+0000 7fc2ce000640 1 -- 172.21.15.33:0/884877986 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc2c40e65b0 con 0x7fc2d0075540 2024-09-11T00:13:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.107+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 0x7fc2b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.108+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 0x7fc2b80b7820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2d01119e0 tx=0x7fc2bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 Processor -- start 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 -- start start 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b399c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5608b3907290 con 0x5608b398fff0 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608b38f66c0 con 0x5608b399c8a0 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2da84f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608b38fa4d0 con 0x5608b3990910 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.135+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40118/0 (socket says 172.21.15.33:40118) 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 -- 172.21.15.33:0/4192671705 learned_addr learned my addr 172.21.15.33:0/4192671705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b399c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 -- 172.21.15.33:0/4192671705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 msgr2=0x5608b399c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b399c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 -- 172.21.15.33:0/4192671705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 msgr2=0x5608b399ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 -- 172.21.15.33:0/4192671705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b3883460 con 0x5608b398fff0 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.136+0000 7fc2d5400640 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ac900 tx=0x7fc2c40ac810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe0e070a9dcd125 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2c2600640 1 -- 172.21.15.33:0/4192671705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40e5040 con 0x5608b398fff0 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2c2600640 1 -- 172.21.15.33:0/4192671705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c40ac480 con 0x5608b398fff0 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2c2600640 1 -- 172.21.15.33:0/4192671705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40b10d0 con 0x5608b398fff0 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 -- 172.21.15.33:0/4192671705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 msgr2=0x5608b39903d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ac900 tx=0x7fc2c40ac810 comp rx=0 tx=0).stop 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 -- 172.21.15.33:0/4192671705 shutdown_connections 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b399c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 --2- 172.21.15.33:0/4192671705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39903d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 -- 172.21.15.33:0/4192671705 >> 172.21.15.33:0/4192671705 conn(0x5608b398de20 msgr2=0x5608b398efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.137+0000 7fc2da84f740 1 -- 172.21.15.33:0/4192671705 shutdown_connections 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.138+0000 7fc2da84f740 1 -- 172.21.15.33:0/4192671705 wait complete. 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.138+0000 7fc2da84f740 1 -- start start 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.138+0000 7fc2da84f740 1 Processor -- start 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3999840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5608b3757bb0 con 0x5608b3990910 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608b38916c0 con 0x5608b399c8a0 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608b399f4f0 con 0x5608b398fff0 2024-09-11T00:13:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2da84f740 10 client.0 _ll_register_callbacks cb 0x5608b38ac490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40126/0 (socket says 172.21.15.33:40126) 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d4a00640 1 -- 172.21.15.33:0/1008633840 learned_addr learned my addr 172.21.15.33:0/1008633840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d5400640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3999840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d4a00640 1 -- 172.21.15.33:0/1008633840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 msgr2=0x5608b3999840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.139+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3999840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d4a00640 1 -- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 msgr2=0x5608b399a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d4a00640 1 -- 172.21.15.33:0/1008633840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b3654b00 con 0x5608b3990910 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d5400640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3999840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0117c0 tx=0x7fc2bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f466a2292b8d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01fbb0 con 0x5608b3990910 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc2bc01fd50 con 0x5608b3990910 2024-09-11T00:13:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.140+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2c40ac480 con 0x5608b3990910 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc028440 con 0x5608b3990910 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 10 client.17142 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5608b36cb960 con 0x5608b3990910 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c40ac480 con 0x5608b3990910 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc2bc026070 con 0x5608b3990910 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 10 client.17142 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:49.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 10 client.17142 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 20 client.17142 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b39ac4f0 0x5608b39ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 4 client.17142 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.141+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608b39091e0 con 0x5608b39ac4f0 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.142+0000 7fc2d5400640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b39ac4f0 0x5608b39ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.142+0000 7fc2d5400640 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b39ac4f0 0x5608b39ae910 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0f5073929a12f9 server_cookie=a0868f3fc23598b4 in_seq=0 out_seq=0 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.142+0000 7fc2b6a00640 10 client.17142 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.143+0000 7fc2b6a00640 1 -- 172.21.15.33:0/1008633840 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608b39091e0 con 0x5608b39ac4f0 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.143+0000 7fc2b6a00640 10 client.17142 handle_command_reply: tid=0 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.143+0000 7fc2da84f740 1 client.17142 shutdown 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 msgr2=0x5608b3999d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0117c0 tx=0x7fc2bc004730 comp rx=0 tx=0).stop 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 shutdown_connections 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b399a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3999d80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b39ac4f0 0x5608b39ae910 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 --2- 172.21.15.33:0/1008633840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3999840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2b6a00640 0 client.17142 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 >> 172.21.15.33:0/1008633840 conn(0x5608b398de20 msgr2=0x5608b39939c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 shutdown_connections 2024-09-11T00:13:49.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 1 -- 172.21.15.33:0/1008633840 wait complete. 2024-09-11T00:13:49.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.144+0000 7fc2da84f740 20 client.17142 trim_cache size 0 max 16384 2024-09-11T00:13:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 Processor -- start 2024-09-11T00:13:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 -- start start 2024-09-11T00:13:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3996a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b39b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01b4550 con 0x5608b3990910 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01b1e20 con 0x5608b399c8a0 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.162+0000 7fc2da84f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01afc70 con 0x5608b398fff0 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40132/0 (socket says 172.21.15.33:40132) 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 -- 172.21.15.33:0/2825946233 learned_addr learned my addr 172.21.15.33:0/2825946233 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d5400640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3996a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b39b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 -- 172.21.15.33:0/2825946233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 msgr2=0x5608b3996a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3996a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 -- 172.21.15.33:0/2825946233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 msgr2=0x5608b39b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b39b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d4a00640 1 -- 172.21.15.33:0/2825946233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b398e8a0 con 0x5608b3990910 2024-09-11T00:13:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.163+0000 7fc2d5400640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3996a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.164+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0276f0 tx=0x7fc2bc010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fbd61ef160d7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.164+0000 7fc2c1c00640 1 -- 172.21.15.33:0/2825946233 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc03c030 con 0x5608b3990910 2024-09-11T00:13:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.164+0000 7fc2c1c00640 1 -- 172.21.15.33:0/2825946233 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2bc0054b0 con 0x5608b3990910 2024-09-11T00:13:49.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.164+0000 7fc2c1c00640 1 -- 172.21.15.33:0/2825946233 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01fa60 con 0x5608b3990910 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- 172.21.15.33:0/2825946233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 msgr2=0x5608b3996f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0276f0 tx=0x7fc2bc010fd0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- 172.21.15.33:0/2825946233 shutdown_connections 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b39b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b3990910 0x5608b3996f90 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 --2- 172.21.15.33:0/2825946233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b398fff0 0x5608b3996a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- 172.21.15.33:0/2825946233 >> 172.21.15.33:0/2825946233 conn(0x5608b398de20 msgr2=0x5608b398cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- 172.21.15.33:0/2825946233 shutdown_connections 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- 172.21.15.33:0/2825946233 wait complete. 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 -- start start 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.165+0000 7fc2da84f740 1 Processor -- start 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b39a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b3a193d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01b02e0 con 0x5608b398fff0 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01b1750 con 0x5608b399c8a0 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d01b09b0 con 0x5608b3990910 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2da84f740 10 client.0 _ll_register_callbacks cb 0x7fc2bc011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2d5400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40136/0 (socket says 172.21.15.33:40136) 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2d5400640 1 -- 172.21.15.33:0/69652705 learned_addr learned my addr 172.21.15.33:0/69652705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b39a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.166+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b3a193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 -- 172.21.15.33:0/69652705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 msgr2=0x5608b39a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b39a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 -- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 msgr2=0x5608b3a193d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b3a193d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 -- 172.21.15.33:0/69652705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b39a27f0 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5e00640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b3a193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2d5400640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40a9be0 tx=0x7fc2c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5314fe37c263f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40e5040 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc2c40a8be0 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc0054b0 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc2c408f050 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2da84f740 10 client.17148 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.167+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5608b3a1aa20 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2bc0054b0 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc2c4005340 con 0x5608b398fff0 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 10 client.17148 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 10 client.17148 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 20 client.17148 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b3a1ad00 0x5608b3a1d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 4 client.17148 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e3bfb3ba", "release": true, "await": true}] 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e3bfb3ba", "release": true, "await": true}) -- 0x5608b3904c90 con 0x5608b3a1ad00 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.168+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b3a1ad00 0x5608b3a1d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.169+0000 7fc2d4a00640 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b3a1ad00 0x5608b3a1d0f0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d78645280585a7 server_cookie=ecdc8ec954d627d8 in_seq=0 out_seq=0 2024-09-11T00:13:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.169+0000 7fc2b6a00640 10 client.17148 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2b6a00640 1 -- 172.21.15.33:0/69652705 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5608b3904c90 con 0x5608b3a1ad00 2024-09-11T00:13:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2b6a00640 10 client.17148 handle_command_reply: tid=0 2024-09-11T00:13:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 client.17148 shutdown 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 msgr2=0x5608b39a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40a9be0 tx=0x7fc2c400cf90 comp rx=0 tx=0).stop 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 shutdown_connections 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608b399c8a0 0x5608b3a193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5608b3a1ad00 0x5608b3a1d0f0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5608b3990910 0x5608b39a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 --2- 172.21.15.33:0/69652705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608b398fff0 0x5608b39a1a20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.222+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 >> 172.21.15.33:0/69652705 conn(0x5608b398de20 msgr2=0x5608b398cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.223+0000 7fc2b6a00640 0 client.17148 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.223+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 shutdown_connections 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.223+0000 7fc2da84f740 1 -- 172.21.15.33:0/69652705 wait complete. 2024-09-11T00:13:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.223+0000 7fc2da84f740 20 client.17148 trim_cache size 0 max 16384 2024-09-11T00:13:49.228 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:13:49.228 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:13:49.228 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 52, 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "e3bfb3ba": { 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 52, 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:13:49.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 154.8, 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-09-11T00:13:49.230 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:13:49.231 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:13:49.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 msgr2=0x7fc2b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 0x7fc2b80b7820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2d01119e0 tx=0x7fc2bc00b390 comp rx=0 tx=0).stop 2024-09-11T00:13:49.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 msgr2=0x7fc2d019b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:49.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400eb90 tx=0x7fc2c400c6a0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 shutdown_connections 2024-09-11T00:13:49.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc2b80b5360 0x7fc2b80b7820 secure :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2d01119e0 tx=0x7fc2bc00b390 comp rx=0 tx=0).stop 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2d010f3c0 0x7fc2d01a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2d0075f40 0x7fc2d019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 --2- 172.21.15.33:0/884877986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2d0075540 0x7fc2d019b3b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.225+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 >> 172.21.15.33:0/884877986 conn(0x7fc2d00fe810 msgr2=0x7fc2d00ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.226+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 shutdown_connections 2024-09-11T00:13:49.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:13:49.226+0000 7fc2d7e00640 1 -- 172.21.15.33:0/884877986 wait complete. 2024-09-11T00:13:50.324 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e3bfb3ba', total seconds elapsed: 39.5 2024-09-11T00:13:50.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:50 smithi033 ceph-mon[30593]: pgmap v948: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 245 KiB/s wr, 32 op/s 2024-09-11T00:13:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:50 smithi189 ceph-mon[34000]: pgmap v948: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 245 KiB/s wr, 32 op/s 2024-09-11T00:13:50.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:50 smithi052 ceph-mon[33526]: pgmap v948: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 245 KiB/s wr, 32 op/s 2024-09-11T00:13:52.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:52 smithi033 ceph-mon[30593]: pgmap v949: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 311 KiB/s wr, 40 op/s 2024-09-11T00:13:52.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:52 smithi189 ceph-mon[34000]: pgmap v949: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 311 KiB/s wr, 40 op/s 2024-09-11T00:13:52.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:52 smithi052 ceph-mon[33526]: pgmap v949: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 311 KiB/s wr, 40 op/s 2024-09-11T00:13:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 845.0 s, 317.7 tps, lat 1889.274 ms stddev 6830.762 2024-09-11T00:13:54.741 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:54 smithi033 ceph-mon[30593]: pgmap v950: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:13:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:54 smithi189 ceph-mon[34000]: pgmap v950: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:13:54.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:54 smithi052 ceph-mon[33526]: pgmap v950: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-09-11T00:13:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 -- 172.21.15.33:0/2170796965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 msgr2=0x7f9680105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 --2- 172.21.15.33:0/2170796965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f9680105fa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f966802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 -- 172.21.15.33:0/2170796965 shutdown_connections 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 --2- 172.21.15.33:0/2170796965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801064e0 0x7f968010ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 --2- 172.21.15.33:0/2170796965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f9680105fa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 --2- 172.21.15.33:0/2170796965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801049d0 0x7f9680104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 -- 172.21.15.33:0/2170796965 >> 172.21.15.33:0/2170796965 conn(0x7f9680100270 msgr2=0x7f96801026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.016+0000 7f9685c00640 1 -- 172.21.15.33:0/2170796965 shutdown_connections 2024-09-11T00:13:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.017+0000 7f9685c00640 1 -- 172.21.15.33:0/2170796965 wait complete. 2024-09-11T00:13:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.018+0000 7f9685c00640 1 Processor -- start 2024-09-11T00:13:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.018+0000 7f9685c00640 1 -- start start 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801049d0 0x7f968019f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 0x7f96801a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96801105a0 con 0x7f96801049d0 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9680110420 con 0x7f9680105b20 2024-09-11T00:13:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f9685c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9680110720 con 0x7f96801064e0 2024-09-11T00:13:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f967f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f967f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43914/0 (socket says 172.21.15.33:43914) 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f967f400640 1 -- 172.21.15.33:0/1294443122 learned_addr learned my addr 172.21.15.33:0/1294443122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.019+0000 7f967fe00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801049d0 0x7f968019f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f967f400640 1 -- 172.21.15.33:0/1294443122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 msgr2=0x7f96801a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f9685200640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 0x7f96801a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f967f400640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 0x7f96801a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f967f400640 1 -- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801049d0 msgr2=0x7f968019f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f967f400640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801049d0 0x7f968019f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f967f400640 1 -- 172.21.15.33:0/1294443122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801a0be0 con 0x7f9680105b20 2024-09-11T00:13:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.020+0000 7f9685200640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 0x7f96801a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f967f400640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9668005ab0 tx=0x7f9668003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f967cc00640 1 -- 172.21.15.33:0/1294443122 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966803f070 con 0x7f9680105b20 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f967cc00640 1 -- 172.21.15.33:0/1294443122 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9668031d10 con 0x7f9680105b20 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f967cc00640 1 -- 172.21.15.33:0/1294443122 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668035030 con 0x7f9680105b20 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801a0e70 con 0x7f9680105b20 2024-09-11T00:13:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.021+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a7440 con 0x7f9680105b20 2024-09-11T00:13:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.026+0000 7f968a038740 1 Processor -- start 2024-09-11T00:13:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.026+0000 7f967cc00640 1 -- 172.21.15.33:0/1294443122 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f966803b460 con 0x7f9680105b20 2024-09-11T00:13:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 -- start start 2024-09-11T00:13:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x55847991cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x55847991f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55847988d6b0 con 0x55847991a970 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55847987cae0 con 0x55847991fce0 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f968a038740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5584798808f0 con 0x55847991d2a0 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f9685200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x55847991cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f967fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x55847991f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f967fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x55847991f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47232/0 (socket says 172.21.15.33:47232) 2024-09-11T00:13:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.027+0000 7f967fe00640 1 -- 172.21.15.33:0/2745742403 learned_addr learned my addr 172.21.15.33:0/2745742403 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.028+0000 7f967f400640 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f9685200640 1 -- 172.21.15.33:0/2745742403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 msgr2=0x55847991f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f9685200640 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x55847991f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f9685200640 1 -- 172.21.15.33:0/2745742403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 msgr2=0x5584799221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f9685200640 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f9685200640 1 -- 172.21.15.33:0/2745742403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558479849780 con 0x55847991a970 2024-09-11T00:13:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f967cc00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 0x7f96640b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.029+0000 7f967cc00640 1 -- 172.21.15.33:0/1294443122 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f9668106d10 con 0x7f9680105b20 2024-09-11T00:13:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.030+0000 7f9685200640 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x55847991cd60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9678007e40 tx=0x7f967800c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6c5439466b3aef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.030+0000 7f967fe00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 0x7f96640b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.030+0000 7f9675600640 1 -- 172.21.15.33:0/2745742403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678014070 con 0x55847991a970 2024-09-11T00:13:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.030+0000 7f9675600640 1 -- 172.21.15.33:0/2745742403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f967800fce0 con 0x55847991a970 2024-09-11T00:13:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.031+0000 7f9675600640 1 -- 172.21.15.33:0/2745742403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800eb10 con 0x55847991a970 2024-09-11T00:13:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 -- 172.21.15.33:0/2745742403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 msgr2=0x55847991cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x55847991cd60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9678007e40 tx=0x7f967800c690 comp rx=0 tx=0).stop 2024-09-11T00:13:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f967fe00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 0x7f96640b78e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f967000a5c0 tx=0x7f967000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 -- 172.21.15.33:0/2745742403 shutdown_connections 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x55847991f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 --2- 172.21.15.33:0/2745742403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x55847991cd60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 -- 172.21.15.33:0/2745742403 >> 172.21.15.33:0/2745742403 conn(0x558479915ac0 msgr2=0x558479916850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 -- 172.21.15.33:0/2745742403 shutdown_connections 2024-09-11T00:13:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.032+0000 7f968a038740 1 -- 172.21.15.33:0/2745742403 wait complete. 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.033+0000 7f968a038740 1 -- start start 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.033+0000 7f968a038740 1 Processor -- start 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479924140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x5584799247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5584797b4ab0 con 0x55847991d2a0 2024-09-11T00:13:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558479823570 con 0x55847991fce0 2024-09-11T00:13:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558479922d60 con 0x55847991a970 2024-09-11T00:13:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f968a038740 10 client.0 _ll_register_callbacks cb 0x558479832100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f9685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f9685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43922/0 (socket says 172.21.15.33:43922) 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f9685200640 1 -- 172.21.15.33:0/1084275796 learned_addr learned my addr 172.21.15.33:0/1084275796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f967f400640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x5584799247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.034+0000 7f967fe00640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479924140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f9685200640 1 -- 172.21.15.33:0/1084275796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 msgr2=0x558479924140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f9685200640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479924140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f9685200640 1 -- 172.21.15.33:0/1084275796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 msgr2=0x5584799247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f9685200640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x5584799247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f9685200640 1 -- 172.21.15.33:0/1084275796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584795de790 con 0x55847991fce0 2024-09-11T00:13:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.035+0000 7f967fe00640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479924140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.036+0000 7f9685200640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9678007bb0 tx=0x7f967800fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877efa4aa4cacf90 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.036+0000 7f966e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.036+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678014040 con 0x55847991fce0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.036+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f967800ec20 con 0x55847991fce0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.036+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f967800fce0 con 0x55847991fce0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.037+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f967800fb10 con 0x55847991fce0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.037+0000 7f968a038740 10 client.37085 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.037+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558479657620 con 0x55847991fce0 2024-09-11T00:13:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.038+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f967800fce0 con 0x55847991fce0 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.038+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9678019b70 con 0x55847991fce0 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 10 client.37085 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 10 client.37085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 20 client.37085 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55847992f6f0 0x558479931ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 4 client.37085 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:13:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55847988f600 con 0x55847992f6f0 2024-09-11T00:13:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.039+0000 7f967fe00640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55847992f6f0 0x558479931ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.040+0000 7f967fe00640 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55847992f6f0 0x558479931ae0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa5e94a5a574e7e server_cookie=9fda6fbcfc547325 in_seq=0 out_seq=0 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.040+0000 7f966e000640 10 client.37085 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.041+0000 7f966e000640 1 -- 172.21.15.33:0/1084275796 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55847988f600 con 0x55847992f6f0 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.041+0000 7f966e000640 10 client.37085 handle_command_reply: tid=0 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.041+0000 7f968a038740 1 client.37085 shutdown 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 msgr2=0x5584799253b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9678007bb0 tx=0x7f967800fe90 comp rx=0 tx=0).stop 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 shutdown_connections 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799253b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x5584799247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55847992f6f0 0x558479931ae0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 --2- 172.21.15.33:0/1084275796 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479924140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 >> 172.21.15.33:0/1084275796 conn(0x558479915ac0 msgr2=0x558479914bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f966e000640 0 client.37085 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 shutdown_connections 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.042+0000 7f968a038740 1 -- 172.21.15.33:0/1084275796 wait complete. 2024-09-11T00:13:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.043+0000 7f968a038740 20 client.37085 trim_cache size 0 max 16384 2024-09-11T00:13:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 Processor -- start 2024-09-11T00:13:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 -- start start 2024-09-11T00:13:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479919e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x55847991a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799200c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96801b43e0 con 0x55847991d2a0 2024-09-11T00:13:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96801b1cb0 con 0x55847991fce0 2024-09-11T00:13:55.076 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.074+0000 7f968a038740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96801afb00 con 0x55847991a970 2024-09-11T00:13:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f967f400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x55847991a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f967fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479919e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f967fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479919e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47252/0 (socket says 172.21.15.33:47252) 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f967fe00640 1 -- 172.21.15.33:0/2924844665 learned_addr learned my addr 172.21.15.33:0/2924844665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 -- 172.21.15.33:0/2924844665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 msgr2=0x558479919e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479919e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 -- 172.21.15.33:0/2924844665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 msgr2=0x55847991a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x55847991a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.075+0000 7f9685200640 1 -- 172.21.15.33:0/2924844665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847992c7a0 con 0x55847991fce0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.076+0000 7f9685200640 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799200c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9678000f80 tx=0x7f9678021670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b82d631a7a3561 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.076+0000 7f9674c00640 1 -- 172.21.15.33:0/2924844665 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967803a070 con 0x55847991fce0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.076+0000 7f9674c00640 1 -- 172.21.15.33:0/2924844665 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9678026070 con 0x55847991fce0 2024-09-11T00:13:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.076+0000 7f9674c00640 1 -- 172.21.15.33:0/2924844665 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678014040 con 0x55847991fce0 2024-09-11T00:13:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 -- 172.21.15.33:0/2924844665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 msgr2=0x5584799200c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799200c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9678000f80 tx=0x7f9678021670 comp rx=0 tx=0).stop 2024-09-11T00:13:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 -- 172.21.15.33:0/2924844665 shutdown_connections 2024-09-11T00:13:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x5584799200c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991d2a0 0x55847991a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 --2- 172.21.15.33:0/2924844665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991a970 0x558479919e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 -- 172.21.15.33:0/2924844665 >> 172.21.15.33:0/2924844665 conn(0x558479915ac0 msgr2=0x5584799232e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 -- 172.21.15.33:0/2924844665 shutdown_connections 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.077+0000 7f968a038740 1 -- 172.21.15.33:0/2924844665 wait complete. 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.078+0000 7f968a038740 1 -- start start 2024-09-11T00:13:55.080 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.078+0000 7f968a038740 1 Processor -- start 2024-09-11T00:13:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x558479926c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x558479927330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96801b0170 con 0x55847991a970 2024-09-11T00:13:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96801b15e0 con 0x55847991fce0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96801b0840 con 0x55847991d2a0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f968a038740 10 client.0 _ll_register_callbacks cb 0x7f967000a730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f9685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f9685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:43942/0 (socket says 172.21.15.33:43942) 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f9685200640 1 -- 172.21.15.33:0/431500469 learned_addr learned my addr 172.21.15.33:0/431500469 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f967fe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x558479926c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.079+0000 7f967f400640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x558479927330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 -- 172.21.15.33:0/431500469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 msgr2=0x558479927330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x558479927330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 -- 172.21.15.33:0/431500469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 msgr2=0x558479926c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x558479926c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 -- 172.21.15.33:0/431500469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558479928730 con 0x55847991fce0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f9685200640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9678038040 tx=0x7f96780075d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cf740a38594fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f966e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967803a070 con 0x55847991fce0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.080+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9678026070 con 0x55847991fce0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.081+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f967800ea20 con 0x55847991fce0 2024-09-11T00:13:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.081+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9678014040 con 0x55847991fce0 2024-09-11T00:13:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.082+0000 7f968a038740 10 client.37091 fetch_fsmap learned FSMap version 30 2024-09-11T00:13:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.082+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55847992bab0 con 0x55847991fce0 2024-09-11T00:13:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9678026070 con 0x55847991fce0 2024-09-11T00:13:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9678019450 con 0x55847991fce0 2024-09-11T00:13:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f968a038740 10 client.37091 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:13:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f968a038740 10 client.37091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:13:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f968a038740 20 client.37091 populate_metadata read hostname 'smithi033' 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.084+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5584799ad430 0x5584799af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.085+0000 7f968a038740 4 client.37091 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.085+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55847988b0b0 con 0x5584799ad430 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.085+0000 7f967fe00640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5584799ad430 0x5584799af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.086+0000 7f967fe00640 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5584799ad430 0x5584799af820 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f14c6e805ca77c4b server_cookie=ea2c6258672c801 in_seq=0 out_seq=0 2024-09-11T00:13:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.086+0000 7f966e000640 10 client.37091 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.204+0000 7f966e000640 1 -- 172.21.15.33:0/431500469 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55847988b0b0 con 0x5584799ad430 2024-09-11T00:13:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.204+0000 7f966e000640 10 client.37091 handle_command_reply: tid=0 2024-09-11T00:13:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.204+0000 7f968a038740 1 client.37091 shutdown 2024-09-11T00:13:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 msgr2=0x558479927f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9678038040 tx=0x7f96780075d0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 shutdown_connections 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55847991fce0 0x558479927f00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5584799ad430 0x5584799af820 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55847991d2a0 0x558479927330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 --2- 172.21.15.33:0/431500469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55847991a970 0x558479926c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 >> 172.21.15.33:0/431500469 conn(0x558479915ac0 msgr2=0x558479919d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.205+0000 7f966e000640 0 client.37091 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:13:55.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.206+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 shutdown_connections 2024-09-11T00:13:55.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.206+0000 7f968a038740 1 -- 172.21.15.33:0/431500469 wait complete. 2024-09-11T00:13:55.208 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.207+0000 7f968a038740 20 client.37091 trim_cache size 0 max 16384 2024-09-11T00:13:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:13:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:13:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:13:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:13:55.209 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.208+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 msgr2=0x7f96640b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.208+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 0x7f96640b78e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f967000a5c0 tx=0x7f967000a2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.208+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 msgr2=0x7f968019f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.208+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9668005ab0 tx=0x7f9668003d80 comp rx=0 tx=0).stop 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 shutdown_connections 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f96640b5420 0x7f96640b78e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96801064e0 0x7f96801a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9680105b20 0x7f968019f6f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 --2- 172.21.15.33:0/1294443122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96801049d0 0x7f968019f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 >> 172.21.15.33:0/1294443122 conn(0x7f9680100270 msgr2=0x7f96800795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 shutdown_connections 2024-09-11T00:13:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:13:55.209+0000 7f9685c00640 1 -- 172.21.15.33:0/1294443122 wait complete. 2024-09-11T00:13:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:56 smithi033 ceph-mon[30593]: pgmap v951: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 136 op/s 2024-09-11T00:13:56.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:56 smithi189 ceph-mon[34000]: pgmap v951: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 136 op/s 2024-09-11T00:13:56.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:56 smithi052 ceph-mon[33526]: pgmap v951: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.6 MiB/s wr, 136 op/s 2024-09-11T00:13:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 850.0 s, 597.6 tps, lat 168.043 ms stddev 58.788 2024-09-11T00:13:58.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:13:58 smithi033 ceph-mon[30593]: pgmap v952: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-09-11T00:13:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:13:58 smithi189 ceph-mon[34000]: pgmap v952: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-09-11T00:13:58.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:13:58 smithi052 ceph-mon[33526]: pgmap v952: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 323 op/s 2024-09-11T00:14:00.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:00 smithi033 ceph-mon[30593]: pgmap v953: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-09-11T00:14:00.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:00 smithi189 ceph-mon[34000]: pgmap v953: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-09-11T00:14:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:00 smithi052 ceph-mon[33526]: pgmap v953: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-09-11T00:14:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:02 smithi033 ceph-mon[30593]: pgmap v954: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2024-09-11T00:14:02.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:02 smithi189 ceph-mon[34000]: pgmap v954: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2024-09-11T00:14:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:02 smithi052 ceph-mon[33526]: pgmap v954: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2024-09-11T00:14:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 855.0 s, 614.5 tps, lat 162.147 ms stddev 46.576 2024-09-11T00:14:04.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:04 smithi033 ceph-mon[30593]: pgmap v955: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2024-09-11T00:14:04.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:04 smithi189 ceph-mon[34000]: pgmap v955: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2024-09-11T00:14:04.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:04 smithi052 ceph-mon[33526]: pgmap v955: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.3 MiB/s wr, 612 op/s 2024-09-11T00:14:06.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:06 smithi033 ceph-mon[30593]: pgmap v956: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-11T00:14:06.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:06 smithi189 ceph-mon[34000]: pgmap v956: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-11T00:14:06.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:06 smithi052 ceph-mon[33526]: pgmap v956: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.5 MiB/s wr, 536 op/s 2024-09-11T00:14:08.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 860.0 s, 575.6 tps, lat 173.623 ms stddev 60.425 2024-09-11T00:14:08.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.480+0000 7fd50b800640 1 -- 172.21.15.33:0/3456747976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 msgr2=0x7fd5040749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.482 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.480+0000 7fd50b800640 1 --2- 172.21.15.33:0/3456747976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5040749d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009900 tx=0x7fd4ec02a400 comp rx=0 tx=0).stop 2024-09-11T00:14:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.482+0000 7fd50b800640 1 -- 172.21.15.33:0/3456747976 shutdown_connections 2024-09-11T00:14:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.482+0000 7fd50b800640 1 --2- 172.21.15.33:0/3456747976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd50410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.482+0000 7fd50b800640 1 --2- 172.21.15.33:0/3456747976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd50410a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.482+0000 7fd50b800640 1 --2- 172.21.15.33:0/3456747976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5040749d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.484 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.482+0000 7fd50b800640 1 -- 172.21.15.33:0/3456747976 >> 172.21.15.33:0/3456747976 conn(0x7fd50406fa40 msgr2=0x7fd504071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.484+0000 7fd50b800640 1 -- 172.21.15.33:0/3456747976 shutdown_connections 2024-09-11T00:14:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.484+0000 7fd50b800640 1 -- 172.21.15.33:0/3456747976 wait complete. 2024-09-11T00:14:08.488 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.487+0000 7fd50b800640 1 Processor -- start 2024-09-11T00:14:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 -- start start 2024-09-11T00:14:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5041a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.494 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd5041a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd504116cc0 con 0x7fd50410a510 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd504116b40 con 0x7fd504073b50 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.492+0000 7fd50b800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd504116e40 con 0x7fd5040745d0 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.493+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.493+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52342/0 (socket says 172.21.15.33:52342) 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.493+0000 7fd508e00640 1 -- 172.21.15.33:0/1329028358 learned_addr learned my addr 172.21.15.33:0/1329028358 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.493+0000 7fd503e00640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5041a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.495 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd509800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd5041a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd508e00640 1 -- 172.21.15.33:0/1329028358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 msgr2=0x7fd5041a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd508e00640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5041a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd508e00640 1 -- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 msgr2=0x7fd5041a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd508e00640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd5041a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd508e00640 1 -- 172.21.15.33:0/1329028358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5041a2fd0 con 0x7fd504073b50 2024-09-11T00:14:08.496 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.494+0000 7fd509800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd5041a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.495+0000 7fd508e00640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009850 tx=0x7fd4ec003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.497 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.496+0000 7fd501600640 1 -- 172.21.15.33:0/1329028358 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec03f070 con 0x7fd504073b50 2024-09-11T00:14:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.496+0000 7fd501600640 1 -- 172.21.15.33:0/1329028358 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4ec031b90 con 0x7fd504073b50 2024-09-11T00:14:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.496+0000 7fd501600640 1 -- 172.21.15.33:0/1329028358 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec035030 con 0x7fd504073b50 2024-09-11T00:14:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.497+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5041a3260 con 0x7fd504073b50 2024-09-11T00:14:08.498 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.497+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5041a97b0 con 0x7fd504073b50 2024-09-11T00:14:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.505+0000 7fd50e6ce740 1 Processor -- start 2024-09-11T00:14:08.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.506+0000 7fd50e6ce740 1 -- start start 2024-09-11T00:14:08.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.506+0000 7fd501600640 1 -- 172.21.15.33:0/1329028358 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd4ec031700 con 0x7fd504073b50 2024-09-11T00:14:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.509+0000 7fd501600640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 0x7fd4e80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.509+0000 7fd501600640 1 -- 172.21.15.33:0/1329028358 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4ec106bf0 con 0x7fd504073b50 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 0x561e9d166b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d167040 0x561e9d175e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d1787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561e9d0db6b0 con 0x561e9d166700 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561e9d0caae0 con 0x561e9d167040 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.510+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e9d0ce8f0 con 0x561e9d1763a0 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd508e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 0x561e9d166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd508e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 0x561e9d166b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53682/0 (socket says 172.21.15.33:53682) 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd503e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d167040 0x561e9d175e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd508e00640 1 -- 172.21.15.33:0/1447741259 learned_addr learned my addr 172.21.15.33:0/1447741259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd509800640 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d1787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.511+0000 7fd509800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 0x7fd4e80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.512+0000 7fd509800640 1 -- 172.21.15.33:0/1447741259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d167040 msgr2=0x561e9d175e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.512+0000 7fd509800640 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d167040 0x561e9d175e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.512+0000 7fd509800640 1 -- 172.21.15.33:0/1447741259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 msgr2=0x561e9d166b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.512+0000 7fd509800640 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 0x561e9d166b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.512+0000 7fd509800640 1 -- 172.21.15.33:0/1447741259 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9d097780 con 0x561e9d1763a0 2024-09-11T00:14:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.513+0000 7fd509800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 0x7fd4e80b79b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00afd0 tx=0x7fd4fc00c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.513+0000 7fd509800640 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d1787d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd5041a2210 tx=0x7fd4fc00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde7c52a7ee68dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.513+0000 7fd4fa000640 1 -- 172.21.15.33:0/1447741259 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc020070 con 0x561e9d1763a0 2024-09-11T00:14:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.513+0000 7fd4fa000640 1 -- 172.21.15.33:0/1447741259 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4fc00aaf0 con 0x561e9d1763a0 2024-09-11T00:14:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.513+0000 7fd4fa000640 1 -- 172.21.15.33:0/1447741259 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc01ce10 con 0x561e9d1763a0 2024-09-11T00:14:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.514+0000 7fd50e6ce740 1 -- 172.21.15.33:0/1447741259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 msgr2=0x561e9d1787d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.514+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d1787d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd5041a2210 tx=0x7fd4fc00f730 comp rx=0 tx=0).stop 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.515+0000 7fd50e6ce740 1 -- 172.21.15.33:0/1447741259 shutdown_connections 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.515+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d1787d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.515+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d167040 0x561e9d175e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.515+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/1447741259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d166700 0x561e9d166b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.515+0000 7fd50e6ce740 1 -- 172.21.15.33:0/1447741259 >> 172.21.15.33:0/1447741259 conn(0x561e9d163860 msgr2=0x561e9d1645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.516+0000 7fd50e6ce740 1 -- 172.21.15.33:0/1447741259 shutdown_connections 2024-09-11T00:14:08.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.516+0000 7fd50e6ce740 1 -- 172.21.15.33:0/1447741259 wait complete. 2024-09-11T00:14:08.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.517+0000 7fd50e6ce740 1 -- start start 2024-09-11T00:14:08.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.518+0000 7fd50e6ce740 1 Processor -- start 2024-09-11T00:14:08.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.519+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.519+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 0x561e9d17ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.519+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561e9d002ab0 con 0x561e9d167040 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561e9d071570 con 0x561e9d166700 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e9d179290 con 0x561e9d1763a0 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd50e6ce740 10 client.0 _ll_register_callbacks cb 0x561e9d080100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd509800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd509800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47026/0 (socket says 172.21.15.33:47026) 2024-09-11T00:14:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.520+0000 7fd509800640 1 -- 172.21.15.33:0/4092427004 learned_addr learned my addr 172.21.15.33:0/4092427004 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd503e00640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 0x561e9d17ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd509800640 1 -- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 msgr2=0x561e9d17a790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd509800640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd509800640 1 -- 172.21.15.33:0/4092427004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 msgr2=0x561e9d17ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd509800640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 0x561e9d17ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd509800640 1 -- 172.21.15.33:0/4092427004 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e9ce2c790 con 0x561e9d1763a0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.521+0000 7fd503e00640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 0x561e9d17ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.522+0000 7fd509800640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc01ce00 tx=0x7fd4fc01ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a783e622ed7d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.522+0000 7fd4f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.522+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc020040 con 0x561e9d1763a0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.522+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4fc011480 con 0x561e9d1763a0 2024-09-11T00:14:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.522+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc00aaf0 con 0x561e9d1763a0 2024-09-11T00:14:08.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.523+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc03b050 con 0x561e9d1763a0 2024-09-11T00:14:08.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.523+0000 7fd50e6ce740 10 client.27055 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:08.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.523+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e9cea5620 con 0x561e9d1763a0 2024-09-11T00:14:08.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4fc032070 con 0x561e9d1763a0 2024-09-11T00:14:08.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd4fc025450 con 0x561e9d1763a0 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 10 client.27055 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 10 client.27055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 20 client.27055 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d188230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 4 client.27055 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.524+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd4fc00aaf0 con 0x561e9d185e40 2024-09-11T00:14:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.525+0000 7fd508e00640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d188230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.527+0000 7fd508e00640 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d188230 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7ad125e889b78f server_cookie=f5549345b1d33205 in_seq=0 out_seq=0 2024-09-11T00:14:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.527+0000 7fd4f2a00640 10 client.27055 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.528+0000 7fd4f2a00640 1 -- 172.21.15.33:0/4092427004 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd4fc00aaf0 con 0x561e9d185e40 2024-09-11T00:14:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.528+0000 7fd4f2a00640 10 client.27055 handle_command_reply: tid=0 2024-09-11T00:14:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.528+0000 7fd50e6ce740 1 client.27055 shutdown 2024-09-11T00:14:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 msgr2=0x561e9d17ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc01ce00 tx=0x7fd4fc01ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 shutdown_connections 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d188230 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d1763a0 0x561e9d17ba00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd4f2a00640 0 client.27055 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d167040 0x561e9d17ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4092427004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.529+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 >> 172.21.15.33:0/4092427004 conn(0x561e9d163860 msgr2=0x561e9d162a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.530+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 shutdown_connections 2024-09-11T00:14:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.530+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4092427004 wait complete. 2024-09-11T00:14:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.530+0000 7fd50e6ce740 20 client.27055 trim_cache size 0 max 16384 2024-09-11T00:14:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.574+0000 7fd50e6ce740 1 Processor -- start 2024-09-11T00:14:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.575+0000 7fd50e6ce740 1 -- start start 2024-09-11T00:14:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.575+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.575+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d174c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.575+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d179660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd503e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d174c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52366/0 (socket says 172.21.15.33:52366) 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd508e00640 1 -- 172.21.15.33:0/4068736875 learned_addr learned my addr 172.21.15.33:0/4068736875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd509800640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d179660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b44f0 con 0x561e9d1763a0 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b1dc0 con 0x561e9d166700 2024-09-11T00:14:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.576+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041afc10 con 0x561e9d167040 2024-09-11T00:14:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.579+0000 7fd503e00640 1 -- 172.21.15.33:0/4068736875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 msgr2=0x561e9d166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.579+0000 7fd503e00640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.579+0000 7fd503e00640 1 -- 172.21.15.33:0/4068736875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 msgr2=0x561e9d179660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.579+0000 7fd503e00640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d179660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.579+0000 7fd503e00640 1 -- 172.21.15.33:0/4068736875 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9d176190 con 0x561e9d167040 2024-09-11T00:14:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.580+0000 7fd508e00640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.580+0000 7fd509800640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d179660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.581+0000 7fd503e00640 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d174c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009c50 tx=0x7fd4f4013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea46df297cb280f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.582+0000 7fd4f9600640 1 -- 172.21.15.33:0/4068736875 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4021070 con 0x561e9d167040 2024-09-11T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.583+0000 7fd4f9600640 1 -- 172.21.15.33:0/4068736875 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4f4009e00 con 0x561e9d167040 2024-09-11T00:14:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.583+0000 7fd4f9600640 1 -- 172.21.15.33:0/4068736875 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401c700 con 0x561e9d167040 2024-09-11T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 msgr2=0x561e9d174c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d174c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009c50 tx=0x7fd4f4013830 comp rx=0 tx=0).stop 2024-09-11T00:14:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 shutdown_connections 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d179660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d174c20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/4068736875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.585+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 >> 172.21.15.33:0/4068736875 conn(0x561e9d163860 msgr2=0x561e9d174510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.586+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 shutdown_connections 2024-09-11T00:14:08.587 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.586+0000 7fd50e6ce740 1 -- 172.21.15.33:0/4068736875 wait complete. 2024-09-11T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.586+0000 7fd50e6ce740 1 -- start start 2024-09-11T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.587+0000 7fd50e6ce740 1 Processor -- start 2024-09-11T00:14:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.587+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.588+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.588+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.588+0000 7fd508e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:52368/0 (socket says 172.21.15.33:52368) 2024-09-11T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.588+0000 7fd50e6ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d17f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd503e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd50e6ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b0280 con 0x561e9d1763a0 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd508e00640 1 -- 172.21.15.33:0/2205697215 learned_addr learned my addr 172.21.15.33:0/2205697215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b16f0 con 0x561e9d166700 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b0950 con 0x561e9d167040 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd50e6ce740 10 client.0 _ll_register_callbacks cb 0x7fd4ec031a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.589+0000 7fd503e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:47034/0 (socket says 172.21.15.33:47034) 2024-09-11T00:14:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd509800640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d17f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd503e00640 1 -- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 msgr2=0x561e9d17e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd503e00640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd503e00640 1 -- 172.21.15.33:0/2205697215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 msgr2=0x561e9d17f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd503e00640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d17f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.590+0000 7fd503e00640 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e9d17fb90 con 0x561e9d167040 2024-09-11T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.591+0000 7fd503e00640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009c50 tx=0x7fd4f4010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e3f34d6766046a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.591+0000 7fd4f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.591+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4021040 con 0x561e9d167040 2024-09-11T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.591+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd4f4010be0 con 0x561e9d167040 2024-09-11T00:14:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.591+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f4009e00 con 0x561e9d167040 2024-09-11T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.592+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd4f4033050 con 0x561e9d167040 2024-09-11T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.592+0000 7fd50e6ce740 10 client.27061 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.592+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561e9d1f3450 con 0x561e9d167040 2024-09-11T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.592+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4f402a070 con 0x561e9d167040 2024-09-11T00:14:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.593+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd4f4024070 con 0x561e9d167040 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.593+0000 7fd50e6ce740 10 client.27061 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd50e6ce740 10 client.27061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd50e6ce740 20 client.27061 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d1f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd50e6ce740 4 client.27061 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:14:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd4f4009e00 con 0x561e9d185e40 2024-09-11T00:14:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.594+0000 7fd508e00640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d1f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.595+0000 7fd508e00640 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d1f5dc0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c5c52bd713ea62 server_cookie=5bff8daadd5ed965 in_seq=0 out_seq=0 2024-09-11T00:14:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.595+0000 7fd4f2a00640 10 client.27061 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.662+0000 7fd4f2a00640 1 -- 172.21.15.33:0/2205697215 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd4f4009e00 con 0x561e9d185e40 2024-09-11T00:14:08.663 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.662+0000 7fd4f2a00640 10 client.27061 handle_command_reply: tid=0 2024-09-11T00:14:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.662+0000 7fd50e6ce740 1 client.27061 shutdown 2024-09-11T00:14:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 msgr2=0x561e9d17e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009c50 tx=0x7fd4f4010a70 comp rx=0 tx=0).stop 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 shutdown_connections 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561e9d1763a0 0x561e9d17f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x561e9d185e40 0x561e9d1f5dc0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e9d167040 0x561e9d17e940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 --2- 172.21.15.33:0/2205697215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561e9d166700 0x561e9d17e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 >> 172.21.15.33:0/2205697215 conn(0x561e9d163860 msgr2=0x561e9d179660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.663+0000 7fd4f2a00640 0 client.27061 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.664+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 shutdown_connections 2024-09-11T00:14:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.664+0000 7fd50e6ce740 1 -- 172.21.15.33:0/2205697215 wait complete. 2024-09-11T00:14:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.664+0000 7fd50e6ce740 20 client.27061 trim_cache size 0 max 16384 2024-09-11T00:14:08.666 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:14:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:14:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:14:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:14:08.667 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 msgr2=0x7fd4e80b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 0x7fd4e80b79b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00afd0 tx=0x7fd4fc00c000 comp rx=0 tx=0).stop 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 msgr2=0x7fd5041a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009850 tx=0x7fd4ec003b90 comp rx=0 tx=0).stop 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 shutdown_connections 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd4e80b54f0 0x7fd4e80b79b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.668 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd50410a510 0x7fd5041a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5040745d0 0x7fd5041a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 --2- 172.21.15.33:0/1329028358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd504073b50 0x7fd5041a1490 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.666+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 >> 172.21.15.33:0/1329028358 conn(0x7fd50406fa40 msgr2=0x7fd50410b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.667+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 shutdown_connections 2024-09-11T00:14:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:08.668+0000 7fd50b800640 1 -- 172.21.15.33:0/1329028358 wait complete. 2024-09-11T00:14:08.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:08 smithi189 ceph-mon[34000]: pgmap v957: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-09-11T00:14:08.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:08 smithi052 ceph-mon[33526]: pgmap v957: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-09-11T00:14:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:08 smithi033 ceph-mon[30593]: pgmap v957: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-09-11T00:14:10.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:10 smithi189 ceph-mon[34000]: pgmap v958: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 610 op/s 2024-09-11T00:14:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:10 smithi052 ceph-mon[33526]: pgmap v958: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 610 op/s 2024-09-11T00:14:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:10 smithi033 ceph-mon[30593]: pgmap v958: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.7 MiB/s wr, 610 op/s 2024-09-11T00:14:12.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:12 smithi189 ceph-mon[34000]: pgmap v959: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.4 MiB/s wr, 646 op/s 2024-09-11T00:14:12.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:12 smithi052 ceph-mon[33526]: pgmap v959: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.4 MiB/s wr, 646 op/s 2024-09-11T00:14:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:12 smithi033 ceph-mon[30593]: pgmap v959: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.4 MiB/s wr, 646 op/s 2024-09-11T00:14:13.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 865.0 s, 569.8 tps, lat 175.786 ms stddev 54.617 2024-09-11T00:14:14.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:14 smithi189 ceph-mon[34000]: pgmap v960: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 719 op/s 2024-09-11T00:14:14.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:14 smithi052 ceph-mon[33526]: pgmap v960: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 719 op/s 2024-09-11T00:14:15.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:14 smithi033 ceph-mon[30593]: pgmap v960: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 719 op/s 2024-09-11T00:14:16.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:16 smithi189 ceph-mon[34000]: pgmap v961: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 577 op/s 2024-09-11T00:14:16.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:16 smithi052 ceph-mon[33526]: pgmap v961: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 577 op/s 2024-09-11T00:14:17.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:16 smithi033 ceph-mon[30593]: pgmap v961: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 577 op/s 2024-09-11T00:14:18.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 870.0 s, 544.3 tps, lat 183.316 ms stddev 142.516 2024-09-11T00:14:18.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:18 smithi189 ceph-mon[34000]: pgmap v962: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 739 op/s 2024-09-11T00:14:18.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:18 smithi052 ceph-mon[33526]: pgmap v962: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 739 op/s 2024-09-11T00:14:19.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:18 smithi033 ceph-mon[30593]: pgmap v962: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 739 op/s 2024-09-11T00:14:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:20 smithi189 ceph-mon[34000]: pgmap v963: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 8.4 MiB/s wr, 674 op/s 2024-09-11T00:14:20.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:20 smithi052 ceph-mon[33526]: pgmap v963: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 8.4 MiB/s wr, 674 op/s 2024-09-11T00:14:21.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:20 smithi033 ceph-mon[30593]: pgmap v963: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 8.4 MiB/s wr, 674 op/s 2024-09-11T00:14:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.888+0000 7f4cc3000640 1 -- 172.21.15.33:0/2150421108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 msgr2=0x7f4cbc10ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.888+0000 7f4cc3000640 1 --2- 172.21.15.33:0/2150421108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc10ae10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ca0 tx=0x7f4cb402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.889+0000 7f4cc3000640 1 -- 172.21.15.33:0/2150421108 shutdown_connections 2024-09-11T00:14:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.889+0000 7f4cc3000640 1 --2- 172.21.15.33:0/2150421108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc10ae10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.889+0000 7f4cc3000640 1 --2- 172.21.15.33:0/2150421108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.889+0000 7f4cc3000640 1 --2- 172.21.15.33:0/2150421108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.889+0000 7f4cc3000640 1 -- 172.21.15.33:0/2150421108 >> 172.21.15.33:0/2150421108 conn(0x7f4cbc0fe240 msgr2=0x7f4cbc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.890+0000 7f4cc3000640 1 -- 172.21.15.33:0/2150421108 shutdown_connections 2024-09-11T00:14:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.890+0000 7f4cc3000640 1 -- 172.21.15.33:0/2150421108 wait complete. 2024-09-11T00:14:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.892+0000 7f4cc3000640 1 Processor -- start 2024-09-11T00:14:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.892+0000 7f4cc3000640 1 -- start start 2024-09-11T00:14:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc19f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10e4f0 con 0x7f4cbc103ad0 2024-09-11T00:14:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10e370 con 0x7f4cbc104490 2024-09-11T00:14:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.893+0000 7f4cc3000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10e670 con 0x7f4cbc102980 2024-09-11T00:14:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36766/0 (socket says 172.21.15.33:36766) 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbb400640 1 -- 172.21.15.33:0/1260284783 learned_addr learned my addr 172.21.15.33:0/1260284783 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc19f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbbe00640 1 -- 172.21.15.33:0/1260284783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 msgr2=0x7f4cbc1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.894+0000 7f4cbbe00640 1 -- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 msgr2=0x7f4cbc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.895+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.895+0000 7f4cbbe00640 1 -- 172.21.15.33:0/1260284783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc1a0d10 con 0x7f4cbc102980 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.895+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.895+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc19f1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e9f0 tx=0x7f4cac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.895+0000 7f4cbb400640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.896+0000 7f4cb8c00640 1 -- 172.21.15.33:0/1260284783 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00ccc0 con 0x7f4cbc102980 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.896+0000 7f4cb8c00640 1 -- 172.21.15.33:0/1260284783 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cac005020 con 0x7f4cbc102980 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.896+0000 7f4cb8c00640 1 -- 172.21.15.33:0/1260284783 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00ce60 con 0x7f4cbc102980 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.896+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc1a1000 con 0x7f4cbc102980 2024-09-11T00:14:21.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.897+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc193db0 con 0x7f4cbc102980 2024-09-11T00:14:21.903 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.901+0000 7f4cc5e70740 1 Processor -- start 2024-09-11T00:14:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.902+0000 7f4cc5e70740 1 -- start start 2024-09-11T00:14:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cb8c00640 1 -- 172.21.15.33:0/1260284783 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4cac004a60 con 0x7f4cbc102980 2024-09-11T00:14:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a85032d6b0 con 0x55a8503ba790 2024-09-11T00:14:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a85031cae0 con 0x55a8503bfb00 2024-09-11T00:14:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.904+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a8503208f0 con 0x55a8503bd0c0 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.905+0000 7f4cc1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.905+0000 7f4cc1000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36770/0 (socket says 172.21.15.33:36770) 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.905+0000 7f4cc1000640 1 -- 172.21.15.33:0/2769611531 learned_addr learned my addr 172.21.15.33:0/2769611531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.905+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.905+0000 7f4cbb400640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cbbe00640 1 -- 172.21.15.33:0/2769611531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 msgr2=0x55a8503c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cbbe00640 1 -- 172.21.15.33:0/2769611531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 msgr2=0x55a8503bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cbbe00640 1 -- 172.21.15.33:0/2769611531 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8502e9780 con 0x55a8503bd0c0 2024-09-11T00:14:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.906+0000 7f4cc1000640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503bf4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0e3630 tx=0x7f4cac0ee1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d460d6c6f46968 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cb8c00640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 0x7f4ca00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cb8c00640 1 -- 172.21.15.33:0/1260284783 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4cac0e5f90 con 0x7f4cbc102980 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cb1600640 1 -- 172.21.15.33:0/2769611531 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0f9070 con 0x55a8503bd0c0 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cb1600640 1 -- 172.21.15.33:0/2769611531 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cac0abe60 con 0x55a8503bd0c0 2024-09-11T00:14:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.908+0000 7f4cb1600640 1 -- 172.21.15.33:0/2769611531 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0abca0 con 0x55a8503bd0c0 2024-09-11T00:14:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.909+0000 7f4cc5e70740 1 -- 172.21.15.33:0/2769611531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 msgr2=0x55a8503bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.909+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503bf4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0e3630 tx=0x7f4cac0ee1a0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.909+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 0x7f4ca00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 -- 172.21.15.33:0/2769611531 shutdown_connections 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503bf4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/2769611531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 -- 172.21.15.33:0/2769611531 >> 172.21.15.33:0/2769611531 conn(0x55a8503b58e0 msgr2=0x55a8503b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 0x7f4ca00b7820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009430 tx=0x7f4cb4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.911+0000 7f4cc5e70740 1 -- 172.21.15.33:0/2769611531 shutdown_connections 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.912+0000 7f4cc5e70740 1 -- 172.21.15.33:0/2769611531 wait complete. 2024-09-11T00:14:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.913+0000 7f4cc5e70740 1 -- start start 2024-09-11T00:14:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.913+0000 7f4cc5e70740 1 Processor -- start 2024-09-11T00:14:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.915+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 0x55a8503c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.915+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.915+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503bfb00 0x55a8503c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.915+0000 7f4cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 0x55a8503c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.916+0000 7f4cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 0x55a8503c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37864/0 (socket says 172.21.15.33:37864) 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.916+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.916+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:42330/0 (socket says 172.21.15.33:42330) 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.917+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a850254ab0 con 0x55a8503bfb00 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.917+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a8502c3570 con 0x55a8503ba790 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.917+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a8503c2ae0 con 0x55a8503bd0c0 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.917+0000 7f4cc5e70740 10 client.0 _ll_register_callbacks cb 0x55a8502d2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.917+0000 7f4cbbe00640 1 -- 172.21.15.33:0/1509041760 learned_addr learned my addr 172.21.15.33:0/1509041760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.918+0000 7f4cbb400640 1 -- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 msgr2=0x55a8503c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.918+0000 7f4cbb400640 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 0x55a8503c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.921 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.918+0000 7f4cbb400640 1 -- 172.21.15.33:0/1509041760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503bfb00 msgr2=0x55a8503c5190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T00:14:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.918+0000 7f4cbb400640 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503bfb00 0x55a8503c5190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.918+0000 7f4cbb400640 1 -- 172.21.15.33:0/1509041760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85007e790 con 0x55a8503bd0c0 2024-09-11T00:14:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.919+0000 7f4cbb400640 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8021bf0 tx=0x7f4ca8020800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac34acf4bbe492f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.922 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.919+0000 7f4ca6000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.919+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8005020 con 0x55a8503bd0c0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.919+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4ca80051c0 con 0x55a8503bd0c0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.920+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cac0abe60 con 0x55a8503bd0c0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.921+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4ca8005400 con 0x55a8503bd0c0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.921+0000 7f4cc5e70740 10 client.27073 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.921+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a8500f7620 con 0x55a8503bd0c0 2024-09-11T00:14:21.923 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.921+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cac0abe60 con 0x55a8503bd0c0 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4ca8021ce0 con 0x55a8503bd0c0 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 10 client.27073 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 10 client.27073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 20 client.27073 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a8503cf850 0x55a8503d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 4 client.27073 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.922+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a85032f600 con 0x55a8503cf850 2024-09-11T00:14:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.923+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a8503cf850 0x55a8503d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.925+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a8503cf850 0x55a8503d1cb0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8b44a24462c678 server_cookie=1afe017e48308768 in_seq=0 out_seq=0 2024-09-11T00:14:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.925+0000 7f4ca6000640 10 client.27073 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.926+0000 7f4ca6000640 1 -- 172.21.15.33:0/1509041760 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a85032f600 con 0x55a8503cf850 2024-09-11T00:14:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.926+0000 7f4ca6000640 10 client.27073 handle_command_reply: tid=0 2024-09-11T00:14:21.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.926+0000 7f4cc5e70740 1 client.27073 shutdown 2024-09-11T00:14:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 msgr2=0x55a8503c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8021bf0 tx=0x7f4ca8020800 comp rx=0 tx=0).stop 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 shutdown_connections 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503bfb00 0x55a8503c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a8503cf850 0x55a8503d1cb0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503c45c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1509041760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503ba790 0x55a8503c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 >> 172.21.15.33:0/1509041760 conn(0x55a8503b58e0 msgr2=0x55a8503b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.929+0000 7f4ca6000640 0 client.27073 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.930+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 shutdown_connections 2024-09-11T00:14:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.930+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1509041760 wait complete. 2024-09-11T00:14:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.930+0000 7f4cc5e70740 20 client.27073 trim_cache size 0 max 16384 2024-09-11T00:14:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.963+0000 7f4cc5e70740 1 Processor -- start 2024-09-11T00:14:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.963+0000 7f4cc5e70740 1 -- start start 2024-09-11T00:14:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bfb00 0x55a8503bff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc070c00 con 0x55a8503ba790 2024-09-11T00:14:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0712d0 con 0x55a8503bd0c0 2024-09-11T00:14:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc06eba0 con 0x55a8503bfb00 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.964+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cc1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bfb00 0x55a8503bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37878/0 (socket says 172.21.15.33:37878) 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 -- 172.21.15.33:0/4206708859 learned_addr learned my addr 172.21.15.33:0/4206708859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 -- 172.21.15.33:0/4206708859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bfb00 msgr2=0x55a8503bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bfb00 0x55a8503bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 -- 172.21.15.33:0/4206708859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 msgr2=0x55a8503d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.965+0000 7f4cbb400640 1 -- 172.21.15.33:0/4206708859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8503c3a20 con 0x55a8503bd0c0 2024-09-11T00:14:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.966+0000 7f4cbb400640 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801f960 tx=0x7f4ca8005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30a0003bee5f7a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.966+0000 7f4cb0c00640 1 -- 172.21.15.33:0/4206708859 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8041070 con 0x55a8503bd0c0 2024-09-11T00:14:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.966+0000 7f4cb0c00640 1 -- 172.21.15.33:0/4206708859 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca801f690 con 0x55a8503bd0c0 2024-09-11T00:14:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.966+0000 7f4cb0c00640 1 -- 172.21.15.33:0/4206708859 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8034a70 con 0x55a8503bd0c0 2024-09-11T00:14:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 -- 172.21.15.33:0/4206708859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 msgr2=0x55a8503d1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801f960 tx=0x7f4ca8005730 comp rx=0 tx=0).stop 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 -- 172.21.15.33:0/4206708859 shutdown_connections 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bfb00 0x55a8503bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bd0c0 0x55a8503d1b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/4206708859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.967+0000 7f4cc5e70740 1 -- 172.21.15.33:0/4206708859 >> 172.21.15.33:0/4206708859 conn(0x55a8503b58e0 msgr2=0x55a8503b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.968+0000 7f4cc5e70740 1 -- 172.21.15.33:0/4206708859 shutdown_connections 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.968+0000 7f4cc5e70740 1 -- 172.21.15.33:0/4206708859 wait complete. 2024-09-11T00:14:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.968+0000 7f4cc5e70740 1 -- start start 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 Processor -- start 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc06d060 con 0x55a8503ba790 2024-09-11T00:14:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc06e4d0 con 0x55a8503bfb00 2024-09-11T00:14:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.969+0000 7f4cc5e70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc06d730 con 0x55a8503bd0c0 2024-09-11T00:14:21.972 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.970+0000 7f4cc5e70740 10 client.0 _ll_register_callbacks cb 0x7f4ca800abc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.970+0000 7f4cc1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.970+0000 7f4cc1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:37894/0 (socket says 172.21.15.33:37894) 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.970+0000 7f4cc1000640 1 -- 172.21.15.33:0/1212600058 learned_addr learned my addr 172.21.15.33:0/1212600058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cbb400640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 -- 172.21.15.33:0/1212600058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 msgr2=0x55a8503cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 -- 172.21.15.33:0/1212600058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 msgr2=0x55a8503cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 -- 172.21.15.33:0/1212600058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8503cabd0 con 0x55a8503bfb00 2024-09-11T00:14:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.971+0000 7f4cc1000640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ca0 tx=0x7f4cb40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350e62d632bd0f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.972+0000 7f4ca6000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.972+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004250 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.972+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4cb40043f0 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.972+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca801f690 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4cb405c050 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 10 client.37118 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a8503c9e90 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca801f690 con 0x55a8503bfb00 2024-09-11T00:14:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f4cb4044040 con 0x55a8503bfb00 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 10 client.37118 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 10 client.37118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 20 client.37118 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.973+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a85043cec0 0x55a85043f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.974+0000 7f4cc5e70740 4 client.37118 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.974+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a85032b0b0 con 0x55a85043cec0 2024-09-11T00:14:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.974+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a85043cec0 0x55a85043f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.977+0000 7f4cbbe00640 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a85043cec0 0x55a85043f2e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=743a36a062c9ab5c server_cookie=d07ed5592bd99d14 in_seq=0 out_seq=0 2024-09-11T00:14:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:21.977+0000 7f4ca6000640 10 client.37118 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.014+0000 7f4ca6000640 1 -- 172.21.15.33:0/1212600058 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a85032b0b0 con 0x55a85043cec0 2024-09-11T00:14:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.014+0000 7f4ca6000640 10 client.37118 handle_command_reply: tid=0 2024-09-11T00:14:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.015+0000 7f4cc5e70740 1 client.37118 shutdown 2024-09-11T00:14:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 msgr2=0x55a8503ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ca0 tx=0x7f4cb40095c0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 shutdown_connections 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a8503bfb00 0x55a8503ca3a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55a85043cec0 0x55a85043f2e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8503bd0c0 0x55a8503cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 --2- 172.21.15.33:0/1212600058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8503ba790 0x55a8503cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 >> 172.21.15.33:0/1212600058 conn(0x55a8503b58e0 msgr2=0x55a8503c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.017+0000 7f4ca6000640 0 client.37118 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.018+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 shutdown_connections 2024-09-11T00:14:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.018+0000 7f4cc5e70740 1 -- 172.21.15.33:0/1212600058 wait complete. 2024-09-11T00:14:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.019+0000 7f4cc5e70740 20 client.37118 trim_cache size 0 max 16384 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 msgr2=0x7f4ca00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 0x7f4ca00b7820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009430 tx=0x7f4cb4009360 comp rx=0 tx=0).stop 2024-09-11T00:14:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 msgr2=0x7f4cbc19f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc19f1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e9f0 tx=0x7f4cac00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 shutdown_connections 2024-09-11T00:14:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4ca00b5360 0x7f4ca00b7820 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cbc104490 0x7f4cbc1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.023+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cbc103ad0 0x7f4cbc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.024+0000 7f4cc3000640 1 --2- 172.21.15.33:0/1260284783 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4cbc102980 0x7f4cbc19f1d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.024+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 >> 172.21.15.33:0/1260284783 conn(0x7f4cbc0fe240 msgr2=0x7f4cbc104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.024+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 shutdown_connections 2024-09-11T00:14:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:22.024+0000 7f4cc3000640 1 -- 172.21.15.33:0/1260284783 wait complete. 2024-09-11T00:14:22.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:22 smithi052 ceph-mon[33526]: pgmap v964: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-09-11T00:14:23.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:22 smithi033 ceph-mon[30593]: pgmap v964: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-09-11T00:14:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:22 smithi189 ceph-mon[34000]: pgmap v964: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-09-11T00:14:23.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 875.0 s, 576.6 tps, lat 174.737 ms stddev 72.656 2024-09-11T00:14:24.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:24 smithi052 ceph-mon[33526]: pgmap v965: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-09-11T00:14:25.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:24 smithi033 ceph-mon[30593]: pgmap v965: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-09-11T00:14:25.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:24 smithi189 ceph-mon[34000]: pgmap v965: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-09-11T00:14:26.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:26 smithi052 ceph-mon[33526]: pgmap v966: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 592 op/s 2024-09-11T00:14:27.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:26 smithi033 ceph-mon[30593]: pgmap v966: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 592 op/s 2024-09-11T00:14:27.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:26 smithi189 ceph-mon[34000]: pgmap v966: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 592 op/s 2024-09-11T00:14:28.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 880.0 s, 587.7 tps, lat 169.242 ms stddev 98.068 2024-09-11T00:14:28.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:28 smithi052 ceph-mon[33526]: pgmap v967: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-09-11T00:14:29.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:28 smithi033 ceph-mon[30593]: pgmap v967: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-09-11T00:14:29.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:28 smithi189 ceph-mon[34000]: pgmap v967: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-09-11T00:14:30.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:30 smithi052 ceph-mon[33526]: pgmap v968: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 8.9 MiB/s wr, 700 op/s 2024-09-11T00:14:31.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:30 smithi033 ceph-mon[30593]: pgmap v968: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 8.9 MiB/s wr, 700 op/s 2024-09-11T00:14:31.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:30 smithi189 ceph-mon[34000]: pgmap v968: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 8.9 MiB/s wr, 700 op/s 2024-09-11T00:14:32.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:32 smithi052 ceph-mon[33526]: pgmap v969: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.6 MiB/s wr, 668 op/s 2024-09-11T00:14:33.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:32 smithi033 ceph-mon[30593]: pgmap v969: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.6 MiB/s wr, 668 op/s 2024-09-11T00:14:33.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:32 smithi189 ceph-mon[34000]: pgmap v969: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.6 MiB/s wr, 668 op/s 2024-09-11T00:14:33.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 885.0 s, 515.0 tps, lat 193.434 ms stddev 92.909 2024-09-11T00:14:34.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:34 smithi052 ceph-mon[33526]: pgmap v970: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 8.2 MiB/s wr, 741 op/s 2024-09-11T00:14:35.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:34 smithi033 ceph-mon[30593]: pgmap v970: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 8.2 MiB/s wr, 741 op/s 2024-09-11T00:14:35.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:34 smithi189 ceph-mon[34000]: pgmap v970: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 8.2 MiB/s wr, 741 op/s 2024-09-11T00:14:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.251+0000 7fe551600640 1 -- 172.21.15.33:0/2243443623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100fb0 msgr2=0x7fe54c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.251+0000 7fe551600640 1 --2- 172.21.15.33:0/2243443623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100fb0 0x7fe54c108240 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe538009900 tx=0x7fe53802a400 comp rx=0 tx=0).stop 2024-09-11T00:14:35.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.252+0000 7fe551600640 1 -- 172.21.15.33:0/2243443623 shutdown_connections 2024-09-11T00:14:35.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.252+0000 7fe551600640 1 --2- 172.21.15.33:0/2243443623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c10ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.252+0000 7fe551600640 1 --2- 172.21.15.33:0/2243443623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100fb0 0x7fe54c108240 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.255 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.252+0000 7fe551600640 1 --2- 172.21.15.33:0/2243443623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100670 0x7fe54c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.252+0000 7fe551600640 1 -- 172.21.15.33:0/2243443623 >> 172.21.15.33:0/2243443623 conn(0x7fe54c0fc440 msgr2=0x7fe54c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.253+0000 7fe551600640 1 -- 172.21.15.33:0/2243443623 shutdown_connections 2024-09-11T00:14:35.257 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.255+0000 7fe551600640 1 -- 172.21.15.33:0/2243443623 wait complete. 2024-09-11T00:14:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.259+0000 7fe551600640 1 Processor -- start 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.260+0000 7fe551600640 1 -- start start 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100fb0 0x7fe54c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c10c310 con 0x7fe54c108780 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c10c190 con 0x7fe54c100670 2024-09-11T00:14:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe551600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c10c490 con 0x7fe54c100fb0 2024-09-11T00:14:35.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38830/0 (socket says 172.21.15.33:38830) 2024-09-11T00:14:35.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe54aa00640 1 -- 172.21.15.33:0/10379101 learned_addr learned my addr 172.21.15.33:0/10379101 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:35.264 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.261+0000 7fe54a000640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100fb0 0x7fe54c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54b400640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54aa00640 1 -- 172.21.15.33:0/10379101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100fb0 msgr2=0x7fe54c19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54aa00640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100fb0 0x7fe54c19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54aa00640 1 -- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 msgr2=0x7fe54c1a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54aa00640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c1a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54aa00640 1 -- 172.21.15.33:0/10379101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c1a0e10 con 0x7fe54c100670 2024-09-11T00:14:35.265 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.262+0000 7fe54b400640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe54aa00640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00d950 tx=0x7fe53c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe543400640 1 -- 172.21.15.33:0/10379101 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c017070 con 0x7fe54c100670 2024-09-11T00:14:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe543400640 1 -- 172.21.15.33:0/10379101 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe53c009c30 con 0x7fe54c100670 2024-09-11T00:14:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe543400640 1 -- 172.21.15.33:0/10379101 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00f620 con 0x7fe54c100670 2024-09-11T00:14:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c1a1100 con 0x7fe54c100670 2024-09-11T00:14:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.264+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c1a77d0 con 0x7fe54c100670 2024-09-11T00:14:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.274+0000 7fe55445f740 1 Processor -- start 2024-09-11T00:14:35.277 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.274+0000 7fe543400640 1 -- 172.21.15.33:0/10379101 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe53c005020 con 0x7fe54c100670 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.276+0000 7fe55445f740 1 -- start start 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe543400640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 0x7fe5300b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee731216b0 con 0x55ee731b10c0 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee73110ae0 con 0x55ee731ae790 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe55445f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee731148f0 con 0x55ee731b3b00 2024-09-11T00:14:35.280 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.277+0000 7fe543400640 1 -- 172.21.15.33:0/10379101 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe53c0e54e0 con 0x7fe54c100670 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38836/0 (socket says 172.21.15.33:38836) 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 -- 172.21.15.33:0/1745415224 learned_addr learned my addr 172.21.15.33:0/1745415224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54a000640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 -- 172.21.15.33:0/1745415224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 msgr2=0x55ee731b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 -- 172.21.15.33:0/1745415224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 msgr2=0x55ee731b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54b400640 1 -- 172.21.15.33:0/1745415224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee730dd780 con 0x55ee731ae790 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.278+0000 7fe54a000640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.279+0000 7fe54aa00640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 0x7fe5300b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.279+0000 7fe54b400640 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe54400ac80 tx=0x7fe544009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42231d5396297f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.279+0000 7fe537400640 1 -- 172.21.15.33:0/1745415224 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544013040 con 0x55ee731ae790 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.279+0000 7fe54aa00640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 0x7fe5300b7810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00dfe0 tx=0x7fe53c0a7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.280+0000 7fe537400640 1 -- 172.21.15.33:0/1745415224 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe54401a430 con 0x55ee731ae790 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.280+0000 7fe537400640 1 -- 172.21.15.33:0/1745415224 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544013040 con 0x55ee731ae790 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.280+0000 7fe55445f740 1 -- 172.21.15.33:0/1745415224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 msgr2=0x55ee731b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.280+0000 7fe55445f740 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe54400ac80 tx=0x7fe544009820 comp rx=0 tx=0).stop 2024-09-11T00:14:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 -- 172.21.15.33:0/1745415224 shutdown_connections 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 --2- 172.21.15.33:0/1745415224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731b0b80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 -- 172.21.15.33:0/1745415224 >> 172.21.15.33:0/1745415224 conn(0x55ee731a98e0 msgr2=0x55ee731aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.281+0000 7fe55445f740 1 -- 172.21.15.33:0/1745415224 shutdown_connections 2024-09-11T00:14:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.282+0000 7fe55445f740 1 -- 172.21.15.33:0/1745415224 wait complete. 2024-09-11T00:14:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.282+0000 7fe55445f740 1 -- start start 2024-09-11T00:14:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.283+0000 7fe55445f740 1 Processor -- start 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 0x55ee731c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b3b00 0x55ee731ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee73048ab0 con 0x55ee731b3b00 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee730b7570 con 0x55ee731b10c0 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee731c7a90 con 0x55ee731ae790 2024-09-11T00:14:35.287 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe55445f740 10 client.0 _ll_register_callbacks cb 0x55ee730c6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe54a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe54a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38844/0 (socket says 172.21.15.33:38844) 2024-09-11T00:14:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.284+0000 7fe54a000640 1 -- 172.21.15.33:0/3932083578 learned_addr learned my addr 172.21.15.33:0/3932083578 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54b400640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 0x55ee731c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54b400640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b3b00 0x55ee731ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 -- 172.21.15.33:0/3932083578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 msgr2=0x55ee731c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 0x55ee731c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 -- 172.21.15.33:0/3932083578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b3b00 msgr2=0x55ee731ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b3b00 0x55ee731ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 -- 172.21.15.33:0/3932083578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee72e72790 con 0x55ee731b10c0 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54b400640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 0x55ee731c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.285+0000 7fe54a000640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe538000c00 tx=0x7fe5380035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710bef48c8e7424e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.286+0000 7fe52be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:14:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.286+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538035030 con 0x55ee731b10c0 2024-09-11T00:14:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.286+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe538003cb0 con 0x55ee731b10c0 2024-09-11T00:14:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.289+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54401a430 con 0x55ee731b10c0 2024-09-11T00:14:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.289+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe538031500 con 0x55ee731b10c0 2024-09-11T00:14:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.289+0000 7fe55445f740 10 client.37130 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.289+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee72eeb620 con 0x55ee731b10c0 2024-09-11T00:14:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.289+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe54401a430 con 0x55ee731b10c0 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe53803c6d0 con 0x55ee731b10c0 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 10 client.37130 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 10 client.37130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 20 client.37130 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee731d46f0 0x55ee731d6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 4 client.37130 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.290+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee73123600 con 0x55ee731d46f0 2024-09-11T00:14:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.292+0000 7fe54b400640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee731d46f0 0x55ee731d6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.293+0000 7fe52be00640 10 client.37130 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.293+0000 7fe54b400640 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee731d46f0 0x55ee731d6ae0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1910cf86d935a9a server_cookie=969a53920162443a in_seq=0 out_seq=0 2024-09-11T00:14:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.294+0000 7fe52be00640 1 -- 172.21.15.33:0/3932083578 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee73123600 con 0x55ee731d46f0 2024-09-11T00:14:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.294+0000 7fe52be00640 10 client.37130 handle_command_reply: tid=0 2024-09-11T00:14:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.295+0000 7fe55445f740 1 client.37130 shutdown 2024-09-11T00:14:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.295+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 msgr2=0x55ee731c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.295+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe538000c00 tx=0x7fe5380035f0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 shutdown_connections 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b3b00 0x55ee731ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731b10c0 0x55ee731c9570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee731d46f0 0x55ee731d6ae0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 --2- 172.21.15.33:0/3932083578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731ae790 0x55ee731c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 >> 172.21.15.33:0/3932083578 conn(0x55ee731a98e0 msgr2=0x55ee731a8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.296+0000 7fe52be00640 0 client.37130 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.297+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 shutdown_connections 2024-09-11T00:14:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.298+0000 7fe55445f740 1 -- 172.21.15.33:0/3932083578 wait complete. 2024-09-11T00:14:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.298+0000 7fe55445f740 20 client.37130 trim_cache size 0 max 16384 2024-09-11T00:14:35.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.327+0000 7fe55445f740 1 Processor -- start 2024-09-11T00:14:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.328+0000 7fe55445f740 1 -- start start 2024-09-11T00:14:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.328+0000 7fe55445f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.333 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.331+0000 7fe55445f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe55445f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe55445f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1abda0 con 0x55ee731b10c0 2024-09-11T00:14:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe55445f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1a9670 con 0x55ee731ae790 2024-09-11T00:14:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe55445f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c074e90 con 0x55ee731b3b00 2024-09-11T00:14:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38860/0 (socket says 172.21.15.33:38860) 2024-09-11T00:14:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.332+0000 7fe54b400640 1 -- 172.21.15.33:0/1571122589 learned_addr learned my addr 172.21.15.33:0/1571122589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.333+0000 7fe54b400640 1 -- 172.21.15.33:0/1571122589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 msgr2=0x55ee731b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.333+0000 7fe54b400640 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.333+0000 7fe54b400640 1 -- 172.21.15.33:0/1571122589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 msgr2=0x55ee731b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.333+0000 7fe54b400640 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.333+0000 7fe54b400640 1 -- 172.21.15.33:0/1571122589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee731d6e50 con 0x55ee731ae790 2024-09-11T00:14:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.334+0000 7fe54b400640 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe54400ac20 tx=0x7fe544014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6948b922a5c3dfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.335+0000 7fe536a00640 1 -- 172.21.15.33:0/1571122589 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54401ac30 con 0x55ee731ae790 2024-09-11T00:14:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.335+0000 7fe536a00640 1 -- 172.21.15.33:0/1571122589 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe54400a890 con 0x55ee731ae790 2024-09-11T00:14:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.335+0000 7fe536a00640 1 -- 172.21.15.33:0/1571122589 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544026420 con 0x55ee731ae790 2024-09-11T00:14:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 -- 172.21.15.33:0/1571122589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 msgr2=0x55ee731c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe54400ac20 tx=0x7fe544014040 comp rx=0 tx=0).stop 2024-09-11T00:14:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 -- 172.21.15.33:0/1571122589 shutdown_connections 2024-09-11T00:14:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 --2- 172.21.15.33:0/1571122589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731c95e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.336+0000 7fe55445f740 1 -- 172.21.15.33:0/1571122589 >> 172.21.15.33:0/1571122589 conn(0x55ee731a98e0 msgr2=0x55ee731c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.339+0000 7fe55445f740 1 -- 172.21.15.33:0/1571122589 shutdown_connections 2024-09-11T00:14:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.339+0000 7fe55445f740 1 -- 172.21.15.33:0/1571122589 wait complete. 2024-09-11T00:14:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.340+0000 7fe55445f740 1 -- start start 2024-09-11T00:14:35.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.340+0000 7fe55445f740 1 Processor -- start 2024-09-11T00:14:35.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1a7b30 con 0x55ee731b10c0 2024-09-11T00:14:35.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1a8fa0 con 0x55ee731ae790 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1a8200 con 0x55ee731b3b00 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe55445f740 10 client.0 _ll_register_callbacks cb 0x7fe538009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:38872/0 (socket says 172.21.15.33:38872) 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.341+0000 7fe54b400640 1 -- 172.21.15.33:0/3726227594 learned_addr learned my addr 172.21.15.33:0/3726227594 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.342+0000 7fe54a000640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.342+0000 7fe54b400640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54a000640 1 -- 172.21.15.33:0/3726227594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 msgr2=0x55ee731cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54a000640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54a000640 1 -- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 msgr2=0x55ee731cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54a000640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54a000640 1 -- 172.21.15.33:0/3726227594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee731cefe0 con 0x55ee731b10c0 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.343+0000 7fe54b400640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.344+0000 7fe54a000640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731d0540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe53802a920 tx=0x7fe5380043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319ee81ba8b5e0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.344+0000 7fe52be00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:14:35.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.345+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538035030 con 0x55ee731b10c0 2024-09-11T00:14:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.345+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe538003cc0 con 0x55ee731b10c0 2024-09-11T00:14:35.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.345+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54400a890 con 0x55ee731b10c0 2024-09-11T00:14:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.347+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe538000e60 con 0x55ee731b10c0 2024-09-11T00:14:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.347+0000 7fe55445f740 10 client.17196 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:35.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.347+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee73241df0 con 0x55ee731b10c0 2024-09-11T00:14:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe54400a890 con 0x55ee731b10c0 2024-09-11T00:14:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe538045450 con 0x55ee731b10c0 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 10 client.17196 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 10 client.17196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 20 client.17196 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee732427a0 0x55ee73244bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 4 client.17196 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.348+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee7311f0b0 con 0x55ee732427a0 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.349+0000 7fe54b400640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee732427a0 0x55ee73244bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.350+0000 7fe54b400640 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee732427a0 0x55ee73244bc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83c4067d663445b server_cookie=1aa3a66bf177bc32 in_seq=0 out_seq=0 2024-09-11T00:14:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.351+0000 7fe52be00640 10 client.17196 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:35.442 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.439+0000 7fe52be00640 1 -- 172.21.15.33:0/3726227594 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee7311f0b0 con 0x55ee732427a0 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.439+0000 7fe52be00640 10 client.17196 handle_command_reply: tid=0 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.439+0000 7fe55445f740 1 client.17196 shutdown 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 msgr2=0x55ee731d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731d0540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe53802a920 tx=0x7fe5380043a0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 shutdown_connections 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55ee732427a0 0x55ee73244bc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe52be00640 0 client.17196 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee731b3b00 0x55ee731cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee731b10c0 0x55ee731d0540 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 --2- 172.21.15.33:0/3726227594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee731ae790 0x55ee731cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.443 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.440+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 >> 172.21.15.33:0/3726227594 conn(0x55ee731a98e0 msgr2=0x55ee731b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.444 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.442+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 shutdown_connections 2024-09-11T00:14:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.442+0000 7fe55445f740 1 -- 172.21.15.33:0/3726227594 wait complete. 2024-09-11T00:14:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.442+0000 7fe55445f740 20 client.17196 trim_cache size 0 max 16384 2024-09-11T00:14:35.445 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:14:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:14:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:14:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:14:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.444+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 msgr2=0x7fe5300b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.444+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 0x7fe5300b7810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00dfe0 tx=0x7fe53c0a7040 comp rx=0 tx=0).stop 2024-09-11T00:14:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.444+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 msgr2=0x7fe54c19f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.444+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00d950 tx=0x7fe53c00de10 comp rx=0 tx=0).stop 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 shutdown_connections 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe5300b5350 0x7fe5300b7810 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe54c108780 0x7fe54c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe54c100fb0 0x7fe54c19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 --2- 172.21.15.33:0/10379101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe54c100670 0x7fe54c19f2d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.449 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.446+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 >> 172.21.15.33:0/10379101 conn(0x7fe54c0fc440 msgr2=0x7fe54c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.447+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 shutdown_connections 2024-09-11T00:14:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:35.447+0000 7fe551600640 1 -- 172.21.15.33:0/10379101 wait complete. 2024-09-11T00:14:36.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:36 smithi052 ceph-mon[33526]: pgmap v971: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-09-11T00:14:37.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:36 smithi033 ceph-mon[30593]: pgmap v971: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-09-11T00:14:37.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:36 smithi189 ceph-mon[34000]: pgmap v971: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-09-11T00:14:37.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:37 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:38.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:37 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:38.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:37 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:38.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 890.0 s, 590.2 tps, lat 169.637 ms stddev 58.660 2024-09-11T00:14:38.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:38 smithi052 ceph-mon[33526]: pgmap v972: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.1 MiB/s wr, 793 op/s 2024-09-11T00:14:39.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:38 smithi033 ceph-mon[30593]: pgmap v972: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.1 MiB/s wr, 793 op/s 2024-09-11T00:14:39.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:38 smithi189 ceph-mon[34000]: pgmap v972: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.1 MiB/s wr, 793 op/s 2024-09-11T00:14:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:40 smithi052 ceph-mon[33526]: pgmap v973: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.0 MiB/s wr, 695 op/s 2024-09-11T00:14:40.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:40.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:40.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:40 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:14:41.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:40 smithi033 ceph-mon[30593]: pgmap v973: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.0 MiB/s wr, 695 op/s 2024-09-11T00:14:41.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:41.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:41.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:40 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:14:41.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:40 smithi189 ceph-mon[34000]: pgmap v973: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 8.0 MiB/s wr, 695 op/s 2024-09-11T00:14:41.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:41.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:41.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:40 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:14:42.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:42 smithi052 ceph-mon[33526]: pgmap v974: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.8 MiB/s wr, 665 op/s 2024-09-11T00:14:43.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:42 smithi033 ceph-mon[30593]: pgmap v974: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.8 MiB/s wr, 665 op/s 2024-09-11T00:14:43.096 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:42 smithi189 ceph-mon[34000]: pgmap v974: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.8 MiB/s wr, 665 op/s 2024-09-11T00:14:43.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 895.0 s, 596.1 tps, lat 164.021 ms stddev 78.256 2024-09-11T00:14:44.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:44 smithi052 ceph-mon[33526]: pgmap v975: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-09-11T00:14:45.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:44 smithi033 ceph-mon[30593]: pgmap v975: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-09-11T00:14:45.167 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:44 smithi189 ceph-mon[34000]: pgmap v975: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 802 op/s 2024-09-11T00:14:46.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:46 smithi052 ceph-mon[33526]: pgmap v976: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 640 op/s 2024-09-11T00:14:47.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:46 smithi033 ceph-mon[30593]: pgmap v976: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 640 op/s 2024-09-11T00:14:47.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:46 smithi189 ceph-mon[34000]: pgmap v976: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 640 op/s 2024-09-11T00:14:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:progress: 900.0 s, 516.6 tps, lat 197.484 ms stddev 138.940 2024-09-11T00:14:48.658 INFO:teuthology.orchestra.run.smithi033.stdout:transaction type: 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:scaling factor: 32 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:query mode: simple 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:number of clients: 100 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:number of threads: 4 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:duration: 900 s 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:number of transactions actually processed: 414187 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:latency average = 217.179 ms 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:latency stddev = 1256.804 ms 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:tps = 460.040203 (including connections establishing) 2024-09-11T00:14:48.659 INFO:teuthology.orchestra.run.smithi033.stdout:tps = 460.049860 (excluding connections establishing) 2024-09-11T00:14:48.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-11T00:14:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.731+0000 7fe32a000640 1 -- 172.21.15.33:0/3313430386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 msgr2=0x7fe32410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.731+0000 7fe32a000640 1 --2- 172.21.15.33:0/3313430386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe32410a6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe318009960 tx=0x7fe31802a460 comp rx=0 tx=0).stop 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 -- 172.21.15.33:0/3313430386 shutdown_connections 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 --2- 172.21.15.33:0/3313430386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 0x7fe324111240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 --2- 172.21.15.33:0/3313430386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324108f80 0x7fe324109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 --2- 172.21.15.33:0/3313430386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe32410a6d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 -- 172.21.15.33:0/3313430386 >> 172.21.15.33:0/3313430386 conn(0x7fe324078070 msgr2=0x7fe32407a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 -- 172.21.15.33:0/3313430386 shutdown_connections 2024-09-11T00:14:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.733+0000 7fe32a000640 1 -- 172.21.15.33:0/3313430386 wait complete. 2024-09-11T00:14:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.734+0000 7fe32a000640 1 Processor -- start 2024-09-11T00:14:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.735+0000 7fe32a000640 1 -- start start 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324108f80 0x7fe32419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 0x7fe32419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe324114900 con 0x7fe324108f80 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe324114780 con 0x7fe324109940 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.736+0000 7fe32a000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe324114a80 con 0x7fe32410a2d0 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:49110/0 (socket says 172.21.15.33:49110) 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 -- 172.21.15.33:0/2924705292 learned_addr learned my addr 172.21.15.33:0/2924705292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe323e00640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 0x7fe32419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 -- 172.21.15.33:0/2924705292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 msgr2=0x7fe32419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 0x7fe32419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 -- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324108f80 msgr2=0x7fe32419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324108f80 0x7fe32419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.737+0000 7fe329600640 1 -- 172.21.15.33:0/2924705292 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3241a0c60 con 0x7fe32410a2d0 2024-09-11T00:14:48.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.739+0000 7fe329600640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00eaa0 tx=0x7fe31c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.740+0000 7fe321600640 1 -- 172.21.15.33:0/2924705292 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00cdb0 con 0x7fe32410a2d0 2024-09-11T00:14:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.740+0000 7fe321600640 1 -- 172.21.15.33:0/2924705292 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe31c005020 con 0x7fe32410a2d0 2024-09-11T00:14:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.740+0000 7fe321600640 1 -- 172.21.15.33:0/2924705292 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0116d0 con 0x7fe32410a2d0 2024-09-11T00:14:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.740+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3241a0f50 con 0x7fe32410a2d0 2024-09-11T00:14:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.740+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3241a7620 con 0x7fe32410a2d0 2024-09-11T00:14:48.749 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.747+0000 7fe321600640 1 -- 172.21.15.33:0/2924705292 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe31c00f040 con 0x7fe32410a2d0 2024-09-11T00:14:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.749+0000 7fe32e478740 1 Processor -- start 2024-09-11T00:14:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.749+0000 7fe32e478740 1 -- start start 2024-09-11T00:14:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 0x55d2b503bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe321600640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 0x7fe30c0b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b503e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4fac6b0 con 0x55d2b503c2a0 2024-09-11T00:14:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4f9bae0 con 0x55d2b503ece0 2024-09-11T00:14:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe32e478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4f9f8f0 con 0x55d2b5039970 2024-09-11T00:14:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe321600640 1 -- 172.21.15.33:0/2924705292 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe31c0e5380 con 0x7fe32410a2d0 2024-09-11T00:14:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe323e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 0x55d2b503bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe329600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe329600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58192/0 (socket says 172.21.15.33:58192) 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.750+0000 7fe329600640 1 -- 172.21.15.33:0/482722233 learned_addr learned my addr 172.21.15.33:0/482722233 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe328c00640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 0x7fe30c0b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b503e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 -- 172.21.15.33:0/482722233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 msgr2=0x55d2b50411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 -- 172.21.15.33:0/482722233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 msgr2=0x55d2b503e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b503e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.751+0000 7fe323e00640 1 -- 172.21.15.33:0/482722233 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b4f68780 con 0x55d2b5039970 2024-09-11T00:14:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.752+0000 7fe323e00640 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 0x55d2b503bd60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe310009f90 tx=0x7fe3100096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44fa2ad6743d72db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.752+0000 7fe328c00640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 0x7fe30c0b7970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3180096c0 tx=0x7fe318000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.752+0000 7fe315c00640 1 -- 172.21.15.33:0/482722233 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004050 con 0x55d2b5039970 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.752+0000 7fe315c00640 1 -- 172.21.15.33:0/482722233 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe310005020 con 0x55d2b5039970 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.752+0000 7fe315c00640 1 -- 172.21.15.33:0/482722233 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004c60 con 0x55d2b5039970 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 -- 172.21.15.33:0/482722233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 msgr2=0x55d2b503bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 0x55d2b503bd60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe310009f90 tx=0x7fe3100096c0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 -- 172.21.15.33:0/482722233 shutdown_connections 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b503e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 --2- 172.21.15.33:0/482722233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b5039970 0x55d2b503bd60 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe310009f90 tx=0x7fe3100096c0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.753+0000 7fe32e478740 1 -- 172.21.15.33:0/482722233 >> 172.21.15.33:0/482722233 conn(0x55d2b5034ac0 msgr2=0x55d2b5035850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.754+0000 7fe32e478740 1 -- 172.21.15.33:0/482722233 shutdown_connections 2024-09-11T00:14:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.755+0000 7fe32e478740 1 -- 172.21.15.33:0/482722233 wait complete. 2024-09-11T00:14:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.755+0000 7fe32e478740 1 -- start start 2024-09-11T00:14:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.755+0000 7fe32e478740 1 Processor -- start 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5043980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b5044530 0x55d2b50449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4ed3ab0 con 0x55d2b503c2a0 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d2b4f42570 con 0x55d2b5044530 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d2b5041cc0 con 0x55d2b503ece0 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.756+0000 7fe32e478740 10 client.0 _ll_register_callbacks cb 0x55d2b4f51100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.757+0000 7fe328c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.757+0000 7fe328c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50118/0 (socket says 172.21.15.33:50118) 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.757+0000 7fe328c00640 1 -- 172.21.15.33:0/4000845727 learned_addr learned my addr 172.21.15.33:0/4000845727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.757+0000 7fe328c00640 1 -- 172.21.15.33:0/4000845727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 msgr2=0x55d2b5043980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.757+0000 7fe323e00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5043980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.758+0000 7fe328c00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5043980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.758+0000 7fe328c00640 1 -- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b5044530 msgr2=0x55d2b50449b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.758+0000 7fe328c00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b5044530 0x55d2b50449b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.758+0000 7fe328c00640 1 -- 172.21.15.33:0/4000845727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b4cfd790 con 0x55d2b503c2a0 2024-09-11T00:14:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.758+0000 7fe323e00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5043980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.759+0000 7fe328c00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe318033000 tx=0x7fe318009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243e8a7f7af3efd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.759+0000 7fe30a000640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:14:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.759+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318048020 con 0x55d2b503c2a0 2024-09-11T00:14:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.759+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe318031670 con 0x55d2b503c2a0 2024-09-11T00:14:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.759+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe310005020 con 0x55d2b503c2a0 2024-09-11T00:14:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.762+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe318053050 con 0x55d2b503c2a0 2024-09-11T00:14:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.762+0000 7fe32e478740 10 client.17205 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.763+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d2b4d76620 con 0x55d2b503c2a0 2024-09-11T00:14:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.763+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe310005020 con 0x55d2b503c2a0 2024-09-11T00:14:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe3180448e0 con 0x55d2b503c2a0 2024-09-11T00:14:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 10 client.17205 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 10 client.17205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 20 client.17205 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 4 client.17205 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:14:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.765+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2b4fae600 con 0x55d2b504efa0 2024-09-11T00:14:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.766+0000 7fe323e00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.767+0000 7fe323e00640 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50513b0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35dab6dafccba6d8 server_cookie=44396eb89c43b769 in_seq=0 out_seq=0 2024-09-11T00:14:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.767+0000 7fe30a000640 10 client.17205 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.769+0000 7fe30a000640 1 -- 172.21.15.33:0/4000845727 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2b4fae600 con 0x55d2b504efa0 2024-09-11T00:14:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.769+0000 7fe30a000640 10 client.17205 handle_command_reply: tid=0 2024-09-11T00:14:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.769+0000 7fe32e478740 1 client.17205 shutdown 2024-09-11T00:14:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.774+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 msgr2=0x55d2b50432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.774+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe318033000 tx=0x7fe318009260 comp rx=0 tx=0).stop 2024-09-11T00:14:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.774+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 shutdown_connections 2024-09-11T00:14:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.774+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b5044530 0x55d2b50449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.774+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50513b0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.775+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5043980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.775+0000 7fe30a000640 0 client.17205 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.775+0000 7fe32e478740 1 --2- 172.21.15.33:0/4000845727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b503c2a0 0x55d2b50432e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.775+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 >> 172.21.15.33:0/4000845727 conn(0x55d2b5034ac0 msgr2=0x55d2b5033bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.775+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 shutdown_connections 2024-09-11T00:14:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.776+0000 7fe32e478740 1 -- 172.21.15.33:0/4000845727 wait complete. 2024-09-11T00:14:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.776+0000 7fe32e478740 20 client.17205 trim_cache size 0 max 16384 2024-09-11T00:14:48.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.812+0000 7fe32e478740 1 Processor -- start 2024-09-11T00:14:48.813 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.812+0000 7fe32e478740 1 -- start start 2024-09-11T00:14:48.815 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503c2a0 0x55d2b5042090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b503f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241b42d0 con 0x55d2b5044530 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241b1ba0 con 0x55d2b503ece0 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.813+0000 7fe32e478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241af9f0 con 0x55d2b503c2a0 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:58210/0 (socket says 172.21.15.33:58210) 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 -- 172.21.15.33:0/4205630676 learned_addr learned my addr 172.21.15.33:0/4205630676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 -- 172.21.15.33:0/4205630676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503c2a0 msgr2=0x55d2b5042090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503c2a0 0x55d2b5042090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 -- 172.21.15.33:0/4205630676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 msgr2=0x55d2b503f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b503f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.814+0000 7fe323e00640 1 -- 172.21.15.33:0/4205630676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b5042de0 con 0x55d2b503ece0 2024-09-11T00:14:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.815+0000 7fe323e00640 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55d2b5036070 tx=0x7fe310009ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8eac8311851bc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.815+0000 7fe315200640 1 -- 172.21.15.33:0/4205630676 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100035f0 con 0x55d2b503ece0 2024-09-11T00:14:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.815+0000 7fe315200640 1 -- 172.21.15.33:0/4205630676 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe310003c20 con 0x55d2b503ece0 2024-09-11T00:14:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.815+0000 7fe315200640 1 -- 172.21.15.33:0/4205630676 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100035f0 con 0x55d2b503ece0 2024-09-11T00:14:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 -- 172.21.15.33:0/4205630676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 msgr2=0x55d2b50425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55d2b5036070 tx=0x7fe310009ac0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 -- 172.21.15.33:0/4205630676 shutdown_connections 2024-09-11T00:14:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b503f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503ece0 0x55d2b50425d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 --2- 172.21.15.33:0/4205630676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503c2a0 0x55d2b5042090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.817+0000 7fe32e478740 1 -- 172.21.15.33:0/4205630676 >> 172.21.15.33:0/4205630676 conn(0x55d2b5034ac0 msgr2=0x55d2b5035560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.818+0000 7fe32e478740 1 -- 172.21.15.33:0/4205630676 shutdown_connections 2024-09-11T00:14:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.818+0000 7fe32e478740 1 -- 172.21.15.33:0/4205630676 wait complete. 2024-09-11T00:14:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.819+0000 7fe32e478740 1 -- start start 2024-09-11T00:14:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.819+0000 7fe32e478740 1 Processor -- start 2024-09-11T00:14:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.821+0000 7fe32e478740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503c2a0 0x55d2b504ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.821+0000 7fe32e478740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.821+0000 7fe32e478740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b5049fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.822+0000 7fe323e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.822+0000 7fe323e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:49124/0 (socket says 172.21.15.33:49124) 2024-09-11T00:14:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.824+0000 7fe328c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503c2a0 0x55d2b504ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe32e478740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241b0060 con 0x55d2b5044530 2024-09-11T00:14:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe32e478740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241b14d0 con 0x55d2b503c2a0 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe32e478740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241b0730 con 0x55d2b503ece0 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe32e478740 10 client.0 _ll_register_callbacks cb 0x7fe310005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe323e00640 1 -- 172.21.15.33:0/934556711 learned_addr learned my addr 172.21.15.33:0/934556711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.825+0000 7fe329600640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b5049fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.826+0000 7fe323e00640 1 -- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503c2a0 msgr2=0x55d2b504ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.826+0000 7fe323e00640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503c2a0 0x55d2b504ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.826+0000 7fe323e00640 1 -- 172.21.15.33:0/934556711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 msgr2=0x55d2b5049fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:14:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.826+0000 7fe323e00640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b5049fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.826+0000 7fe323e00640 1 -- 172.21.15.33:0/934556711 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b50361a0 con 0x55d2b503ece0 2024-09-11T00:14:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.827+0000 7fe323e00640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe310009990 tx=0x7fe3100099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba4ce45b3317e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.827+0000 7fe30a000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-11T00:14:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.827+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100037f0 con 0x55d2b503ece0 2024-09-11T00:14:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.827+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe310003c20 con 0x55d2b503ece0 2024-09-11T00:14:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.828+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe3100035f0 con 0x55d2b503ece0 2024-09-11T00:14:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.828+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe3100037f0 con 0x55d2b503ece0 2024-09-11T00:14:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.829+0000 7fe32e478740 10 client.27106 fetch_fsmap learned FSMap version 30 2024-09-11T00:14:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.829+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d2b50bbec0 con 0x55d2b503ece0 2024-09-11T00:14:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe310003c20 con 0x55d2b503ece0 2024-09-11T00:14:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fe310030430 con 0x55d2b503ece0 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 10 client.27106 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 10 client.27106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 20 client.27106 populate_metadata read hostname 'smithi033' 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 4 client.27106 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.830+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2b4faa0b0 con 0x55d2b504efa0 2024-09-11T00:14:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.831+0000 7fe328c00640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.832+0000 7fe30a000640 10 client.27106 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.832+0000 7fe328c00640 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50be630 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c0408ede9d475b server_cookie=135d0ed3377cd927 in_seq=0 out_seq=0 2024-09-11T00:14:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.870+0000 7fe30a000640 1 -- 172.21.15.33:0/934556711 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2b4faa0b0 con 0x55d2b504efa0 2024-09-11T00:14:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.870+0000 7fe30a000640 10 client.27106 handle_command_reply: tid=0 2024-09-11T00:14:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.870+0000 7fe32e478740 1 client.27106 shutdown 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 msgr2=0x55d2b5049a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe310009990 tx=0x7fe3100099c0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 shutdown_connections 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2b5044530 0x55d2b5049fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55d2b504efa0 0x55d2b50be630 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d2b503ece0 0x55d2b5049a40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.871+0000 7fe30a000640 0 client.27106 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.872+0000 7fe32e478740 1 --2- 172.21.15.33:0/934556711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2b503c2a0 0x55d2b504ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.872+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 >> 172.21.15.33:0/934556711 conn(0x55d2b5034ac0 msgr2=0x55d2b5042090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.872+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 shutdown_connections 2024-09-11T00:14:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.873+0000 7fe32e478740 1 -- 172.21.15.33:0/934556711 wait complete. 2024-09-11T00:14:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.873+0000 7fe32e478740 20 client.27106 trim_cache size 0 max 16384 2024-09-11T00:14:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:14:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:14:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:14:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:14:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.874+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 msgr2=0x7fe30c0b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.874+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 0x7fe30c0b7970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3180096c0 tx=0x7fe318000bc0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.874+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 msgr2=0x7fe3241a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.874+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00eaa0 tx=0x7fe31c00ef60 comp rx=0 tx=0).stop 2024-09-11T00:14:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 shutdown_connections 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe30c0b54b0 0x7fe30c0b7970 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe32410a2d0 0x7fe3241a03a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe324109940 0x7fe32419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 --2- 172.21.15.33:0/2924705292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324108f80 0x7fe32419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 >> 172.21.15.33:0/2924705292 conn(0x7fe324078070 msgr2=0x7fe32410d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 shutdown_connections 2024-09-11T00:14:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:14:48.875+0000 7fe32a000640 1 -- 172.21.15.33:0/2924705292 wait complete. 2024-09-11T00:14:48.955 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:48 smithi052 ceph-mon[33526]: pgmap v977: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.8 MiB/s wr, 812 op/s 2024-09-11T00:14:49.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:48 smithi033 ceph-mon[30593]: pgmap v977: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.8 MiB/s wr, 812 op/s 2024-09-11T00:14:49.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:48 smithi189 ceph-mon[34000]: pgmap v977: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.8 MiB/s wr, 812 op/s 2024-09-11T00:14:50.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:50 smithi052 ceph-mon[33526]: pgmap v978: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 703 op/s 2024-09-11T00:14:51.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:50 smithi033 ceph-mon[30593]: pgmap v978: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 703 op/s 2024-09-11T00:14:51.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:50 smithi189 ceph-mon[34000]: pgmap v978: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 703 op/s 2024-09-11T00:14:53.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:52 smithi033 ceph-mon[30593]: pgmap v979: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-11T00:14:53.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:52 smithi189 ceph-mon[34000]: pgmap v979: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-11T00:14:53.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:52 smithi052 ceph-mon[33526]: pgmap v979: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-11T00:14:54.955 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T00:14:54.955 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.0 2024-09-11T00:14:54.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:55.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:54 smithi033 ceph-mon[30593]: pgmap v980: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T00:14:55.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:54 smithi189 ceph-mon[34000]: pgmap v980: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T00:14:55.207 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:54 smithi052 ceph-mon[33526]: pgmap v980: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 952 op/s 2024-09-11T00:14:55.511 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:57.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:56 smithi033 ceph-mon[30593]: pgmap v981: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:14:57.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:56 smithi189 ceph-mon[34000]: pgmap v981: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:14:57.228 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:56 smithi052 ceph-mon[33526]: pgmap v981: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.4 MiB/s wr, 751 op/s 2024-09-11T00:14:59.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:58 smithi033 ceph-mon[30593]: pgmap v982: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-11T00:14:59.041 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-11T00:14:59.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:58 smithi189 ceph-mon[34000]: pgmap v982: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-11T00:14:59.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:58 smithi052 ceph-mon[33526]: pgmap v982: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-11T00:14:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 -- 172.21.15.33:0/3660862390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c104e10 msgr2=0x7f8d5c1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 --2- 172.21.15.33:0/3660862390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c104e10 0x7f8d5c1051f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009900 tx=0x7f8d4c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 -- 172.21.15.33:0/3660862390 shutdown_connections 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 --2- 172.21.15.33:0/3660862390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c10b1a0 0x7f8d5c1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 --2- 172.21.15.33:0/3660862390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10a820 0x7f8d5c10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 --2- 172.21.15.33:0/3660862390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c104e10 0x7f8d5c1051f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 -- 172.21.15.33:0/3660862390 >> 172.21.15.33:0/3660862390 conn(0x7f8d5c100840 msgr2=0x7f8d5c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 -- 172.21.15.33:0/3660862390 shutdown_connections 2024-09-11T00:14:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.346+0000 7f8d5b200640 1 -- 172.21.15.33:0/3660862390 wait complete. 2024-09-11T00:14:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 Processor -- start 2024-09-11T00:14:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 -- start start 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 0x7f8d5c19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10b1a0 0x7f8d5c1a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c114d10 con 0x7f8d5c10a820 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c114b90 con 0x7f8d5c104e10 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.348+0000 7f8d5b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c114e90 con 0x7f8d5c10b1a0 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40150/0 (socket says 172.21.15.33:40150) 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59400640 1 -- 172.21.15.33:0/1375174488 learned_addr learned my addr 172.21.15.33:0/1375174488 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 0x7f8d5c19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d5a800640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10b1a0 0x7f8d5c1a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 -- 172.21.15.33:0/1375174488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10b1a0 msgr2=0x7f8d5c1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10b1a0 0x7f8d5c1a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 -- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 msgr2=0x7f8d5c19b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59e00640 1 -- 172.21.15.33:0/1375174488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c1a1230 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.349+0000 7f8d59400640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d59e00640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 0x7f8d5c19b180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005940 tx=0x7f8d4c0040e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c03f070 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d4c003c80 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c035070 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c1a14c0 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.350+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1a7be0 con 0x7f8d5c104e10 2024-09-11T00:14:59.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.351+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c1051f0 con 0x7f8d5c104e10 2024-09-11T00:14:59.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.356+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8d4c04b060 con 0x7f8d5c104e10 2024-09-11T00:14:59.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.357+0000 7f8d52a00640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 0x7f8d400b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.357+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f8d4c106990 con 0x7f8d5c104e10 2024-09-11T00:14:59.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.357+0000 7f8d59400640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 0x7f8d400b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.358+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8d4c0cce00 con 0x7f8d5c104e10 2024-09-11T00:14:59.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.358+0000 7f8d59400640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 0x7f8d400b7850 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c103de0 tx=0x7f8d4800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.617+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d5c19c2b0 con 0x7f8d5c104e10 2024-09-11T00:14:59.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.618+0000 7f8d52a00640 1 -- 172.21.15.33:0/1375174488 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f8d4c0d1830 con 0x7f8d5c104e10 2024-09-11T00:14:59.621 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:14:59.621 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:14:59.621 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:14:59.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.621+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 msgr2=0x7f8d400b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.621+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 0x7f8d400b7850 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c103de0 tx=0x7f8d4800b4a0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.621+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 msgr2=0x7f8d5c19b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.621+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 0x7f8d5c19b180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005940 tx=0x7f8d4c0040e0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 shutdown_connections 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f8d400b5390 0x7f8d400b7850 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d5c10b1a0 0x7f8d5c1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c10a820 0x7f8d5c19b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 --2- 172.21.15.33:0/1375174488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d5c104e10 0x7f8d5c19b180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 >> 172.21.15.33:0/1375174488 conn(0x7f8d5c100840 msgr2=0x7f8d5c102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.622+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 shutdown_connections 2024-09-11T00:14:59.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:14:59.623+0000 7f8d5b200640 1 -- 172.21.15.33:0/1375174488 wait complete. 2024-09-11T00:14:59.787 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/: 2024-09-11T00:14:59.787 INFO:teuthology.orchestra.run.smithi033.stdout:total 2 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1441019513 Sep 10 23:57 . 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1441019513 Sep 10 23:57 .. 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 data 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data: 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:total 46 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 . 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1441019513 Sep 10 23:57 .. 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 base 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 11 00:00 current_logfiles 2024-09-11T00:14:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 10 23:57 global 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1545 Sep 11 00:00 log 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_commit_ts 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_dynshmem 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 23:57 pg_hba.conf 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 23:57 pg_ident.conf 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 00:14 pg_logical 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 pg_multixact 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_notify 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_replslot 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_serial 2024-09-11T00:14:59.789 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_snapshots 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 11 00:14 pg_stat 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 00:14 pg_stat_tmp 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 00:14 pg_subtrans 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_tblspc 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 pg_twophase 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 855638016 Sep 11 00:14 pg_wal 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 pg_xact 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 23:57 postgresql.auto.conf 2024-09-11T00:14:59.790 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 23:57 postgresql.conf 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 10 23:57 postmaster.opts 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base: 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:total 3 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 . 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 1 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 13493 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 551580207 Sep 11 00:04 13494 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:59 pgsql_tmp 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-11T00:14:59.791 INFO:teuthology.orchestra.run.smithi033.stdout:total 7778 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 . 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 .. 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 1247 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1247_vm 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 23:57 1249 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1249_fsm 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1249_vm 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-11T00:14:59.792 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 1259 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1259_vm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-11T00:14:59.793 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-11T00:14:59.794 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2579 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-11T00:14:59.795 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-11T00:14:59.796 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-11T00:14:59.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606 2024-09-11T00:14:59.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-11T00:14:59.797 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606_vm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 23:57 2608 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2608_vm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-11T00:14:59.801 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2610 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2610_vm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-11T00:14:59.802 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 23:57 2619 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2619_fsm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2619_vm 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-11T00:14:59.803 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 23:57 2658 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 2659 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2662 2024-09-11T00:14:59.804 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2663 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2664 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2665 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2666 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2667 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 23:57 2673 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 23:57 2674 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2678 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2679 2024-09-11T00:14:59.805 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-11T00:14:59.806 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2696 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2703 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2704 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-11T00:14:59.807 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-11T00:14:59.808 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-11T00:14:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-11T00:14:59.810 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3455 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-11T00:14:59.811 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-11T00:14:59.812 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-11T00:14:59.813 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-11T00:14:59.814 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-11T00:14:59.815 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-11T00:14:59.993 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:14:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1375174488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:00.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:14:59 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1375174488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:00.208 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:14:59 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1375174488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:00.369 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-11T00:15:00.369 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-11T00:15:00.369 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-11T00:15:00.369 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-11T00:15:00.370 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-11T00:15:00.371 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-11T00:15:00.372 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:total 7778 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 10 23:57 . 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 .. 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 1247 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1247_vm 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 23:57 1249 2024-09-11T00:15:00.373 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1249_fsm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1249_vm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 1259 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1259_vm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-11T00:15:00.374 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-11T00:15:00.375 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-11T00:15:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2579 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-11T00:15:00.377 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2606_vm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-11T00:15:00.378 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 23:57 2608 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2608_vm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2610 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2610_vm 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-11T00:15:00.379 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-11T00:15:00.380 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 23:57 2619 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2619_fsm 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2619_vm 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-11T00:15:00.381 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 23:57 2658 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 23:57 2659 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2662 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2663 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2664 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2665 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2666 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2667 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-11T00:15:00.382 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 23:57 2673 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 23:57 2674 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2678 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2679 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-11T00:15:00.383 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2696 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-11T00:15:00.384 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2703 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2704 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-11T00:15:00.385 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-11T00:15:00.386 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-11T00:15:00.387 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-11T00:15:00.388 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3455 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-11T00:15:00.389 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-11T00:15:00.390 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-11T00:15:00.391 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-11T00:15:00.392 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-11T00:15:00.393 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-11T00:15:00.394 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-11T00:15:00.394 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-11T00:15:00.394 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-11T00:15:00.394 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-11T00:15:00.394 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-11T00:15:00.936 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0' 2024-09-11T00:15:00.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db / --timeout 90 --expiration 141.0 --await-for 45.0 2024-09-11T00:15:00.977 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-11T00:15:00.977 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-11T00:15:00.977 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-11T00:15:00.977 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-11T00:15:00.978 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-11T00:15:00.979 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:total 538655 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 551580207 Sep 11 00:04 . 2024-09-11T00:15:00.980 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 .. 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 112 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 113 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 00:00 1247 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1247_fsm 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:59 1247_vm 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 11 00:00 1249 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:59 1249_fsm 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:59 1249_vm 2024-09-11T00:15:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 23:57 1255 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1255_fsm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1255_vm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 00:14 1259 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1259_fsm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:59 1259_vm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 23:57 13344 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13344_fsm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13344_vm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13346 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13348 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13349_fsm 2024-09-11T00:15:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13349_vm 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13351 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13353 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13354_fsm 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13354_vm 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13356 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13358 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 13359_fsm 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13359_vm 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 13361 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 13363 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1417 2024-09-11T00:15:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 1418 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442384384 Sep 11 00:14 16396 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 11 00:14 16396_fsm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:14 16396_vm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2818048 Sep 11 00:14 16397 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 00:14 16397_fsm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:13 16397_vm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4358144 Sep 11 00:14 16399 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 00:14 16399_fsm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:13 16399_vm 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:14 16400 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 11 00:14 16402 2024-09-11T00:15:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 11 00:14 16404 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21651456 Sep 11 00:14 16406 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 00:14 16406_fsm 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:14 16406_vm 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 174 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 175 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2187 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2224 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2328 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2336 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2337 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2579 2024-09-11T00:15:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2600 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2600_fsm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2600_vm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2601_fsm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2601_vm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2602 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2602_fsm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2602_vm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2603 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2603_fsm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2603_vm 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2604 2024-09-11T00:15:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2605 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2605_fsm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2605_vm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:00 2606 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2606_fsm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:00 2606_vm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2607 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2607_fsm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2607_vm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 11 00:00 2608 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2608_fsm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:59 2608_vm 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 23:57 2609 2024-09-11T00:15:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2609_fsm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2609_vm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 00:00 2610 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2610_fsm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:00 2610_vm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2611 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2612_fsm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2612_vm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2613 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2615_fsm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2615_vm 2024-09-11T00:15:00.988 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2616 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2616_fsm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2616_vm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 23:57 2617 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2617_fsm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2617_vm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 23:57 2618 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2618_fsm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2618_vm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 11 00:14 2619 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 11 00:02 2619_fsm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:00 2619_vm 2024-09-11T00:15:00.989 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2620 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2650 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2651 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2652 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2653 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2654 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2655 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2656 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2657 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 11 00:00 2658 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 11 00:00 2659 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2660 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2661 2024-09-11T00:15:00.990 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 00:00 2662 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 11 00:00 2663 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2664 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2665 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2666 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2667 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2668 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2669 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2670 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 11 00:00 2673 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 11 00:00 2674 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 23:57 2675 2024-09-11T00:15:00.991 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2678 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 11 00:00 2679 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2680 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2681 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2682 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2683 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2684 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2685 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2686 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2687 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 2688 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 23:57 2689 2024-09-11T00:15:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 23:57 2690 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 23:57 2691 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2692 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2693 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 00:14 2696 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2699 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2701 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2702 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 11 00:00 2703 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 00:00 2704 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2753 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2753_fsm 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2753_vm 2024-09-11T00:15:00.993 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2754 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2755 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2756 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 2757 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2830 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2831 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2832 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2833 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2834 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2835 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2836 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2837 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 23:57 2838 2024-09-11T00:15:00.994 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2838_fsm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2838_vm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2839 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2840_fsm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2840_vm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2841 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2995 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2996 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3079_fsm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3079_vm 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3080 2024-09-11T00:15:00.995 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3081 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 23:57 3085 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3118 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3119 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 23:57 3164 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3256 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3257 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3258 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3350 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3351 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3379 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3380 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3381 2024-09-11T00:15:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3394 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3394_fsm 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3394_vm 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3395 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3429 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3430 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3431 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3433 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3439 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3440 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 11 00:00 3455 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 23:57 3456 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3456_fsm 2024-09-11T00:15:00.997 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3456_vm 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3466 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3467 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3468 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3501 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3502 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3503 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3534 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541 2024-09-11T00:15:00.998 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3541_fsm 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3541_vm 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3542 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3574 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3575 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3576 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3596 2024-09-11T00:15:00.999 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3597 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3598 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3599 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3600_fsm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3600_vm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3601_fsm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3601_vm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3602_fsm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3602_vm 2024-09-11T00:15:01.000 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3603_fsm 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3603_vm 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3604 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3605 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3606 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3607 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3608 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 23:57 3609 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3712 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 3764_fsm 2024-09-11T00:15:01.001 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3764_vm 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3766 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 3767 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3997 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4143 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4144 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4145 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4146 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4147 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4148 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4149 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4150 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4151 2024-09-11T00:15:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4152 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4153 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4154 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4155 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4156 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4157 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4158 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4159 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4160 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4161 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4162 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4163 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4164 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4165 2024-09-11T00:15:01.003 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4166 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4167 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4168 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4169 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4170 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4171 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4172 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4173 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4174 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 5002 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 548 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 549 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6102 2024-09-11T00:15:01.004 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6104 2024-09-11T00:15:01.005 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6106 2024-09-11T00:15:01.005 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6110 2024-09-11T00:15:01.005 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:00 smithi033 ceph-mon[30593]: pgmap v983: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 996 op/s 2024-09-11T00:15:01.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:00 smithi189 ceph-mon[34000]: pgmap v983: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 996 op/s 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6111 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6112 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6113 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6117 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 826 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 827 2024-09-11T00:15:01.091 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 828 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 10 23:57 pg_internal.init 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 23:57 PG_VERSION 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:59 . 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 567506485 Sep 10 23:59 .. 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/global: 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:total 561 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 10 23:57 . 2024-09-11T00:15:01.092 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1213 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1213_fsm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1213_vm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1214 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1214_fsm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1214_vm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 1232 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 1233 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1260 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1260_fsm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1260_vm 2024-09-11T00:15:01.093 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1261 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1261_fsm 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1261_vm 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1262 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 1262_fsm 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 1262_vm 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2396 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 23:57 2396_fsm 2024-09-11T00:15:01.094 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2396_vm 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2397 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2671 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2672 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2676 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2677 2024-09-11T00:15:01.095 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2694 2024-09-11T00:15:01.112 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2695 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2697 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 2698 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2846 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2847 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2964 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2965 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 2966 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 2967 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 3592 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 3593 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4060 2024-09-11T00:15:01.113 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4061 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4175 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4176 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4177 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4178 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4181 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4182 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4183 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4184 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 4185 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 4186 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6000 2024-09-11T00:15:01.114 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6001 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6002 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 6100 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6114 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 6115 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:14 pg_control 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 23:57 pg_filenode.map 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 10 23:57 pg_internal.init 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/log: 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:total 3 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1545 Sep 11 00:00 . 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.115 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 716 Sep 10 23:57 postgresql-Tue.log 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 900 Sep 11 00:14 postgresql-Wed.log 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-11T00:15:01.116 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.117 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:00 smithi052 ceph-mon[33526]: pgmap v983: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 996 op/s 2024-09-11T00:15:01.228 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.228 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-11T00:15:01.228 INFO:teuthology.orchestra.run.smithi033.stdout:total 3 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 00:14 . 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 mappings 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 00:14 replorigin_checkpoint 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 snapshots 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 00:14 .. 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.229 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 11 00:14 .. 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:total 2 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 . 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 members 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 offsets 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.230 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 .. 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 0000 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:total 9 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 23:57 . 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 23:57 .. 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 11 00:02 0000 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-11T00:15:01.231 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.232 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:total 16 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 11 00:14 . 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 11 00:14 db_0.stat 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 11 00:14 db_13494.stat 2024-09-11T00:15:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 11 00:14 global.stat 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 11 00:14 . 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:total 89 2024-09-11T00:15:01.234 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 00:14 . 2024-09-11T00:15:01.341 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.341 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 11 00:14 0006 2024-09-11T00:15:01.341 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:total 835586 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 855638016 Sep 11 00:14 . 2024-09-11T00:15:01.342 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 00000001000000000000006E 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 00000001000000000000006F 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:10 000000010000000000000070 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000071 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:09 000000010000000000000072 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000073 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:10 000000010000000000000074 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000075 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000076 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000077 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 000000010000000000000078 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000079 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:10 00000001000000000000007A 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 00000001000000000000007B 2024-09-11T00:15:01.343 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 00000001000000000000007C 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 00000001000000000000007D 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:09 00000001000000000000007E 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 00000001000000000000007F 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:09 000000010000000000000080 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:09 000000010000000000000081 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:10 000000010000000000000082 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:10 000000010000000000000083 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:11 000000010000000000000084 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000085 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 000000010000000000000086 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 000000010000000000000087 2024-09-11T00:15:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:07 000000010000000000000088 2024-09-11T00:15:01.357 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:08 000000010000000000000089 2024-09-11T00:15:01.357 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 00000001000000000000008A 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 00000001000000000000008B 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 00000001000000000000008C 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 00000001000000000000008D 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 00000001000000000000008E 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 00000001000000000000008F 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 000000010000000000000090 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 000000010000000000000091 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 000000010000000000000092 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 000000010000000000000093 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 000000010000000000000094 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 000000010000000000000095 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 000000010000000000000096 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 000000010000000000000097 2024-09-11T00:15:01.358 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 000000010000000000000098 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 000000010000000000000099 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 00000001000000000000009A 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 00000001000000000000009B 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 00000001000000000000009C 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 00000001000000000000009D 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:12 00000001000000000000009E 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:14 00000001000000000000009F 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 11 00:13 0000000100000000000000A0 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 archive_status 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:total 1 2024-09-11T00:15:01.359 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 23:57 . 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 855638016 Sep 11 00:14 .. 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:total 105 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 23:57 . 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1423980046 Sep 11 00:14 .. 2024-09-11T00:15:01.360 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 11 00:14 0000 2024-09-11T00:15:01.365 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-11T00:15:01.375 INFO:tasks.quiescer:joining Quiescers 2024-09-11T00:15:01.376 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-11T00:15:01.376 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:01.379 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 -- 172.21.15.33:0/4024520497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 msgr2=0x7fcb58077e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/4024520497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb58077e20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009900 tx=0x7fcb4802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 -- 172.21.15.33:0/4024520497 shutdown_connections 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/4024520497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 0x7fcb58079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/4024520497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 0x7fcb58078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/4024520497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb58077e20 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 -- 172.21.15.33:0/4024520497 >> 172.21.15.33:0/4024520497 conn(0x7fcb58100460 msgr2=0x7fcb58102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 -- 172.21.15.33:0/4024520497 shutdown_connections 2024-09-11T00:15:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.001+0000 7fcb5ce00640 1 -- 172.21.15.33:0/4024520497 wait complete. 2024-09-11T00:15:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.002+0000 7fcb5ce00640 1 Processor -- start 2024-09-11T00:15:02.005 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.002+0000 7fcb5ce00640 1 -- start start 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.002+0000 7fcb5ce00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb5ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 0x7fcb5819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb5ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 0x7fcb581a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb5ce00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58114ad0 con 0x7fcb58077a20 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb5ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58114950 con 0x7fcb58078b70 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb5ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58114c50 con 0x7fcb58079530 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41212/0 (socket says 172.21.15.33:41212) 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 -- 172.21.15.33:0/3279128082 learned_addr learned my addr 172.21.15.33:0/3279128082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55400640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 0x7fcb5819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb56800640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 0x7fcb581a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 -- 172.21.15.33:0/3279128082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 msgr2=0x7fcb581a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.006 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 0x7fcb581a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 -- 172.21.15.33:0/3279128082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 msgr2=0x7fcb5819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 0x7fcb5819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.003+0000 7fcb55e00640 1 -- 172.21.15.33:0/3279128082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb581a0de0 con 0x7fcb58077a20 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb55e00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009230 tx=0x7fcb480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb4ea00640 1 -- 172.21.15.33:0/3279128082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4803f030 con 0x7fcb58077a20 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb4ea00640 1 -- 172.21.15.33:0/3279128082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb48032e10 con 0x7fcb58077a20 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb4ea00640 1 -- 172.21.15.33:0/3279128082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48035070 con 0x7fcb58077a20 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb581a1070 con 0x7fcb58077a20 2024-09-11T00:15:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.004+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581a75c0 con 0x7fcb58077a20 2024-09-11T00:15:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.008+0000 7fcb4ea00640 1 -- 172.21.15.33:0/3279128082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcb4803b9c0 con 0x7fcb58077a20 2024-09-11T00:15:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 Processor -- start 2024-09-11T00:15:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 -- start start 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a582efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5600a579a6b0 con 0x5600a582a0c0 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600a5789ae0 con 0x5600a582cb00 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.009+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5600a578d8f0 con 0x5600a5827790 2024-09-11T00:15:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb56800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb56800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:48926/0 (socket says 172.21.15.33:48926) 2024-09-11T00:15:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb56800640 1 -- 172.21.15.33:0/4234003726 learned_addr learned my addr 172.21.15.33:0/4234003726 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55400640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a582efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 -- 172.21.15.33:0/4234003726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 msgr2=0x5600a5829b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 -- 172.21.15.33:0/4234003726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 msgr2=0x5600a582efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a582efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55e00640 1 -- 172.21.15.33:0/4234003726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a5756780 con 0x5600a582a0c0 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb56800640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.010+0000 7fcb55400640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a582efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb4ea00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 0x7fcb3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb55e00640 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582c4b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcb48104030 tx=0x7fcb4810ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4eb15edf830ddbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb4ea00640 1 -- 172.21.15.33:0/3279128082 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcb48106900 con 0x7fcb58077a20 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb56800640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 0x7fcb3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb43400640 1 -- 172.21.15.33:0/4234003726 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb480c9430 con 0x5600a582a0c0 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb43400640 1 -- 172.21.15.33:0/4234003726 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb480cc8f0 con 0x5600a582a0c0 2024-09-11T00:15:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.011+0000 7fcb43400640 1 -- 172.21.15.33:0/4234003726 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb480044e0 con 0x5600a582a0c0 2024-09-11T00:15:02.019 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 -- 172.21.15.33:0/4234003726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 msgr2=0x5600a582c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582c4b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcb48104030 tx=0x7fcb4810ccd0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb56800640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 0x7fcb3c0b77a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb500117f0 tx=0x7fcb50009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 -- 172.21.15.33:0/4234003726 shutdown_connections 2024-09-11T00:15:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a582efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582c4b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/4234003726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5829b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 -- 172.21.15.33:0/4234003726 >> 172.21.15.33:0/4234003726 conn(0x5600a58228e0 msgr2=0x5600a5823670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 -- 172.21.15.33:0/4234003726 shutdown_connections 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.012+0000 7fcb5fc70740 1 -- 172.21.15.33:0/4234003726 wait complete. 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.013+0000 7fcb5fc70740 1 -- start start 2024-09-11T00:15:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.013+0000 7fcb5fc70740 1 Processor -- start 2024-09-11T00:15:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 0x5600a5830bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a582cb00 0x5600a5831e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5600a56c1ab0 con 0x5600a582a0c0 2024-09-11T00:15:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600a5730570 con 0x5600a5827790 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5600a582f8a0 con 0x5600a582cb00 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb5fc70740 10 client.0 _ll_register_callbacks cb 0x5600a573f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41224/0 (socket says 172.21.15.33:41224) 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.014+0000 7fcb55400640 1 -- 172.21.15.33:0/1104576699 learned_addr learned my addr 172.21.15.33:0/1104576699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55e00640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 0x5600a5830bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb56800640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a582cb00 0x5600a5831e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 -- 172.21.15.33:0/1104576699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a582cb00 msgr2=0x5600a5831e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a582cb00 0x5600a5831e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 -- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 msgr2=0x5600a5830bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 0x5600a5830bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 -- 172.21.15.33:0/1104576699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a54eb790 con 0x5600a582a0c0 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55e00640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 0x5600a5830bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb55400640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcb440126e0 tx=0x7fcb44012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26365a735bffa8bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.015+0000 7fcb37e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb440120d0 con 0x5600a582a0c0 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcb4400f920 con 0x5600a582a0c0 2024-09-11T00:15:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb480cc8f0 con 0x5600a582a0c0 2024-09-11T00:15:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb44012270 con 0x5600a582a0c0 2024-09-11T00:15:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb5fc70740 10 client.17226 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5600a5564620 con 0x5600a582a0c0 2024-09-11T00:15:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.016+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb480cc8f0 con 0x5600a582a0c0 2024-09-11T00:15:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcb44010c30 con 0x5600a582a0c0 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 10 client.17226 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 10 client.17226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 20 client.17226 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a583c5f0 0x5600a583ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 4 client.17226 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:15:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.017+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600a579c600 con 0x5600a583c5f0 2024-09-11T00:15:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.018+0000 7fcb55e00640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a583c5f0 0x5600a583ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.018+0000 7fcb55e00640 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a583c5f0 0x5600a583ea20 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d834b89b79cda69 server_cookie=4bc008e8aa12e101 in_seq=0 out_seq=0 2024-09-11T00:15:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.018+0000 7fcb37e00640 10 client.17226 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.019+0000 7fcb37e00640 1 -- 172.21.15.33:0/1104576699 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600a579c600 con 0x5600a583c5f0 2024-09-11T00:15:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.019+0000 7fcb37e00640 10 client.17226 handle_command_reply: tid=0 2024-09-11T00:15:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.019+0000 7fcb5fc70740 1 client.17226 shutdown 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 msgr2=0x5600a5831290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcb440126e0 tx=0x7fcb44012ba0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 shutdown_connections 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a583c5f0 0x5600a583ea20 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a582cb00 0x5600a5831e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a5831290 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/1104576699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a5827790 0x5600a5830bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 >> 172.21.15.33:0/1104576699 conn(0x5600a58228e0 msgr2=0x5600a5821a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb37e00640 0 client.17226 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 shutdown_connections 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.020+0000 7fcb5fc70740 1 -- 172.21.15.33:0/1104576699 wait complete. 2024-09-11T00:15:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.021+0000 7fcb5fc70740 20 client.17226 trim_cache size 0 max 16384 2024-09-11T00:15:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 Processor -- start 2024-09-11T00:15:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 -- start start 2024-09-11T00:15:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a582cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.039 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a5830bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b4410 con 0x5600a582a0c0 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b1ce0 con 0x5600a582cb00 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.037+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581afb30 con 0x5600a5827790 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb55400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41240/0 (socket says 172.21.15.33:41240) 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb55400640 1 -- 172.21.15.33:0/7278486 learned_addr learned my addr 172.21.15.33:0/7278486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a5830bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb55e00640 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a582cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 -- 172.21.15.33:0/7278486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 msgr2=0x5600a582cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.040 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a582cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 -- 172.21.15.33:0/7278486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 msgr2=0x5600a582d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.038+0000 7fcb56800640 1 -- 172.21.15.33:0/7278486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600a582c820 con 0x5600a582cb00 2024-09-11T00:15:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.039+0000 7fcb56800640 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a5830bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb500115d0 tx=0x7fcb50019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08899fc8e4c0e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.039+0000 7fcb42a00640 1 -- 172.21.15.33:0/7278486 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50004b20 con 0x5600a582cb00 2024-09-11T00:15:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.039+0000 7fcb42a00640 1 -- 172.21.15.33:0/7278486 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb5001ee00 con 0x5600a582cb00 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.039+0000 7fcb42a00640 1 -- 172.21.15.33:0/7278486 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50005690 con 0x5600a582cb00 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 -- 172.21.15.33:0/7278486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 msgr2=0x5600a5830bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a5830bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb500115d0 tx=0x7fcb50019000 comp rx=0 tx=0).stop 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 -- 172.21.15.33:0/7278486 shutdown_connections 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582cb00 0x5600a5830bf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582a0c0 0x5600a582d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/7278486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a582cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 -- 172.21.15.33:0/7278486 >> 172.21.15.33:0/7278486 conn(0x5600a58228e0 msgr2=0x5600a5823380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 -- 172.21.15.33:0/7278486 shutdown_connections 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.040+0000 7fcb5fc70740 1 -- 172.21.15.33:0/7278486 wait complete. 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.041+0000 7fcb5fc70740 1 -- start start 2024-09-11T00:15:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.041+0000 7fcb5fc70740 1 Processor -- start 2024-09-11T00:15:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5837a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582cb00 0x5600a5836550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b01a0 con 0x5600a582cb00 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b1610 con 0x5600a582a0c0 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b0870 con 0x5600a5827790 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb5fc70740 10 client.0 _ll_register_callbacks cb 0x7fcb44009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb56800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582cb00 0x5600a5836550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36520/0 (socket says 172.21.15.33:36520) 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55400640 1 -- 172.21.15.33:0/2010587692 learned_addr learned my addr 172.21.15.33:0/2010587692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55e00640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5837a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55400640 1 -- 172.21.15.33:0/2010587692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 msgr2=0x5600a5837a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.042+0000 7fcb55400640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5837a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb55400640 1 -- 172.21.15.33:0/2010587692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582cb00 msgr2=0x5600a5836550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb55400640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582cb00 0x5600a5836550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb55400640 1 -- 172.21.15.33:0/2010587692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600a5836a90 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb55400640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009de0 tx=0x7fcb44005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9a226078282218 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb37e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb440120d0 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb5001ee00 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.043+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcb440056a0 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.044+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb44035050 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.044+0000 7fcb5fc70740 10 client.37175 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.044+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5600a58a9c70 con 0x5600a582a0c0 2024-09-11T00:15:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.044+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb5001ee00 con 0x5600a582a0c0 2024-09-11T00:15:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.044+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcb440035f0 con 0x5600a582a0c0 2024-09-11T00:15:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 10 client.37175 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 10 client.37175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T00:15:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 20 client.37175 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a58aa6d0 0x5600a58acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 4 client.37175 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T00:15:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600a57980b0 con 0x5600a58aa6d0 2024-09-11T00:15:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.045+0000 7fcb55e00640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a58aa6d0 0x5600a58acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.046+0000 7fcb55e00640 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a58aa6d0 0x5600a58acaf0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a46bdc1cb904ee server_cookie=9e1e634b419ac40f in_seq=0 out_seq=0 2024-09-11T00:15:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.046+0000 7fcb37e00640 10 client.37175 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.118+0000 7efe02c00640 1 -- 172.21.15.33:0/3497634155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc10a3b0 msgr2=0x7efdfc10a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.118+0000 7efe02c00640 1 --2- 172.21.15.33:0/3497634155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc10a3b0 0x7efdfc10a790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efdf400afd0 tx=0x7efdf402b3e0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.120+0000 7efe02c00640 1 -- 172.21.15.33:0/3497634155 shutdown_connections 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.120+0000 7efe02c00640 1 --2- 172.21.15.33:0/3497634155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.120+0000 7efe02c00640 1 --2- 172.21.15.33:0/3497634155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.120+0000 7efe02c00640 1 --2- 172.21.15.33:0/3497634155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc10a3b0 0x7efdfc10a790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.120+0000 7efe02c00640 1 -- 172.21.15.33:0/3497634155 >> 172.21.15.33:0/3497634155 conn(0x7efdfc06dfc0 msgr2=0x7efdfc06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.121+0000 7fcb37e00640 1 -- 172.21.15.33:0/2010587692 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600a57980b0 con 0x5600a58aa6d0 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.121+0000 7fcb37e00640 10 client.37175 handle_command_reply: tid=0 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.121+0000 7fcb5fc70740 1 client.37175 shutdown 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.121+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 msgr2=0x5600a5837f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.121+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009de0 tx=0x7fcb44005270 comp rx=0 tx=0).stop 2024-09-11T00:15:02.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 shutdown_connections 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600a582cb00 0x5600a5836550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600a582a0c0 0x5600a5837f70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5600a58aa6d0 0x5600a58acaf0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb37e00640 0 client.37175 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 --2- 172.21.15.33:0/2010587692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5600a5827790 0x5600a5837a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 >> 172.21.15.33:0/2010587692 conn(0x5600a58228e0 msgr2=0x5600a5826c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.122+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 shutdown_connections 2024-09-11T00:15:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.121+0000 7efe02c00640 1 -- 172.21.15.33:0/3497634155 shutdown_connections 2024-09-11T00:15:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.121+0000 7efe02c00640 1 -- 172.21.15.33:0/3497634155 wait complete. 2024-09-11T00:15:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.122+0000 7efe02c00640 1 Processor -- start 2024-09-11T00:15:02.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.123+0000 7fcb5fc70740 1 -- 172.21.15.33:0/2010587692 wait complete. 2024-09-11T00:15:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.123+0000 7efe02c00640 1 -- start start 2024-09-11T00:15:02.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.123+0000 7fcb5fc70740 20 client.37175 trim_cache size 0 max 16384 2024-09-11T00:15:02.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-09-11T00:15:02.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-09-11T00:15:02.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-09-11T00:15:02.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-09-11T00:15:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.124+0000 7efe02c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.124+0000 7efe02c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.124+0000 7efe02c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 0x7efdfc077040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.124+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.125+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 msgr2=0x7fcb3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.125+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 0x7fcb3c0b77a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb500117f0 tx=0x7fcb50009500 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.125+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 msgr2=0x7fcb5819f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.125+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009230 tx=0x7fcb480042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 shutdown_connections 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb3c0b52e0 0x7fcb3c0b77a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb58079530 0x7fcb581a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58078b70 0x7fcb5819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 --2- 172.21.15.33:0/3279128082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb58077a20 0x7fcb5819f2a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 >> 172.21.15.33:0/3279128082 conn(0x7fcb58100460 msgr2=0x7fcb58101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41264/0 (socket says 172.21.15.33:41264) 2024-09-11T00:15:02.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 shutdown_connections 2024-09-11T00:15:02.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-09-11T00:15:02.126+0000 7fcb5ce00640 1 -- 172.21.15.33:0/3279128082 wait complete. 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efdfb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efdfb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:48966/0 (socket says 172.21.15.33:48966) 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc07f590 con 0x7efdfc075070 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efdfbe00640 1 -- 172.21.15.33:0/2738144638 learned_addr learned my addr 172.21.15.33:0/2738144638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc07f410 con 0x7efdfc10a3b0 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc07f710 con 0x7efdfc0759f0 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.125+0000 7efe00c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 0x7efdfc077040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efe00c00640 1 -- 172.21.15.33:0/2738144638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 msgr2=0x7efdfc07c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efe00c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efe00c00640 1 -- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 msgr2=0x7efdfc07bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efe00c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efe00c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc077900 con 0x7efdfc10a3b0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.126+0000 7efdfbe00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.127+0000 7efe00c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 0x7efdfc077040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efde800d680 tx=0x7efde800db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.127+0000 7efdf8c00640 1 -- 172.21.15.33:0/2738144638 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8017070 con 0x7efdfc10a3b0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.127+0000 7efdf8c00640 1 -- 172.21.15.33:0/2738144638 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde8009820 con 0x7efdfc10a3b0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.127+0000 7efdf8c00640 1 -- 172.21.15.33:0/2738144638 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8004c60 con 0x7efdfc10a3b0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.127+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc077bf0 con 0x7efdfc10a3b0 2024-09-11T00:15:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.128+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc1bd1c0 con 0x7efdfc10a3b0 2024-09-11T00:15:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.133+0000 7efdf8c00640 1 -- 172.21.15.33:0/2738144638 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efde8005220 con 0x7efdfc10a3b0 2024-09-11T00:15:02.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.135+0000 7efdf8c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 0x7efde00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.135+0000 7efdf8c00640 1 -- 172.21.15.33:0/2738144638 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efde80e58b0 con 0x7efdfc10a3b0 2024-09-11T00:15:02.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.136+0000 7efdfbe00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 0x7efde00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.137+0000 7efdfbe00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 0x7efde00b77e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efdf4004af0 tx=0x7efdf4032f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 Processor -- start 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 -- start start 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43180 0x5568eee43560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43aa0 0x5568eee4f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5568eedb8ca0 con 0x5568eee4fa30 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5568eeda80d0 con 0x5568eee43aa0 2024-09-11T00:15:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.281+0000 7efe056a0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568eedabee0 con 0x5568eee43180 2024-09-11T00:15:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43180 0x5568eee43560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41274/0 (socket says 172.21.15.33:41274) 2024-09-11T00:15:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 -- 172.21.15.33:0/735664822 learned_addr learned my addr 172.21.15.33:0/735664822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efdfb400640 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43aa0 0x5568eee4f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 -- 172.21.15.33:0/735664822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43180 msgr2=0x5568eee43560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43180 0x5568eee43560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 -- 172.21.15.33:0/735664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43aa0 msgr2=0x5568eee4f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43aa0 0x5568eee4f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 -- 172.21.15.33:0/735664822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568eed5a400 con 0x5568eee4fa30 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.282+0000 7efe00c00640 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efde80abc60 tx=0x7efde80ab7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8937eff54dc337 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.283+0000 7efdf1200640 1 -- 172.21.15.33:0/735664822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8020070 con 0x5568eee4fa30 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.283+0000 7efdf1200640 1 -- 172.21.15.33:0/735664822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde80abcd0 con 0x5568eee4fa30 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.283+0000 7efdf1200640 1 -- 172.21.15.33:0/735664822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80099d0 con 0x5568eee4fa30 2024-09-11T00:15:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.283+0000 7efe056a0740 1 -- 172.21.15.33:0/735664822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 msgr2=0x5568eee51e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.283+0000 7efe056a0740 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7efde80abc60 tx=0x7efde80ab7e0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 -- 172.21.15.33:0/735664822 shutdown_connections 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee4fa30 0x5568eee51e20 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43aa0 0x5568eee4f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 --2- 172.21.15.33:0/735664822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43180 0x5568eee43560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 -- 172.21.15.33:0/735664822 >> 172.21.15.33:0/735664822 conn(0x5568eee40fb0 msgr2=0x5568eee42150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 -- 172.21.15.33:0/735664822 shutdown_connections 2024-09-11T00:15:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 -- 172.21.15.33:0/735664822 wait complete. 2024-09-11T00:15:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.284+0000 7efe056a0740 1 -- start start 2024-09-11T00:15:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 Processor -- start 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee4f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee4cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5568eec097a0 con 0x5568eee43aa0 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5568eed4da10 con 0x5568eee43180 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568eee52650 con 0x5568eee4fa30 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efe056a0740 10 client.0 _ll_register_callbacks cb 0x5568eed5dbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efdfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efdfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41280/0 (socket says 172.21.15.33:41280) 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efdfb400640 1 -- 172.21.15.33:0/4051757582 learned_addr learned my addr 172.21.15.33:0/4051757582 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.285+0000 7efdfbe00640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee4f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efe00c00640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee4cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 -- 172.21.15.33:0/4051757582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 msgr2=0x5568eee4cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee4cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 -- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 msgr2=0x5568eee4f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee4f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 -- 172.21.15.33:0/4051757582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568eeb15b90 con 0x5568eee43aa0 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efe00c00640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee4cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efdfb400640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efdec0117c0 tx=0x7efdec011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4f5b1e3494763a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.286+0000 7efde5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec01e060 con 0x5568eee43aa0 2024-09-11T00:15:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efde80abcd0 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efdec00fdb0 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efdec025050 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efe056a0740 10 client.17241 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568eee5e000 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.287+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde80abcd0 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efdec018030 con 0x5568eee43aa0 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 10 client.17241 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 10 client.17241 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 20 client.17241 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eee5f4c0 0x5568eee618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 4 client.17241 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:15:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568eedbabf0 con 0x5568eee5f4c0 2024-09-11T00:15:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.288+0000 7efdfbe00640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eee5f4c0 0x5568eee618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.289+0000 7efdfbe00640 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eee5f4c0 0x5568eee618d0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=405a1c35b67cd092 server_cookie=76df16968510e45 in_seq=0 out_seq=0 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.289+0000 7efde5600640 10 client.17241 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efde5600640 1 -- 172.21.15.33:0/4051757582 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568eedbabf0 con 0x5568eee5f4c0 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efde5600640 10 client.17241 handle_command_reply: tid=0 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 client.17241 shutdown 2024-09-11T00:15:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 msgr2=0x5568eee4c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efdec0117c0 tx=0x7efdec011c80 comp rx=0 tx=0).stop 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 shutdown_connections 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eee5f4c0 0x5568eee618d0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee4cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee4c780 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 --2- 172.21.15.33:0/4051757582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee4f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 >> 172.21.15.33:0/4051757582 conn(0x5568eee40fb0 msgr2=0x5568eee46b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.290+0000 7efde5600640 0 client.17241 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.291+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 shutdown_connections 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.291+0000 7efe056a0740 1 -- 172.21.15.33:0/4051757582 wait complete. 2024-09-11T00:15:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.291+0000 7efe056a0740 20 client.17241 trim_cache size 0 max 16384 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 Processor -- start 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 -- start start 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee5b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee42540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1da950 con 0x5568eee43aa0 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1d8220 con 0x5568eee43180 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.309+0000 7efe056a0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1d6070 con 0x5568eee4fa30 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41296/0 (socket says 172.21.15.33:41296) 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 -- 172.21.15.33:0/4110372841 learned_addr learned my addr 172.21.15.33:0/4110372841 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efe00c00640 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee42540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfbe00640 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee5b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 -- 172.21.15.33:0/4110372841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 msgr2=0x5568eee42540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee42540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 -- 172.21.15.33:0/4110372841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 msgr2=0x5568eee5b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee5b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 -- 172.21.15.33:0/4110372841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568eee4ac80 con 0x5568eee43aa0 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.310+0000 7efdfb400640 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efdec011790 tx=0x7efdec005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2667ffd05223a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.311+0000 7efde7e00640 1 -- 172.21.15.33:0/4110372841 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec00fbb0 con 0x5568eee43aa0 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.311+0000 7efde7e00640 1 -- 172.21.15.33:0/4110372841 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdec00fd50 con 0x5568eee43aa0 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.311+0000 7efde7e00640 1 -- 172.21.15.33:0/4110372841 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec0043a0 con 0x5568eee43aa0 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.311+0000 7efe056a0740 1 -- 172.21.15.33:0/4110372841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 msgr2=0x5568eee42000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.311+0000 7efe056a0740 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efdec011790 tx=0x7efdec005f20 comp rx=0 tx=0).stop 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 -- 172.21.15.33:0/4110372841 shutdown_connections 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee4fa30 0x5568eee42540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43aa0 0x5568eee42000 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 --2- 172.21.15.33:0/4110372841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee43180 0x5568eee5b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 -- 172.21.15.33:0/4110372841 >> 172.21.15.33:0/4110372841 conn(0x5568eee40fb0 msgr2=0x5568eee4bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 -- 172.21.15.33:0/4110372841 shutdown_connections 2024-09-11T00:15:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 -- 172.21.15.33:0/4110372841 wait complete. 2024-09-11T00:15:02.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 -- start start 2024-09-11T00:15:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.312+0000 7efe056a0740 1 Processor -- start 2024-09-11T00:15:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 0x5568eee528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 0x5568eee52de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1d66e0 con 0x5568eee43180 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1d7b50 con 0x5568eee4fa30 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1d6db0 con 0x5568eee43aa0 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe056a0740 10 client.0 _ll_register_callbacks cb 0x7efdec00c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41306/0 (socket says 172.21.15.33:41306) 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efdfbe00640 1 -- 172.21.15.33:0/1762389375 learned_addr learned my addr 172.21.15.33:0/1762389375 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efe00c00640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 0x5568eee52de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.313+0000 7efdfb400640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 0x5568eee528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 -- 172.21.15.33:0/1762389375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 msgr2=0x5568eee528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 0x5568eee528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 -- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 msgr2=0x5568eee52de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 0x5568eee52de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 -- 172.21.15.33:0/1762389375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568eee53480 con 0x5568eee43180 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfb400640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 0x5568eee528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efe00c00640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 0x5568eee52de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efdfbe00640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007a40 tx=0x7efdf403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c28e0cccedba9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efde5600640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:15:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4044040 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7efdf4032880 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.314+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdec00fd50 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efdf4063050 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 10 client.17247 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5568eeecd2b0 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdec00fd50 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efdf402fc00 con 0x5568eee43180 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 10 client.17247 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 10 client.17247 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:15:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 20 client.17247 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eeecdad0 0x5568eeecfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 4 client.17247 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}] 2024-09-11T00:15:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.315+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.0, "await_for": 45.0}) -- 0x5568eedb66a0 con 0x5568eeecdad0 2024-09-11T00:15:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.316+0000 7efdfb400640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eeecdad0 0x5568eeecfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.317+0000 7efdfb400640 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eeecdad0 0x5568eeecfef0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e670c4a451576f0 server_cookie=42c7f91ea249e96a in_seq=0 out_seq=0 2024-09-11T00:15:02.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.317+0000 7efde5600640 10 client.17247 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.746+0000 7efde5600640 1 -- 172.21.15.33:0/1762389375 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5568eedb66a0 con 0x5568eeecdad0 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.746+0000 7efde5600640 10 client.17247 handle_command_reply: tid=0 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.746+0000 7efe056a0740 1 client.17247 shutdown 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 msgr2=0x5568eee57f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007a40 tx=0x7efdf403a000 comp rx=0 tx=0).stop 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 shutdown_connections 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568eee4fa30 0x5568eee52de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x5568eeecdad0 0x5568eeecfef0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568eee43aa0 0x5568eee528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 --2- 172.21.15.33:0/1762389375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5568eee43180 0x5568eee57f00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efde5600640 0 client.17247 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 >> 172.21.15.33:0/1762389375 conn(0x5568eee40fb0 msgr2=0x5568eee42000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 shutdown_connections 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 1 -- 172.21.15.33:0/1762389375 wait complete. 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.747+0000 7efe056a0740 20 client.17247 trim_cache size 0 max 16384 2024-09-11T00:15:02.750 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 54, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "7a7f971c": { 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 54, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-09-11T00:15:02.751 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 141.0, 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-09-11T00:15:02.752 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:02.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:02.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:02.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:02.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:02.753 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 msgr2=0x7efde00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 0x7efde00b77e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efdf4004af0 tx=0x7efdf4032f90 comp rx=0 tx=0).stop 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 msgr2=0x7efdfc077040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 0x7efdfc077040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efde800d680 tx=0x7efde800db40 comp rx=0 tx=0).stop 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 shutdown_connections 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7efde00b5320 0x7efde00b77e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdfc10a3b0 0x7efdfc077040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efdfc0759f0 0x7efdfc07c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 --2- 172.21.15.33:0/2738144638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc075070 0x7efdfc07bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 >> 172.21.15.33:0/2738144638 conn(0x7efdfc06dfc0 msgr2=0x7efdfc10b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.748+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 shutdown_connections 2024-09-11T00:15:02.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:02.749+0000 7efe02c00640 1 -- 172.21.15.33:0/2738144638 wait complete. 2024-09-11T00:15:02.868 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:02 smithi033 ceph-mon[30593]: pgmap v984: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 926 op/s 2024-09-11T00:15:03.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:02 smithi189 ceph-mon[34000]: pgmap v984: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 926 op/s 2024-09-11T00:15:03.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:02 smithi052 ceph-mon[33526]: pgmap v984: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 926 op/s 2024-09-11T00:15:04.846 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7a7f971c', quiesce took 9.9 seconds. Will release after: 11.1 2024-09-11T00:15:05.010 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:04 smithi033 ceph-mon[30593]: pgmap v985: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 820 op/s 2024-09-11T00:15:05.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:04 smithi189 ceph-mon[34000]: pgmap v985: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 820 op/s 2024-09-11T00:15:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 -- 172.21.15.33:0/2068079361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494109150 msgr2=0x7f349410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 --2- 172.21.15.33:0/2068079361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494109150 0x7f349410f950 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f348c009ca0 tx=0x7f348c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 -- 172.21.15.33:0/2068079361 shutdown_connections 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 --2- 172.21.15.33:0/2068079361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494109150 0x7f349410f950 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 --2- 172.21.15.33:0/2068079361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 0x7f3494108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 --2- 172.21.15.33:0/2068079361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494102dc0 0x7f34941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.135+0000 7f349b000640 1 -- 172.21.15.33:0/2068079361 >> 172.21.15.33:0/2068079361 conn(0x7f34940fe830 msgr2=0x7f3494100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.136+0000 7f349b000640 1 -- 172.21.15.33:0/2068079361 shutdown_connections 2024-09-11T00:15:05.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.136+0000 7f349b000640 1 -- 172.21.15.33:0/2068079361 wait complete. 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.136+0000 7f349b000640 1 Processor -- start 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 -- start start 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 0x7f349419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494109150 0x7f34941a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3494112cd0 con 0x7f3494102dc0 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3494112b50 con 0x7f3494109150 2024-09-11T00:15:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f349b000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3494112e50 con 0x7f34941087d0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f3493e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f3493e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41330/0 (socket says 172.21.15.33:41330) 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f3493e00640 1 -- 172.21.15.33:0/388093426 learned_addr learned my addr 172.21.15.33:0/388093426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.137+0000 7f348be00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 0x7f349419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3499000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494109150 0x7f34941a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 -- 172.21.15.33:0/388093426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 msgr2=0x7f349419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 0x7f349419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 -- 172.21.15.33:0/388093426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494109150 msgr2=0x7f34941a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494109150 0x7f34941a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 -- 172.21.15.33:0/388093426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34941a1430 con 0x7f3494102dc0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3493e00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f348400d950 tx=0x7f348400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484017030 con 0x7f3494102dc0 2024-09-11T00:15:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34941a1720 con 0x7f3494102dc0 2024-09-11T00:15:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3484004020 con 0x7f3494102dc0 2024-09-11T00:15:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.138+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34840055d0 con 0x7f3494102dc0 2024-09-11T00:15:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.139+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a7fb0 con 0x7f3494102dc0 2024-09-11T00:15:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.140+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34941031a0 con 0x7f3494102dc0 2024-09-11T00:15:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.142+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3484009a30 con 0x7f3494102dc0 2024-09-11T00:15:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.143+0000 7f3491600640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.144+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f34840e59f0 con 0x7f3494102dc0 2024-09-11T00:15:05.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.144+0000 7f348be00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.144+0000 7f348be00640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 0x7f34780b7820 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3494104d80 tx=0x7f347c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.147+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f34840ac4b0 con 0x7f3494102dc0 2024-09-11T00:15:05.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:04 smithi052 ceph-mon[33526]: pgmap v985: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 820 op/s 2024-09-11T00:15:05.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.380+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f349402e5c0 con 0x7f3494102dc0 2024-09-11T00:15:05.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.381+0000 7f3491600640 1 -- 172.21.15.33:0/388093426 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f34840abdb0 con 0x7f3494102dc0 2024-09-11T00:15:05.383 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:05.383 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:15:05.383 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:15:05.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 msgr2=0x7f34780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 0x7f34780b7820 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3494104d80 tx=0x7f347c005f90 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 msgr2=0x7f349419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f348400d950 tx=0x7f348400de10 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 shutdown_connections 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f34780b5360 0x7f34780b7820 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3494109150 0x7f34941a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34941087d0 0x7f349419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 --2- 172.21.15.33:0/388093426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3494102dc0 0x7f349419b380 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 >> 172.21.15.33:0/388093426 conn(0x7f34940fe830 msgr2=0x7f3494106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 shutdown_connections 2024-09-11T00:15:05.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:05.383+0000 7f349b000640 1 -- 172.21.15.33:0/388093426 wait complete. 2024-09-11T00:15:06.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/388093426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/388093426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:06.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/388093426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:06.219 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34688 quiesce db --cancel --all' 2024-09-11T00:15:06.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.34688 quiesce db --cancel --all 2024-09-11T00:15:06.602 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:06.994 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:06 smithi033 ceph-mon[30593]: pgmap v986: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 524 op/s 2024-09-11T00:15:07.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:06 smithi189 ceph-mon[34000]: pgmap v986: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 524 op/s 2024-09-11T00:15:07.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:06 smithi052 ceph-mon[33526]: pgmap v986: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 7.7 MiB/s wr, 524 op/s 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 -- 172.21.15.33:0/1813037374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd710104fa0 msgr2=0x7fd710105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 --2- 172.21.15.33:0/1813037374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd710104fa0 0x7fd710105380 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd700009ca0 tx=0x7fd70002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 -- 172.21.15.33:0/1813037374 shutdown_connections 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 --2- 172.21.15.33:0/1813037374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd71010b330 0x7fd710111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 --2- 172.21.15.33:0/1813037374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010a9b0 0x7fd71010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 --2- 172.21.15.33:0/1813037374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd710104fa0 0x7fd710105380 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 -- 172.21.15.33:0/1813037374 >> 172.21.15.33:0/1813037374 conn(0x7fd710100a50 msgr2=0x7fd710102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.229+0000 7fd714e00640 1 -- 172.21.15.33:0/1813037374 shutdown_connections 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.230+0000 7fd714e00640 1 -- 172.21.15.33:0/1813037374 wait complete. 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.230+0000 7fd714e00640 1 Processor -- start 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 -- start start 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd710104fa0 0x7fd71019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010b330 0x7fd7101a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd710114e40 con 0x7fd71010a9b0 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd710114cc0 con 0x7fd71010b330 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd714e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd710114fc0 con 0x7fd710104fa0 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41346/0 (socket says 172.21.15.33:41346) 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd705400640 1 -- 172.21.15.33:0/4007399902 learned_addr learned my addr 172.21.15.33:0/4007399902 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd70de00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd710104fa0 0x7fd71019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.231+0000 7fd70e800640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010b330 0x7fd7101a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 -- 172.21.15.33:0/4007399902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd710104fa0 msgr2=0x7fd71019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd710104fa0 0x7fd71019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 -- 172.21.15.33:0/4007399902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010b330 msgr2=0x7fd7101a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010b330 0x7fd7101a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 -- 172.21.15.33:0/4007399902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101a1460 con 0x7fd71010a9b0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd705400640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9f0 tx=0x7fd6f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd707400640 1 -- 172.21.15.33:0/4007399902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800cd80 con 0x7fd71010a9b0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd707400640 1 -- 172.21.15.33:0/4007399902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f80108c0 con 0x7fd71010a9b0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd707400640 1 -- 172.21.15.33:0/4007399902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80187c0 con 0x7fd71010a9b0 2024-09-11T00:15:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7101a1750 con 0x7fd71010a9b0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.232+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101a7e10 con 0x7fd71010a9b0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.236+0000 7fd717809740 1 Processor -- start 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 -- start start 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe3433c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 0x55fe34348410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe3434ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fe342b3ff0 con 0x55fe34348950 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fe342a3420 con 0x55fe3433c0a0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd717809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fe342a7230 con 0x55fe3433c9c0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.237+0000 7fd707400640 1 -- 172.21.15.33:0/4007399902 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd6f8010430 con 0x7fd71010a9b0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe3434ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd70e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe3433c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd70de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 0x55fe34348410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd70e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe3433c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.33:36626/0 (socket says 172.21.15.33:36626) 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd70e800640 1 -- 172.21.15.33:0/3164682332 learned_addr learned my addr 172.21.15.33:0/3164682332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 -- 172.21.15.33:0/3164682332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 msgr2=0x55fe34348410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 0x55fe34348410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 -- 172.21.15.33:0/3164682332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 msgr2=0x55fe3433c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe3433c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 -- 172.21.15.33:0/3164682332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe340018b0 con 0x55fe34348950 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd70de00640 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 0x55fe34348410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.238+0000 7fd705400640 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe3434ad40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80e39c0 tx=0x7fd6f80ee930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbf1595ad4df16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd6ff400640 1 -- 172.21.15.33:0/3164682332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80f9070 con 0x55fe34348950 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd6ff400640 1 -- 172.21.15.33:0/3164682332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f80e8480 con 0x55fe34348950 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd6ff400640 1 -- 172.21.15.33:0/3164682332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80f4920 con 0x55fe34348950 2024-09-11T00:15:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd707400640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 0x7fd6f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd707400640 1 -- 172.21.15.33:0/4007399902 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd6f80e6350 con 0x7fd71010a9b0 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd717809740 1 -- 172.21.15.33:0/3164682332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 msgr2=0x55fe3434ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd717809740 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe3434ad40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80e39c0 tx=0x7fd6f80ee930 comp rx=0 tx=0).stop 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.239+0000 7fd70e800640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 0x7fd6f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 -- 172.21.15.33:0/3164682332 shutdown_connections 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe3434ad40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c9c0 0x55fe34348410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 --2- 172.21.15.33:0/3164682332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe3433c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 -- 172.21.15.33:0/3164682332 >> 172.21.15.33:0/3164682332 conn(0x55fe34339ed0 msgr2=0x55fe3433b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 -- 172.21.15.33:0/3164682332 shutdown_connections 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 -- 172.21.15.33:0/3164682332 wait complete. 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 -- start start 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd70e800640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 0x7fd6f40b77a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd708005fd0 tx=0x7fd708005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.240+0000 7fd717809740 1 Processor -- start 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34348260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c9c0 0x55fe343456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fe34104810 con 0x55fe34348950 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fe3423e550 con 0x55fe3433c9c0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fe3434b600 con 0x55fe3433c0a0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd717809740 10 client.0 _ll_register_callbacks cb 0x55fe3424e040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd70e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd70e800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41362/0 (socket says 172.21.15.33:41362) 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.241+0000 7fd70e800640 1 -- 172.21.15.33:0/2242049647 learned_addr learned my addr 172.21.15.33:0/2242049647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70de00640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34348260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd705400640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c9c0 0x55fe343456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 -- 172.21.15.33:0/2242049647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 msgr2=0x55fe34348260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34348260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 -- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c9c0 msgr2=0x55fe343456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c9c0 0x55fe343456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 -- 172.21.15.33:0/2242049647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe34230200 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd70e800640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd708003b90 tx=0x7fd708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d3fa7ffe764004 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.242+0000 7fd6f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70802c060 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd708017030 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f80e8480 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd708033050 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd717809740 10 client.17265 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fe34356fc0 con 0x55fe34348950 2024-09-11T00:15:07.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.243+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f80e8480 con 0x55fe34348950 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd708011440 con 0x55fe34348950 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 10 client.17265 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 10 client.17265 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 20 client.17265 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343584d0 0x55fe3435a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 4 client.17265 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe342b5f40 con 0x55fe343584d0 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.244+0000 7fd70de00640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343584d0 0x55fe3435a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.245+0000 7fd70de00640 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343584d0 0x55fe3435a8f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80694d2080ea3c28 server_cookie=e8b10068d6635886 in_seq=0 out_seq=0 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.245+0000 7fd6f3e00640 10 client.17265 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd6f3e00640 1 -- 172.21.15.33:0/2242049647 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe342b5f40 con 0x55fe343584d0 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd6f3e00640 10 client.17265 handle_command_reply: tid=0 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 client.17265 shutdown 2024-09-11T00:15:07.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 msgr2=0x55fe34345ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd708003b90 tx=0x7fd708004730 comp rx=0 tx=0).stop 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 shutdown_connections 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe34348950 0x55fe34345ce0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c9c0 0x55fe343456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343584d0 0x55fe3435a8f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 --2- 172.21.15.33:0/2242049647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34348260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd6f3e00640 0 client.17265 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.246+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 >> 172.21.15.33:0/2242049647 conn(0x55fe34339ed0 msgr2=0x55fe3433fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.247+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 shutdown_connections 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.247+0000 7fd717809740 1 -- 172.21.15.33:0/2242049647 wait complete. 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.247+0000 7fd717809740 20 client.17265 trim_cache size 0 max 16384 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 Processor -- start 2024-09-11T00:15:07.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 -- start start 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34345c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe34348950 0x55fe34349d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101b4550 con 0x55fe3433c9c0 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101b1e20 con 0x55fe34348950 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.265+0000 7fd717809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101afc70 con 0x55fe3433c0a0 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41376/0 (socket says 172.21.15.33:41376) 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 -- 172.21.15.33:0/3456285298 learned_addr learned my addr 172.21.15.33:0/3456285298 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd70de00640 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34345c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd70e800640 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe34348950 0x55fe34349d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 -- 172.21.15.33:0/3456285298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 msgr2=0x55fe34345c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34345c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 -- 172.21.15.33:0/3456285298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe34348950 msgr2=0x55fe34349d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe34348950 0x55fe34349d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 -- 172.21.15.33:0/3456285298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3433c7f0 con 0x55fe3433c9c0 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.266+0000 7fd705400640 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80f4510 tx=0x7fd6f80f44a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bba1ae43f96c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd6fea00640 1 -- 172.21.15.33:0/3456285298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80a8660 con 0x55fe3433c9c0 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd6fea00640 1 -- 172.21.15.33:0/3456285298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f80ac2d0 con 0x55fe3433c9c0 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd6fea00640 1 -- 172.21.15.33:0/3456285298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80abf30 con 0x55fe3433c9c0 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 -- 172.21.15.33:0/3456285298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 msgr2=0x55fe343473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80f4510 tx=0x7fd6f80f44a0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 -- 172.21.15.33:0/3456285298 shutdown_connections 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe34348950 0x55fe34349d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe343473f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 --2- 172.21.15.33:0/3456285298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe3433c0a0 0x55fe34345c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 -- 172.21.15.33:0/3456285298 >> 172.21.15.33:0/3456285298 conn(0x55fe34339ed0 msgr2=0x55fe34346ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.267+0000 7fd717809740 1 -- 172.21.15.33:0/3456285298 shutdown_connections 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 -- 172.21.15.33:0/3456285298 wait complete. 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 -- start start 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 Processor -- start 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe34350890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.268+0000 7fd717809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe34348950 0x55fe34341d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd717809740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101b02e0 con 0x55fe3433c9c0 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd717809740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101b1750 con 0x55fe3433c0a0 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd717809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7101b09b0 con 0x55fe34348950 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd717809740 10 client.0 _ll_register_callbacks cb 0x7fd708003a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:07.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41384/0 (socket says 172.21.15.33:41384) 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 -- 172.21.15.33:0/135971003 learned_addr learned my addr 172.21.15.33:0/135971003 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd70e800640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe34348950 0x55fe34341d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd70de00640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe34350890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 -- 172.21.15.33:0/135971003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe34348950 msgr2=0x55fe34341d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe34348950 0x55fe34341d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 -- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 msgr2=0x55fe34350890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe34350890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 -- 172.21.15.33:0/135971003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe34342260 con 0x55fe3433c9c0 2024-09-11T00:15:07.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd70de00640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe34350890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd705400640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80ac750 tx=0x7fd6f80ee930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c230893cf8be45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.269+0000 7fd6f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80ac110 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fd6f8010a70 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f80ac2d0 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd6f80ac590 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 10 client.17271 fetch_fsmap learned FSMap version 30 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fe343c6bb0 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6f80ac2d0 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd6f80e9b60 con 0x55fe3433c9c0 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 10 client.17271 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 10 client.17271 resolve_mds: validated gid 34688 aka daemon mds.b 2024-09-11T00:15:07.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 20 client.17271 populate_metadata read hostname 'smithi033' 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343c6e40 0x55fe343c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 4 client.17271 mds_command: new command op to 34688 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.270+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 --> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55fe342b19f0 con 0x55fe343c6e40 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.271+0000 7fd70de00640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343c6e40 0x55fe343c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.271+0000 7fd70de00640 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343c6e40 0x55fe343c9230 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ead568df17cd28 server_cookie=28c7ecd797fd69ec in_seq=0 out_seq=0 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.271+0000 7fd6f3e00640 10 client.17271 ms_handle_connect on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd6f3e00640 1 -- 172.21.15.33:0/135971003 <== mds.0 v2:172.21.15.52:6838/2315099444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55fe342b19f0 con 0x55fe343c6e40 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd6f3e00640 10 client.17271 handle_command_reply: tid=0 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 client.17271 shutdown 2024-09-11T00:15:07.352 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 30, 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 34688, 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 55, 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": {} 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 msgr2=0x55fe34350dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80ac750 tx=0x7fd6f80ee930 comp rx=0 tx=0).stop 2024-09-11T00:15:07.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 shutdown_connections 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:6838/2315099444,v1:172.21.15.52:6839/2315099444] conn(0x55fe343c6e40 0x55fe343c9230 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fe34348950 0x55fe34341d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe3433c9c0 0x55fe34350dd0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd6f3e00640 0 client.17271 ms_handle_reset on v2:172.21.15.52:6838/2315099444 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 --2- 172.21.15.33:0/135971003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fe3433c0a0 0x55fe34350890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 >> 172.21.15.33:0/135971003 conn(0x55fe34339ed0 msgr2=0x55fe34347500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 shutdown_connections 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.272+0000 7fd717809740 1 -- 172.21.15.33:0/135971003 wait complete. 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd717809740 20 client.17271 trim_cache size 0 max 16384 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 msgr2=0x7fd6f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 0x7fd6f40b77a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd708005fd0 tx=0x7fd708005cc0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 msgr2=0x7fd71019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9f0 tx=0x7fd6f800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 shutdown_connections 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fd6f40b52e0 0x7fd6f40b77a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd71010b330 0x7fd7101a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd71010a9b0 0x7fd71019b8f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 --2- 172.21.15.33:0/4007399902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd710104fa0 0x7fd71019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 >> 172.21.15.33:0/4007399902 conn(0x7fd710100a50 msgr2=0x7fd7101013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 shutdown_connections 2024-09-11T00:15:07.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:07.273+0000 7fd714e00640 1 -- 172.21.15.33:0/4007399902 wait complete. 2024-09-11T00:15:08.525 INFO:tasks.quiescer:done joining Quiescers 2024-09-11T00:15:08.525 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-11T00:15:08.539 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi033.front.sepia.ceph.com 2024-09-11T00:15:08.552 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T00:15:08.561 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:15:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 -- 172.21.15.33:0/589605608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4079530 msgr2=0x7f91c4079e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 --2- 172.21.15.33:0/589605608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4079530 0x7f91c4079e80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ca0 tx=0x7f91bc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 -- 172.21.15.33:0/589605608 shutdown_connections 2024-09-11T00:15:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 --2- 172.21.15.33:0/589605608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4079530 0x7f91c4079e80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 --2- 172.21.15.33:0/589605608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4078b70 0x7f91c4078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 --2- 172.21.15.33:0/589605608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4077a20 0x7f91c4077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.758+0000 7f91c9200640 1 -- 172.21.15.33:0/589605608 >> 172.21.15.33:0/589605608 conn(0x7f91c4100440 msgr2=0x7f91c4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.759+0000 7f91c9200640 1 -- 172.21.15.33:0/589605608 shutdown_connections 2024-09-11T00:15:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.759+0000 7f91c9200640 1 -- 172.21.15.33:0/589605608 wait complete. 2024-09-11T00:15:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 Processor -- start 2024-09-11T00:15:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 -- start start 2024-09-11T00:15:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4077a20 0x7f91c419f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4079530 0x7f91c41a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4114b40 con 0x7f91c4078b70 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91c41149c0 con 0x7f91c4079530 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.760+0000 7f91c9200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4114cc0 con 0x7f91c4077a20 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41406/0 (socket says 172.21.15.33:41406) 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91c1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4077a20 0x7f91c419f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 -- 172.21.15.33:0/1385627615 learned_addr learned my addr 172.21.15.33:0/1385627615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91c2800640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4079530 0x7f91c41a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 -- 172.21.15.33:0/1385627615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4077a20 msgr2=0x7f91c419f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4077a20 0x7f91c419f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 -- 172.21.15.33:0/1385627615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4079530 msgr2=0x7f91c41a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4079530 0x7f91c41a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 -- 172.21.15.33:0/1385627615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c41a0d70 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.761+0000 7f91bbe00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d770 tx=0x7f91ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.762+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac017070 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.762+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f91ac0054b0 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.762+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac004c60 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.763+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c41a1060 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.763+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41a7730 con 0x7f91c4078b70 2024-09-11T00:15:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.764+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c4078ff0 con 0x7f91c4078b70 2024-09-11T00:15:08.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.766+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f91ac004e00 con 0x7f91c4078b70 2024-09-11T00:15:08.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.768+0000 7f91baa00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 0x7f91a80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.768+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f91ac0e5930 con 0x7f91c4078b70 2024-09-11T00:15:08.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.768+0000 7f91c1e00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 0x7f91a80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.769+0000 7f91c1e00640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 0x7f91a80b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f91b400bbe0 tx=0x7f91b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.771+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f91ac0abda0 con 0x7f91c4078b70 2024-09-11T00:15:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.973+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c4063d50 con 0x7f91c4078b70 2024-09-11T00:15:08.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.975+0000 7f91baa00640 1 -- 172.21.15.33:0/1385627615 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24816 (secure 0 0 0) 0x7f91ac0b07d0 con 0x7f91c4078b70 2024-09-11T00:15:08.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:55:48.186249+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.977+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 msgr2=0x7f91a80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.977+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 0x7f91a80b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f91b400bbe0 tx=0x7f91b400b390 comp rx=0 tx=0).stop 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.977+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 msgr2=0x7f91c419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.977+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d770 tx=0x7f91ac00dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 shutdown_connections 2024-09-11T00:15:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f91a80b5360 0x7f91a80b7820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4079530 0x7f91c41a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c4078b70 0x7f91c419f880 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 --2- 172.21.15.33:0/1385627615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f91c4077a20 0x7f91c419f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 >> 172.21.15.33:0/1385627615 conn(0x7f91c4100440 msgr2=0x7f91c4101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 shutdown_connections 2024-09-11T00:15:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:08.978+0000 7f91c9200640 1 -- 172.21.15.33:0/1385627615 wait complete. 2024-09-11T00:15:08.995 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:48:07.161907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:53:52.123969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:53:54.680861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T23:54:02.777509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T00:15:08.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:15:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:08 smithi033 ceph-mon[30593]: pgmap v987: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 522 op/s 2024-09-11T00:15:09.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:08 smithi189 ceph-mon[34000]: pgmap v987: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 522 op/s 2024-09-11T00:15:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 -- 172.21.15.33:0/2451924320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 msgr2=0x7fb5e8103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 --2- 172.21.15.33:0/2451924320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e8103d40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009930 tx=0x7fb5d402a420 comp rx=0 tx=0).stop 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 -- 172.21.15.33:0/2451924320 shutdown_connections 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 --2- 172.21.15.33:0/2451924320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8104280 0x7fb5e810ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 --2- 172.21.15.33:0/2451924320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e8103d40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 --2- 172.21.15.33:0/2451924320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8102770 0x7fb5e8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 -- 172.21.15.33:0/2451924320 >> 172.21.15.33:0/2451924320 conn(0x7fb5e80fe030 msgr2=0x7fb5e8100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 -- 172.21.15.33:0/2451924320 shutdown_connections 2024-09-11T00:15:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.156+0000 7fb5ef000640 1 -- 172.21.15.33:0/2451924320 wait complete. 2024-09-11T00:15:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 Processor -- start 2024-09-11T00:15:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 -- start start 2024-09-11T00:15:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8102770 0x7fb5e819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8104280 0x7fb5e819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e810e2e0 con 0x7fb5e81038c0 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e810e160 con 0x7fb5e8102770 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.157+0000 7fb5ef000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e810e460 con 0x7fb5e8104280 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41426/0 (socket says 172.21.15.33:41426) 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 -- 172.21.15.33:0/3317050038 learned_addr learned my addr 172.21.15.33:0/3317050038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5edc00640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8102770 0x7fb5e819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ee600640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8104280 0x7fb5e819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 -- 172.21.15.33:0/3317050038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8104280 msgr2=0x7fb5e819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8104280 0x7fb5e819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 -- 172.21.15.33:0/3317050038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8102770 msgr2=0x7fb5e819aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8102770 0x7fb5e819aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 -- 172.21.15.33:0/3317050038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e819c7e0 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.158+0000 7fb5ed200640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4031460 tx=0x7fb5d4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.159+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d403f070 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.159+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5d4031da0 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.159+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4035030 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.159+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e819ca70 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.159+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e819cd80 con 0x7fb5e81038c0 2024-09-11T00:15:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.160+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e81a31a0 con 0x7fb5e81038c0 2024-09-11T00:15:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.162+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb5d403b460 con 0x7fb5e81038c0 2024-09-11T00:15:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.163+0000 7fb5e6000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 0x7fb5d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.164+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fb5d41070e0 con 0x7fb5e81038c0 2024-09-11T00:15:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.164+0000 7fb5edc00640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 0x7fb5d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.164+0000 7fb5edc00640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 0x7fb5d00b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc005fd0 tx=0x7fb5dc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.165+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb5d40cd550 con 0x7fb5e81038c0 2024-09-11T00:15:09.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:08 smithi052 ceph-mon[33526]: pgmap v987: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 522 op/s 2024-09-11T00:15:09.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.363+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5e81a3370 con 0x7fb5e81038c0 2024-09-11T00:15:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.363+0000 7fb5e6000640 1 -- 172.21.15.33:0/3317050038 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fb5d40d1f80 con 0x7fb5e81038c0 2024-09-11T00:15:09.365 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-09-11T00:15:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 msgr2=0x7fb5d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 0x7fb5d00b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc005fd0 tx=0x7fb5dc009680 comp rx=0 tx=0).stop 2024-09-11T00:15:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 msgr2=0x7fb5e819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4031460 tx=0x7fb5d4003c80 comp rx=0 tx=0).stop 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 shutdown_connections 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fb5d00b52e0 0x7fb5d00b77a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb5e8104280 0x7fb5e819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e81038c0 0x7fb5e819b2f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 --2- 172.21.15.33:0/3317050038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5e8102770 0x7fb5e819aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.365+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 >> 172.21.15.33:0/3317050038 conn(0x7fb5e80fe030 msgr2=0x7fb5e8075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.366+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 shutdown_connections 2024-09-11T00:15:09.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.366+0000 7fb5ef000640 1 -- 172.21.15.33:0/3317050038 wait complete. 2024-09-11T00:15:09.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 -- 172.21.15.33:0/2969839557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c105cd0 msgr2=0x7f633c106150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 --2- 172.21.15.33:0/2969839557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c105cd0 0x7f633c106150 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6324009930 tx=0x7f632402a440 comp rx=0 tx=0).stop 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 -- 172.21.15.33:0/2969839557 shutdown_connections 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 --2- 172.21.15.33:0/2969839557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106690 0x7f633c10d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 --2- 172.21.15.33:0/2969839557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c105cd0 0x7f633c106150 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 --2- 172.21.15.33:0/2969839557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f633c104b80 0x7f633c104f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 -- 172.21.15.33:0/2969839557 >> 172.21.15.33:0/2969839557 conn(0x7f633c100440 msgr2=0x7f633c102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 -- 172.21.15.33:0/2969839557 shutdown_connections 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.584+0000 7f6341400640 1 -- 172.21.15.33:0/2969839557 wait complete. 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 Processor -- start 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 -- start start 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 0x7f633c19b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f633c106690 0x7f633c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f633c1106a0 con 0x7f633c104b80 2024-09-11T00:15:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f633c110520 con 0x7f633c105cd0 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f6341400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f633c110820 con 0x7f633c106690 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f633a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f633a800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41448/0 (socket says 172.21.15.33:41448) 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.585+0000 7f633a800640 1 -- 172.21.15.33:0/49137010 learned_addr learned my addr 172.21.15.33:0/49137010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6331e00640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 0x7f633c19b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 -- 172.21.15.33:0/49137010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f633c106690 msgr2=0x7f633c19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f633c106690 0x7f633c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 -- 172.21.15.33:0/49137010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 msgr2=0x7f633c19b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 0x7f633c19b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 -- 172.21.15.33:0/49137010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c19c9e0 con 0x7f633c104b80 2024-09-11T00:15:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6331e00640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 0x7f633c19b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f633a800640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e9f0 tx=0x7f632c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c00cd80 con 0x7f633c104b80 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f632c0054b0 con 0x7f633c104b80 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c19ccd0 con 0x7f633c104b80 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c010430 con 0x7f633c104b80 2024-09-11T00:15:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.586+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c1a33a0 con 0x7f633c104b80 2024-09-11T00:15:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.587+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c10bf50 con 0x7f633c104b80 2024-09-11T00:15:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.590+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f632c005020 con 0x7f633c104b80 2024-09-11T00:15:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.591+0000 7f6333e00640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 0x7f63200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.591+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f632c0e64c0 con 0x7f633c104b80 2024-09-11T00:15:09.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.591+0000 7f6331e00640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 0x7f63200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.592+0000 7f6331e00640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 0x7f63200b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f6324000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.595+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f632c0acf80 con 0x7f633c104b80 2024-09-11T00:15:09.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.791+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f633c063d80 con 0x7f633c104b80 2024-09-11T00:15:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.792+0000 7f6333e00640 1 -- 172.21.15.33:0/49137010 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f632c0ac880 con 0x7f633c104b80 2024-09-11T00:15:09.793 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 msgr2=0x7f63200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 0x7f63200b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f6324000bc0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 msgr2=0x7f633c19aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e9f0 tx=0x7f632c00edf0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 shutdown_connections 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f63200b5360 0x7f63200b7820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f633c106690 0x7f633c19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c105cd0 0x7f633c19b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 --2- 172.21.15.33:0/49137010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f633c104b80 0x7f633c19aea0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 >> 172.21.15.33:0/49137010 conn(0x7f633c100440 msgr2=0x7f633c109120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 shutdown_connections 2024-09-11T00:15:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.794+0000 7f6341400640 1 -- 172.21.15.33:0/49137010 wait complete. 2024-09-11T00:15:09.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:15:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 -- 172.21.15.33:0/772582153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678102960 msgr2=0x7f9678102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 --2- 172.21.15.33:0/772582153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678102960 0x7f9678102d60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9668009930 tx=0x7f966802a420 comp rx=0 tx=0).stop 2024-09-11T00:15:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 -- 172.21.15.33:0/772582153 shutdown_connections 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 --2- 172.21.15.33:0/772582153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678104470 0x7f967810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 --2- 172.21.15.33:0/772582153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 0x7f9678103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 --2- 172.21.15.33:0/772582153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678102960 0x7f9678102d60 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.972+0000 7f967d800640 1 -- 172.21.15.33:0/772582153 >> 172.21.15.33:0/772582153 conn(0x7f96780fe220 msgr2=0x7f9678100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.973+0000 7f967d800640 1 -- 172.21.15.33:0/772582153 shutdown_connections 2024-09-11T00:15:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.973+0000 7f967d800640 1 -- 172.21.15.33:0/772582153 wait complete. 2024-09-11T00:15:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.973+0000 7f967d800640 1 Processor -- start 2024-09-11T00:15:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 -- start start 2024-09-11T00:15:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 0x7f9678105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 0x7f96781059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 0x7f9678106600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f967810e560 con 0x7f9678104470 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f967810e3e0 con 0x7f9678103ab0 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f967d800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f967810e6e0 con 0x7f9678102960 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f9676a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 0x7f9678105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f9677400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 0x7f9678106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f9676a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 0x7f9678105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.33:49172/0 (socket says 172.21.15.33:49172) 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f9676a00640 1 -- 172.21.15.33:0/2375257636 learned_addr learned my addr 172.21.15.33:0/2375257636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.974+0000 7f966fe00640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 0x7f96781059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 -- 172.21.15.33:0/2375257636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 msgr2=0x7f9678105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 0x7f9678105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 -- 172.21.15.33:0/2375257636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 msgr2=0x7f96781059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 0x7f96781059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 -- 172.21.15.33:0/2375257636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678106ec0 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f9677400640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 0x7f9678106600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f967000be20 tx=0x7f9670009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670019070 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f967000cd70 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700126b0 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.975+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96781071b0 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.976+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96781078d0 con 0x7f9678104470 2024-09-11T00:15:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.977+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9678107410 con 0x7f9678104470 2024-09-11T00:15:09.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.979+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9670014440 con 0x7f9678104470 2024-09-11T00:15:09.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.980+0000 7f966f400640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 0x7f965c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:09.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.980+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f96700e5d60 con 0x7f9678104470 2024-09-11T00:15:09.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.981+0000 7f9676a00640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 0x7f965c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:09.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.981+0000 7f9676a00640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 0x7f965c0b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f96680096c0 tx=0x7f9668031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:09.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:09.982+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96700ac1d0 con 0x7f9678104470 2024-09-11T00:15:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:09 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1385627615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:10.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:09 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3317050038' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:15:10.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:09 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1385627615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:10.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:09 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3317050038' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:15:10.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.179+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9678107b90 con 0x7f9678104470 2024-09-11T00:15:10.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.179+0000 7f966f400640 1 -- 172.21.15.33:0/2375257636 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f96700b0c00 con 0x7f9678104470 2024-09-11T00:15:10.181 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 msgr2=0x7f965c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 0x7f965c0b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f96680096c0 tx=0x7f9668031400 comp rx=0 tx=0).stop 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 msgr2=0x7f9678106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 0x7f9678106600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f967000be20 tx=0x7f9670009ed0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 shutdown_connections 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f965c0b52e0 0x7f965c0b77a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9678104470 0x7f9678106600 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9678103ab0 0x7f96781059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 --2- 172.21.15.33:0/2375257636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9678102960 0x7f9678105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.181+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 >> 172.21.15.33:0/2375257636 conn(0x7f96780fe220 msgr2=0x7f9678109370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.182+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 shutdown_connections 2024-09-11T00:15:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.182+0000 7f967d800640 1 -- 172.21.15.33:0/2375257636 wait complete. 2024-09-11T00:15:10.199 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T00:15:10.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:09 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1385627615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:10.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:09 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3317050038' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:15:10.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.358+0000 7fcbaf400640 1 -- 172.21.15.33:0/793109357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8104b80 msgr2=0x7fcba8104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.358+0000 7fcbaf400640 1 --2- 172.21.15.33:0/793109357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8104b80 0x7fcba8104f80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009930 tx=0x7fcb9c02a440 comp rx=0 tx=0).stop 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 -- 172.21.15.33:0/793109357 shutdown_connections 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 --2- 172.21.15.33:0/793109357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8106690 0x7fcba810d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 --2- 172.21.15.33:0/793109357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 0x7fcba8106150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 --2- 172.21.15.33:0/793109357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8104b80 0x7fcba8104f80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 -- 172.21.15.33:0/793109357 >> 172.21.15.33:0/793109357 conn(0x7fcba8100440 msgr2=0x7fcba8102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 -- 172.21.15.33:0/793109357 shutdown_connections 2024-09-11T00:15:10.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 -- 172.21.15.33:0/793109357 wait complete. 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.359+0000 7fcbaf400640 1 Processor -- start 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 -- start start 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8104b80 0x7fcba819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 0x7fcba819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcba81106a0 con 0x7fcba8106690 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8110520 con 0x7fcba8105cd0 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaf400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8110820 con 0x7fcba8104b80 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbad400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbad400640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41474/0 (socket says 172.21.15.33:41474) 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbad400640 1 -- 172.21.15.33:0/3025829039 learned_addr learned my addr 172.21.15.33:0/3025829039 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcbaca00640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8104b80 0x7fcba819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.360+0000 7fcba7e00640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 0x7fcba819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 -- 172.21.15.33:0/3025829039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8104b80 msgr2=0x7fcba819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8104b80 0x7fcba819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 -- 172.21.15.33:0/3025829039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 msgr2=0x7fcba819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 0x7fcba819b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 -- 172.21.15.33:0/3025829039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba819c9e0 con 0x7fcba8106690 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbad400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcba000eb10 tx=0x7fcba000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0004b20 con 0x7fcba8106690 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcba0004cc0 con 0x7fcba8106690 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba819ccd0 con 0x7fcba8106690 2024-09-11T00:15:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0010690 con 0x7fcba8106690 2024-09-11T00:15:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.361+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81a33a0 con 0x7fcba8106690 2024-09-11T00:15:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.362+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba810bf10 con 0x7fcba8106690 2024-09-11T00:15:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.366+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcba0005000 con 0x7fcba8106690 2024-09-11T00:15:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.368+0000 7fcba5600640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 0x7fcb900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.368+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fcba00e67c0 con 0x7fcba8106690 2024-09-11T00:15:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.368+0000 7fcbaca00640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 0x7fcb900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.369+0000 7fcbaca00640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 0x7fcb900b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0057c0 tx=0x7fcb9c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.369+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcba0056220 con 0x7fcba8106690 2024-09-11T00:15:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.566+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcba802e810 con 0x7fcba8106690 2024-09-11T00:15:10.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.567+0000 7fcba5600640 1 -- 172.21.15.33:0/3025829039 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) ==== 103+0+11 (secure 0 0 0) 0x7fcba00ad280 con 0x7fcba8106690 2024-09-11T00:15:10.569 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 msgr2=0x7fcb900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 0x7fcb900b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0057c0 tx=0x7fcb9c031400 comp rx=0 tx=0).stop 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 msgr2=0x7fcba819c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcba000eb10 tx=0x7fcba000c2d0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 shutdown_connections 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fcb900b52e0 0x7fcb900b77a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcba8106690 0x7fcba819c120 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba8105cd0 0x7fcba819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 --2- 172.21.15.33:0/3025829039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcba8104b80 0x7fcba819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 >> 172.21.15.33:0/3025829039 conn(0x7fcba8100440 msgr2=0x7fcba81090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 shutdown_connections 2024-09-11T00:15:10.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.569+0000 7fcbaf400640 1 -- 172.21.15.33:0/3025829039 wait complete. 2024-09-11T00:15:10.589 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 -- 172.21.15.33:0/3313486915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e501066b0 msgr2=0x7f4e5010d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 --2- 172.21.15.33:0/3313486915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e501066b0 0x7f4e5010d030 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009cd0 tx=0x7f4e4802a8f0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 -- 172.21.15.33:0/3313486915 shutdown_connections 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 --2- 172.21.15.33:0/3313486915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e501066b0 0x7f4e5010d030 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 --2- 172.21.15.33:0/3313486915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50105cf0 0x7f4e50106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 --2- 172.21.15.33:0/3313486915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e50104ba0 0x7f4e50104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 -- 172.21.15.33:0/3313486915 >> 172.21.15.33:0/3313486915 conn(0x7f4e50100440 msgr2=0x7f4e50102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 -- 172.21.15.33:0/3313486915 shutdown_connections 2024-09-11T00:15:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.746+0000 7f4e55c00640 1 -- 172.21.15.33:0/3313486915 wait complete. 2024-09-11T00:15:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 Processor -- start 2024-09-11T00:15:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 -- start start 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 0x7f4e5019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e501066b0 0x7f4e5019c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501106f0 con 0x7f4e50105cf0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110570 con 0x7f4e501066b0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.747+0000 7f4e55c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110870 con 0x7f4e50104ba0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 0x7f4e5019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41494/0 (socket says 172.21.15.33:41494) 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 -- 172.21.15.33:0/1473051664 learned_addr learned my addr 172.21.15.33:0/1473051664 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4f400640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e501066b0 0x7f4e5019c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 -- 172.21.15.33:0/1473051664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 msgr2=0x7f4e5019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 0x7f4e5019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 -- 172.21.15.33:0/1473051664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e501066b0 msgr2=0x7f4e5019c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e501066b0 0x7f4e5019c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 -- 172.21.15.33:0/1473051664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5019c980 con 0x7f4e50105cf0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4ea00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 0x7f4e5019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.748+0000 7f4e4e000640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d950 tx=0x7f4e3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.749+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e50105cf0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.749+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e3c009c30 con 0x7f4e50105cf0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.749+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00f620 con 0x7f4e50105cf0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.749+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5019cc70 con 0x7f4e50105cf0 2024-09-11T00:15:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.749+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a3340 con 0x7f4e50105cf0 2024-09-11T00:15:10.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.750+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5010be40 con 0x7f4e50105cf0 2024-09-11T00:15:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.753+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4e3c010460 con 0x7f4e50105cf0 2024-09-11T00:15:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.754+0000 7f4e47400640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 0x7f4e340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.754+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4e3c0e5ae0 con 0x7f4e50105cf0 2024-09-11T00:15:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.754+0000 7f4e4ea00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 0x7f4e340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.755+0000 7f4e4ea00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 0x7f4e340b7820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009fc0 tx=0x7f4e40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:10.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:10.758+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e3c009de0 con 0x7f4e50105cf0 2024-09-11T00:15:11.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.005+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f4e50063d50 con 0x7f4e50105cf0 2024-09-11T00:15:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.016+0000 7f4e47400640 1 -- 172.21.15.33:0/1473051664 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+827940 (secure 0 0 0) 0x7f4e3c0abf50 con 0x7f4e50105cf0 2024-09-11T00:15:11.028 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 20, 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "active_gid": 14150, 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "active_name": "x", 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addrs": { 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6800", 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 604054582 2024-09-11T00:15:11.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6801", 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 604054582 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addr": "172.21.15.33:6801/604054582", 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "active_change": "2024-09-10T23:44:46.663671+0000", 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "active_mgr_features": 4540719139924082687, 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "available": true, 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: "standbys": [ 2024-09-11T00:15:11.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 24124, 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "z", 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.033 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-11T00:15:11.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-11T00:15:11.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-11T00:15:11.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-11T00:15:11.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.055 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.056 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.057 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.060 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-11T00:15:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:15:11.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-11T00:15:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:15:11.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:15:11.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:15:11.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-11T00:15:11.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.093 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:15:11.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.103 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba_metrics": { 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-11T00:15:11.112 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-11T00:15:11.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.114 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.121 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-11T00:15:11.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-11T00:15:11.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-11T00:15:11.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.133 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-11T00:15:11.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-11T00:15:11.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.139 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:15:11.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.149 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.154 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.155 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.157 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.160 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:15:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:15:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:15:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:15:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:15:11.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:15:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.183 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.184 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.196 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.197 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:15:11.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:15:11.202 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.203 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-11T00:15:11.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-11T00:15:11.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-11T00:15:11.226 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.227 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.231 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.236 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:15:11.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:15:11.244 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-11T00:15:11.249 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.250 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.251 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.253 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-11T00:15:11.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.256 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-11T00:15:11.260 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.265 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.268 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.269 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.274 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-11T00:15:11.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-11T00:15:11.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.279 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.282 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.284 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.286 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.287 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.291 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.293 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.299 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.301 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.301 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.304 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.309 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.310 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.311 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.314 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.315 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-11T00:15:11.316 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.318 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-11T00:15:11.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.320 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.322 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.328 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.329 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.330 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.332 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.333 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.336 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.339 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.344 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.345 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.347 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.350 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.351 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.354 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.356 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.357 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.358 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.362 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.363 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.366 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.367 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.368 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.371 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.376 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.378 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.379 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.380 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.381 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.382 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.383 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.384 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.385 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.389 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.391 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.392 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.393 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.395 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.396 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.398 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-11T00:15:11.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.400 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.401 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.402 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.403 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.404 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:11.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.409 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.410 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.418 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.424 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.426 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.428 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.431 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.432 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.434 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.435 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.441 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.448 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.449 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.452 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-11T00:15:11.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-11T00:15:11.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.460 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.463 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.465 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-11T00:15:11.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.473 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.478 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.480 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.481 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.484 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.489 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.490 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.491 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.492 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.500 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.502 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-11T00:15:11.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.504 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.506 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.509 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.509 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.509 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.509 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.512 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.512 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.512 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.514 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.515 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.517 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-11T00:15:11.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-11T00:15:11.519 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.521 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.523 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:15:11.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-11T00:15:11.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-11T00:15:11.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.529 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.531 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.540 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.541 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.544 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.549 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.551 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.552 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-11T00:15:11.553 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.554 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.557 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.559 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-11T00:15:11.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.562 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.563 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-11T00:15:11.570 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-11T00:15:11.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.572 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 34145, 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "y", 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.573 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.578 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-11T00:15:11.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.583 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:15:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:15:11.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.590 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:15:11.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:11.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:15:11.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-11T00:15:11.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-11T00:15:11.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.601 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.603 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-11T00:15:11.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.611 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-11T00:15:11.614 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.616 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:15:11.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-11T00:15:11.621 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.624 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:15:11.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-11T00:15:11.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-11T00:15:11.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.631 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-11T00:15:11.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:15:11.636 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-11T00:15:11.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.640 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:15:11.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba_metrics": { 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.647 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.648 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:15:11.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.652 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:15:11.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.654 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.657 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.660 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.663 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.664 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.665 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.666 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.668 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:11.671 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:15:11.673 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.676 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-11T00:15:11.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.683 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.686 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:15:11.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.690 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.691 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.693 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-11T00:15:11.695 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.696 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.697 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.698 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:15:11.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.701 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:15:11.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:15:11.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.706 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.710 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.713 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.715 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.719 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.721 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.722 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:15:11.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.724 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.725 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.726 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.728 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.734 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.737 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.740 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.741 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-11T00:15:11.742 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:15:11.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.745 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.746 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.747 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.748 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:15:11.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.751 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.754 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.755 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.758 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.759 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.760 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.761 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.762 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.764 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.768 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-11T00:15:11.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:11.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.774 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.776 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.777 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.778 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.779 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.780 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.781 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-11T00:15:11.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.785 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.787 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.788 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.789 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.792 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.793 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.796 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.798 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.800 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.801 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.802 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.803 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-11T00:15:11.805 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.806 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.809 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.811 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.813 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.814 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.816 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.817 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.824 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.826 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.827 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.828 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.831 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.835 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.836 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.838 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.839 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.840 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.841 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.845 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.846 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.848 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.851 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.854 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:15:11.856 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.859 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.860 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.861 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.866 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.867 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.871 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.872 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.873 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.874 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.875 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.877 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.878 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.881 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.882 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.883 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.885 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.886 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-11T00:15:11.888 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.891 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.897 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.898 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.899 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.900 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.901 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.902 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.903 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-11T00:15:11.905 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.908 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.909 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.911 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-11T00:15:11.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.915 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:11.916 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.918 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.920 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.921 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.922 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-11T00:15:11.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.925 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.926 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.927 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-11T00:15:11.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.930 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.932 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.933 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.934 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:15:11.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.937 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.939 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:15:11.940 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.941 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.942 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.943 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-11T00:15:11.945 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.947 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.949 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.951 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:15:11.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-11T00:15:11.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.959 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.961 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.962 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.965 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.966 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.967 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.968 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.969 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.970 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.972 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.973 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.974 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.977 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.978 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.979 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.981 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-11T00:15:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.993 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.994 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:11.996 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:11.997 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:11.997 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:11.997 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:11.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:11.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.001 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.004 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.005 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.006 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-11T00:15:12.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.011 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.016 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.018 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-11T00:15:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.025 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.028 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.029 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.032 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.035 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.036 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.042 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.043 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.045 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.047 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.048 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-11T00:15:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.057 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.065 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.069 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.070 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:15:12.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-11T00:15:12.076 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.077 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.080 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.083 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.084 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.087 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:15:12.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:15:12.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.094 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-11T00:15:12.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.099 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.102 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.104 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "modules": [ 2024-09-11T00:15:12.109 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "iostat", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "nfs", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "restful" 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.112 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:15:12.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-09-11T00:15:12.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.123 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.127 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:15:12.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:12.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-09-11T00:15:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.137 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.143 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-09-11T00:15:12.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:12.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.146 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.147 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-09-11T00:15:12.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.153 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:15:12.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.157 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.159 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-09-11T00:15:12.160 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-09-11T00:15:12.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-09-11T00:15:12.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:15:12.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:15:12.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-09-11T00:15:12.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba_metrics": { 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:15:12.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-09-11T00:15:12.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.186 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:15:12.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.195 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-09-11T00:15:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-09-11T00:15:12.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-09-11T00:15:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-09-11T00:15:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:15:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-09-11T00:15:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-09-11T00:15:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:15:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:15:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-09-11T00:15:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-09-11T00:15:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:15:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:15:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:15:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:15:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-09-11T00:15:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-09-11T00:15:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-09-11T00:15:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-09-11T00:15:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-09-11T00:15:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.356 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.357 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.359 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.360 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.361 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.363 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.364 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.366 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.368 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-09-11T00:15:12.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.372 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.373 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.375 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.379 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:15:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.386 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:15:12.387 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.388 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.389 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.390 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.391 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.392 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.395 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.396 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.397 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.398 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.399 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.401 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.402 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.403 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.405 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.406 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-09-11T00:15:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.410 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.412 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.413 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.419 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.421 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-09-11T00:15:12.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.424 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.425 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.426 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.427 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.430 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.432 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.435 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.437 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.439 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.440 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.444 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:12.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-09-11T00:15:12.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.449 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.455 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.457 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:15:12.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.470 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-09-11T00:15:12.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-09-11T00:15:12.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:12.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.480 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.481 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.482 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:15:12.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:15:12.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.488 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.489 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.490 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.491 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.492 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.496 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:15:12.499 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.508 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.511 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.513 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.516 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-09-11T00:15:12.519 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-09-11T00:15:12.520 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.521 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.524 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-09-11T00:15:12.528 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-09-11T00:15:12.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-09-11T00:15:12.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-09-11T00:15:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.535 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.542 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.547 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.549 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-09-11T00:15:12.552 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.553 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.559 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.562 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.564 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.567 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.571 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.573 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.574 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.578 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.580 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.583 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.584 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.585 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-09-11T00:15:12.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-09-11T00:15:12.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.596 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.598 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.599 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.601 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.602 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.609 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.613 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.614 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.616 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.623 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-09-11T00:15:12.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-09-11T00:15:12.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.635 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.636 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-09-11T00:15:12.638 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-09-11T00:15:12.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-09-11T00:15:12.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "services": { 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard": "https://172.21.15.33:8443/" 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "always_on_modules": { 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "octopus": [ 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-11T00:15:12.645 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "pacific": [ 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-11T00:15:12.646 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "quincy": [ 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-11T00:15:12.647 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "reef": [ 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-11T00:15:12.648 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "squid": [ 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-09-11T00:15:12.649 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "force_disabled_modules": {}, 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "last_failure_osd_epoch": 3, 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "active_clients": [ 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 573450865 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "libcephsqlite", 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-11T00:15:12.651 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1188665581 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1586886077 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3816887957 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-09-11T00:15:12.653 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 msgr2=0x7f4e340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 0x7f4e340b7820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009fc0 tx=0x7f4e40005f90 comp rx=0 tx=0).stop 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 msgr2=0x7f4e5019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d950 tx=0x7f4e3c00de10 comp rx=0 tx=0).stop 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 shutdown_connections 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4e340b5360 0x7f4e340b7820 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e501066b0 0x7f4e5019c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.655 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:10 smithi033 ceph-mon[30593]: pgmap v988: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-09-11T00:15:12.655 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/49137010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.655 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2375257636' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.655 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3025829039' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e50105cf0 0x7f4e5019b490 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 --2- 172.21.15.33:0/1473051664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50104ba0 0x7f4e5019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.024+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 >> 172.21.15.33:0/1473051664 conn(0x7f4e50100440 msgr2=0x7f4e50109010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.025+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 shutdown_connections 2024-09-11T00:15:12.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:11.025+0000 7f4e55c00640 1 -- 172.21.15.33:0/1473051664 wait complete. 2024-09-11T00:15:12.665 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T00:15:12.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T00:15:12.665 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:11 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1473051664' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:10 smithi052 ceph-mon[33526]: pgmap v988: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/49137010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2375257636' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3025829039' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:11 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1473051664' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:10 smithi189 ceph-mon[34000]: pgmap v988: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.8 MiB/s wr, 231 op/s 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/49137010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2375257636' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3025829039' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T00:15:12.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:11 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1473051664' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:15:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:12 smithi033 ceph-mon[30593]: pgmap v989: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-09-11T00:15:13.057 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:13.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:12 smithi189 ceph-mon[34000]: pgmap v989: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-09-11T00:15:13.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:12 smithi052 ceph-mon[33526]: pgmap v989: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-09-11T00:15:13.718 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 349, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 344, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 868160, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 212736, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.096110932, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.058499978, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.040537909, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 343, 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.045038499, 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000131307 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 868160, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 212736 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 263, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-09-11T00:15:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 207024, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.046883546, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.040411934, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002485830, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 261, 2024-09-11T00:15:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.031863573, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000122082 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 207024 2024-09-11T00:15:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2960, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.003543526, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000075915, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.003409807, 2024-09-11T00:15:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.005945159, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001981719 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148744, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-11T00:15:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 351, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 818805, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 351, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-11T00:15:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 351, 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 818805, 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:13.733 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:14.574 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T00:15:14.574 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T00:15:14.574 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T00:15:14.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T00:15:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:15.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:14 smithi033 ceph-mon[30593]: pgmap v990: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 488 KiB/s wr, 44 op/s 2024-09-11T00:15:15.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:14 smithi189 ceph-mon[34000]: pgmap v990: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 488 KiB/s wr, 44 op/s 2024-09-11T00:15:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:14 smithi052 ceph-mon[33526]: pgmap v990: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 488 KiB/s wr, 44 op/s 2024-09-11T00:15:15.618 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.003198863, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000464495, 2024-09-11T00:15:15.619 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:15.620 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 269, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 208080, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.044638977, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.038061399, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002499573, 2024-09-11T00:15:15.621 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 267, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.039456835, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000147778 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.622 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 208080 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 360, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 353, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 873024, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 217664, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.098585407, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.056476167, 2024-09-11T00:15:15.623 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.050396160, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 353, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.050992309, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000144454 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.624 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 873024, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 217664 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:15.625 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:15.626 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:15.627 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:15.628 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148738, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 31, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-11T00:15:15.629 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-11T00:15:15.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 358, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 819715, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 358, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 358, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 819715, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:15.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:15.632 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:16.692 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T00:15:16.692 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T00:15:16.692 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T00:15:16.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T00:15:17.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:16 smithi033 ceph-mon[30593]: pgmap v991: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-11T00:15:17.042 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:16 smithi052 ceph-mon[33526]: pgmap v991: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-11T00:15:17.074 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:17.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:16 smithi189 ceph-mon[34000]: pgmap v991: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-11T00:15:17.703 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:17.703 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:17.703 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.003561010, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000635504, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:17.704 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:17.705 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 6, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 267, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 3280, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 207824, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.045954910, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.037420363, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.004920693, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 266, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.047005241, 2024-09-11T00:15:17.706 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000176711 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 207824 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 351, 2024-09-11T00:15:17.707 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 346, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 868704, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 214016, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.098329635, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.057664563, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.044794092, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 345, 2024-09-11T00:15:17.708 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.046440702, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000134610 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 868704, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 214016 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-11T00:15:17.709 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:17.710 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:17.711 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:17.712 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148744, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:17.713 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:17.714 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 353, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 819065, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 353, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 353, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 819065, 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-11T00:15:17.715 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:17.716 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:17.716 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:17.716 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:17.716 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:17.716 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:18.812 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T00:15:18.812 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T00:15:18.812 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T00:15:18.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T00:15:19.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:18 smithi033 ceph-mon[30593]: pgmap v992: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 22 op/s 2024-09-11T00:15:19.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:18 smithi189 ceph-mon[34000]: pgmap v992: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 22 op/s 2024-09-11T00:15:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:19.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:18 smithi052 ceph-mon[33526]: pgmap v992: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 22 op/s 2024-09-11T00:15:19.838 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-09-11T00:15:19.838 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:19.838 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 358, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 353, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 870608, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 218496, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.091809052, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.050762583, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.046577600, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:19.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 352, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.048012939, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000136400 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 870608, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 218496 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.840 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 270, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 208256, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.050310688, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.042519571, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.003351570, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 268, 2024-09-11T00:15:19.841 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.034585839, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000129051 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 208256 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2960, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.003629661, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000067312, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.003464863, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-09-11T00:15:19.843 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.006119173, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002039724 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:15:19.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:19.845 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:19.846 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-09-11T00:15:19.847 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148744, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:19.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-09-11T00:15:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 360, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 819975, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 360, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 360, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 819975, 2024-09-11T00:15:19.850 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-09-11T00:15:19.851 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-09-11T00:15:20.664 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T00:15:20.664 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T00:15:20.664 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T00:15:20.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T00:15:21.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:20 smithi189 ceph-mon[34000]: pgmap v993: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:21.205 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:20 smithi052 ceph-mon[33526]: pgmap v993: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:21.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:20 smithi033 ceph-mon[30593]: pgmap v993: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:15:22.495 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T00:15:22.495 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:22.495 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 5773, 2024-09-11T00:15:22.495 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 7237, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 1628645, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 27018873, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 219, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 7, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.956121407, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.481136712, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.339369219, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.109847175, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7235, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.861684320, 2024-09-11T00:15:22.496 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000257316 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4649, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002720594, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000585 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 29504, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 1856 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.497 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 41389, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 34478, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 13752123, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 26407193, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 24, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 4.083617240, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 1.933619811, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 2.558541886, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.162902977, 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:22.498 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 34477, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 3.445293184, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000099930 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 64327, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.014579774, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000226 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 59888, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 559584 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.499 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 4755, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 5466, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 2259626, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 15497385, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 12, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.737946005, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.416892490, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.240616621, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.096708040, 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:22.500 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 5465, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.947327555, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000539309 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3027, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003167795, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000001046 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 938448, 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 221424 2024-09-11T00:15:22.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-11T00:15:22.502 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8526, 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 6.427448441, 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000753864 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1038, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.052226420, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000050314 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 9586, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 9582, 2024-09-11T00:15:22.504 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 9582, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 78.343017447, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.008176061 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 4, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 1293, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 3, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 1095, 2024-09-11T00:15:22.505 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 26, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 1069, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 1054, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 2, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 1040, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 1040, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 4, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 15891, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 13532, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 1, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:22.506 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 63, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 1, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 2, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 1, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 1013, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 1423980280, 2024-09-11T00:15:22.507 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 2, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 4466, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4003, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:22.508 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 27291, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 11230, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 73, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 2744 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 6, 2024-09-11T00:15:22.509 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 415, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 255, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 160, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:22.510 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 14, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 14527, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 1, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 3, 2024-09-11T00:15:22.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 18593, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 18551, 2024-09-11T00:15:22.512 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 18551, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 42, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 281, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 95, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 94, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 94, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 1, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 1, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 2, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 46472250, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 46555942, 2024-09-11T00:15:22.513 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3753, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 22.830619210, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006083298 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 1061, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 1318, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 257, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 68, 2024-09-11T00:15:22.514 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 73, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 5, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 1095, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 1677, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 582, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 1040, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 1310, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 270, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 71604, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 293462016 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 10564, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 4, 2024-09-11T00:15:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 9586, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 227, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 10, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1268, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 59.122806157, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.046626818 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 479, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.973913491, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002033222 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.516 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 160, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.288828183, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001805176 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4887, 2024-09-11T00:15:22.517 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 14.247408653, 2024-09-11T00:15:22.518 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002915369 2024-09-11T00:15:22.518 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.518 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:22.518 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.518 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.519 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:22.520 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 37, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.042437300, 2024-09-11T00:15:22.521 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001146954 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-11T00:15:22.522 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2054, 2024-09-11T00:15:22.523 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.470746503, 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000716040 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 97, 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.137820755, 2024-09-11T00:15:22.524 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001420832 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 399, 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.752626657, 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.004392548 2024-09-11T00:15:22.525 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.526 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.527 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.013694614, 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006847307 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:22.528 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.529 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001743072, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000871536 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-11T00:15:22.531 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 9, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.024487435, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002720826 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.532 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 188, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.266504627, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001417577 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 4, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 3, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-11T00:15:22.534 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 1940, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 1940, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 1114, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:22.535 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:22.536 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:22.537 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:22.538 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 302727, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 104, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-11T00:15:22.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 167, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-11T00:15:22.540 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 3552541, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 30280, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 9807, 2024-09-11T00:15:22.541 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 46391070, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 31, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 9807, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 9807, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 270.881490907, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.027621239 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 9807, 2024-09-11T00:15:22.542 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 16658 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 9807, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 134, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 9673, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 1221, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 2448, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 134, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 3887, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 393, 2024-09-11T00:15:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 3, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 1085, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 3759, 2024-09-11T00:15:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-11T00:15:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-11T00:15:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 87, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 10, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 12, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 12, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-11T00:15:22.547 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 3408, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 320 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-11T00:15:22.548 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 25, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 8, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 553, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 255, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:22.549 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 51913, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 12935124, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 51913, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 51913, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 12935124, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.550 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:22.551 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 9807, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 46418849, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 9807, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 46418849, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.552 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 9807, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 9807, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 9807, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 9807, 2024-09-11T00:15:22.553 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 255, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 27779, 2024-09-11T00:15:22.554 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 255, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 134, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 27779, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x5620455f0dc0": { 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 18593, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 42361638, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 18593, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:22.556 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3753, 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 42361638, 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 13494 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:22.557 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T00:15:23.064 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:22 smithi052 ceph-mon[33526]: pgmap v994: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-11T00:15:23.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:22 smithi189 ceph-mon[34000]: pgmap v994: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-11T00:15:23.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:22 smithi033 ceph-mon[30593]: pgmap v994: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-09-11T00:15:23.618 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-11T00:15:23.618 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-11T00:15:23.618 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T00:15:23.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T00:15:24.046 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3403, 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1882, 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 832522, 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 641194, 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 11, 2024-09-11T00:15:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.369104417, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.211748696, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.214137822, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.006639643, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1882, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.205777462, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000109339 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4758, 2024-09-11T00:15:24.744 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002541922, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000534 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 38, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 304, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 11970, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 612945, 2024-09-11T00:15:24.745 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 12, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.033589090, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.019228120, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.010241816, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000589223, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 303, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.060217743, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000198738 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:24.746 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 23, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000004388, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000190 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 6656, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 574096 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 453, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 450, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 936568, 2024-09-11T00:15:24.747 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 269690, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 11, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.088762594, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.043478173, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.058833667, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000374986, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 447, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.039070790, 2024-09-11T00:15:24.748 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000087406 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 66, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000015316, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000232 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 926672, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 226448 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-11T00:15:24.749 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 75, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005133928, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000068452 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:24.750 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 17, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000475600, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000027976 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 13, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 10, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 10, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.012608079, 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001260807 2024-09-11T00:15:24.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 3, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 11, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 19, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 19, 2024-09-11T00:15:24.752 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 18, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 2, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 1, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 1, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 3, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 56, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 45, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 1, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 3, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:24.753 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 1, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 1, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 2, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:24.754 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 1016, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 1441019747, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:24.755 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 4, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 6, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 1, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 5 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.756 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 4, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 2, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 2, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-11T00:15:24.757 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 14, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 108, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 1, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:24.758 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 21, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 21, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-11T00:15:24.759 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 2, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4221799, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-11T00:15:24.760 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 15, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.030573836, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002038255 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 23, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 26, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 3, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 22, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 24, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 2, 2024-09-11T00:15:24.761 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 19, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 25, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 6, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 1, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 8, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 7, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 50224, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 258727936 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.762 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 24, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 1, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 13, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 22, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 6, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:24.763 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000431643, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000215821 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.764 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007811638, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001952909 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.765 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.766 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.767 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.768 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000443514, 2024-09-11T00:15:24.769 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000221757 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.770 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.771 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.772 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.773 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-11T00:15:24.774 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:24.775 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003921284, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001960642 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-11T00:15:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 3, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 2, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 6, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 6, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 1117, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:24.777 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:24.778 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:24.779 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:24.780 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 264535, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 88, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 167, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 94421, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 375, 2024-09-11T00:15:24.782 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 72, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 39913, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 32, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 72, 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-11T00:15:24.783 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 72, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.376995130, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005236043 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 72, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 100 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 72, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 1, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 71, 2024-09-11T00:15:24.784 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 10, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 1, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 16, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 11, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-11T00:15:24.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 16, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 20, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:24.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-11T00:15:24.787 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 87, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 4, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 10, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 13, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 3, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 22, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-11T00:15:24.788 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 4 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 4, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 2, 2024-09-11T00:15:24.789 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 4, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 2, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 3890, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1406520, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 3890, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:24.790 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3890, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1406520, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:24.791 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 72, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 40131, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 72, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 40131, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.792 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 72, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 72, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 72, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 72, 2024-09-11T00:15:24.793 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 2, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 218, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:24.794 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 2, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 1, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 218, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x55b015606dc0": { 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:24.795 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 21, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 27495, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 21, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 15, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 27495, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:24.796 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 112 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T00:15:24.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:24 smithi052 ceph-mon[33526]: pgmap v995: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-11T00:15:25.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:24 smithi189 ceph-mon[34000]: pgmap v995: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-11T00:15:25.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:24 smithi033 ceph-mon[30593]: pgmap v995: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-11T00:15:25.611 INFO:tasks.check_counter:Daemon mds.e mds.exported=1 2024-09-11T00:15:25.611 INFO:tasks.check_counter:Daemon mds.e mds.imported=1 2024-09-11T00:15:25.611 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T00:15:25.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T00:15:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:15:26.657 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 450, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 436, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 938615, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 262703, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 12, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.090867293, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.042880244, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.052998011, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000709196, 2024-09-11T00:15:26.658 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 433, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.046339498, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000107019 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 55, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000025683, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000466 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 929616, 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 224288 2024-09-11T00:15:26.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2078, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1606, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 494820, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 1025786, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 11, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.295156532, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.175814963, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.142045555, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.006702004, 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:26.660 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1607, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.154613234, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000096212 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3125, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000691714, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000221 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 3280, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 569232 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.661 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 20, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 22, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 4981, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 63037, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 10, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.007510805, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000845742, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.005550991, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000516512, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 20, 2024-09-11T00:15:26.662 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.040526039, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002026301 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000221, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000055 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-11T00:15:26.663 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 30, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002800144, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000093338 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:26.664 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000021598, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000010799 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 5, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 4, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001838855, 2024-09-11T00:15:26.665 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000459713 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 1, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 11, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 14, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 14, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:26.666 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 14, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 4, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 4, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 34, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 32, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 1, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-11T00:15:26.667 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 1016, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 1441019747, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:26.668 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 4, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:26.669 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 4, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 1 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 2, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:26.670 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 14, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 70, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-11T00:15:26.671 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 5, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-11T00:15:26.672 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 5, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 2, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4195901, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-11T00:15:26.673 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.010400008, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002600002 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 17, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 17, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 15, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 16, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 1, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 14, 2024-09-11T00:15:26.674 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 14, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 0, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 4, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 4, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 0, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 49504, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 258727936 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 6, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 5, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 18, 2024-09-11T00:15:26.675 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001838855, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000459713 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.676 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.677 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.680 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.681 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.682 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:26.685 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-11T00:15:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-11T00:15:26.688 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 2, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 3, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 3, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 1118, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.689 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:26.690 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:26.691 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 246663, 2024-09-11T00:15:26.692 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 76, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 167, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:26.693 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 69357, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 297, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-11T00:15:26.694 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 41, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 12180, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 33, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 41, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 41, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.335995665, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.008195016 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 41, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 64 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.695 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 41, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 41, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 10, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 4, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 7, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-11T00:15:26.696 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 6, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 20, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-11T00:15:26.697 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-11T00:15:26.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 87, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 4, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 9, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 13, 2024-09-11T00:15:26.699 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 4, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 16, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 1 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-11T00:15:26.700 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 2544, 2024-09-11T00:15:26.701 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1185580, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 2544, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2544, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1185580, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.702 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 41, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 12180, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 41, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 12180, 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:26.703 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:26.704 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 41, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 41, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 41, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 41, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:26.705 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.706 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x5556bd324dc0": { 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 5, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1597, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 5, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4, 2024-09-11T00:15:26.707 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1597, 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 78 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:26.708 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T00:15:27.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:26 smithi033 ceph-mon[30593]: pgmap v996: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:27.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:26 smithi189 ceph-mon[34000]: pgmap v996: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:27.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:26 smithi052 ceph-mon[33526]: pgmap v996: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:27.846 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-11T00:15:27.847 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-11T00:15:27.847 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T00:15:27.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T00:15:28.227 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:15:28.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:28 smithi052 ceph-mon[33526]: pgmap v997: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-11T00:15:29.044 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-11T00:15:29.044 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2588, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2589, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 21731471, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 822676, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 7, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-11T00:15:29.045 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.382331461, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.171506377, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.107679500, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.073126437, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2587, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.138949254, 2024-09-11T00:15:29.046 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000053710 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.047 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1528, 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1515, 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 14210826, 2024-09-11T00:15:29.048 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 587372, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 5, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.225547387, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.095412909, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.101356254, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.030772837, 2024-09-11T00:15:29.049 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1515, 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.085840944, 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000056660 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.050 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 916560, 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 222560 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 510, 2024-09-11T00:15:29.051 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 781, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 8517007, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 731193, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.098544975, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.043338594, 2024-09-11T00:15:29.052 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.031548450, 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.015321739, 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 779, 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.040394354, 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000051854 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.053 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 569648 2024-09-11T00:15:29.054 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:29.055 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7173, 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.222474142, 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000031015 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:29.056 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-11T00:15:29.057 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-11T00:15:29.057 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.057 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.058 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.058 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.058 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.058 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-11T00:15:29.058 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 0, 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 0, 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.059 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-11T00:15:29.060 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 1630, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 1015, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 615, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 55, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-11T00:15:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:29.062 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:29.063 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-11T00:15:29.063 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-11T00:15:29.063 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-11T00:15:29.063 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-11T00:15:29.064 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-11T00:15:29.064 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-11T00:15:29.064 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-11T00:15:29.064 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:29.064 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 1013, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 1423980280, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:29.065 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:29.066 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-11T00:15:29.067 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 0 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-11T00:15:29.068 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:29.069 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:29.070 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-11T00:15:29.071 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-11T00:15:29.072 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 0, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 18593, 2024-09-11T00:15:29.073 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 0, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 83, 2024-09-11T00:15:29.074 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 46472250, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 46555942, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 46553180, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.075 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 18593 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 1061, 2024-09-11T00:15:29.076 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 1318, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 257, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 68, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 73, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 5, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 1630, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 1634, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 4, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 0, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 0, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 53568, 2024-09-11T00:15:29.077 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 256053248 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.078 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.079 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.080 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:29.081 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.082 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-11T00:15:29.083 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.084 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.085 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.086 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:29.087 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.088 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-11T00:15:29.089 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-11T00:15:29.090 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 4, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 3, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 2, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 3779, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:29.091 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:29.092 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:29.093 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 215191, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 66, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-11T00:15:29.094 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 167, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 3496964, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 21697, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:29.095 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 4242, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 26, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 4, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 4242, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4242, 2024-09-11T00:15:29.096 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.329944586, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001020731 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4242, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4243 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 4242, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 4242, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 0, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-11T00:15:29.097 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 2481, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 1758, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 2, 2024-09-11T00:15:29.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-11T00:15:29.099 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-11T00:15:29.100 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 87, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 4, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 0, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 2, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 0 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.101 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-11T00:15:29.102 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 4622, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 44020924, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 4622, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:29.103 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4622, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 44020924, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:29.104 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4242, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 42364826, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4242, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 42364826, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.105 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4242, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 4242, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4242, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 4242, 2024-09-11T00:15:29.106 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.108 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x559e851c7040": { 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-11T00:15:29.109 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-11T00:15:29.110 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-11T00:15:29.110 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-11T00:15:29.111 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-11T00:15:29.111 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.111 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-11T00:15:29.112 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-11T00:15:29.112 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-11T00:15:29.112 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-11T00:15:29.112 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-11T00:15:29.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:28 smithi189 ceph-mon[34000]: pgmap v997: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-11T00:15:29.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:28 smithi033 ceph-mon[30593]: pgmap v997: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-11T00:15:29.997 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-11T00:15:29.997 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-11T00:15:29.998 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T00:15:29.998 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T00:15:30.656 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:15:31.047 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:30 smithi189 ceph-mon[34000]: pgmap v998: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:31.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:30 smithi052 ceph-mon[33526]: pgmap v998: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:31.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:30 smithi033 ceph-mon[30593]: pgmap v998: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3649, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 3648, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1033780, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 1159247, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.422814489, 2024-09-11T00:15:31.754 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.190544778, 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.093773467, 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.107680200, 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3647, 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.192036561, 2024-09-11T00:15:31.755 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000052656 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-11T00:15:31.756 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 374, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 363, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 912908, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 220090, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.074002346, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.039274857, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.044371996, 2024-09-11T00:15:31.757 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000058109, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 362, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.029210239, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000080691 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 912352, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 219392 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.758 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 271, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 588, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 571086, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.025297468, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.018615278, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002960811, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000026561, 2024-09-11T00:15:31.759 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 269, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.020868143, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000077576 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 570768 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.760 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 6109, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.159374662, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000026088 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.761 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.762 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:31.763 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-11T00:15:31.764 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:31.765 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:15:31.766 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:31.767 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-11T00:15:31.768 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_started": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_write_failed": 0 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-11T00:15:31.769 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 5, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195901, 2024-09-11T00:15:31.770 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4195424, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 5 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 3, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 3, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 1, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 1, 2024-09-11T00:15:31.771 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48164, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 249290752 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-11T00:15:31.772 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.773 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.774 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:31.775 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.776 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-11T00:15:31.777 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.778 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.780 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:31.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.783 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.784 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:31.786 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-11T00:15:31.787 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 2430, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:31.788 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:31.789 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:31.790 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 182144, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 50, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:31.791 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 167, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 8672, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 13, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-11T00:15:31.792 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 3647, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 3647, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3647, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 4.845901991, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001328736 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-11T00:15:31.793 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3647, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 3648 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 3647, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 3647, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 2395, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 1250, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-11T00:15:31.794 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-11T00:15:31.795 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-11T00:15:31.796 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 87, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 4, 2024-09-11T00:15:31.797 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 4, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 6, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 2, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-11T00:15:31.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:31.799 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 4022, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1563150, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 4022, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 4022, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1563150, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3647, 2024-09-11T00:15:31.801 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1602, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3647, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1602, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:31.802 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3647, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 3647, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3647, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3647, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.803 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-11T00:15:31.804 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x563609c3f040": { 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:31.805 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "trackedop": { 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-11T00:15:31.806 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:31.807 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-11T00:15:32.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:31 smithi189 ceph-mon[34000]: pgmap v999: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T00:15:32.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:31 smithi052 ceph-mon[33526]: pgmap v999: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T00:15:32.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:31 smithi033 ceph-mon[30593]: pgmap v999: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T00:15:32.893 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-11T00:15:32.893 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-11T00:15:32.894 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T00:15:32.894 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T00:15:33.311 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1257, 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1259, 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 357308, 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 399790, 2024-09-11T00:15:33.961 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.149483276, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.064954087, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.034316886, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.032462043, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1257, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.067983431, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000054083 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:33.962 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1159, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1426, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 287026, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 882385, 2024-09-11T00:15:33.963 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.164411037, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.073092726, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.034601624, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.042074221, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1425, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.083442286, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000058555 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3120, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 515408 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1618, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1607, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1330880, 2024-09-11T00:15:33.965 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 616264, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.260216486, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.122565717, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.087071519, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.043951392, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1606, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.112203640, 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000069865 2024-09-11T00:15:33.966 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 912896, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 220672 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-11T00:15:33.967 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 6030, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.177586614, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000029450 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-11T00:15:33.968 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.969 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 3, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 3, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-11T00:15:33.970 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 3, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-11T00:15:33.971 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-11T00:15:33.972 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:15:33.973 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-11T00:15:33.974 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-11T00:15:33.975 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_started": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_succeeded": 0, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_write_failed": 0 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.976 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 21, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-11T00:15:33.977 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4221799, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4220148, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 21 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-11T00:15:33.978 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 4, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 17, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 13, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 2, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 14, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 12, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 3, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 16, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 13, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 47376, 2024-09-11T00:15:33.979 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 248238080 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.980 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-11T00:15:33.981 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.982 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.983 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.984 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.985 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.985 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.985 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-11T00:15:33.985 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.985 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.986 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.987 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-11T00:15:33.988 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.989 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.990 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.991 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.992 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:33.993 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 3, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 2, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 2, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 3739, 2024-09-11T00:15:33.994 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:33.995 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:33.996 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:33.997 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 190184, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 53, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8864, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 167, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:33.998 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 14288, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 40, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 3655, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-11T00:15:33.999 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 3655, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3655, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 5.185895760, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001418849 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3655, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 3656 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 3655, 2024-09-11T00:15:34.000 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 3655, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 2396, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 1257, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-11T00:15:34.001 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-11T00:15:34.002 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-11T00:15:34.003 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 87, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 4, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 6, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 1, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-11T00:15:34.004 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-11T00:15:34.005 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 4030, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1590307, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 4030, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 4030, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1590307, 2024-09-11T00:15:34.006 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:34.007 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3655, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 27500, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3655, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 27500, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-11T00:15:34.008 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 3655, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 3655, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3655, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 3655, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:34.009 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-11T00:15:34.010 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x5576526bf040": { 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:34.011 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "trackedop": { 2024-09-11T00:15:34.012 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-11T00:15:34.013 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:34.013 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-11T00:15:34.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:34 smithi189 ceph-mon[34000]: pgmap v1000: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:15:34.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:34 smithi052 ceph-mon[33526]: pgmap v1000: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:15:34.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:34 smithi033 ceph-mon[30593]: pgmap v1000: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-11T00:15:35.637 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T00:15:35.637 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T00:15:35.637 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T00:15:35.637 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T00:15:36.023 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:15:36.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:36 smithi052 ceph-mon[33526]: pgmap v1001: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:36.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:36 smithi189 ceph-mon[34000]: pgmap v1001: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:36.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:36 smithi033 ceph-mon[30593]: pgmap v1001: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:36.818 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 357, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 352, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 870336, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 217856, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.068561154, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.030070821, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.044159922, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:36.819 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 351, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.028075633, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000079987 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 870336, 2024-09-11T00:15:36.820 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 217856 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 269, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 139312, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.024995633, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.019220788, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001803725, 2024-09-11T00:15:36.821 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 267, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.022781345, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000085323 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 139312 2024-09-11T00:15:36.822 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 4, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2960, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 448, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.003843701, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000075637, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.003582478, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:36.823 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006033986, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002011328 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.824 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:36.825 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:36.826 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 149735, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 30, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:36.828 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:36.829 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 359, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 819845, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 359, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 359, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 819845, 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:36.830 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:36.831 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:36.831 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:36.831 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:36.831 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:36.831 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-11T00:15:37.676 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.i 2024-09-11T00:15:37.677 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.i 2024-09-11T00:15:37.677 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T00:15:37.677 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T00:15:38.051 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:15:38.523 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:38 smithi189 ceph-mon[34000]: pgmap v1002: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:15:38.665 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 4, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2960, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 448, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.005918537, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000079776, 2024-09-11T00:15:38.666 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.003513460, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006136369, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002045456 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-09-11T00:15:38.667 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 2, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 276, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 320, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 140544, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.025462097, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.019823290, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001625032, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:38.668 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 274, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.021829351, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000079669 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 140544 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.669 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 364, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 359, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 872240, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 222336, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.072599719, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.039035305, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.042057659, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 358, 2024-09-11T00:15:38.670 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.029322298, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000081905 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 872240, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 222336 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-11T00:15:38.671 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:15:38.672 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:15:38.673 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:15:38.674 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148704, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 29, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:15:38.675 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 968, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-11T00:15:38.676 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 366, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 820755, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 366, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 366, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 820755, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-11T00:15:38.677 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:38.678 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-11T00:15:38.678 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-11T00:15:38.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:38 smithi052 ceph-mon[33526]: pgmap v1002: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:15:38.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:38 smithi033 ceph-mon[30593]: pgmap v1002: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T00:15:39.626 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-11T00:15:39.626 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-11T00:15:39.626 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T00:15:39.638 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T00:15:39.639 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-11T00:15:39.639 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:15:39.700 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-11T00:15:39.701 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:15:39.781 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:15:40.205 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:40.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:40 smithi033 ceph-mon[30593]: pgmap v1003: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:40.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:40 smithi052 ceph-mon[33526]: pgmap v1003: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 -- 172.21.15.33:0/3494484903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410b1a0 msgr2=0x7fc1b41119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3494484903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41119a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009ca0 tx=0x7fc1ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 -- 172.21.15.33:0/3494484903 shutdown_connections 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3494484903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41119a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3494484903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b410a820 0x7fc1b410ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3494484903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b4104e10 0x7fc1b41051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 -- 172.21.15.33:0/3494484903 >> 172.21.15.33:0/3494484903 conn(0x7fc1b4100840 msgr2=0x7fc1b4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 -- 172.21.15.33:0/3494484903 shutdown_connections 2024-09-11T00:15:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.789+0000 7fc1b9200640 1 -- 172.21.15.33:0/3494484903 wait complete. 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.790+0000 7fc1b9200640 1 Processor -- start 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.790+0000 7fc1b9200640 1 -- start start 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b4104e10 0x7fc1b419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4114d20 con 0x7fc1b410a820 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4114ba0 con 0x7fc1b410b1a0 2024-09-11T00:15:40.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b9200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4114ea0 con 0x7fc1b4104e10 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1aaa00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48126/0 (socket says 172.21.15.33:48126) 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1aaa00640 1 -- 172.21.15.33:0/3801429322 learned_addr learned my addr 172.21.15.33:0/3801429322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.791+0000 7fc1b3400640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b4104e10 0x7fc1b419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1b3e00640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 -- 172.21.15.33:0/3801429322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b4104e10 msgr2=0x7fc1b419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b4104e10 0x7fc1b419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 -- 172.21.15.33:0/3801429322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b410b1a0 msgr2=0x7fc1b41a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 -- 172.21.15.33:0/3801429322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b41a1260 con 0x7fc1b410a820 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.792+0000 7fc1aaa00640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d770 tx=0x7fc19c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.793+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c017070 con 0x7fc1b410a820 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.793+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc19c0054b0 con 0x7fc1b410a820 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.793+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41a1550 con 0x7fc1b410a820 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.793+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c004c60 con 0x7fc1b410a820 2024-09-11T00:15:40.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.793+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41a7c10 con 0x7fc1b410a820 2024-09-11T00:15:40.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.794+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b41051f0 con 0x7fc1b410a820 2024-09-11T00:15:40.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.796+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc19c004e00 con 0x7fc1b410a820 2024-09-11T00:15:40.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.797+0000 7fc1b0c00640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 0x7fc1980b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.798+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fc19c0e5940 con 0x7fc1b410a820 2024-09-11T00:15:40.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.798+0000 7fc1b3400640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 0x7fc1980b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.798+0000 7fc1b3400640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 0x7fc1980b7850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400bbe0 tx=0x7fc1a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:40.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:40.801+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc19c0abdb0 con 0x7fc1b410a820 2024-09-11T00:15:40.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:40 smithi189 ceph-mon[34000]: pgmap v1003: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.017+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1b410cfb0 con 0x7fc1b410a820 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.017+0000 7fc1b0c00640 1 -- 172.21.15.33:0/3801429322 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+591 (secure 0 0 0) 0x7fc19c0b07e0 con 0x7fc1b410a820 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/391857889 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3555926237 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1526717857 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3494052248 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2678027127 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2864911126 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:41.021 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-11T00:15:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 msgr2=0x7fc1980b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 0x7fc1980b7850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400bbe0 tx=0x7fc1a400b390 comp rx=0 tx=0).stop 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 msgr2=0x7fc1b419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d770 tx=0x7fc19c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 shutdown_connections 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc1980b5390 0x7fc1980b7850 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b410b1a0 0x7fc1b41a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1b410a820 0x7fc1b419b6f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 --2- 172.21.15.33:0/3801429322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1b4104e10 0x7fc1b419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.021+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 >> 172.21.15.33:0/3801429322 conn(0x7fc1b4100840 msgr2=0x7fc1b4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.022+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 shutdown_connections 2024-09-11T00:15:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:41.022+0000 7fc1b9200640 1 -- 172.21.15.33:0/3801429322 wait complete. 2024-09-11T00:15:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:41 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3801429322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:41 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:41 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3801429322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:41 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:41.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:41 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3801429322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:41.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:41 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:41.955 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-09-11T00:15:41.955 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:15:41.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:15:42.425 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:42 smithi052 ceph-mon[33526]: pgmap v1004: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-11T00:15:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:42 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:42 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:42 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:42 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:42 smithi033 ceph-mon[30593]: pgmap v1004: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-11T00:15:42.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:42 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:42 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:42 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:42 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:42 smithi189 ceph-mon[34000]: pgmap v1004: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:42 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:42 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:42 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:42 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:43.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.041+0000 7f33bb200640 1 -- 172.21.15.33:0/696610547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 msgr2=0x7f33bc1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.041+0000 7f33bb200640 1 --2- 172.21.15.33:0/696610547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc1051f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009900 tx=0x7f33ac02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 -- 172.21.15.33:0/696610547 shutdown_connections 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 --2- 172.21.15.33:0/696610547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 --2- 172.21.15.33:0/696610547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 0x7f33bc10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 --2- 172.21.15.33:0/696610547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc1051f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 -- 172.21.15.33:0/696610547 >> 172.21.15.33:0/696610547 conn(0x7f33bc100840 msgr2=0x7f33bc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 -- 172.21.15.33:0/696610547 shutdown_connections 2024-09-11T00:15:43.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.042+0000 7f33bb200640 1 -- 172.21.15.33:0/696610547 wait complete. 2024-09-11T00:15:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 Processor -- start 2024-09-11T00:15:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 -- start start 2024-09-11T00:15:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 0x7f33bc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc114cd0 con 0x7f33bc104e10 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc114b50 con 0x7f33bc10a820 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.043+0000 7f33bb200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc114e50 con 0x7f33bc10b1a0 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33b9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33b9e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33672/0 (socket says 172.21.15.33:33672) 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33b9e00640 1 -- 172.21.15.33:0/2741824243 learned_addr learned my addr 172.21.15.33:0/2741824243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33b9400640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 0x7f33bc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 -- 172.21.15.33:0/2741824243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 msgr2=0x7f33bc19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 0x7f33bc19b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 -- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 msgr2=0x7f33bc19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33ba800640 1 -- 172.21.15.33:0/2741824243 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc1a11d0 con 0x7f33bc10b1a0 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.044+0000 7f33b9e00640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33ba800640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1a0a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009fd0 tx=0x7f33b400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b400cd60 con 0x7f33bc10b1a0 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc1a14c0 con 0x7f33bc10b1a0 2024-09-11T00:15:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33b4005020 con 0x7f33bc10b1a0 2024-09-11T00:15:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4010690 con 0x7f33bc10b1a0 2024-09-11T00:15:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.045+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc1a7b80 con 0x7f33bc10b1a0 2024-09-11T00:15:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.046+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc1051f0 con 0x7f33bc10b1a0 2024-09-11T00:15:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.048+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f33b4004a40 con 0x7f33bc10b1a0 2024-09-11T00:15:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.050+0000 7f33b2a00640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 0x7f33a00b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.050+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f33b40e6710 con 0x7f33bc10b1a0 2024-09-11T00:15:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.050+0000 7f33b9e00640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 0x7f33a00b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.051+0000 7f33b9e00640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 0x7f33a00b7850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f33ac032fd0 tx=0x7f33ac009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.051+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f33b40ad260 con 0x7f33bc10b1a0 2024-09-11T00:15:43.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.260+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33bc10cf80 con 0x7f33bc10b1a0 2024-09-11T00:15:43.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.260+0000 7f33b2a00640 1 -- 172.21.15.33:0/2741824243 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+591 (secure 0 0 0) 0x7f33b40acb60 con 0x7f33bc10b1a0 2024-09-11T00:15:43.263 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/391857889 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:43.263 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3555926237 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1526717857 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/4044788418 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1302943839 2024-09-11T23:44:46.663521+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3494052248 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2678027127 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:43.264 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2864911126 2024-09-11T23:44:17.611833+0000 2024-09-11T00:15:43.265 INFO:teuthology.orchestra.run.smithi033.stderr:listed 10 entries 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 msgr2=0x7f33a00b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 0x7f33a00b7850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f33ac032fd0 tx=0x7f33ac009580 comp rx=0 tx=0).stop 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 msgr2=0x7f33bc1a0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1a0a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009fd0 tx=0x7f33b400ee50 comp rx=0 tx=0).stop 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 shutdown_connections 2024-09-11T00:15:43.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f33a00b5390 0x7f33a00b7850 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33bc10b1a0 0x7f33bc1a0a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33bc10a820 0x7f33bc19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 --2- 172.21.15.33:0/2741824243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33bc104e10 0x7f33bc19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 >> 172.21.15.33:0/2741824243 conn(0x7f33bc100840 msgr2=0x7f33bc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 shutdown_connections 2024-09-11T00:15:43.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:43.263+0000 7f33bb200640 1 -- 172.21.15.33:0/2741824243 wait complete. 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:43 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2741824243' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:43 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2741824243' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:44.107 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:44.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /tmp/cephfs 2024-09-11T00:15:44.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[86608]: fuse finished with error 0 and tester_r 0 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' 2024-09-11T00:15:44.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:43 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2741824243' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:15:44.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:15:45.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:44 smithi189 ceph-mon[34000]: pgmap v1005: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T00:15:45.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:44 smithi052 ceph-mon[33526]: pgmap v1005: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T00:15:45.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:44 smithi033 ceph-mon[30593]: pgmap v1005: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T00:15:46.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:45 smithi189 ceph-mon[34000]: pgmap v1006: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T00:15:46.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:45 smithi052 ceph-mon[33526]: pgmap v1006: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T00:15:46.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:45 smithi033 ceph-mon[30593]: pgmap v1006: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T00:15:48.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:48 smithi052 ceph-mon[33526]: pgmap v1007: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T00:15:48.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:48 smithi033 ceph-mon[30593]: pgmap v1007: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T00:15:48.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:48 smithi189 ceph-mon[34000]: pgmap v1007: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T00:15:50.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-09-11T00:15:50.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:50.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-11T00:15:50.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:50.578 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-09-11T00:15:50.616 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-11T00:15:50.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:50.617 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-11T00:15:50.705 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:50 smithi052 ceph-mon[33526]: pgmap v1008: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:15:50.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:50 smithi033 ceph-mon[30593]: pgmap v1008: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:15:50.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:15:50.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-09-11T00:15:50.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:50 smithi189 ceph-mon[34000]: pgmap v1008: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T00:15:51.085 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T00:15:51.098 INFO:tasks.cephadm:Teardown begin 2024-09-11T00:15:51.098 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:15:51.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:51.482 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 -- 172.21.15.33:0/3522802205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 msgr2=0x7f200c113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 --2- 172.21.15.33:0/3522802205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c113450 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009900 tx=0x7f1ff802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 -- 172.21.15.33:0/3522802205 shutdown_connections 2024-09-11T00:15:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 --2- 172.21.15.33:0/3522802205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c113990 0x7f200c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 --2- 172.21.15.33:0/3522802205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c113450 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 --2- 172.21.15.33:0/3522802205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c0776d0 0x7f200c077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 -- 172.21.15.33:0/3522802205 >> 172.21.15.33:0/3522802205 conn(0x7f200c100a50 msgr2=0x7f200c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 -- 172.21.15.33:0/3522802205 shutdown_connections 2024-09-11T00:15:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.118+0000 7f2014000640 1 -- 172.21.15.33:0/3522802205 wait complete. 2024-09-11T00:15:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.119+0000 7f2014000640 1 Processor -- start 2024-09-11T00:15:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.119+0000 7f2014000640 1 -- start start 2024-09-11T00:15:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c0776d0 0x7f200c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 0x7f200c1a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f200c119220 con 0x7f200c077ff0 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1190a0 con 0x7f200c0776d0 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2014000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1193a0 con 0x7f200c113990 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2010c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2010c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35728/0 (socket says 172.21.15.33:35728) 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2010c00640 1 -- 172.21.15.33:0/1727261171 learned_addr learned my addr 172.21.15.33:0/1727261171 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2011600640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c0776d0 0x7f200c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.120+0000 7f2012000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 0x7f200c1a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 -- 172.21.15.33:0/1727261171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 msgr2=0x7f200c1a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 0x7f200c1a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 -- 172.21.15.33:0/1727261171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c0776d0 msgr2=0x7f200c19f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c0776d0 0x7f200c19f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 -- 172.21.15.33:0/1727261171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c1a5920 con 0x7f200c077ff0 2024-09-11T00:15:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2012000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 0x7f200c1a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2010c00640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009230 tx=0x7f1ff8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff803f030 con 0x7f200c077ff0 2024-09-11T00:15:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ff8003a80 con 0x7f200c077ff0 2024-09-11T00:15:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8035070 con 0x7f200c077ff0 2024-09-11T00:15:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c1a5bb0 con 0x7f200c077ff0 2024-09-11T00:15:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.121+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c1ac2d0 con 0x7f200c077ff0 2024-09-11T00:15:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.123+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c077ab0 con 0x7f200c077ff0 2024-09-11T00:15:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.126+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1ff803b980 con 0x7f200c077ff0 2024-09-11T00:15:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.128+0000 7f200a000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 0x7f1ff40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.128+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f1ff8106d80 con 0x7f200c077ff0 2024-09-11T00:15:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.128+0000 7f2011600640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 0x7f1ff40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.129+0000 7f2011600640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 0x7f1ff40b7820 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f200000bbe0 tx=0x7f200000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.130+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1ff80cd840 con 0x7f200c077ff0 2024-09-11T00:15:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.363+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f200c1a09a0 con 0x7f200c077ff0 2024-09-11T00:15:52.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.364+0000 7f200a000640 1 -- 172.21.15.33:0/1727261171 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f1ff80cd140 con 0x7f200c077ff0 2024-09-11T00:15:52.365 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:52.366 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:15:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 msgr2=0x7f1ff40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 0x7f1ff40b7820 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f200000bbe0 tx=0x7f200000b390 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 msgr2=0x7f200c19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009230 tx=0x7f1ff8004270 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 shutdown_connections 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f1ff40b5360 0x7f1ff40b7820 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f200c113990 0x7f200c1a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f200c077ff0 0x7f200c19fdb0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 --2- 172.21.15.33:0/1727261171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f200c0776d0 0x7f200c19f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 >> 172.21.15.33:0/1727261171 conn(0x7f200c100a50 msgr2=0x7f200c114590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 shutdown_connections 2024-09-11T00:15:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:52.366+0000 7f2014000640 1 -- 172.21.15.33:0/1727261171 wait complete. 2024-09-11T00:15:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:52 smithi052 ceph-mon[33526]: pgmap v1009: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:15:52.706 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:52 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1727261171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:52.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:52 smithi033 ceph-mon[30593]: pgmap v1009: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:15:52.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:52 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1727261171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:52.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:52 smithi189 ceph-mon[34000]: pgmap v1009: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T00:15:52.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:52 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1727261171' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:53.194 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.161+0000 7f4bd7000640 1 -- 172.21.15.33:0/3162593281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0109150 msgr2=0x7f4bd010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.161+0000 7f4bd7000640 1 --2- 172.21.15.33:0/3162593281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0109150 0x7f4bd010f950 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009ca0 tx=0x7f4bc802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 -- 172.21.15.33:0/3162593281 shutdown_connections 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 --2- 172.21.15.33:0/3162593281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0109150 0x7f4bd010f950 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 --2- 172.21.15.33:0/3162593281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd01087d0 0x7f4bd0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 --2- 172.21.15.33:0/3162593281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd0102dc0 0x7f4bd01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 -- 172.21.15.33:0/3162593281 >> 172.21.15.33:0/3162593281 conn(0x7f4bd00fe830 msgr2=0x7f4bd0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 -- 172.21.15.33:0/3162593281 shutdown_connections 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.162+0000 7f4bd7000640 1 -- 172.21.15.33:0/3162593281 wait complete. 2024-09-11T00:15:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 Processor -- start 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 -- start start 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd01087d0 0x7f4bd00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 0x7f4bd0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0112d10 con 0x7f4bd0102dc0 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0112b90 con 0x7f4bd01087d0 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bd7000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0112e90 con 0x7f4bd0109150 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bcfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bcfe00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35754/0 (socket says 172.21.15.33:35754) 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.163+0000 7f4bcfe00640 1 -- 172.21.15.33:0/2135862317 learned_addr learned my addr 172.21.15.33:0/2135862317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bc7e00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd01087d0 0x7f4bd00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bd5000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 0x7f4bd0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 -- 172.21.15.33:0/2135862317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 msgr2=0x7f4bd0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 0x7f4bd0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 -- 172.21.15.33:0/2135862317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd01087d0 msgr2=0x7f4bd00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd01087d0 0x7f4bd00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 -- 172.21.15.33:0/2135862317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd01a7600 con 0x7f4bd0102dc0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bd5000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 0x7f4bd0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcfe00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000d950 tx=0x7f4bc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0017030 con 0x7f4bd0102dc0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.164+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bc0004020 con 0x7f4bd0102dc0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.165+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd01a78f0 con 0x7f4bd0102dc0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.165+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00055d0 con 0x7f4bd0102dc0 2024-09-11T00:15:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.165+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd01a7e30 con 0x7f4bd0102dc0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.166+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd01031a0 con 0x7f4bd0102dc0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.168+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4bc0009a30 con 0x7f4bd0102dc0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.169+0000 7f4bcd600640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 0x7f4bb40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.169+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f4bc00e59a0 con 0x7f4bd0102dc0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.170+0000 7f4bc7e00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 0x7f4bb40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.170+0000 7f4bc7e00640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 0x7f4bb40b77a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0076f90 tx=0x7f4bb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.171+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4bc00ac460 con 0x7f4bd0102dc0 2024-09-11T00:15:54.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.409+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bd002e5c0 con 0x7f4bd0102dc0 2024-09-11T00:15:54.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.410+0000 7f4bcd600640 1 -- 172.21.15.33:0/2135862317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11910 (secure 0 0 0) 0x7f4bc00abd60 con 0x7f4bd0102dc0 2024-09-11T00:15:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:54.412 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"btime":"2024-09-11T00:01:53:469835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1700135488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1700135488},{"type":"v1","addr":"172.21.15.33:6835","nonce":1700135488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3156147972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":3156147972},{"type":"v1","addr":"172.21.15.33:6837","nonce":3156147972}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/317615852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":317615852},{"type":"v1","addr":"172.21.15.189:6839","nonce":317615852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14787,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/1714634262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":1714634262},{"type":"v1","addr":"172.21.15.33:6839","nonce":1714634262}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1697461712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1697461712},{"type":"v1","addr":"172.21.15.33:6841","nonce":1697461712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24577,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/588474684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":588474684},{"type":"v1","addr":"172.21.15.189:6833","nonce":588474684}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:53:56.754883+0000","modified":"2024-09-11T00:01:52.846745+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34688,"mds_1":34649,"mds_2":34622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24622":{"gid":24622,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3755759093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3755759093},{"type":"v1","addr":"172.21.15.189:6835","nonce":3755759093}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/3553481852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":3553481852},{"type":"v1","addr":"172.21.15.189:6837","nonce":3553481852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34595":{"gid":34595,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/1634418949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1634418949},{"type":"v1","addr":"172.21.15.52:6833","nonce":1634418949}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34622":{"gid":34622,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":23,"addr":"172.21.15.52:6835/3258065233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3258065233},{"type":"v1","addr":"172.21.15.52:6835","nonce":3258065233}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34649":{"gid":34649,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.52:6837/106203237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":106203237},{"type":"v1","addr":"172.21.15.52:6837","nonce":106203237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34688":{"gid":34688,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.52:6839/2315099444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":2315099444},{"type":"v1","addr":"172.21.15.52:6839","nonce":2315099444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34688,"qdb_cluster":[34622,34649,34688]},"id":1}]} 2024-09-11T00:15:54.412 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 msgr2=0x7f4bb40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 0x7f4bb40b77a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0076f90 tx=0x7f4bb8005f90 comp rx=0 tx=0).stop 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 msgr2=0x7f4bd00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000d950 tx=0x7f4bc000de10 comp rx=0 tx=0).stop 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 shutdown_connections 2024-09-11T00:15:54.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f4bb40b52e0 0x7f4bb40b77a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4bd0109150 0x7f4bd0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd01087d0 0x7f4bd00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 --2- 172.21.15.33:0/2135862317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd0102dc0 0x7f4bd00754a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.412+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 >> 172.21.15.33:0/2135862317 conn(0x7f4bd00fe830 msgr2=0x7f4bd0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.413+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 shutdown_connections 2024-09-11T00:15:54.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:54.413+0000 7f4bd7000640 1 -- 172.21.15.33:0/2135862317 wait complete. 2024-09-11T00:15:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:54 smithi033 ceph-mon[30593]: pgmap v1010: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T00:15:54.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:54 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2135862317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:54.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:54 smithi189 ceph-mon[34000]: pgmap v1010: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T00:15:54.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:54 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2135862317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:54.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:54 smithi052 ceph-mon[33526]: pgmap v1010: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T00:15:54.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:54 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2135862317' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:55.366 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:15:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 -- 172.21.15.33:0/1393873556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410b330 msgr2=0x7f6e04111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 --2- 172.21.15.33:0/1393873556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410b330 0x7f6e04111b30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009ca0 tx=0x7f6dfc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 -- 172.21.15.33:0/1393873556 shutdown_connections 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 --2- 172.21.15.33:0/1393873556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410b330 0x7f6e04111b30 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 --2- 172.21.15.33:0/1393873556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e0410a9b0 0x7f6e0410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 --2- 172.21.15.33:0/1393873556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e04104fa0 0x7f6e04105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 -- 172.21.15.33:0/1393873556 >> 172.21.15.33:0/1393873556 conn(0x7f6e04100a50 msgr2=0x7f6e04102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 -- 172.21.15.33:0/1393873556 shutdown_connections 2024-09-11T00:15:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.303+0000 7f6e0c200640 1 -- 172.21.15.33:0/1393873556 wait complete. 2024-09-11T00:15:56.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.304+0000 7f6e0c200640 1 Processor -- start 2024-09-11T00:15:56.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 -- start start 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e04104fa0 0x7f6e0419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 0x7f6e041a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04114e60 con 0x7f6e0410a9b0 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04114ce0 con 0x7f6e0410b330 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e0c200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04114fe0 con 0x7f6e04104fa0 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e08e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e08e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35784/0 (socket says 172.21.15.33:35784) 2024-09-11T00:15:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.305+0000 7f6e08e00640 1 -- 172.21.15.33:0/3918005465 learned_addr learned my addr 172.21.15.33:0/3918005465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e0a200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 0x7f6e041a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e09800640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e04104fa0 0x7f6e0419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 -- 172.21.15.33:0/3918005465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e04104fa0 msgr2=0x7f6e0419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e04104fa0 0x7f6e0419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 -- 172.21.15.33:0/3918005465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 msgr2=0x7f6e041a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 0x7f6e041a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 -- 172.21.15.33:0/3918005465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e041a1440 con 0x7f6e0410a9b0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e0a200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 0x7f6e041a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e08e00640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6df000e9f0 tx=0x7f6df000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000cd80 con 0x7f6e0410a9b0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6df00054b0 con 0x7f6e0410a9b0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.306+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e041a1730 con 0x7f6e0410a9b0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.307+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e041a7df0 con 0x7f6e0410a9b0 2024-09-11T00:15:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.307+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0010430 con 0x7f6e0410a9b0 2024-09-11T00:15:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.308+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40052c0 con 0x7f6e0410a9b0 2024-09-11T00:15:56.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.310+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6df0005020 con 0x7f6e0410a9b0 2024-09-11T00:15:56.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.312+0000 7f6e02000640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 0x7f6dec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:56.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.312+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7f6df00e6240 con 0x7f6e0410a9b0 2024-09-11T00:15:56.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.312+0000 7f6e09800640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 0x7f6dec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:56.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.313+0000 7f6e09800640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 0x7f6dec0b7820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005d00 tx=0x7f6df8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.315+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6df00acd00 con 0x7f6e0410a9b0 2024-09-11T00:15:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.513+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6de40055b0 con 0x7f6e0410a9b0 2024-09-11T00:15:56.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.514+0000 7f6e02000640 1 -- 172.21.15.33:0/3918005465 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24816 (secure 0 0 0) 0x7f6df00ac600 con 0x7f6e0410a9b0 2024-09-11T00:15:56.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"fsid":"63242646-6fce-11ef-bcea-c7b262605968","created":"2024-09-10T23:43:51.795198+0000","modified":"2024-09-10T23:55:48.186249+0000","last_up_change":"2024-09-10T23:52:51.344325+0000","last_in_change":"2024-09-10T23:52:25.553350+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:48:07.161907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:53:52.123969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:53:54.680861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:54:02.777509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"770a7315-b2b7-4916-8b58-841896f5c42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6803","nonce":2046959245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6805","nonce":2046959245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6809","nonce":2046959245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2046959245},{"type":"v1","addr":"172.21.15.33:6807","nonce":2046959245}]},"public_addr":"172.21.15.33:6803/2046959245","cluster_addr":"172.21.15.33:6805/2046959245","heartbeat_back_addr":"172.21.15.33:6809/2046959245","heartbeat_front_addr":"172.21.15.33:6807/2046959245","state":["exists","up"]},{"osd":1,"uuid":"fb29230e-70a8-47b9-bcb0-615a6af7ac0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6801","nonce":3373850910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6803","nonce":3373850910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6807","nonce":3373850910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3373850910},{"type":"v1","addr":"172.21.15.52:6805","nonce":3373850910}]},"public_addr":"172.21.15.52:6801/3373850910","cluster_addr":"172.21.15.52:6803/3373850910","heartbeat_back_addr":"172.21.15.52:6807/3373850910","heartbeat_front_addr":"172.21.15.52:6805/3373850910","state":["exists","up"]},{"osd":2,"uuid":"d681ac2c-445f-4d58-9e24-1dbdf6f3eb27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6801","nonce":2060707768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6803","nonce":2060707768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6807","nonce":2060707768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2060707768},{"type":"v1","addr":"172.21.15.189:6805","nonce":2060707768}]},"public_addr":"172.21.15.189:6801/2060707768","cluster_addr":"172.21.15.189:6803/2060707768","heartbeat_back_addr":"172.21.15.189:6807/2060707768","heartbeat_front_addr":"172.21.15.189:6805/2060707768","state":["exists","up"]},{"osd":3,"uuid":"b7e5a213-1488-4280-81e2-70d506b36fb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6811","nonce":525214774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6813","nonce":525214774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6817","nonce":525214774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":525214774},{"type":"v1","addr":"172.21.15.33:6815","nonce":525214774}]},"public_addr":"172.21.15.33:6811/525214774","cluster_addr":"172.21.15.33:6813/525214774","heartbeat_back_addr":"172.21.15.33:6817/525214774","heartbeat_front_addr":"172.21.15.33:6815/525214774","state":["exists","up"]},{"osd":4,"uuid":"a411ce7d-b2de-4483-bad6-22a7514a2712","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6809","nonce":3474115140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6811","nonce":3474115140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6815","nonce":3474115140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3474115140},{"type":"v1","addr":"172.21.15.52:6813","nonce":3474115140}]},"public_addr":"172.21.15.52:6809/3474115140","cluster_addr":"172.21.15.52:6811/3474115140","heartbeat_back_addr":"172.21.15.52:6815/3474115140","heartbeat_front_addr":"172.21.15.52:6813/3474115140","state":["exists","up"]},{"osd":5,"uuid":"2091d686-673d-429d-935b-6516891b8d6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6809","nonce":4208509833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6811","nonce":4208509833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6815","nonce":4208509833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":4208509833},{"type":"v1","addr":"172.21.15.189:6813","nonce":4208509833}]},"public_addr":"172.21.15.189:6809/4208509833","cluster_addr":"172.21.15.189:6811/4208509833","heartbeat_back_addr":"172.21.15.189:6815/4208509833","heartbeat_front_addr":"172.21.15.189:6813/4208509833","state":["exists","up"]},{"osd":6,"uuid":"8a9a4975-39c8-4996-94a0-a0b119b61b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6819","nonce":3475374016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6821","nonce":3475374016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6825","nonce":3475374016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3475374016},{"type":"v1","addr":"172.21.15.33:6823","nonce":3475374016}]},"public_addr":"172.21.15.33:6819/3475374016","cluster_addr":"172.21.15.33:6821/3475374016","heartbeat_back_addr":"172.21.15.33:6825/3475374016","heartbeat_front_addr":"172.21.15.33:6823/3475374016","state":["exists","up"]},{"osd":7,"uuid":"266fe9b2-62df-4671-81b3-100dc5abd315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6817","nonce":775777717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6819","nonce":775777717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6823","nonce":775777717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":775777717},{"type":"v1","addr":"172.21.15.52:6821","nonce":775777717}]},"public_addr":"172.21.15.52:6817/775777717","cluster_addr":"172.21.15.52:6819/775777717","heartbeat_back_addr":"172.21.15.52:6823/775777717","heartbeat_front_addr":"172.21.15.52:6821/775777717","state":["exists","up"]},{"osd":8,"uuid":"56e0c2a1-9cff-40f2-9dad-5119984743e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6817","nonce":3739595846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6819","nonce":3739595846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6823","nonce":3739595846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":3739595846},{"type":"v1","addr":"172.21.15.189:6821","nonce":3739595846}]},"public_addr":"172.21.15.189:6817/3739595846","cluster_addr":"172.21.15.189:6819/3739595846","heartbeat_back_addr":"172.21.15.189:6823/3739595846","heartbeat_front_addr":"172.21.15.189:6821/3739595846","state":["exists","up"]},{"osd":9,"uuid":"7c1eb7a4-412e-46b0-830c-138a45e0cc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6827","nonce":119922777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6829","nonce":119922777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6833","nonce":119922777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":119922777},{"type":"v1","addr":"172.21.15.33:6831","nonce":119922777}]},"public_addr":"172.21.15.33:6827/119922777","cluster_addr":"172.21.15.33:6829/119922777","heartbeat_back_addr":"172.21.15.33:6833/119922777","heartbeat_front_addr":"172.21.15.33:6831/119922777","state":["exists","up"]},{"osd":10,"uuid":"c44b0d1e-3875-477b-96ce-3e82126df19e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6825","nonce":2130690017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6827","nonce":2130690017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6831","nonce":2130690017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2130690017},{"type":"v1","addr":"172.21.15.52:6829","nonce":2130690017}]},"public_addr":"172.21.15.52:6825/2130690017","cluster_addr":"172.21.15.52:6827/2130690017","heartbeat_back_addr":"172.21.15.52:6831/2130690017","heartbeat_front_addr":"172.21.15.52:6829/2130690017","state":["exists","up"]},{"osd":11,"uuid":"9ac102b3-44aa-4de6-a636-1fd62a7c05eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6825","nonce":3659047878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6827","nonce":3659047878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6831","nonce":3659047878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3659047878},{"type":"v1","addr":"172.21.15.189:6829","nonce":3659047878}]},"public_addr":"172.21.15.189:6825/3659047878","cluster_addr":"172.21.15.189:6827/3659047878","heartbeat_back_addr":"172.21.15.189:6831/3659047878","heartbeat_front_addr":"172.21.15.189:6829/3659047878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:03.154891+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:47:33.655770+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:04.673589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:48:36.956731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:09.221169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:49:40.177874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:12.683986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:50:43.830878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:14.759647+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:51:47.273926+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:18.679873+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:52:49.768992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8},{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/391857889":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3555926237":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/1526717857":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6800/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:6801/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6800/4044788418":"2024-09-11T23:44:17.611833+0000","172.21.15.33:6801/1302943839":"2024-09-11T23:44:46.663521+0000","172.21.15.33:0/3494052248":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2678027127":"2024-09-11T23:44:17.611833+0000","172.21.15.33:0/2864911126":"2024-09-11T23:44:17.611833+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 msgr2=0x7f6dec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 0x7f6dec0b7820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005d00 tx=0x7f6df8005c50 comp rx=0 tx=0).stop 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 msgr2=0x7f6e0419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6df000e9f0 tx=0x7f6df000edf0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 shutdown_connections 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6dec0b5360 0x7f6dec0b7820 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e0410b330 0x7f6e041a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e0410a9b0 0x7f6e0419b8d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 --2- 172.21.15.33:0/3918005465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e04104fa0 0x7f6e0419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.518+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 >> 172.21.15.33:0/3918005465 conn(0x7f6e04100a50 msgr2=0x7f6e04102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.519+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 shutdown_connections 2024-09-11T00:15:56.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:56.519+0000 7f6e0c200640 1 -- 172.21.15.33:0/3918005465 wait complete. 2024-09-11T00:15:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:56 smithi033 ceph-mon[30593]: pgmap v1011: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:15:56.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:56 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3918005465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:56.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:56 smithi189 ceph-mon[34000]: pgmap v1011: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:15:56.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:56 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3918005465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:56.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:56 smithi052 ceph-mon[33526]: pgmap v1011: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-11T00:15:56.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:56 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3918005465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:57.308 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T00:15:57.692 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 -- 172.21.15.33:0/3979880196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe46010b330 msgr2=0x7fe460111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 --2- 172.21.15.33:0/3979880196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe46010b330 0x7fe460111b30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe458009ca0 tx=0x7fe45802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 -- 172.21.15.33:0/3979880196 shutdown_connections 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 --2- 172.21.15.33:0/3979880196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe46010b330 0x7fe460111b30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 --2- 172.21.15.33:0/3979880196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010a9b0 0x7fe46010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 --2- 172.21.15.33:0/3979880196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe460104fa0 0x7fe460105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 -- 172.21.15.33:0/3979880196 >> 172.21.15.33:0/3979880196 conn(0x7fe460100a50 msgr2=0x7fe460102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 -- 172.21.15.33:0/3979880196 shutdown_connections 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.306+0000 7fe465e00640 1 -- 172.21.15.33:0/3979880196 wait complete. 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.307+0000 7fe465e00640 1 Processor -- start 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.307+0000 7fe465e00640 1 -- start start 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe46010a9b0 0x7fe46019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 0x7fe4601a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe460114e60 con 0x7fe460104fa0 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe460114ce0 con 0x7fe46010a9b0 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe465e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe460114fe0 con 0x7fe46010b330 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe45ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe45ea00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35804/0 (socket says 172.21.15.33:35804) 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe45ea00640 1 -- 172.21.15.33:0/1040570605 learned_addr learned my addr 172.21.15.33:0/1040570605 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe45e000640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe46010a9b0 0x7fe46019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.308+0000 7fe45f400640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 0x7fe4601a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 -- 172.21.15.33:0/1040570605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 msgr2=0x7fe4601a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 0x7fe4601a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 -- 172.21.15.33:0/1040570605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe46010a9b0 msgr2=0x7fe46019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe46010a9b0 0x7fe46019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 -- 172.21.15.33:0/1040570605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4601a13e0 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45f400640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 0x7fe4601a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe45ea00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe45000d950 tx=0x7fe45000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450017030 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe450004020 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.309+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500055d0 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.310+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4601a16d0 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.310+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4601a7d90 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.311+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe460105380 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.313+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe450009a30 con 0x7fe460104fa0 2024-09-11T00:15:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.315+0000 7fe464a00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 0x7fe4440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.316+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9158+0+0 (secure 0 0 0) 0x7fe4500e5a50 con 0x7fe460104fa0 2024-09-11T00:15:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.316+0000 7fe45e000640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 0x7fe4440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.317+0000 7fe45e000640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 0x7fe4440b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe460104570 tx=0x7fe44c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.319+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe4500ac510 con 0x7fe460104fa0 2024-09-11T00:15:58.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.556+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe46002e5c0 con 0x7fe460104fa0 2024-09-11T00:15:58.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.559+0000 7fe464a00640 1 -- 172.21.15.33:0/1040570605 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7fe4500abe10 con 0x7fe460104fa0 2024-09-11T00:15:58.560 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:15:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.562+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 msgr2=0x7fe4440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.562+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 0x7fe4440b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe460104570 tx=0x7fe44c00b390 comp rx=0 tx=0).stop 2024-09-11T00:15:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.562+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 msgr2=0x7fe46019b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.562+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe45000d950 tx=0x7fe45000de10 comp rx=0 tx=0).stop 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 shutdown_connections 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fe4440b52e0 0x7fe4440b77a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46010b330 0x7fe4601a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe46010a9b0 0x7fe46019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 --2- 172.21.15.33:0/1040570605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe460104fa0 0x7fe46019b330 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 >> 172.21.15.33:0/1040570605 conn(0x7fe460100a50 msgr2=0x7fe460102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 shutdown_connections 2024-09-11T00:15:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:15:58.563+0000 7fe465e00640 1 -- 172.21.15.33:0/1040570605 wait complete. 2024-09-11T00:15:58.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-mon[34000]: pgmap v1012: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T00:15:58.833 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.833 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.833 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-mds[63682]: -- 172.21.15.189:0/1533161707 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f4de9f860 con 0x556f4de7d400 2024-09-11T00:15:58.833 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: starting mds.f at 2024-09-11T00:15:58.833 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.834 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.834 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-mds[63984]: -- 172.21.15.189:0/2335266642 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d01807860 con 0x562d017e4800 2024-09-11T00:15:58.834 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:15:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: starting mds.c at 2024-09-11T00:15:58.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-mon[33526]: pgmap v1012: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T00:15:58.956 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-mds[64360]: -- 172.21.15.52:0/543828397 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c6178fc20 con 0x561c6176d000 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: starting mds.h at 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: 2024-09-11T00:15:58.642+0000 7f4996800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-mds[64065]: -- 172.21.15.52:0/2693000109 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556326f7c20 con 0x5556326d5000 2024-09-11T00:15:58.957 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: starting mds.e at 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-mds[63758]: -- 172.21.15.52:0/2188838068 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560602d7860 con 0x5560602b5000 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: starting mds.k at 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: ignoring --setuser ceph since I am not root 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: ignoring --setgroup ceph since I am not root 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-mds[64664]: -- 172.21.15.52:0/2430832296 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a566775c20 con 0x55a566753000 2024-09-11T00:15:58.958 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:15:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: starting mds.b at 2024-09-11T00:15:59.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:58 smithi033 ceph-mon[30593]: pgmap v1012: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T00:15:59.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:58 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a[30589]: 2024-09-11T00:15:58.556+0000 7f32e0000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:15:59.465 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:15:59.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:15:59.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:15:59.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:15:59.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:15:59.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:15:59.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:15:59 smithi033 ceph-mon[30593]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:15:59.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:15:59.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:15:59.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:15:59.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:15:59.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:15:59.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:15:59 smithi189 ceph-mon[34000]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:15:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/1040570605' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:15:59.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:15:59 smithi052 ceph-mon[33526]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 -- 172.21.15.33:0/1092211302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc102dc0 msgr2=0x7f53fc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 --2- 172.21.15.33:0/1092211302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc102dc0 0x7f53fc1031a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009900 tx=0x7f53ec02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 -- 172.21.15.33:0/1092211302 shutdown_connections 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 --2- 172.21.15.33:0/1092211302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc109150 0x7f53fc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 --2- 172.21.15.33:0/1092211302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 0x7f53fc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 --2- 172.21.15.33:0/1092211302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc102dc0 0x7f53fc1031a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 -- 172.21.15.33:0/1092211302 >> 172.21.15.33:0/1092211302 conn(0x7f53fc0fe830 msgr2=0x7f53fc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 -- 172.21.15.33:0/1092211302 shutdown_connections 2024-09-11T00:16:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.526+0000 7f5401200640 1 -- 172.21.15.33:0/1092211302 wait complete. 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.527+0000 7f5401200640 1 Processor -- start 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.527+0000 7f5401200640 1 -- start start 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc102dc0 0x7f53fc19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 0x7f53fc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc112d10 con 0x7f53fc109150 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc112b90 con 0x7f53fc1087d0 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f5401200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc112e90 con 0x7f53fc102dc0 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35824/0 (socket says 172.21.15.33:35824) 2024-09-11T00:16:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 -- 172.21.15.33:0/3191054990 learned_addr learned my addr 172.21.15.33:0/3191054990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53f9e00640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc102dc0 0x7f53fc19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53f1400640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 0x7f53fc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 -- 172.21.15.33:0/3191054990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc102dc0 msgr2=0x7f53fc19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc102dc0 0x7f53fc19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 -- 172.21.15.33:0/3191054990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 msgr2=0x7f53fc19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 0x7f53fc19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.528+0000 7f53fa800640 1 -- 172.21.15.33:0/3191054990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1a1490 con 0x7f53fc109150 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f53fa800640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f53f400eaa0 tx=0x7f53f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f400cdb0 con 0x7f53fc109150 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53f4005020 con 0x7f53fc109150 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f40116d0 con 0x7f53fc109150 2024-09-11T00:16:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc1a1780 con 0x7f53fc109150 2024-09-11T00:16:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.529+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1a7e40 con 0x7f53fc109150 2024-09-11T00:16:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.530+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc1031a0 con 0x7f53fc109150 2024-09-11T00:16:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.533+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f53f400f040 con 0x7f53fc109150 2024-09-11T00:16:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.534+0000 7f53f3400640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 0x7f53e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.534+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9416+0+0 (secure 0 0 0) 0x7f53f40e61c0 con 0x7f53fc109150 2024-09-11T00:16:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.534+0000 7f53f9e00640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 0x7f53e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.535+0000 7f53f9e00640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 0x7f53e00b77a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006010 tx=0x7f53ec005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.536+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53f4016030 con 0x7f53fc109150 2024-09-11T00:16:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:00.769+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f53fc02e5c0 con 0x7f53fc109150 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: pgmap v1014: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6832/2024045109,v1:172.21.15.52:6835/2024045109] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6833/199036107,v1:172.21.15.52:6836/199036107] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6834/3340451472,v1:172.21.15.52:6837/3340451472] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6834/2422500653,v1:172.21.15.189:6836/2422500653] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.189:6835/2035625951,v1:172.21.15.189:6837/2035625951] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: mds.? [v2:172.21.15.52:6838/2574298378,v1:172.21.15.52:6839/2574298378] up:boot 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:16:00.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:16:00.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:16:00.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:16:00.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:16:00.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:00 smithi033 ceph-mon[30593]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: pgmap v1014: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6832/2024045109,v1:172.21.15.52:6835/2024045109] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6833/199036107,v1:172.21.15.52:6836/199036107] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6834/3340451472,v1:172.21.15.52:6837/3340451472] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6834/2422500653,v1:172.21.15.189:6836/2422500653] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.189:6835/2035625951,v1:172.21.15.189:6837/2035625951] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: mds.? [v2:172.21.15.52:6838/2574298378,v1:172.21.15.52:6839/2574298378] up:boot 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:16:00.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:16:00.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:16:00.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:16:00.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:16:00.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:00 smithi189 ceph-mon[34000]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: pgmap v1014: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6832/2024045109,v1:172.21.15.52:6835/2024045109] up:boot 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6833/199036107,v1:172.21.15.52:6836/199036107] up:boot 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6834/3340451472,v1:172.21.15.52:6837/3340451472] up:boot 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6834/2422500653,v1:172.21.15.189:6836/2422500653] up:boot 2024-09-11T00:16:00.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.189:6835/2035625951,v1:172.21.15.189:6837/2035625951] up:boot 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: mds.? [v2:172.21.15.52:6838/2574298378,v1:172.21.15.52:6839/2574298378] up:boot 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:16:00.957 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:00 smithi052 ceph-mon[33526]: from='mgr.14150 172.21.15.33:0/3922646035' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:16:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.573+0000 7f53f3400640 1 -- 172.21.15.33:0/3191054990 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f53f40ac530 con 0x7f53fc109150 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 msgr2=0x7f53e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 0x7f53e00b77a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006010 tx=0x7f53ec005e80 comp rx=0 tx=0).stop 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 msgr2=0x7f53fc1a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f53f400eaa0 tx=0x7f53f400ef60 comp rx=0 tx=0).stop 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 shutdown_connections 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f53e00b52e0 0x7f53e00b77a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53fc109150 0x7f53fc1a0cc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53fc1087d0 0x7f53fc19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 --2- 172.21.15.33:0/3191054990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53fc102dc0 0x7f53fc19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 >> 172.21.15.33:0/3191054990 conn(0x7f53fc0fe830 msgr2=0x7f53fc104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:01.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 shutdown_connections 2024-09-11T00:16:01.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:01.576+0000 7f5401200640 1 -- 172.21.15.33:0/3191054990 wait complete. 2024-09-11T00:16:01.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:01 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:16:01.949 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:01 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:16:01.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:01 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:16:02.498 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: pgmap v1015: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: Cluster is now healthy 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:16:02.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:02 smithi033 ceph-mon[30593]: fsmap 12 up:standby 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: pgmap v1015: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: Cluster is now healthy 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:16:02.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:02 smithi189 ceph-mon[34000]: fsmap 12 up:standby 2024-09-11T00:16:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: pgmap v1015: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: Cluster is now healthy 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3191054990' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:16:02.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:02 smithi052 ceph-mon[33526]: fsmap 12 up:standby 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 -- 172.21.15.33:0/1915603782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075e60 msgr2=0x7f6e801135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 --2- 172.21.15.33:0/1915603782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075e60 0x7f6e801135c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009900 tx=0x7f6e6c02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 -- 172.21.15.33:0/1915603782 shutdown_connections 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 --2- 172.21.15.33:0/1915603782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80113b00 0x7f6e80115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 --2- 172.21.15.33:0/1915603782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075e60 0x7f6e801135c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 --2- 172.21.15.33:0/1915603782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80075540 0x7f6e80075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 -- 172.21.15.33:0/1915603782 >> 172.21.15.33:0/1915603782 conn(0x7f6e800fe810 msgr2=0x7f6e80100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 -- 172.21.15.33:0/1915603782 shutdown_connections 2024-09-11T00:16:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.546+0000 7f6e87a00640 1 -- 172.21.15.33:0/1915603782 wait complete. 2024-09-11T00:16:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.547+0000 7f6e87a00640 1 Processor -- start 2024-09-11T00:16:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 -- start start 2024-09-11T00:16:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80075e60 0x7f6e8019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80113b00 0x7f6e801a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80119290 con 0x7f6e80075540 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80119110 con 0x7f6e80113b00 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.548+0000 7f6e87a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80119410 con 0x7f6e80075e60 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35956/0 (socket says 172.21.15.33:35956) 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 -- 172.21.15.33:0/2877801975 learned_addr learned my addr 172.21.15.33:0/2877801975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80113b00 0x7f6e801a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e7fe00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80075e60 0x7f6e8019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 -- 172.21.15.33:0/2877801975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80075e60 msgr2=0x7f6e8019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80075e60 0x7f6e8019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 -- 172.21.15.33:0/2877801975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80113b00 msgr2=0x7f6e801a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80113b00 0x7f6e801a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 -- 172.21.15.33:0/2877801975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e801a5890 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.549+0000 7f6e85000640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400d950 tx=0x7f6e7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.550+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74017070 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.550+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e74009c30 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.550+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400f620 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.550+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e801a5b80 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.550+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e801ac240 con 0x7f6e80075540 2024-09-11T00:16:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.551+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e80075920 con 0x7f6e80075540 2024-09-11T00:16:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.553+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6e74010460 con 0x7f6e80075540 2024-09-11T00:16:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.555+0000 7f6e7d600640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 0x7f6e680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.555+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9416+0+0 (secure 0 0 0) 0x7f6e740e5c90 con 0x7f6e80075540 2024-09-11T00:16:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.555+0000 7f6e7fe00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 0x7f6e680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:03.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.556+0000 7f6e7fe00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 0x7f6e680b7820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006010 tx=0x7f6e6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:03.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.559+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6e740ac650 con 0x7f6e80075540 2024-09-11T00:16:03.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:03.757+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6e801ac630 con 0x7f6e80075540 2024-09-11T00:16:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.579+0000 7f6e7d600640 1 -- 172.21.15.33:0/2877801975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f6e74009de0 con 0x7f6e80075540 2024-09-11T00:16:04.581 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 msgr2=0x7f6e680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 0x7f6e680b7820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006010 tx=0x7f6e6c005a20 comp rx=0 tx=0).stop 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 msgr2=0x7f6e8019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400d950 tx=0x7f6e7400de10 comp rx=0 tx=0).stop 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 shutdown_connections 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f6e680b5360 0x7f6e680b7820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e80113b00 0x7f6e801a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:04.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e80075e60 0x7f6e8019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 --2- 172.21.15.33:0/2877801975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e80075540 0x7f6e8019f7e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 >> 172.21.15.33:0/2877801975 conn(0x7f6e800fe810 msgr2=0x7f6e800ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 shutdown_connections 2024-09-11T00:16:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:04.584+0000 7f6e87a00640 1 -- 172.21.15.33:0/2877801975 wait complete. 2024-09-11T00:16:04.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:04 smithi189 ceph-mon[34000]: pgmap v1016: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T00:16:04.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:04 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:04.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:04 smithi052 ceph-mon[33526]: pgmap v1016: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T00:16:04.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:04 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:05.018 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:04 smithi033 ceph-mon[30593]: pgmap v1016: 129 pgs: 129 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T00:16:05.018 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:04 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:05.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:16:05.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:05 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:05.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:05 smithi033 ceph-mon[30593]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:16:05.837 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:05.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:05 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:05.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:05 smithi052 ceph-mon[33526]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:16:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:05 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2877801975' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:06.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:05 smithi189 ceph-mon[34000]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:16:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 -- 172.21.15.33:0/2906161466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c104fa0 msgr2=0x7fc07c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 --2- 172.21.15.33:0/2906161466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c104fa0 0x7fc07c105380 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc070009900 tx=0x7fc07002a3f0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 -- 172.21.15.33:0/2906161466 shutdown_connections 2024-09-11T00:16:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 --2- 172.21.15.33:0/2906161466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c10b330 0x7fc07c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 --2- 172.21.15.33:0/2906161466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 0x7fc07c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 --2- 172.21.15.33:0/2906161466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c104fa0 0x7fc07c105380 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 -- 172.21.15.33:0/2906161466 >> 172.21.15.33:0/2906161466 conn(0x7fc07c100a50 msgr2=0x7fc07c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 -- 172.21.15.33:0/2906161466 shutdown_connections 2024-09-11T00:16:06.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.428+0000 7fc084800640 1 -- 172.21.15.33:0/2906161466 wait complete. 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.429+0000 7fc084800640 1 Processor -- start 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.429+0000 7fc084800640 1 -- start start 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c104fa0 0x7fc07c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 0x7fc07c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c114eb0 con 0x7fc07c10b330 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c114d30 con 0x7fc07c104fa0 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc084800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c115030 con 0x7fc07c10a9b0 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc082800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc082800640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35970/0 (socket says 172.21.15.33:35970) 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc082800640 1 -- 172.21.15.33:0/3962749028 learned_addr learned my addr 172.21.15.33:0/3962749028 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc081400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 0x7fc07c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.430+0000 7fc081e00640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c104fa0 0x7fc07c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 -- 172.21.15.33:0/3962749028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 msgr2=0x7fc07c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 0x7fc07c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 -- 172.21.15.33:0/3962749028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c104fa0 msgr2=0x7fc07c19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c104fa0 0x7fc07c19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 -- 172.21.15.33:0/3962749028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07c1a1490 con 0x7fc07c10b330 2024-09-11T00:16:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc082800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc07800cce0 tx=0x7fc07800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.431+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07800f450 con 0x7fc07c10b330 2024-09-11T00:16:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.432+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc07800fa80 con 0x7fc07c10b330 2024-09-11T00:16:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.432+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07c1a1780 con 0x7fc07c10b330 2024-09-11T00:16:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.432+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0780189c0 con 0x7fc07c10b330 2024-09-11T00:16:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.432+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07c1a7ec0 con 0x7fc07c10b330 2024-09-11T00:16:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.433+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07c105380 con 0x7fc07c10b330 2024-09-11T00:16:06.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.435+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc078020030 con 0x7fc07c10b330 2024-09-11T00:16:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.436+0000 7fc076a00640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 0x7fc0640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.437+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8862+0+0 (secure 0 0 0) 0x7fc0780e5f70 con 0x7fc07c10b330 2024-09-11T00:16:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.437+0000 7fc081e00640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 0x7fc0640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.437+0000 7fc081e00640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 0x7fc0640b77a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc070006010 tx=0x7fc070005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.440+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc078014030 con 0x7fc07c10b330 2024-09-11T00:16:06.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:06.639+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc07c19c510 con 0x7fc07c10b330 2024-09-11T00:16:06.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:06 smithi052 ceph-mon[33526]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:06.984 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:06 smithi189 ceph-mon[34000]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:07.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:06 smithi033 ceph-mon[30593]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:07.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.595+0000 7fc076a00640 1 -- 172.21.15.33:0/3962749028 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7fc0780acb60 con 0x7fc07c10b330 2024-09-11T00:16:07.597 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-09-11T00:16:07.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.600+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 msgr2=0x7fc0640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.600+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 0x7fc0640b77a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc070006010 tx=0x7fc070005e80 comp rx=0 tx=0).stop 2024-09-11T00:16:07.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.600+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 msgr2=0x7fc07c1a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.600+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc07800cce0 tx=0x7fc07800a620 comp rx=0 tx=0).stop 2024-09-11T00:16:07.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 shutdown_connections 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7fc0640b52e0 0x7fc0640b77a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc07c10b330 0x7fc07c1a0cc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc07c10a9b0 0x7fc07c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 --2- 172.21.15.33:0/3962749028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc07c104fa0 0x7fc07c19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 >> 172.21.15.33:0/3962749028 conn(0x7fc07c100a50 msgr2=0x7fc07c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.601+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 shutdown_connections 2024-09-11T00:16:07.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:07.602+0000 7fc084800640 1 -- 172.21.15.33:0/3962749028 wait complete. 2024-09-11T00:16:07.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:07 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:08.010 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:07 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:08.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:07 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:08.619 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 63242646-6fce-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T00:16:08.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:08 smithi052 ceph-mon[33526]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:08.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:08 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:08.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:08 smithi052 ceph-mon[33526]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:16:09.002 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:08 smithi033 ceph-mon[30593]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:08 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:09.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:08 smithi033 ceph-mon[30593]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:16:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:08 smithi189 ceph-mon[34000]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:09.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:08 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/3962749028' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:09.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:08 smithi189 ceph-mon[34000]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:16:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 -- 172.21.15.33:0/4165961482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010b180 msgr2=0x7f9440111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 --2- 172.21.15.33:0/4165961482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010b180 0x7f9440111980 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9438009ca0 tx=0x7f943802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 -- 172.21.15.33:0/4165961482 shutdown_connections 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 --2- 172.21.15.33:0/4165961482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010b180 0x7f9440111980 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 --2- 172.21.15.33:0/4165961482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f944010a800 0x7f944010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 --2- 172.21.15.33:0/4165961482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9440104df0 0x7f94401051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 -- 172.21.15.33:0/4165961482 >> 172.21.15.33:0/4165961482 conn(0x7f9440100840 msgr2=0x7f9440102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 -- 172.21.15.33:0/4165961482 shutdown_connections 2024-09-11T00:16:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.585+0000 7f9446a00640 1 -- 172.21.15.33:0/4165961482 wait complete. 2024-09-11T00:16:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.586+0000 7f9446a00640 1 Processor -- start 2024-09-11T00:16:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 -- start start 2024-09-11T00:16:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9440104df0 0x7f944019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944010b180 0x7f94401a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9440114d00 con 0x7f944010a800 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9440114b80 con 0x7f9440104df0 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9446a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9440114e80 con 0x7f944010b180 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9444c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9444c00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35984/0 (socket says 172.21.15.33:35984) 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.587+0000 7f9444c00640 1 -- 172.21.15.33:0/2962137172 learned_addr learned my addr 172.21.15.33:0/2962137172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9445600640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9440104df0 0x7f944019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9446000640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944010b180 0x7f94401a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 -- 172.21.15.33:0/2962137172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944010b180 msgr2=0x7f94401a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944010b180 0x7f94401a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 -- 172.21.15.33:0/2962137172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9440104df0 msgr2=0x7f944019b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9440104df0 0x7f944019b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 -- 172.21.15.33:0/2962137172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94401a1160 con 0x7f944010a800 2024-09-11T00:16:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.588+0000 7f9444c00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f942c00d950 tx=0x7f942c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.589+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c017030 con 0x7f944010a800 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.589+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f942c004020 con 0x7f944010a800 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.589+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94401a1450 con 0x7f944010a800 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.589+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c0055d0 con 0x7f944010a800 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.589+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94401a7ce0 con 0x7f944010a800 2024-09-11T00:16:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.590+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94401051d0 con 0x7f944010a800 2024-09-11T00:16:09.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.593+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f942c009a30 con 0x7f944010a800 2024-09-11T00:16:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.594+0000 7f943e000640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 0x7f94280b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.595+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8303+0+0 (secure 0 0 0) 0x7f942c0e5b70 con 0x7f944010a800 2024-09-11T00:16:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.595+0000 7f9445600640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 0x7f94280b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.595+0000 7f9445600640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 0x7f94280b78d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9434009bd0 tx=0x7f9434005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.596+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f942c0aca10 con 0x7f944010a800 2024-09-11T00:16:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:09.794+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f944019c1e0 con 0x7f944010a800 2024-09-11T00:16:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.607+0000 7f943e000640 1 -- 172.21.15.33:0/2962137172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v91) ==== 178+0+0 (secure 0 0 0) 0x7f942c0ac310 con 0x7f944010a800 2024-09-11T00:16:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' removed 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.612+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 msgr2=0x7f94280b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.612+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 0x7f94280b78d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9434009bd0 tx=0x7f9434005f90 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.612+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 msgr2=0x7f944019b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.612+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f942c00d950 tx=0x7f942c00de10 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 shutdown_connections 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:6800/604054582,v1:172.21.15.33:6801/604054582] conn(0x7f94280b5410 0x7f94280b78d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944010b180 0x7f94401a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f944010a800 0x7f944019b5f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 --2- 172.21.15.33:0/2962137172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9440104df0 0x7f944019b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.613+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 >> 172.21.15.33:0/2962137172 conn(0x7f9440100840 msgr2=0x7f9440100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.615+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 shutdown_connections 2024-09-11T00:16:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-09-11T00:16:10.615+0000 7f9446a00640 1 -- 172.21.15.33:0/2962137172 wait complete. 2024-09-11T00:16:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:10 smithi052 ceph-mon[33526]: pgmap v1021: 33 pgs: 33 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:10.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:10 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:10 smithi033 ceph-mon[30593]: pgmap v1021: 33 pgs: 33 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:11.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:10 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:11.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:10 smithi189 ceph-mon[34000]: pgmap v1021: 33 pgs: 33 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:16:11.084 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:10 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:16:11.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:11.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:11.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:11 smithi033 ceph-mon[30593]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:11.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:11 smithi033 ceph-mon[30593]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:16:11.902 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:11 smithi052 ceph-mon[33526]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:11.903 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:11 smithi052 ceph-mon[33526]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:16:11.911 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:16:11.964 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:11 smithi189 ceph-mon[34000]: from='client.? 172.21.15.33:0/2962137172' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:16:11.964 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:11 smithi189 ceph-mon[34000]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T00:16:11.974 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T00:16:11.974 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:16:12.010 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:16:12.045 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:16:12.081 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T00:16:12.081 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T00:16:12.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a 2024-09-11T00:16:12.527 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:12 smithi033 systemd[1]: Stopping Ceph mon.a for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a[30589]: 2024-09-11T00:16:12.594+0000 7f32e6e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:13.026 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a[30589]: 2024-09-11T00:16:12.594+0000 7f32e6e00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T00:16:13.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:12 smithi033 podman[108112]: 2024-09-11 00:16:12.799193066 +0000 UTC m=+0.400097604 container died 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T00:16:13.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:13 smithi033 podman[108112]: 2024-09-11 00:16:13.350019408 +0000 UTC m=+0.950923916 container cleanup 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:13.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:13 smithi033 bash[108112]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a 2024-09-11T00:16:13.899 INFO:journalctl@ceph.mon.a.smithi033.stdout:Sep 11 00:16:13 smithi033 podman[108132]: 2024-09-11 00:16:13.604455753 +0000 UTC m=+0.799731920 container remove 0aca1138a05f460c50ef8b6e6ad8d63fbaf6f3b1733e49282ce5515a5e7345ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:16:13.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T00:16:14.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:14.027 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T00:16:14.027 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T00:16:14.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.b 2024-09-11T00:16:14.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:14 smithi052 systemd[1]: Stopping Ceph mon.b for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:14.784 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b[33522]: 2024-09-11T00:16:14.515+0000 7f696ec00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:14.784 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b[33522]: 2024-09-11T00:16:14.515+0000 7f696ec00640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:16:15.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:14 smithi052 podman[70608]: 2024-09-11 00:16:14.782909969 +0000 UTC m=+0.423943698 container died d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:15.701 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:15 smithi052 podman[70608]: 2024-09-11 00:16:15.405315714 +0000 UTC m=+1.046349452 container cleanup d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T00:16:15.701 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:15 smithi052 bash[70608]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b 2024-09-11T00:16:15.956 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 11 00:16:15 smithi052 podman[70620]: 2024-09-11 00:16:15.699203524 +0000 UTC m=+0.906615843 container remove d69079c547587fec497aedaffcc7c1d57199ed3e8c4411e7ece2f43ac8e5f4b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T00:16:15.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T00:16:16.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:16.108 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T00:16:16.108 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T00:16:16.108 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.c 2024-09-11T00:16:16.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:16 smithi189 systemd[1]: Stopping Ceph mon.c for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:17.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c[33996]: 2024-09-11T00:16:17.318+0000 7f83d8600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:17.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c[33996]: 2024-09-11T00:16:17.318+0000 7f83d8600640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:16:17.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:17 smithi189 podman[69837]: 2024-09-11 00:16:17.464837432 +0000 UTC m=+0.455356589 container died 8d5288a513d74082a0f264436ea6efe208a0c7a79d49bf8004c93cdbe9d18541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:16:18.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:17 smithi189 podman[69837]: 2024-09-11 00:16:17.949207061 +0000 UTC m=+0.939726217 container cleanup 8d5288a513d74082a0f264436ea6efe208a0c7a79d49bf8004c93cdbe9d18541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:16:18.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:17 smithi189 bash[69837]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c 2024-09-11T00:16:18.451 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 11 00:16:18 smithi189 podman[69848]: 2024-09-11 00:16:18.284730802 +0000 UTC m=+0.809069513 container remove 8d5288a513d74082a0f264436ea6efe208a0c7a79d49bf8004c93cdbe9d18541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:16:18.475 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T00:16:18.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:18.565 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T00:16:18.565 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T00:16:18.565 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x 2024-09-11T00:16:19.010 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:18 smithi033 systemd[1]: Stopping Ceph mgr.x for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:19.276 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-11T00:16:19.008+0000 7fd85e400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:19.276 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x[30829]: 2024-09-11T00:16:19.008+0000 7fd85e400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-11T00:16:19.277 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:19 smithi033 podman[108243]: 2024-09-11 00:16:19.090890053 +0000 UTC m=+0.227622479 container died d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:16:20.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:20 smithi033 podman[108243]: 2024-09-11 00:16:20.073974697 +0000 UTC m=+1.210707122 container cleanup d5e83021c92317e4835712ed0c3a1f31577ce8cfaa907aec72f78359f0f0b902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:20.526 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Sep 11 00:16:20 smithi033 bash[108243]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-x 2024-09-11T00:16:21.089 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T00:16:21.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:21.162 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T00:16:21.162 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T00:16:21.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.y 2024-09-11T00:16:21.706 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:21 smithi052 systemd[1]: Stopping Ceph mgr.y for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:22.122 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:21 smithi052 podman[70731]: 2024-09-11 00:16:21.801364667 +0000 UTC m=+0.345706221 container died 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T00:16:22.456 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:22 smithi052 podman[70731]: 2024-09-11 00:16:22.278320241 +0000 UTC m=+0.822661800 container cleanup 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:22.456 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:22 smithi052 bash[70731]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y 2024-09-11T00:16:22.818 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:22 smithi052 podman[70743]: 2024-09-11 00:16:22.554850264 +0000 UTC m=+0.740799984 container remove 65194799183bc277413adfa69befff4a4e79b5af290efbc2ebadcf7c598a58b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T00:16:22.819 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 11 00:16:22 smithi052 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-11T00:16:22.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T00:16:22.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:22.900 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T00:16:22.900 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T00:16:22.900 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.z 2024-09-11T00:16:23.333 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:22 smithi189 systemd[1]: Stopping Ceph mgr.z for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:23.737 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:23 smithi189 podman[69970]: 2024-09-11 00:16:23.386312303 +0000 UTC m=+0.194258443 container died 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T00:16:24.082 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:23 smithi189 podman[69970]: 2024-09-11 00:16:23.88844201 +0000 UTC m=+0.696388151 container cleanup 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T00:16:24.083 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:23 smithi189 bash[69970]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z 2024-09-11T00:16:24.478 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:24 smithi189 podman[69982]: 2024-09-11 00:16:24.206978878 +0000 UTC m=+0.805502698 container remove 69677b0d04d0ac7739eee9e2a73b39ab1472765fcd030229193394cf78d198cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T00:16:24.478 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 11 00:16:24 smithi189 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-11T00:16:24.503 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T00:16:24.578 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:24.578 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T00:16:24.578 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T00:16:24.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.0 2024-09-11T00:16:25.018 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:24 smithi033 systemd[1]: Stopping Ceph osd.0 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:25.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0[46718]: 2024-09-11T00:16:25.016+0000 7fc692200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:25.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0[46718]: 2024-09-11T00:16:25.016+0000 7fc692200640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-11T00:16:25.276 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0[46718]: 2024-09-11T00:16:25.016+0000 7fc692200640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:16:31.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:30 smithi033 podman[108363]: 2024-09-11 00:16:30.77142508 +0000 UTC m=+5.899712471 container died 87493da49fb1fada748ee0089416c504d3e990c3b0bca1c7e996002644141170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:16:31.378 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:31 smithi033 podman[108363]: 2024-09-11 00:16:31.372606892 +0000 UTC m=+6.500894262 container cleanup 87493da49fb1fada748ee0089416c504d3e990c3b0bca1c7e996002644141170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:31.378 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:31 smithi033 bash[108363]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0 2024-09-11T00:16:32.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:31 smithi033 podman[108392]: 2024-09-11 00:16:31.682914325 +0000 UTC m=+0.900874216 container remove 87493da49fb1fada748ee0089416c504d3e990c3b0bca1c7e996002644141170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:16:32.527 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:32 smithi033 podman[108481]: 2024-09-11 00:16:32.135844215 +0000 UTC m=+0.027986629 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:32.661 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:32 smithi033 podman[108481]: 2024-09-11 00:16:32.300758544 +0000 UTC m=+0.192900954 container create 1188621ae5b181089e462ecbd5f3fc576f0c965b565da3601881e591fe8a0ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:33.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:32 smithi033 podman[108481]: 2024-09-11 00:16:32.58704691 +0000 UTC m=+0.479189325 container init 1188621ae5b181089e462ecbd5f3fc576f0c965b565da3601881e591fe8a0ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T00:16:33.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:32 smithi033 podman[108481]: 2024-09-11 00:16:32.593826294 +0000 UTC m=+0.485968707 container start 1188621ae5b181089e462ecbd5f3fc576f0c965b565da3601881e591fe8a0ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T00:16:33.026 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:32 smithi033 podman[108481]: 2024-09-11 00:16:32.745448423 +0000 UTC m=+0.637590850 container attach 1188621ae5b181089e462ecbd5f3fc576f0c965b565da3601881e591fe8a0ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T00:16:33.518 INFO:journalctl@ceph.osd.0.smithi033.stdout:Sep 11 00:16:33 smithi033 podman[108481]: 2024-09-11 00:16:33.146523931 +0000 UTC m=+1.038666344 container died 1188621ae5b181089e462ecbd5f3fc576f0c965b565da3601881e591fe8a0ca2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:33.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T00:16:34.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:34.043 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T00:16:34.043 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T00:16:34.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.1 2024-09-11T00:16:34.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:34 smithi052 systemd[1]: Stopping Ceph osd.1 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:34.956 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-11T00:16:34.601+0000 7fbc50600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:34.956 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-11T00:16:34.601+0000 7fbc50600640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-11T00:16:34.956 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1[38004]: 2024-09-11T00:16:34.601+0000 7fbc50600640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:16:40.706 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:40 smithi052 podman[70857]: 2024-09-11 00:16:40.416812305 +0000 UTC m=+6.080712680 container died fe261c3f28716f2f31bb4b08cbc4453fa85e325e079a3c7f058c78c9e84e7439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:16:41.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:41 smithi052 podman[70857]: 2024-09-11 00:16:41.075054919 +0000 UTC m=+6.738955293 container cleanup fe261c3f28716f2f31bb4b08cbc4453fa85e325e079a3c7f058c78c9e84e7439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T00:16:41.206 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:41 smithi052 bash[70857]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1 2024-09-11T00:16:41.706 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:41 smithi052 podman[70874]: 2024-09-11 00:16:41.310228504 +0000 UTC m=+0.869977800 container remove fe261c3f28716f2f31bb4b08cbc4453fa85e325e079a3c7f058c78c9e84e7439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:16:42.190 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:41 smithi052 podman[70961]: 2024-09-11 00:16:41.753571015 +0000 UTC m=+0.027809699 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:42.191 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:41 smithi052 podman[70961]: 2024-09-11 00:16:41.89441175 +0000 UTC m=+0.168650415 container create 097e758b5fff8c02aa270ef12ed2e8838e02acfb1d4822110e0b2f8156fca916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T00:16:42.191 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:42 smithi052 podman[70961]: 2024-09-11 00:16:42.189297299 +0000 UTC m=+0.463535990 container init 097e758b5fff8c02aa270ef12ed2e8838e02acfb1d4822110e0b2f8156fca916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T00:16:42.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:42 smithi052 podman[70961]: 2024-09-11 00:16:42.197128306 +0000 UTC m=+0.471366972 container start 097e758b5fff8c02aa270ef12ed2e8838e02acfb1d4822110e0b2f8156fca916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T00:16:42.456 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:42 smithi052 podman[70961]: 2024-09-11 00:16:42.297412492 +0000 UTC m=+0.571651177 container attach 097e758b5fff8c02aa270ef12ed2e8838e02acfb1d4822110e0b2f8156fca916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:16:42.956 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 11 00:16:42 smithi052 podman[70984]: 2024-09-11 00:16:42.728228515 +0000 UTC m=+0.027017431 container died 097e758b5fff8c02aa270ef12ed2e8838e02acfb1d4822110e0b2f8156fca916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T00:16:43.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T00:16:43.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:43.775 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T00:16:43.775 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T00:16:43.775 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.2 2024-09-11T00:16:44.082 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:43 smithi189 systemd[1]: Stopping Ceph osd.2 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:44.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2[39081]: 2024-09-11T00:16:44.239+0000 7f59daa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:44.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2[39081]: 2024-09-11T00:16:44.239+0000 7f59daa00640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-11T00:16:44.583 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2[39081]: 2024-09-11T00:16:44.239+0000 7f59daa00640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:16:50.333 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:50 smithi189 podman[70091]: 2024-09-11 00:16:50.051091276 +0000 UTC m=+5.988799581 container died 7e55e04ee0b69500fe52922458e47e0661c616f3f33749b99f04e3cb5da698e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:16:50.833 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:50 smithi189 podman[70091]: 2024-09-11 00:16:50.609329747 +0000 UTC m=+6.547038052 container cleanup 7e55e04ee0b69500fe52922458e47e0661c616f3f33749b99f04e3cb5da698e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T00:16:50.833 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:50 smithi189 bash[70091]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2 2024-09-11T00:16:51.332 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:50 smithi189 podman[70110]: 2024-09-11 00:16:50.85263183 +0000 UTC m=+0.770158153 container remove 7e55e04ee0b69500fe52922458e47e0661c616f3f33749b99f04e3cb5da698e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T00:16:51.740 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:51 smithi189 podman[70196]: 2024-09-11 00:16:51.329645381 +0000 UTC m=+0.027191574 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:51.741 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:51 smithi189 podman[70196]: 2024-09-11 00:16:51.44541369 +0000 UTC m=+0.142959860 container create 1c162784e7c9858411a003a945552c4756fe252c1e80755ee0f08df3ea6929ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:16:51.741 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:51 smithi189 podman[70196]: 2024-09-11 00:16:51.739736655 +0000 UTC m=+0.437282843 container init 1c162784e7c9858411a003a945552c4756fe252c1e80755ee0f08df3ea6929ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T00:16:52.082 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:51 smithi189 podman[70196]: 2024-09-11 00:16:51.746788403 +0000 UTC m=+0.444334574 container start 1c162784e7c9858411a003a945552c4756fe252c1e80755ee0f08df3ea6929ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:16:52.082 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:51 smithi189 podman[70196]: 2024-09-11 00:16:51.864763792 +0000 UTC m=+0.562309963 container attach 1c162784e7c9858411a003a945552c4756fe252c1e80755ee0f08df3ea6929ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T00:16:52.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:51.874+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:52.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:51.970+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:52.276 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:52.016+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:52.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:52.117+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:52.562 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 11 00:16:52 smithi189 podman[70196]: 2024-09-11 00:16:52.147620788 +0000 UTC m=+0.845166969 container died 1c162784e7c9858411a003a945552c4756fe252c1e80755ee0f08df3ea6929ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T00:16:52.973 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T00:16:53.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:16:53.050 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T00:16:53.050 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T00:16:53.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.3 2024-09-11T00:16:53.276 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:52.977+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:53.276 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:53 smithi033 systemd[1]: Stopping Ceph osd.3 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:16:53.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:53.078+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:53.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:52.836+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:53.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:52.923+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:53.809 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:53.528+0000 7f2e79000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:53.809 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:53.528+0000 7f2e79000640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-11T00:16:53.809 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:53.528+0000 7f2e79000640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:16:54.116 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:53.974+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:54.117 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:53.807+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:54.333 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:53.879+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:54.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:53.928+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:54.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:54 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:54.112+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:54.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:54.618+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:16:55.119 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:54 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:54.812+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:55.119 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:54 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:54.965+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:55.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:54.869+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:55.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:54.933+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:54.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:16:55.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:55 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:55.117+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:55.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:55.623+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:16:56.116 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:55 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:55.998+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:56.117 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:55 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:55.842+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:56.117 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:56 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:56.114+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:56.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:55.831+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:56.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:55.918+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:56.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:55.945+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:16:56.955 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:56.648+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:16:57.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:56.813+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:57.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:56.874+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:57.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:56.986+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:16:57.276 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:56 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:56.977+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:57.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:57 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:57.131+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:57.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:56 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:56.885+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:57.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:57.682+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:16:58.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:57.805+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:58.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:57.895+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:58.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:57.988+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:16:58.276 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:58 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3[53755]: 2024-09-11T00:16:58.017+0000 7f2e6fa00640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.299529+0000 front 2024-09-11T00:16:28.299566+0000 (oldest deadline 2024-09-11T00:16:51.799565+0000) 2024-09-11T00:16:58.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:58 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:58.111+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:58.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:57 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:57.931+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:58.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:58.666+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:16:59.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:58.762+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:16:59.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:58.910+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:16:59.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:58.951+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:16:59.178 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:58 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:58.887+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:16:59.178 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:16:59 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:16:59.119+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:16:59.526 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:59 smithi033 podman[108582]: 2024-09-11 00:16:59.327748173 +0000 UTC m=+5.977023779 container died b219487a3e31a0f4626e4c35fa03becc504467849aac0ef25cbaf97997e797ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:16:59.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:16:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:16:59.630+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:00.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:16:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:16:59.755+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:00.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:16:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:16:59.882+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:00.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:16:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:16:59.932+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:00.170 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:16:59 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:16:59.867+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:00.171 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:59 smithi033 podman[108582]: 2024-09-11 00:16:59.918921413 +0000 UTC m=+6.568197018 container cleanup b219487a3e31a0f4626e4c35fa03becc504467849aac0ef25cbaf97997e797ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:17:00.171 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:16:59 smithi033 bash[108582]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3 2024-09-11T00:17:00.526 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:00 smithi033 podman[108600]: 2024-09-11 00:17:00.204084065 +0000 UTC m=+0.861897059 container remove b219487a3e31a0f4626e4c35fa03becc504467849aac0ef25cbaf97997e797ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T00:17:00.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:00 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:00.168+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:00.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:00.590+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:01.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:00.800+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:01.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:00.907+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:01.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:00.907+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:01.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:00.884+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:01.194 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:00 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:00.869+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:01.194 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:00 smithi033 podman[108698]: 2024-09-11 00:17:00.782700931 +0000 UTC m=+0.028879550 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:01.195 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:00 smithi033 podman[108698]: 2024-09-11 00:17:00.921584709 +0000 UTC m=+0.167763328 container create 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T00:17:01.518 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:01 smithi033 podman[108698]: 2024-09-11 00:17:01.241500228 +0000 UTC m=+0.487678848 container init 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T00:17:01.518 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:01 smithi033 podman[108698]: 2024-09-11 00:17:01.248420985 +0000 UTC m=+0.494599614 container start 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T00:17:01.518 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:01 smithi033 podman[108698]: 2024-09-11 00:17:01.349452129 +0000 UTC m=+0.595630764 container attach 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T00:17:01.518 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:01 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:01.192+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:01.518 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:01 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:01.192+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:01.776 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:01 smithi033 podman[108698]: 2024-09-11 00:17:01.516728426 +0000 UTC m=+0.762907045 container died 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:17:01.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:01.556+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:01.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:01.556+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:02.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:01.931+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:02.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:01.931+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:02.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:01.882+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:02.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:01.804+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:02.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:01.804+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:02.222 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:01 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:01.838+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:02.222 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:01 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:01.838+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:02.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T00:17:02.523 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:02 smithi033 podman[108721]: 2024-09-11 00:17:02.429035023 +0000 UTC m=+0.899223320 container remove 6375e894ab43eeccd6bb1900f4b43678747143587e52f9cb3885d825468b3538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:02.523 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:02 smithi033 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-11T00:17:02.523 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:02 smithi033 systemd[1]: Stopped Ceph osd.3 for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-11T00:17:02.523 INFO:journalctl@ceph.osd.3.smithi033.stdout:Sep 11 00:17:02 smithi033 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.3.service: Consumed 9min 53.199s CPU time. 2024-09-11T00:17:02.524 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:02 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:02.220+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:02.524 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:02 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:02.220+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:02.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:02.552 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T00:17:02.552 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T00:17:02.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.4 2024-09-11T00:17:02.594 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:02.285+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:02.956 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:02 smithi052 systemd[1]: Stopping Ceph osd.4 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:02.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:02.593+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:02.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:02.593+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:03.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:02.757+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:03.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:02.757+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:03.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:02.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:03.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:02.912+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:03.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:02.912+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:03.231 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:02 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:02.807+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:03.231 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:02 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:02.807+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:03.262 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:02.958+0000 7f7349e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:03.262 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:02.958+0000 7f7349e00640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-11T00:17:03.262 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:02.958+0000 7f7349e00640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:03.262 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:03 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:03.260+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:03.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:03.229+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:03.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:03.229+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:03.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:03 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:03.640+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:03.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:03 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:03.640+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:04.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:03.758+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:04.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:03 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:03.758+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:04.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:03.751+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:04.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:03.751+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:04.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:03.950+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:04.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:03.950+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:04.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:03.872+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:04.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:03.872+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:04.456 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:04 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:04.291+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:04.457 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:04 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:04.166+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:04.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:04 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:04.234+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:04.527 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:04 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:04.234+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:04.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:04 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:04.594+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:04.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:04 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:04.594+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:05.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:04 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:04.736+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:05.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:04 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:04.736+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:04.707+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:04.707+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:04.900+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:04.900+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:04.830+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:05.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:04.830+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:05.456 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:05 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:05.261+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:05.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:05 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:05.195+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:05.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:05 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:05.189+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:05.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:05 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:05.190+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:05.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:05 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:05.593+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:05.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:05 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:05.593+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:06.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:05 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:05.763+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:06.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:05 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:05.763+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:06.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:05.705+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:06.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:05.705+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:06.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:05.943+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:06.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:05.943+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:06.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:05.795+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:06.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:05.795+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:06.456 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:06 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:06.291+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:06.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:06 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:06.173+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:06.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:06 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:06.159+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:06.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:06 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:06.159+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:06.953 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:06 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:06.558+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:06.953 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:06 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:06.558+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:07.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:06 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:06.726+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:07.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:06 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:06.726+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:07.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:06.751+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:07.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:06.751+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:07.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:06.943+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:07.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:06.943+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:07.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:06.751+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:07.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:06.751+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:07.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:07 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:07.145+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:07.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:07 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:07.146+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:07.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:07 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:07.146+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:07.592 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:07 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4[44998]: 2024-09-11T00:17:07.325+0000 7f7345800640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.340616+0000 front 2024-09-11T00:16:39.340575+0000 (oldest deadline 2024-09-11T00:17:02.141234+0000) 2024-09-11T00:17:07.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:07 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:07.591+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:07.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:07 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:07.591+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:08.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:07 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:07.731+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:08.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:07 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:07.731+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:08.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:07.709+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:08.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:07.709+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:08.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:07.914+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:08.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:07.914+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:07.764+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:07.764+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:08.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:08 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:08.147+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:08.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:08 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:08.122+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:08.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:08 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:08.122+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:08.956 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:08 smithi052 podman[71075]: 2024-09-11 00:17:08.717306964 +0000 UTC m=+5.874546502 container died 6227fe1e2d64d3aba868b48e6ee3940aa9823849b4e6ac939a204cc607d3aa5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:17:08.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:08 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:08.561+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:08.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:08 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:08.561+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:09.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:08 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:08.754+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:09.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:08 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:08.754+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:09.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:08.752+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:09.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:08.752+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:09.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:08.926+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:09.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:08.926+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:08.716+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:09.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:08.716+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:09.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:09 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:09.157+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:09.456 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:09 smithi052 podman[71075]: 2024-09-11 00:17:09.238746868 +0000 UTC m=+6.395986411 container cleanup 6227fe1e2d64d3aba868b48e6ee3940aa9823849b4e6ac939a204cc607d3aa5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T00:17:09.456 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:09 smithi052 bash[71075]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4 2024-09-11T00:17:09.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:09 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:09.084+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:09.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:09 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:09.084+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:09.956 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:09 smithi052 podman[71092]: 2024-09-11 00:17:09.515607412 +0000 UTC m=+0.788063742 container remove 6227fe1e2d64d3aba868b48e6ee3940aa9823849b4e6ac939a204cc607d3aa5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-11T00:17:09.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:09 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:09.560+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:09.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:09 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:09.560+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:10.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:09 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:09.708+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:10.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:09 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:09.708+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:10.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:09.890+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:10.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:09.890+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:10.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:09.748+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:10.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:09.748+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:09.754+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:09.754+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:10.445 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:10 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:10.124+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:10.446 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71177]: 2024-09-11 00:17:10.001182101 +0000 UTC m=+0.027437890 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:10.446 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71177]: 2024-09-11 00:17:10.165370213 +0000 UTC m=+0.191625989 container create 375d2954c2994493806c0cfa1cea24a98c947461e41385089c3dacb1cfee0adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T00:17:10.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:10 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:10.062+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:10.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:10 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:10.062+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:10.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:10 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:10.536+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:10.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:10 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:10.536+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:10.706 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71177]: 2024-09-11 00:17:10.44450301 +0000 UTC m=+0.470758788 container init 375d2954c2994493806c0cfa1cea24a98c947461e41385089c3dacb1cfee0adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:10.706 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71177]: 2024-09-11 00:17:10.451314653 +0000 UTC m=+0.477570431 container start 375d2954c2994493806c0cfa1cea24a98c947461e41385089c3dacb1cfee0adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:10.706 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71177]: 2024-09-11 00:17:10.585972979 +0000 UTC m=+0.612228766 container attach 375d2954c2994493806c0cfa1cea24a98c947461e41385089c3dacb1cfee0adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T00:17:11.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:10 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:10.661+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:11.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:10 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:10.661+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:11.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:10.736+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:11.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:10.736+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:11.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:10.879+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:11.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:10.879+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:11.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:10.739+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:11.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:10.739+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:11.148 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 11 00:17:10 smithi052 podman[71200]: 2024-09-11 00:17:10.758675885 +0000 UTC m=+0.026421703 container died 375d2954c2994493806c0cfa1cea24a98c947461e41385089c3dacb1cfee0adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:11.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:11 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:11.154+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:11.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T00:17:11.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:11.045+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:11.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:11.045+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:11.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:11.045+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:11.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:11.644 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T00:17:11.645 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T00:17:11.645 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.5 2024-09-11T00:17:11.955 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:11 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:11.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:11.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:11 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:11.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:12.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:11.656+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:12.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:11 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:11.656+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:12.068 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:11.907+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:12.068 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:11.907+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:12.068 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:11.690+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:12.069 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:11.690+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:12.069 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:11 smithi189 systemd[1]: Stopping Ceph osd.5 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:12.069 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:11.773+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:12.069 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:11 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:11.773+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:12.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:12.065+0000 7f629e600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:12.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:12.065+0000 7f629e600640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-11T00:17:12.332 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:12.065+0000 7f629e600640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:12.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:12 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:12.139+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:12.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:12 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:12.139+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:12.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:12.044+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:12.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:12.044+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:12.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:12.044+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:12.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:12 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:12.478+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:12.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:12 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:12.478+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:12.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:12 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:12.478+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:13.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:12.650+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:13.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:12 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:12.650+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:13.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:12.678+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:12.678+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:12.876+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:12.876+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:12.732+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:12.732+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:13.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:12 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:12.732+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:13.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:13 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:13.149+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:13.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:13 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:13.149+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:13.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:13.053+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:13.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:13.053+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:13.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:13.053+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:13.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:13 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:13.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:13.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:13 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:13.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:13.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:13 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:13.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:14.015 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:13.700+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:14.015 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:13 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:13.700+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:14.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:13.884+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:13.884+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:13.673+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:13.673+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:13.673+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.454123+0000 front 2024-09-11T00:16:47.454102+0000 (oldest deadline 2024-09-11T00:17:12.754257+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:13.685+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:13.685+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:14.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:13 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:13.685+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:14.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:14.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:14.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:14.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:14.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:14.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:14.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:14.147+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:14.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:14.147+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:14.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:14.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:14.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:14.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:14.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:14 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:14.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:14.984 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:14.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:14.984 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:14.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:14.720+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:14.720+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:14.720+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.454123+0000 front 2024-09-11T00:16:47.454102+0000 (oldest deadline 2024-09-11T00:17:12.754257+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:14.669+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:14.669+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:14.985 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:14 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:14.669+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:15.014 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:14.732+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:15.014 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:14 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:14.732+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:15.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:15.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:15.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:15.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:15.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:15.013+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:15.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:15 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:15.177+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:15.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:15 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:15.177+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:15.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:15 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:15.517+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:15.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:15 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:15.517+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:15.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:15 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:15.517+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:16.007 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:15.712+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:16.007 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:15.712+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:15.712+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.454123+0000 front 2024-09-11T00:16:47.454102+0000 (oldest deadline 2024-09-11T00:17:12.754257+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:15.876+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:15.876+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:15.876+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:15.638+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:15.638+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:16.008 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:15 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:15.638+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:16.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:15.739+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:16.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:15.739+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:16.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:15.739+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:16.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:16 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:16.134+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:16.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:16 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:16.134+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:16.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:16.035+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:16.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:16.035+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:16.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:16.035+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:16.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:16 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:16.482+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:16.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:16 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:16.482+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:16.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:16 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:16.482+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:17.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:16.738+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:17.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:16.738+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:17.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:16 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:16.738+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:17.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:16.714+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.649540+0000 front 2024-09-11T00:16:27.649777+0000 (oldest deadline 2024-09-11T00:16:51.650685+0000) 2024-09-11T00:17:17.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:16.714+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.952175+0000 front 2024-09-11T00:16:36.952153+0000 (oldest deadline 2024-09-11T00:17:01.652225+0000) 2024-09-11T00:17:17.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5[45572]: 2024-09-11T00:17:16.714+0000 7f629a000640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.454123+0000 front 2024-09-11T00:16:47.454102+0000 (oldest deadline 2024-09-11T00:17:12.754257+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:16.895+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:16.895+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:16.895+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:16.660+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:16.660+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:17.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:16 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:16.660+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:17.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:17.097+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:17.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:17.097+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:17.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:17.066+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:17.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:17.066+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:17.526 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:17.066+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:17.832 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:17.682+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:17.832 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:17.682+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:17.832 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:17.682+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:17.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:17.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:17.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:17.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:17.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:17 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:17.508+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:18.082 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:17 smithi189 podman[70302]: 2024-09-11 00:17:17.831056586 +0000 UTC m=+5.895111059 container died f08edb820f2f176a48e9f0fd0ce0229ae377760c43a236a1be2423c092d6ca5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:17:18.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:17.900+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:18.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:17.900+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:18.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:17 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:17.900+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:18.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:18.027+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:18.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:18.027+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:18.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:18.027+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:18.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:17.787+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:18.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:17.787+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:18.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:17.787+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:18.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:18 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:18.052+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:18.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:18 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:18.052+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:18.583 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:18 smithi189 podman[70302]: 2024-09-11 00:17:18.380659963 +0000 UTC m=+6.444714435 container cleanup f08edb820f2f176a48e9f0fd0ce0229ae377760c43a236a1be2423c092d6ca5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:17:18.583 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:18 smithi189 bash[70302]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5 2024-09-11T00:17:18.929 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:18 smithi189 podman[70331]: 2024-09-11 00:17:18.674021095 +0000 UTC m=+0.839728468 container remove f08edb820f2f176a48e9f0fd0ce0229ae377760c43a236a1be2423c092d6ca5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-11T00:17:18.929 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:18.649+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:18.929 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:18.649+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:18.929 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:18.649+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:18.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:18 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:18.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:18.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:18 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:18.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:18.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:18 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:18.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:19.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.008+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:19.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.008+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:19.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.008+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:19.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:18.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:19.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:18.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:19.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:18 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:18.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:18.926+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:18.926+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:18 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:18.926+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:19.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:19.017+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:19.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:19.017+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:19.582 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.198603606 +0000 UTC m=+0.027107357 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:19.582 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.352503508 +0000 UTC m=+0.181007261 container create c145f87c436cc773b42caca6bebf7251dd5be600d1a08b7f41a27aab0dbb0188 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:19.699+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:19.699+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:19.699+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.661123814 +0000 UTC m=+0.489627565 container init c145f87c436cc773b42caca6bebf7251dd5be600d1a08b7f41a27aab0dbb0188 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.6679425 +0000 UTC m=+0.496446251 container start c145f87c436cc773b42caca6bebf7251dd5be600d1a08b7f41a27aab0dbb0188 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:17:19.932 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.769063193 +0000 UTC m=+0.597566945 container attach c145f87c436cc773b42caca6bebf7251dd5be600d1a08b7f41a27aab0dbb0188 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:17:19.955 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:19.460+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:19.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:19.460+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:19.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:19.460+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:20.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.984+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:20.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.984+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:20.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:19.984+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:20.278 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:19.800+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:20.278 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:19.800+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:20.278 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:19 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:19.800+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:20.323 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 11 00:17:19 smithi189 podman[70417]: 2024-09-11 00:17:19.931096309 +0000 UTC m=+0.759600073 container died c145f87c436cc773b42caca6bebf7251dd5be600d1a08b7f41a27aab0dbb0188 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:20.324 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:19.939+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:20.324 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:19.939+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:20.324 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:19.939+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:20.324 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:19 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:19.939+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:20.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:19.970+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:20.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:19 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:19.970+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:20.753 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T00:17:20.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:20.830 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T00:17:20.830 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T00:17:20.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.6 2024-09-11T00:17:20.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:20.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:20.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:20.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:20.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:20.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:20.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:20.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:20.985 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:20.690+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:20.986 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:20.690+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:20.986 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:20.690+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:21.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:20.819+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:20.819+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:20.819+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:20 smithi033 systemd[1]: Stopping Ceph osd.6 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:20.955+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:20.955+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:21.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:20 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:20.955+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:21.332 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:20.983+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:21.332 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:20.983+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:21.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:20.983+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:21.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:20 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:20.983+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:21.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:20.964+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:21.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:20 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:20.964+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:21.776 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.326+0000 7f7fe7a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:21.776 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.326+0000 7f7fe7a00640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-11T00:17:21.776 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.326+0000 7f7fe7a00640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:21.933 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:21.501+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:21.933 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:21.501+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:21.933 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:21.501+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:21.933 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:21.501+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:21.988 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:21.710+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:21.989 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:21.710+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:21.989 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:21.710+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:22.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:21.931+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:22.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:21.931+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:22.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:21 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:21.931+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:22.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:21.838+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:22.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:21.838+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:22.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:21.838+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:22.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.961+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:22.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.961+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:22.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:21 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:21.961+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:22.332 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:21.986+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:22.332 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:21.986+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:22.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:21.986+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:22.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:21 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:21.986+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:22.906 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:22.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:22.906 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:22.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:22.907 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:22.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:22.907 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:22.524+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:23.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:22.970+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:22.970+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:22.970+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:22.970+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:22.739+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:22.739+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:23.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:22 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:22.739+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:23.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:22.903+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:23.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:22.903+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:23.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:22 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:22.903+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:23.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:22.805+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:23.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:22.805+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:23.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:22.805+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:23.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:22.805+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:23.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:22.922+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:23.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:22.922+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:23.278 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:22.922+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:23.278 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:22 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:22.922+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:56.894991+0000 front 2024-09-11T00:16:56.895075+0000 (oldest deadline 2024-09-11T00:17:22.795104+0000) 2024-09-11T00:17:23.924 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:23.546+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:23.924 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:23.546+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:23.924 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:23.546+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:23.924 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:23.546+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:23.785+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:23.785+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:23.785+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:23.948+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:23.948+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:24.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:23.948+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:24.084 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:23 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:23.948+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:24.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:23.922+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:24.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:23.922+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:24.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:23 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:23.922+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:24.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:23.956+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:24.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:23.956+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:24.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:23.956+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:24.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:23.956+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:56.894991+0000 front 2024-09-11T00:16:56.895075+0000 (oldest deadline 2024-09-11T00:17:22.795104+0000) 2024-09-11T00:17:24.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:23.783+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:24.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:23.783+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:24.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:23.783+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:24.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:23.783+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:24.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:24.550+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:24.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:24.550+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:24.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:24.550+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:24.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:24.550+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:25.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:24.774+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:25.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:24.774+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:25.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:24.774+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:25.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:24.774+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:25.027 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:24.998+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:25.027 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:24.998+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:25.027 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:24.998+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:25.027 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:24 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:24.998+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:56.894991+0000 front 2024-09-11T00:16:56.895075+0000 (oldest deadline 2024-09-11T00:17:22.795104+0000) 2024-09-11T00:17:25.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:24.742+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:24.742+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:24.742+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:24.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:24.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:24.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:25.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:24 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:24.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:25.302 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:24.967+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:25.302 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:24.967+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:25.302 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:24 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:24.967+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:25.624 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:25 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:25.502+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:25.624 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:25 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:25.502+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:25.625 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:25 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:25.502+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:25.625 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:25 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:25.502+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:26.016 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:25.759+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:26.016 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:25.759+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:26.016 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:25.759+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:26.017 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:25 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:25.759+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:26.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:25.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:25.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:25.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:25.922+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:25.774+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:25.774+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:26.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:25 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:25.774+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:26.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:26.014+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:28.086521+0000 front 2024-09-11T00:16:28.086671+0000 (oldest deadline 2024-09-11T00:16:51.486932+0000) 2024-09-11T00:17:26.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:26.014+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:36.188221+0000 front 2024-09-11T00:16:36.188068+0000 (oldest deadline 2024-09-11T00:17:00.888140+0000) 2024-09-11T00:17:26.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:26.014+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.792418+0000 front 2024-09-11T00:16:48.792329+0000 (oldest deadline 2024-09-11T00:17:10.492558+0000) 2024-09-11T00:17:26.277 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6[60264]: 2024-09-11T00:17:26.014+0000 7f7fe3400640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:56.894991+0000 front 2024-09-11T00:16:56.895075+0000 (oldest deadline 2024-09-11T00:17:22.795104+0000) 2024-09-11T00:17:26.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:25.999+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:26.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:25.999+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:26.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:25.999+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:26.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:26.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:26.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:26.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:26.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:26.456+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:26.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:26 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:26.456+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:27.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:26.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:26.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:26.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:26.918+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:26.918+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:26.918+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:27.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:26 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:26.918+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:27.276 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:26 smithi033 podman[108800]: 2024-09-11 00:17:26.945567327 +0000 UTC m=+5.826181858 container died 50af67c1ca87ce7f0952e1931ae8f40213139aa6595131afe1cd249d43296962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T00:17:27.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:26.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:27.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:26.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:27.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:26.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:27.277 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:26 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:26.798+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:27.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:27.049+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:27.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:27.049+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:27.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:27.049+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:27.719 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:27 smithi033 podman[108800]: 2024-09-11 00:17:27.507903231 +0000 UTC m=+6.388517765 container cleanup 50af67c1ca87ce7f0952e1931ae8f40213139aa6595131afe1cd249d43296962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:17:27.719 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:27 smithi033 bash[108800]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6 2024-09-11T00:17:27.873 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:27.780+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:27.873 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:27.780+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:27.873 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:27.780+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:27.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:27.483+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:27.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:27.483+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:27.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:27.483+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:27.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:27 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:27.483+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:28.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:27 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:27.829+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:28.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:27 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:27.829+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:28.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:27 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:27.829+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:28.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:27 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:27.829+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:28.027 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:27 smithi033 podman[108816]: 2024-09-11 00:17:27.717802846 +0000 UTC m=+0.747139199 container remove 50af67c1ca87ce7f0952e1931ae8f40213139aa6595131afe1cd249d43296962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T00:17:28.332 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:27.871+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:28.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:27.871+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:28.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:27.871+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:28.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:27 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:27.871+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:28.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:28.060+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:28.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:28.060+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:28.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:28.060+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:28.605 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.181480889 +0000 UTC m=+0.027771629 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:28.605 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.310176636 +0000 UTC m=+0.156467370 container create d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.604300208 +0000 UTC m=+0.450590950 container init d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.611353556 +0000 UTC m=+0.457644285 container start d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.704193701 +0000 UTC m=+0.550484433 container attach d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:28 smithi033 podman[108910]: 2024-09-11 00:17:28.864705128 +0000 UTC m=+0.710995872 container died d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:28 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:28.825+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:28 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:28.825+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:28 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:28.825+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:28.866 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:28 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:28.825+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:28.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:28.476+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:28.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:28.476+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:28.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:28.476+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:28.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:28 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:28.476+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:28.749+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:28.749+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:28.749+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:28.885+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:28.885+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:28.885+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:29.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:28 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:28.885+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:29.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:29.036+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:29.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:29.036+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:29.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:29.036+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:29.787 INFO:journalctl@ceph.osd.6.smithi033.stdout:Sep 11 00:17:29 smithi033 podman[108933]: 2024-09-11 00:17:29.766607436 +0000 UTC m=+0.885506147 container remove d5847c6548e8b4143e173bd0619149970b6f7e1cf759e017cc6fae12d6f3ff23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T00:17:29.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T00:17:29.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:29.872 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T00:17:29.872 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T00:17:29.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.7 2024-09-11T00:17:29.929 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:29.486+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:29.929 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:29.486+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:29.929 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:29.486+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:29.929 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:29 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:29.486+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:29.850+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:29.850+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:29.850+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:29.850+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:29.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:30.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:29.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:30.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:29.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:30.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:29 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:29.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:30.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:29 smithi052 systemd[1]: Stopping Ceph osd.7 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:30.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.042+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:30.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.042+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:30.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.042+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:30.206 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.042+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:30.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:29.792+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:30.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:29.792+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:30.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:29.792+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:30.276 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:29.792+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:30.706 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.329+0000 7efccf400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:30.706 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.329+0000 7efccf400640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-11T00:17:30.706 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:30.329+0000 7efccf400640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:30.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:30.492+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:30.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:30.492+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:30.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:30.492+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:30.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:30 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:30.492+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:31.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:30.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:31.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:30.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:31.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:30.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:31.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:30.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:31.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:30.768+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:31.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:30.768+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:31.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:30.768+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:31.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:30 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:30.768+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:31.222 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:30 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:30.824+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:31.223 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:30 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:30.824+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:31.223 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:30 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:30.824+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:31.223 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:30 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:30.824+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:31.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:31.028+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:31.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:31.028+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:31.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:31.028+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:31.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:31.028+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:31.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:31.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:31.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:31.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:31.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:31.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:31.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:31.504+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:32.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:31 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:31.782+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:32.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:31 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:31.782+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:32.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:31 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:31.782+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:32.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:31 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:31.782+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:32.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:31.825+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:31.825+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:31.825+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:31.825+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:31.787+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:31.787+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:31.787+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:32.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:31 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:31.787+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:32.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:32.051+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:32.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:32.051+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:32.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:32.051+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:32.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:32.051+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:32.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:32.500+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:32.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:32.500+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:32.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:32.500+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:32.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:32 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:32.500+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:33.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:32 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:32.743+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:33.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:32 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:32.743+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:33.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:32 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:32.743+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:33.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:32 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:32.743+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:33.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:32.805+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:32.805+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:32.805+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:32.805+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:32.753+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:32.753+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:32.753+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:33.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:32 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:32.753+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:33.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:33.018+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:33.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:33.018+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:33.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:33.018+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:33.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:33.018+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:33.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:33.485+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:33.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:33.485+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:33.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:33.485+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:33.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:33.485+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:33.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:33 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:33.485+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:34.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:33 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:33.722+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:34.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:33 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:33.722+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:34.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:33 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:33.722+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:34.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:33 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:33.722+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:34.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:33 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:33.722+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:34.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:33.768+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:34.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:33.768+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:34.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:33.768+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:34.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:33.768+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:34.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:33.777+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:34.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:33.777+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:34.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:33.777+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:34.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:33 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:33.777+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:34.451 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:34.058+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:34.451 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:34.058+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:34.451 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:34.058+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:34.451 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:34.058+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:34.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:34.449+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:34.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:34.449+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:34.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:34.449+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:34.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:34.449+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:34.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:34 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:34.449+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:35.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:34 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:34.701+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:35.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:34 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:34.701+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:35.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:34 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:34.701+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:35.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:34 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:34.701+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:35.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:34 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:34.701+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:34.791+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:34.791+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:34.791+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:34.791+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:34.816+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:34.816+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:35.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:34.816+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:35.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:34 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:34.816+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:35.405 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:35.068+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.405688+0000 front 2024-09-11T00:16:38.405724+0000 (oldest deadline 2024-09-11T00:17:03.705830+0000) 2024-09-11T00:17:35.405 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:35.068+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.307913+0000 front 2024-09-11T00:16:48.307862+0000 (oldest deadline 2024-09-11T00:17:11.207815+0000) 2024-09-11T00:17:35.405 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:35.068+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.309489+0000 front 2024-09-11T00:16:55.309351+0000 (oldest deadline 2024-09-11T00:17:21.209209+0000) 2024-09-11T00:17:35.405 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7[51924]: 2024-09-11T00:17:35.068+0000 7efccae00640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.610670+0000 front 2024-09-11T00:17:07.610698+0000 (oldest deadline 2024-09-11T00:17:29.310742+0000) 2024-09-11T00:17:35.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:35.402+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:35.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:35.402+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:35.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:35.402+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:35.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:35.402+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:35.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:35 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:35.402+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:36.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:35.654+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:36.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:35.654+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:36.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:35.654+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:36.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:35.654+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:36.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:35 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:35.654+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:36.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:35.841+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:35.841+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:35.841+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:35.841+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:35.812+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:35.812+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:35.812+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:36.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:35 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:35.812+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:36.418 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:36 smithi052 podman[71289]: 2024-09-11 00:17:36.193244242 +0000 UTC m=+6.032103916 container died 53e9acd1db1ce78a0a02fb7845fab563c1e271a7cf77ab1eb432217de148c418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T00:17:36.690 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:36.416+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:36.690 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:36.416+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:36.690 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:36.416+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:36.690 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:36.416+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:36.690 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:36.416+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:36.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:36 smithi052 podman[71289]: 2024-09-11 00:17:36.838702273 +0000 UTC m=+6.677561955 container cleanup 53e9acd1db1ce78a0a02fb7845fab563c1e271a7cf77ab1eb432217de148c418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T00:17:36.956 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:36 smithi052 bash[71289]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7 2024-09-11T00:17:37.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:36.690+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:37.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:36.690+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:37.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:36.690+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:37.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:36.690+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:37.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:36 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:36.690+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:37.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:36.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:36.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:36.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:36.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:36.823+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:36.823+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:36.823+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:37.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:36 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:36.823+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:37.456 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:37 smithi052 podman[71305]: 2024-09-11 00:17:37.078410795 +0000 UTC m=+0.874348907 container remove 53e9acd1db1ce78a0a02fb7845fab563c1e271a7cf77ab1eb432217de148c418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T00:17:37.722 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:37 smithi052 podman[71393]: 2024-09-11 00:17:37.519495029 +0000 UTC m=+0.027481561 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:37.722 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:37 smithi052 podman[71393]: 2024-09-11 00:17:37.721078994 +0000 UTC m=+0.229065509 container create ddf3edebf0d70a1546230deea0c51d39aa6fc83700c8ee9f546575382293b838 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:17:37.722 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:37 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:37.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:37.723 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:37 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:37.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:37.723 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:37 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:37.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:37.723 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:37 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:37.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:37.723 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:37 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:37.455+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:38.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:37.668+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:38.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:37.668+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:38.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:37.668+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:38.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:37.668+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:38.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:37 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:37.668+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:38.068 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:38 smithi052 podman[71393]: 2024-09-11 00:17:38.067559137 +0000 UTC m=+0.575545678 container init ddf3edebf0d70a1546230deea0c51d39aa6fc83700c8ee9f546575382293b838 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T00:17:38.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:37.858+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:38.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:37.858+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:38.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:37.858+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:38.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:37.858+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:38.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:37.816+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:38.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:37.817+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:38.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:37.817+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:38.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:37 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:37.817+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:38.342 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:38 smithi052 podman[71393]: 2024-09-11 00:17:38.074337563 +0000 UTC m=+0.582324089 container start ddf3edebf0d70a1546230deea0c51d39aa6fc83700c8ee9f546575382293b838 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:38.342 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:38 smithi052 podman[71393]: 2024-09-11 00:17:38.175648284 +0000 UTC m=+0.683634843 container attach ddf3edebf0d70a1546230deea0c51d39aa6fc83700c8ee9f546575382293b838 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 11 00:17:38 smithi052 podman[71393]: 2024-09-11 00:17:38.34169364 +0000 UTC m=+0.849680168 container died ddf3edebf0d70a1546230deea0c51d39aa6fc83700c8ee9f546575382293b838 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:38 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:38.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:38 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:38.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:38 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:38.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:38 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:38.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:38.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:38 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:38.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:39.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:38 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:38.652+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:39.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:38 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:38.652+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:39.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:38 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:38.652+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:39.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:38 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:38.652+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:39.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:38 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:38.652+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:39.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:38.824+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:38.824+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:38.824+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:38.824+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:38.852+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:38.852+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:38.852+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:38.852+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:39.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:38 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:38.852+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:39.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T00:17:39.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:39.247 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T00:17:39.248 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T00:17:39.248 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.8 2024-09-11T00:17:39.582 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 systemd[1]: Stopping Ceph osd.8 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:39.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:39 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:39.443+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:39.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:39 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:39.443+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:39.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:39 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:39.443+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:39.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:39 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:39.443+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:39.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:39 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:39.443+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:40.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:39 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:39.612+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:40.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:39 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:39.612+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:40.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:39 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:39.612+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:40.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:39 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:39.612+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:40.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:39 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:39.612+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:40.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:39.834+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:39.834+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:39.834+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:39.834+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:39.834+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.679+0000 7fdefa400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.679+0000 7fdefa400640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.679+0000 7fdefa400640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.822+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:40.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.822+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:40.084 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.822+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:40.084 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:39 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:39.822+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:40.596 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:40.400+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:40.596 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:40.400+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:40.596 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:40.400+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:40.596 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:40.400+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:40.596 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:40.400+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:41.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:40.606+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:41.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:40.606+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:41.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:40.606+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:41.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:40.606+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:41.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:40 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:40.606+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:41.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:40.857+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:40.857+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:40.857+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:40.857+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:40.857+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:15.573854+0000 front 2024-09-11T00:17:15.573883+0000 (oldest deadline 2024-09-11T00:17:40.274109+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:40.806+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:40.806+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:40.806+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:40.806+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:41.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:40 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:40.806+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:41.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:41 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:41.404+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:41.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:41 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:41.404+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:41.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:41 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:41.404+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:41.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:41 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:41.404+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:41.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:41 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:41.404+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:41.870 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:41.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:41.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:41.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:41.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:41.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:41 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:41.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:42.082 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:41.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:41.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:41.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:41.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:41.829+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:15.573854+0000 front 2024-09-11T00:17:15.573883+0000 (oldest deadline 2024-09-11T00:17:40.274109+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:41.829+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:41.829+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:41.829+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:41.829+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:42.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:41 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:41.829+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:42.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:42.376+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:42.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:42.376+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:42.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:42.376+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:42.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:42.376+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:42.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:42 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:42.376+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:42.776 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:42.776 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:42.776 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:42.776 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:42.777 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:42.777 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:42 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:42.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:42.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:42.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:42.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:42.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:42.835+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:15.573854+0000 front 2024-09-11T00:17:15.573883+0000 (oldest deadline 2024-09-11T00:17:40.274109+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:42.877+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:42.877+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:42.877+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:42.877+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:43.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:42 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:42.877+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:43.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:43 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:43.363+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:43.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:43 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:43.363+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:43.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:43 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:43.363+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:43.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:43 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:43.363+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:43.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:43 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:43.363+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:44.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:43 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:43.604+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:43.820+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.062475+0000 front 2024-09-11T00:16:27.062609+0000 (oldest deadline 2024-09-11T00:16:51.762496+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:43.820+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:38.164352+0000 front 2024-09-11T00:16:38.164321+0000 (oldest deadline 2024-09-11T00:17:00.464059+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:43.820+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.465554+0000 front 2024-09-11T00:16:47.465570+0000 (oldest deadline 2024-09-11T00:17:15.066251+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:43.820+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:55.066951+0000 front 2024-09-11T00:16:55.066923+0000 (oldest deadline 2024-09-11T00:17:19.766854+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8[52601]: 2024-09-11T00:17:43.820+0000 7fdef0e00640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:15.573854+0000 front 2024-09-11T00:17:15.573883+0000 (oldest deadline 2024-09-11T00:17:40.274109+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:43.865+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:43.865+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:44.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:43.865+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:44.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:43.865+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:44.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:43 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:43.865+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:44.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:44.410+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:45.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:45.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:45.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:45.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:45.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:45.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:44 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:44.579+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:45.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:44.820+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:45.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:44.820+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:45.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:44.820+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:45.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:44.820+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:45.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:44 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:44.820+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:45.582 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:45 smithi189 podman[70519]: 2024-09-11 00:17:45.292785102 +0000 UTC m=+5.759779669 container died ef4a2c7e46225b9f7e5a268b90bee0c57e5ade7ee7568b62e912bb41a60ba262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T00:17:45.910 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:45 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:45.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:45.910 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:45 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:45.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:45.910 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:45 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:45.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:45.910 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:45 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:45.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:45.910 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:45 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:45.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:45.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:45 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:45.457+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:46.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:46.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:46.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:46.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:46.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:46.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:45 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:45.542+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:46.228 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:45 smithi189 podman[70519]: 2024-09-11 00:17:45.909248191 +0000 UTC m=+6.376242764 container cleanup ef4a2c7e46225b9f7e5a268b90bee0c57e5ade7ee7568b62e912bb41a60ba262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:17:46.228 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:45 smithi189 bash[70519]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8 2024-09-11T00:17:46.582 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:46 smithi189 podman[70548]: 2024-09-11 00:17:46.227349968 +0000 UTC m=+0.920233841 container remove ef4a2c7e46225b9f7e5a268b90bee0c57e5ade7ee7568b62e912bb41a60ba262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:46.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:46 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:46.411+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:47.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:47.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:47.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:47.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:47.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:47.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:46 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:46.582+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:46 smithi189 podman[70642]: 2024-09-11 00:17:46.734178813 +0000 UTC m=+0.026526203 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:46 smithi189 podman[70642]: 2024-09-11 00:17:46.88653149 +0000 UTC m=+0.178878874 container create 146d81813dfecabfc42ab061bdba17cb8e4f0dc716732d15b185d7165953d425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:46 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:46.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:46 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:46.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:46 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:46.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:46 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:46.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:47.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:46 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:46.797+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:47.472 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:47 smithi189 podman[70642]: 2024-09-11 00:17:47.197837119 +0000 UTC m=+0.490184525 container init 146d81813dfecabfc42ab061bdba17cb8e4f0dc716732d15b185d7165953d425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:17:47.473 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:47 smithi189 podman[70642]: 2024-09-11 00:17:47.204601713 +0000 UTC m=+0.496949098 container start 146d81813dfecabfc42ab061bdba17cb8e4f0dc716732d15b185d7165953d425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T00:17:47.473 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:47 smithi189 podman[70642]: 2024-09-11 00:17:47.305855915 +0000 UTC m=+0.598203300 container attach 146d81813dfecabfc42ab061bdba17cb8e4f0dc716732d15b185d7165953d425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:47.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:47 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:47.382+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:47.802 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 11 00:17:47 smithi189 podman[70642]: 2024-09-11 00:17:47.472131659 +0000 UTC m=+0.764479053 container died 146d81813dfecabfc42ab061bdba17cb8e4f0dc716732d15b185d7165953d425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T00:17:48.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:48.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:48.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:48.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:48.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:48.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:47 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:47.573+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:48.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:47 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:47.839+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:48.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:47 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:47.839+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:48.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:47 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:47.839+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:48.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:47 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:47.839+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:48.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:47 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:47.839+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:48.159 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T00:17:48.235 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:48.236 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T00:17:48.236 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T00:17:48.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.9 2024-09-11T00:17:48.589 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 systemd[1]: Stopping Ceph osd.9 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:48.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:48 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:48.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:49.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.586+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.704+0000 7fa6b0e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.704+0000 7fa6b0e00640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-11T00:17:49.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:48 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:48.704+0000 7fa6b0e00640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:49.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:48.880+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:49.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:48.880+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:49.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:48.880+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:49.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:48.880+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:49.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:48.880+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:49.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:49 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:49.468+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:50.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:49 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:49.584+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:50.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:49 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:49.900+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:50.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:49 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:49.900+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:50.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:49 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:49.900+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:50.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:49 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:49.900+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:50.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:49 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:49.900+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:50.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:50.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:50.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:50.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:50.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:50.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:50 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:50.511+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:51.028 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:51.028 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:51.029 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:51.029 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:51.029 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:51.029 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:50 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:50.567+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:51.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:50.862+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:51.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:50.862+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:51.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:50.862+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:51.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:50.862+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:51.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:50 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:50.862+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:51.868 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:51 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:51.539+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:52.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:52.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:52.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:52.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:52.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:52.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:51 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:51.590+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:52.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:51 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:51.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:52.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:52.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:52.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:52.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:52.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:52.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:52.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:52 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:52.497+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:53.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:53.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:53.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:53.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:53.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:53.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:52 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:52.574+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:53.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:53.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:53.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:53.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:53.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:53.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:52.905+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:53.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:53.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:53.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:53.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:53.956 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:53.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:53.957 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:53 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:53.465+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:54.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:26.910949+0000 front 2024-09-11T00:16:26.910982+0000 (oldest deadline 2024-09-11T00:16:53.311927+0000) 2024-09-11T00:17:54.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.413305+0000 front 2024-09-11T00:16:37.413332+0000 (oldest deadline 2024-09-11T00:17:00.913567+0000) 2024-09-11T00:17:54.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:49.016261+0000 front 2024-09-11T00:16:49.016211+0000 (oldest deadline 2024-09-11T00:17:14.916358+0000) 2024-09-11T00:17:54.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:57.217360+0000 front 2024-09-11T00:16:57.217412+0000 (oldest deadline 2024-09-11T00:17:22.517491+0000) 2024-09-11T00:17:54.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.818546+0000 front 2024-09-11T00:17:07.818681+0000 (oldest deadline 2024-09-11T00:17:33.718470+0000) 2024-09-11T00:17:54.027 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:53 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9[66898]: 2024-09-11T00:17:53.562+0000 7fa6a7800640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:13.719200+0000 front 2024-09-11T00:17:13.719131+0000 (oldest deadline 2024-09-11T00:17:40.719370+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:54.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:53 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:53.947+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:54.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:54.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:54.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:54.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:54.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:54.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:54.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:54 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:54.437+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:54.871 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:54 smithi033 podman[109026]: 2024-09-11 00:17:54.533058512 +0000 UTC m=+6.002482409 container died da36a338a977caffc077620942a57e9afa87b644c0d7a9df502f79f5d1399270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:17:55.218 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:54 smithi033 podman[109026]: 2024-09-11 00:17:54.992900905 +0000 UTC m=+6.462324800 container cleanup da36a338a977caffc077620942a57e9afa87b644c0d7a9df502f79f5d1399270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T00:17:55.218 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:54 smithi033 bash[109026]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:55.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:54 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:54.917+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:55.526 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:55 smithi033 podman[109044]: 2024-09-11 00:17:55.217444662 +0000 UTC m=+0.674738734 container remove da36a338a977caffc077620942a57e9afa87b644c0d7a9df502f79f5d1399270 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:55.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:55.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:55 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:55.391+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:56.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:55 smithi033 podman[109135]: 2024-09-11 00:17:55.669893188 +0000 UTC m=+0.027648635 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:56.026 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:55 smithi033 podman[109135]: 2024-09-11 00:17:55.786920865 +0000 UTC m=+0.144676296 container create d610a396fa20d085958dba7825b3471755982f64224a70a854f3c4b39da43efc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:56.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:55 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:55.923+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:56.358 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:56 smithi033 podman[109135]: 2024-09-11 00:17:56.081173766 +0000 UTC m=+0.438929226 container init d610a396fa20d085958dba7825b3471755982f64224a70a854f3c4b39da43efc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T00:17:56.358 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:56 smithi033 podman[109135]: 2024-09-11 00:17:56.088164095 +0000 UTC m=+0.445919526 container start d610a396fa20d085958dba7825b3471755982f64224a70a854f3c4b39da43efc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T00:17:56.358 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:56 smithi033 podman[109135]: 2024-09-11 00:17:56.172469702 +0000 UTC m=+0.530225136 container attach d610a396fa20d085958dba7825b3471755982f64224a70a854f3c4b39da43efc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:56.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:56 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:56.408+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:56.725 INFO:journalctl@ceph.osd.9.smithi033.stdout:Sep 11 00:17:56 smithi033 podman[109135]: 2024-09-11 00:17:56.35768227 +0000 UTC m=+0.715437710 container died d610a396fa20d085958dba7825b3471755982f64224a70a854f3c4b39da43efc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T00:17:57.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T00:17:57.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:17:57.294 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T00:17:57.294 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T00:17:57.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.10 2024-09-11T00:17:57.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:57.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:57.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:57.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:57.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:57.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:56.914+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:57.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 systemd[1]: Stopping Ceph osd.10 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:17:57.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:57.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:57.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:57.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:57.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:57.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:57.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.427+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:58.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.726+0000 7fb09d000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:58.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.726+0000 7fb09d000640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-11T00:17:58.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:57 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:57.726+0000 7fb09d000640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:58.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:57 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:57.881+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:58.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:58.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:58 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:58.453+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:17:59.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:17:59.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:58 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:58.921+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:17:59.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:17:59 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:17:59.441+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:18:00.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:00.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:00.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:00.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:00.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:00.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:00.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:17:59 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:17:59.940+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:18:00.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:18:00.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:00 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:00.422+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:01.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:00 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:00.930+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:01.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:18:01.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:18:01.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:18:01.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:18:01.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:18:01.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:18:01.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:01 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:01.412+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:02.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:01.942+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:27.724849+0000 front 2024-09-11T00:16:27.725293+0000 (oldest deadline 2024-09-11T00:16:53.624696+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:37.026490+0000 front 2024-09-11T00:16:37.026527+0000 (oldest deadline 2024-09-11T00:17:01.126562+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:47.528409+0000 front 2024-09-11T00:16:47.528559+0000 (oldest deadline 2024-09-11T00:17:11.628368+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-09-11T00:16:58.030037+0000 front 2024-09-11T00:16:58.030134+0000 (oldest deadline 2024-09-11T00:17:19.730081+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:07.832218+0000 front 2024-09-11T00:17:07.832267+0000 (oldest deadline 2024-09-11T00:17:32.532454+0000) 2024-09-11T00:18:02.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:16.633365+0000 front 2024-09-11T00:17:16.633412+0000 (oldest deadline 2024-09-11T00:17:43.634113+0000) 2024-09-11T00:18:02.707 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:02 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10[59028]: 2024-09-11T00:18:02.431+0000 7fb093a00640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.335259+0000 front 2024-09-11T00:17:25.335336+0000 (oldest deadline 2024-09-11T00:17:50.635337+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:03.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:02 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:02.937+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:03.706 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:03 smithi052 podman[71508]: 2024-09-11 00:18:03.389786012 +0000 UTC m=+5.797573773 container died 52201543a2dc9875ff90938dd32a734e6c349120983ce2e1eec4460240059034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T00:18:04.109 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:03 smithi052 podman[71508]: 2024-09-11 00:18:03.84802977 +0000 UTC m=+6.255817529 container cleanup 52201543a2dc9875ff90938dd32a734e6c349120983ce2e1eec4460240059034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T00:18:04.109 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:03 smithi052 bash[71508]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:04.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:03 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:03.953+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:04.455 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:04 smithi052 podman[71524]: 2024-09-11 00:18:04.107545365 +0000 UTC m=+0.712664139 container remove 52201543a2dc9875ff90938dd32a734e6c349120983ce2e1eec4460240059034 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:18:04.953 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:04 smithi052 podman[71610]: 2024-09-11 00:18:04.554593549 +0000 UTC m=+0.027960021 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:18:04.953 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:04 smithi052 podman[71610]: 2024-09-11 00:18:04.674985649 +0000 UTC m=+0.148352116 container create e69a9bfbe56134f914aba241c82813040896018bacb8ca5e029e84b8f771ff85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T00:18:04.953 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:04 smithi052 podman[71610]: 2024-09-11 00:18:04.952456473 +0000 UTC m=+0.425822933 container init e69a9bfbe56134f914aba241c82813040896018bacb8ca5e029e84b8f771ff85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:18:05.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:04 smithi052 podman[71610]: 2024-09-11 00:18:04.959254 +0000 UTC m=+0.432620468 container start e69a9bfbe56134f914aba241c82813040896018bacb8ca5e029e84b8f771ff85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:18:05.206 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:05 smithi052 podman[71610]: 2024-09-11 00:18:05.043633937 +0000 UTC m=+0.517000412 container attach e69a9bfbe56134f914aba241c82813040896018bacb8ca5e029e84b8f771ff85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:18:05.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:05.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:04 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:04.913+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:05.611 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 11 00:18:05 smithi052 podman[71610]: 2024-09-11 00:18:05.239468373 +0000 UTC m=+0.712834833 container died e69a9bfbe56134f914aba241c82813040896018bacb8ca5e029e84b8f771ff85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:18:05.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T00:18:06.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:06.008 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T00:18:06.008 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T00:18:06.008 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.11 2024-09-11T00:18:06.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:06.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:06.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:06.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:06.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:06.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:06.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:05 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:05.893+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:06.334 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 systemd[1]: Stopping Ceph osd.11 for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:06.832 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.429+0000 7f0969e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:06.832 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.429+0000 7f0969e00640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-11T00:18:06.833 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.429+0000 7f0969e00640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:07.333 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:06 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:06.846+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-11T00:17:42.536027+0000 front 2024-09-11T00:17:42.536079+0000 (oldest deadline 2024-09-11T00:18:06.635990+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:08.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:07 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:07.803+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-11T00:17:42.536027+0000 front 2024-09-11T00:17:42.536079+0000 (oldest deadline 2024-09-11T00:18:06.635990+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:09.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:08 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:08.779+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-11T00:17:42.536027+0000 front 2024-09-11T00:17:42.536079+0000 (oldest deadline 2024-09-11T00:18:06.635990+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:10.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:09 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:09.802+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-11T00:17:42.536027+0000 front 2024-09-11T00:17:42.536079+0000 (oldest deadline 2024-09-11T00:18:06.635990+0000) 2024-09-11T00:18:11.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-09-11T00:16:29.822633+0000 front 2024-09-11T00:16:29.822736+0000 (oldest deadline 2024-09-11T00:16:54.522620+0000) 2024-09-11T00:18:11.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-11T00:16:39.223999+0000 front 2024-09-11T00:16:39.224052+0000 (oldest deadline 2024-09-11T00:17:03.323765+0000) 2024-09-11T00:18:11.083 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-11T00:16:48.024920+0000 front 2024-09-11T00:16:48.025043+0000 (oldest deadline 2024-09-11T00:17:12.025581+0000) 2024-09-11T00:18:11.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-11T00:17:05.928665+0000 front 2024-09-11T00:17:05.928690+0000 (oldest deadline 2024-09-11T00:17:28.828944+0000) 2024-09-11T00:18:11.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-11T00:17:12.330069+0000 front 2024-09-11T00:17:12.330044+0000 (oldest deadline 2024-09-11T00:17:38.230253+0000) 2024-09-11T00:18:11.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-09-11T00:17:25.132760+0000 front 2024-09-11T00:17:25.132791+0000 (oldest deadline 2024-09-11T00:17:51.032649+0000) 2024-09-11T00:18:11.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-11T00:17:31.534108+0000 front 2024-09-11T00:17:31.534063+0000 (oldest deadline 2024-09-11T00:17:57.433941+0000) 2024-09-11T00:18:11.084 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:10 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11[59151]: 2024-09-11T00:18:10.788+0000 7f0965800640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-11T00:17:42.536027+0000 front 2024-09-11T00:17:42.536079+0000 (oldest deadline 2024-09-11T00:18:06.635990+0000) 2024-09-11T00:18:12.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:12 smithi189 podman[70744]: 2024-09-11 00:18:12.079031919 +0000 UTC m=+5.784133564 container died afbef574c2f406e8b774202df38532a6166268a48d16f77e72d1454f2945690d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T00:18:12.805 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:12 smithi189 podman[70744]: 2024-09-11 00:18:12.594083557 +0000 UTC m=+6.299185201 container cleanup afbef574c2f406e8b774202df38532a6166268a48d16f77e72d1454f2945690d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:18:12.805 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:12 smithi189 bash[70744]: ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11 2024-09-11T00:18:13.082 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:12 smithi189 podman[70763]: 2024-09-11 00:18:12.803686325 +0000 UTC m=+0.706442986 container remove afbef574c2f406e8b774202df38532a6166268a48d16f77e72d1454f2945690d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T00:18:13.650 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.244180597 +0000 UTC m=+0.027322160 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:18:13.650 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.381229616 +0000 UTC m=+0.164371168 container create 7d31618da2279d13c995925cd10289192afb23323e71354b540074e8ba71e2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T00:18:13.914 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.648839159 +0000 UTC m=+0.431980732 container init 7d31618da2279d13c995925cd10289192afb23323e71354b540074e8ba71e2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T00:18:13.915 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.655647769 +0000 UTC m=+0.438789325 container start 7d31618da2279d13c995925cd10289192afb23323e71354b540074e8ba71e2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T00:18:13.915 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.748606136 +0000 UTC m=+0.531747707 container attach 7d31618da2279d13c995925cd10289192afb23323e71354b540074e8ba71e2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T00:18:14.332 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 11 00:18:13 smithi189 podman[70847]: 2024-09-11 00:18:13.913850383 +0000 UTC m=+0.696991946 container died 7d31618da2279d13c995925cd10289192afb23323e71354b540074e8ba71e2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:18:14.674 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T00:18:14.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:14.751 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T00:18:14.752 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T00:18:14.752 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.a 2024-09-11T00:18:15.165 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:14 smithi033 systemd[1]: Stopping Ceph mds.a for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:15.526 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a[73613]: 2024-09-11T00:18:15.163+0000 7f50ebc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:15.526 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:15 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a[73613]: 2024-09-11T00:18:15.163+0000 7f50ebc00640 -1 mds.a *** got signal Terminated *** 2024-09-11T00:18:16.515 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:16 smithi033 podman[109238]: 2024-09-11 00:18:16.404943149 +0000 UTC m=+1.365178647 container died add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T00:18:17.163 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:16 smithi033 podman[109238]: 2024-09-11 00:18:16.926659322 +0000 UTC m=+1.886894820 container cleanup add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:18:17.163 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:16 smithi033 bash[109238]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a 2024-09-11T00:18:17.423 INFO:journalctl@ceph.mds.a.smithi033.stdout:Sep 11 00:18:17 smithi033 podman[109253]: 2024-09-11 00:18:17.16125368 +0000 UTC m=+0.743158370 container remove add0be645d59dc42c8d9758413359a84e582712c05479dd22cb87cdf43390ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:18:17.443 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T00:18:17.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:17.516 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T00:18:17.516 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T00:18:17.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.d 2024-09-11T00:18:17.776 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:17 smithi033 systemd[1]: Stopping Ceph mds.d for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:18.276 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d[72368]: 2024-09-11T00:18:17.958+0000 7f67e7200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:18.276 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:17 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d[72368]: 2024-09-11T00:18:17.958+0000 7f67e7200640 -1 mds.d *** got signal Terminated *** 2024-09-11T00:18:22.276 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:21 smithi033 podman[109369]: 2024-09-11 00:18:21.988575156 +0000 UTC m=+4.174744365 container died 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T00:18:22.776 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:22 smithi033 podman[109369]: 2024-09-11 00:18:22.463696808 +0000 UTC m=+4.649866017 container cleanup 0672ce1d918e8717a4afb6654436cc817a9205c7b2476973d0e28093986b3255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:18:22.776 INFO:journalctl@ceph.mds.d.smithi033.stdout:Sep 11 00:18:22 smithi033 bash[109369]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-d 2024-09-11T00:18:22.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T00:18:23.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:23.051 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T00:18:23.052 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T00:18:23.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.g 2024-09-11T00:18:23.495 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:23 smithi033 systemd[1]: Stopping Ceph mds.g for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:23.776 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g[73244]: 2024-09-11T00:18:23.493+0000 7f1c0fa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:23.776 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:23 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g[73244]: 2024-09-11T00:18:23.493+0000 7f1c0fa00640 -1 mds.g *** got signal Terminated *** 2024-09-11T00:18:27.776 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:27 smithi033 podman[109488]: 2024-09-11 00:18:27.512008663 +0000 UTC m=+4.182572674 container died d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:18:28.276 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:28 smithi033 podman[109488]: 2024-09-11 00:18:28.050920275 +0000 UTC m=+4.721484286 container cleanup d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:18:28.276 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:28 smithi033 bash[109488]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g 2024-09-11T00:18:28.546 INFO:journalctl@ceph.mds.g.smithi033.stdout:Sep 11 00:18:28 smithi033 podman[109500]: 2024-09-11 00:18:28.295124147 +0000 UTC m=+0.772895023 container remove d6f27b2c73a37cf30b7eedda78e4a3367bdf9aac7a4f9c9ee1d18f8f59dfaf6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-11T00:18:28.554 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T00:18:28.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:28.623 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T00:18:28.623 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T00:18:28.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.j 2024-09-11T00:18:29.026 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:28 smithi033 systemd[1]: Stopping Ceph mds.j for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:29.526 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j[72025]: 2024-09-11T00:18:29.024+0000 7f3c27600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:29.526 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:29 smithi033 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j[72025]: 2024-09-11T00:18:29.024+0000 7f3c27600640 -1 mds.j *** got signal Terminated *** 2024-09-11T00:18:30.778 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:30 smithi033 podman[109607]: 2024-09-11 00:18:30.526664478 +0000 UTC m=+1.632914796 container died 60fdc02714d50fc1550e43a49e605b1aaa41b2c010a52646b503684592cdcfc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T00:18:31.082 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:30 smithi033 podman[109607]: 2024-09-11 00:18:30.896277283 +0000 UTC m=+2.002527610 container cleanup 60fdc02714d50fc1550e43a49e605b1aaa41b2c010a52646b503684592cdcfc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:18:31.082 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:30 smithi033 bash[109607]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j 2024-09-11T00:18:31.337 INFO:journalctl@ceph.mds.j.smithi033.stdout:Sep 11 00:18:31 smithi033 podman[109618]: 2024-09-11 00:18:31.080586683 +0000 UTC m=+0.536768381 container remove 60fdc02714d50fc1550e43a49e605b1aaa41b2c010a52646b503684592cdcfc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:18:31.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T00:18:31.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:31.415 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T00:18:31.415 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T00:18:31.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.b 2024-09-11T00:18:31.828 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:31 smithi052 systemd[1]: Stopping Ceph mds.b for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:32.153 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: 2024-09-11T00:18:31.826+0000 7f4c5d200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:32.153 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:31 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b[64655]: 2024-09-11T00:18:31.826+0000 7f4c5d200640 -1 mds.b *** got signal Terminated *** 2024-09-11T00:18:34.956 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:34 smithi052 podman[71712]: 2024-09-11 00:18:34.678664814 +0000 UTC m=+2.963268172 container died d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-11T00:18:35.456 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 podman[71712]: 2024-09-11 00:18:35.14766692 +0000 UTC m=+3.432270271 container cleanup d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:18:35.456 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 bash[71712]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b 2024-09-11T00:18:35.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T00:18:35.752 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 podman[71737]: 2024-09-11 00:18:35.498537131 +0000 UTC m=+0.807004200 container remove d60ece56d4ab4ef79f9433f1f7dab27d023a93d067bde4c0244f89f078be5431 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T00:18:35.752 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-11T00:18:35.752 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 systemd[1]: Stopped Ceph mds.b for 63242646-6fce-11ef-bcea-c7b262605968. 2024-09-11T00:18:35.752 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 11 00:18:35 smithi052 systemd[1]: ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.b.service: Consumed 59.195s CPU time. 2024-09-11T00:18:35.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:35.777 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T00:18:35.777 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T00:18:35.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.e 2024-09-11T00:18:36.181 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:35 smithi052 systemd[1]: Stopping Ceph mds.e for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:36.456 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: 2024-09-11T00:18:36.178+0000 7fda93600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:36.456 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:36 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e[64061]: 2024-09-11T00:18:36.178+0000 7fda93600640 -1 mds.e *** got signal Terminated *** 2024-09-11T00:18:38.956 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:38 smithi052 podman[71844]: 2024-09-11 00:18:38.675908792 +0000 UTC m=+2.617858782 container died 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:18:39.456 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:39 smithi052 podman[71844]: 2024-09-11 00:18:39.176082875 +0000 UTC m=+3.118032864 container cleanup 46fdbd10f1ed99cb7f4aedcab0d86db7ad1241103e8d6c19543b76fe989e704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:18:39.456 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 11 00:18:39 smithi052 bash[71844]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-e 2024-09-11T00:18:39.676 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T00:18:39.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:39.747 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T00:18:39.747 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T00:18:39.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.h 2024-09-11T00:18:40.206 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:39 smithi052 systemd[1]: Stopping Ceph mds.h for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:40.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: 2024-09-11T00:18:40.265+0000 7f4994000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:40.706 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:40 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h[64356]: 2024-09-11T00:18:40.265+0000 7f4994000640 -1 mds.h *** got signal Terminated *** 2024-09-11T00:18:42.956 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:42 smithi052 podman[71962]: 2024-09-11 00:18:42.66599249 +0000 UTC m=+2.644638005 container died ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:18:43.390 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:43 smithi052 podman[71962]: 2024-09-11 00:18:43.129515898 +0000 UTC m=+3.108161412 container cleanup ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:18:43.390 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:43 smithi052 bash[71962]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h 2024-09-11T00:18:43.661 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 11 00:18:43 smithi052 podman[71975]: 2024-09-11 00:18:43.389060865 +0000 UTC m=+0.708601311 container remove ae71f83257d9a382f694a09e854c618f8f8425089b5c938d581873eae8f49566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T00:18:43.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T00:18:43.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:43.756 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T00:18:43.756 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T00:18:43.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.k 2024-09-11T00:18:43.956 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:43 smithi052 systemd[1]: Stopping Ceph mds.k for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:44.456 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: 2024-09-11T00:18:44.151+0000 7f786e000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:44.456 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:44 smithi052 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k[63752]: 2024-09-11T00:18:44.151+0000 7f786e000640 -1 mds.k *** got signal Terminated *** 2024-09-11T00:18:46.934 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:46 smithi052 podman[72078]: 2024-09-11 00:18:46.67497337 +0000 UTC m=+2.647660787 container died b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:18:47.206 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:47 smithi052 podman[72078]: 2024-09-11 00:18:47.099955647 +0000 UTC m=+3.072643064 container cleanup b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T00:18:47.206 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:47 smithi052 bash[72078]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k 2024-09-11T00:18:47.637 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 11 00:18:47 smithi052 podman[72090]: 2024-09-11 00:18:47.384525383 +0000 UTC m=+0.690500609 container remove b92d1624b1f45b2175c4cf4837744c1c07ead814cd2a7fc3eae79d990bd745bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:18:47.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T00:18:47.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:47.714 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T00:18:47.714 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T00:18:47.714 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.c 2024-09-11T00:18:48.082 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:47 smithi189 systemd[1]: Stopping Ceph mds.c for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:48.582 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: 2024-09-11T00:18:48.137+0000 7ff24a000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:48.582 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:48 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c[63980]: 2024-09-11T00:18:48.137+0000 7ff24a000640 -1 mds.c *** got signal Terminated *** 2024-09-11T00:18:51.006 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:50 smithi189 podman[70958]: 2024-09-11 00:18:50.690140354 +0000 UTC m=+2.696163213 container died 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:18:51.332 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:51 smithi189 podman[70958]: 2024-09-11 00:18:51.15992683 +0000 UTC m=+3.165949685 container cleanup 870ed63c353b6a3c1581f2af3f56dfc88d058cb7cbf79dc30c1c541769171a4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-11T00:18:51.333 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 11 00:18:51 smithi189 bash[70958]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-c 2024-09-11T00:18:51.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T00:18:51.879 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:51.879 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T00:18:51.879 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T00:18:51.879 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.f 2024-09-11T00:18:52.276 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:51 smithi189 systemd[1]: Stopping Ceph mds.f for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:52.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: 2024-09-11T00:18:52.274+0000 7fb2ffe00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:52.582 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:52 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f[63676]: 2024-09-11T00:18:52.274+0000 7fb2ffe00640 -1 mds.f *** got signal Terminated *** 2024-09-11T00:18:55.020 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:54 smithi189 podman[71079]: 2024-09-11 00:18:54.693210514 +0000 UTC m=+2.535045258 container died adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T00:18:55.332 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:55 smithi189 podman[71079]: 2024-09-11 00:18:55.146604847 +0000 UTC m=+2.988439590 container cleanup adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:18:55.333 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:55 smithi189 bash[71079]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f 2024-09-11T00:18:55.675 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 11 00:18:55 smithi189 podman[71091]: 2024-09-11 00:18:55.399545949 +0000 UTC m=+0.700925271 container remove adfda705a087336217f32ea0758786054a253977515748137d9e33cbf2452b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T00:18:55.696 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T00:18:55.767 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:18:55.767 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T00:18:55.768 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T00:18:55.768 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.i 2024-09-11T00:18:56.082 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:18:55 smithi189 systemd[1]: Stopping Ceph mds.i for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:18:56.582 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:18:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i[64281]: 2024-09-11T00:18:56.186+0000 7f21fd000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:18:56.582 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:18:56 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i[64281]: 2024-09-11T00:18:56.186+0000 7f21fd000640 -1 mds.i *** got signal Terminated *** 2024-09-11T00:19:00.253 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:18:59 smithi189 podman[71203]: 2024-09-11 00:18:59.986137419 +0000 UTC m=+3.945416835 container died 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:19:00.582 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:19:00 smithi189 podman[71203]: 2024-09-11 00:19:00.400603971 +0000 UTC m=+4.359883391 container cleanup 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T00:19:00.582 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:19:00 smithi189 bash[71203]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i 2024-09-11T00:19:00.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 11 00:19:00 smithi189 podman[71215]: 2024-09-11 00:19:00.628795544 +0000 UTC m=+0.630796742 container remove 84a998f4ca3f3450d5c7a2f856a027814ff7046e9fde8681560bf8e460875af0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:19:00.895 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T00:19:00.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:19:00.965 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T00:19:00.965 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T00:19:00.966 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.l 2024-09-11T00:19:01.332 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:01 smithi189 systemd[1]: Stopping Ceph mds.l for 63242646-6fce-11ef-bcea-c7b262605968... 2024-09-11T00:19:01.832 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l[63354]: 2024-09-11T00:19:01.339+0000 7f5fbcc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:19:01.832 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:01 smithi189 ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l[63354]: 2024-09-11T00:19:01.339+0000 7f5fbcc00640 -1 mds.l *** got signal Terminated *** 2024-09-11T00:19:03.082 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:02 smithi189 podman[71322]: 2024-09-11 00:19:02.821361994 +0000 UTC m=+1.583167935 container died 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T00:19:03.431 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:03 smithi189 podman[71322]: 2024-09-11 00:19:03.245476121 +0000 UTC m=+2.007282062 container cleanup 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:19:03.431 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:03 smithi189 bash[71322]: ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l 2024-09-11T00:19:03.681 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 11 00:19:03 smithi189 podman[71334]: 2024-09-11 00:19:03.429813267 +0000 UTC m=+0.598988783 container remove 3d8573bde488c6f2cd18cc2481e9bc1426f73a0b5fd2a37cb5659b36dc718f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-63242646-6fce-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-11T00:19:03.690 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-63242646-6fce-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T00:19:03.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:19:03.759 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T00:19:03.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:19:04.042 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:19:08.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:19:08.503 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:19:12.692 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:19:12.969 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:19:16.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:19:16.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:19:16.950 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:19:17.008 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T00:19:17.010 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi033/crash 2024-09-11T00:19:17.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:19:17.085 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:19:17.085 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:19:17.088 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi052/crash 2024-09-11T00:19:17.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:19:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:19:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:19:17.169 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi189/crash 2024-09-11T00:19:17.170 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:19:17.237 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/63242646-6fce-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:19:17.238 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:19:17.240 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T00:19:17.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T00:19:17.352 INFO:tasks.cephadm:Compressing logs... 2024-09-11T00:19:17.353 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:19:17.357 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:19:17.361 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:19:17.425 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T00:19:17.425 INFO:teuthology.orchestra.run.smithi052.stderr:: No such file or directory 2024-09-11T00:19:17.425 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T00:19:17.426 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T00:19:17.427 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:19:17.428 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T00:19:17.429 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T00:19:17.430 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T00:19:17.430 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:19:17.431 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:19:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-11T00:19:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:: No such file or directory 2024-09-11T00:19:17.432 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T00:19:17.434 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:19:17.434 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T00:19:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T00:19:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T00:19:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:19:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T00:19:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T00:19:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:19:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:19:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T00:19:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:19:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T00:19:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T00:19:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T00:19:17.440 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T00:19:17.441 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T00:19:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:19:17.442 INFO:teuthology.orchestra.run.smithi052.stderr: 93.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.j.log: 87.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:19:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T00:19:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T00:19:17.447 INFO:teuthology.orchestra.run.smithi189.stderr: 95.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T00:19:17.447 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:19:17.448 INFO:teuthology.orchestra.run.smithi033.stderr: 94.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T00:19:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:19:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T00:19:17.448 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:19:17.450 INFO:teuthology.orchestra.run.smithi189.stderr: 94.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T00:19:17.452 INFO:teuthology.orchestra.run.smithi189.stderr: 93.1% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T00:19:17.453 INFO:teuthology.orchestra.run.smithi033.stderr: 95.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T00:19:17.454 INFO:teuthology.orchestra.run.smithi033.stderr: 94.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T00:19:17.504 INFO:teuthology.orchestra.run.smithi189.stderr: 83.1% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:19:17.537 INFO:teuthology.orchestra.run.smithi189.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:19:17.547 INFO:teuthology.orchestra.run.smithi052.stderr: 83.2% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:19:17.561 INFO:teuthology.orchestra.run.smithi033.stderr: 90.1% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:19:17.565 INFO:teuthology.orchestra.run.smithi052.stderr: 87.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:19:17.646 INFO:teuthology.orchestra.run.smithi189.stderr: 94.6% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T00:19:17.649 INFO:teuthology.orchestra.run.smithi189.stderr: 94.3% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T00:19:17.658 INFO:teuthology.orchestra.run.smithi052.stderr: 90.3% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:19:17.664 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:19:17.680 INFO:teuthology.orchestra.run.smithi033.stderr: 90.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:19:17.697 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T00:19:17.729 INFO:teuthology.orchestra.run.smithi033.stderr: 82.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:19:17.798 INFO:teuthology.orchestra.run.smithi033.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-11T00:19:17.865 INFO:teuthology.orchestra.run.smithi052.stderr: 92.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T00:19:17.937 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T00:19:17.944 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:19:18.214 INFO:teuthology.orchestra.run.smithi189.stderr: 91.6% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T00:19:18.448 INFO:teuthology.orchestra.run.smithi033.stderr: 90.2% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T00:19:18.867 INFO:teuthology.orchestra.run.smithi052.stderr: 95.3% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T00:19:18.956 INFO:teuthology.orchestra.run.smithi189.stderr: 90.3% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:19:18.964 INFO:teuthology.orchestra.run.smithi189.stderr: 87.0% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:19:23.743 INFO:teuthology.orchestra.run.smithi033.stderr: 90.2% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T00:19:36.623 INFO:teuthology.orchestra.run.smithi052.stderr: 95.1% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T00:19:51.084 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T00:20:27.203 INFO:teuthology.orchestra.run.smithi189.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T00:20:36.205 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T00:20:41.788 INFO:teuthology.orchestra.run.smithi189.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T00:20:46.442 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T00:20:46.445 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-11T00:20:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:real 1m29.053s 2024-09-11T00:20:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:user 3m50.231s 2024-09-11T00:20:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m17.566s 2024-09-11T00:20:47.258 INFO:teuthology.orchestra.run.smithi189.stderr: 90.9% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T00:20:59.804 INFO:teuthology.orchestra.run.smithi189.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T00:20:59.807 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-11T00:20:59.807 INFO:teuthology.orchestra.run.smithi189.stderr:real 1m42.413s 2024-09-11T00:20:59.807 INFO:teuthology.orchestra.run.smithi189.stderr:user 3m53.418s 2024-09-11T00:20:59.807 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m19.339s 2024-09-11T00:24:12.555 INFO:teuthology.orchestra.run.smithi033.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T00:24:51.401 INFO:teuthology.orchestra.run.smithi033.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T00:24:56.643 INFO:teuthology.orchestra.run.smithi033.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T00:25:59.595 INFO:teuthology.orchestra.run.smithi033.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-11T00:26:08.329 INFO:teuthology.orchestra.run.smithi033.stderr: 90.8% -- replaced with /var/log/ceph/63242646-6fce-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T00:26:08.332 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-09-11T00:26:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:real 6m50.947s 2024-09-11T00:26:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:user 5m24.717s 2024-09-11T00:26:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m35.236s 2024-09-11T00:26:08.333 INFO:tasks.cephadm:Archiving logs... 2024-09-11T00:26:08.334 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi033/log 2024-09-11T00:26:08.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:27:01.220 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi052/log 2024-09-11T00:27:01.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:27:38.737 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi189/log 2024-09-11T00:27:38.738 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:28:19.464 INFO:tasks.cephadm:Removing cluster... 2024-09-11T00:28:19.464 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force 2024-09-11T00:28:19.920 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:28:21.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force 2024-09-11T00:28:21.736 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:28:23.100 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 63242646-6fce-11ef-bcea-c7b262605968 --force 2024-09-11T00:28:23.379 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 63242646-6fce-11ef-bcea-c7b262605968 2024-09-11T00:28:24.912 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T00:28:24.913 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:28:24.953 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:28:24.993 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:28:25.029 INFO:tasks.cephadm:Teardown complete 2024-09-11T00:28:25.029 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T00:28:25.040 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T00:28:25.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:28:25.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:28:25.048 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:28:25.232 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T00:28:25.245 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T00:28:25.245 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:28:25.249 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:28:25.253 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:28:25.280 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:28:25.285 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:28:25.287 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:28:25.380 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:28:25.380 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-11T00:28:25.380 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -604us[ -583us] +/- 46ms 2024-09-11T00:28:25.380 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +946us[ +966us] +/- 59ms 2024-09-11T00:28:25.381 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -173us[ -152us] +/- 88ms 2024-09-11T00:28:25.381 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:28:25.385 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:28:25.385 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-09-11T00:28:25.385 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -622us[ -634us] +/- 46ms 2024-09-11T00:28:25.385 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +929us[ +917us] +/- 59ms 2024-09-11T00:28:25.385 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -184us[ -196us] +/- 88ms 2024-09-11T00:28:25.386 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 -629us[ -620us] +/- 46ms 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 +917us[ +925us] +/- 59ms 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -172us[ -172us] +/- 88ms 2024-09-11T00:28:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:28:25.397 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T00:28:25.406 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T00:28:25.407 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T00:28:25.416 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:28:25.621 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:28:25.751 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:28:25.898 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:28:25.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:25.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:28:26.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:26.024 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:28:26.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:26.085 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T00:28:26.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T00:28:26.108 INFO:teuthology.task.internal:Duration was 3143.463961 seconds 2024-09-11T00:28:26.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T00:28:26.118 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T00:28:26.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:28:26.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:28:26.126 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:28:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:28:26.241 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:28:26.244 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:28:26.621 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T00:28:26.621 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-09-11T00:28:26.622 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:28:26.671 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-11T00:28:26.671 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:28:26.723 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-11T00:28:26.723 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:28:26.778 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T00:28:26.779 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:28:26.783 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:28:26.787 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:28:26.846 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T00:28:26.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:28:26.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:28:26.854 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:28:27.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T00:28:27.699 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T00:28:27.699 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:28:27.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:28:27.839 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:28:27.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T00:28:27.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:27.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:27.942 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:28.015 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-11T00:28:28.025 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-11T00:28:28.040 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-09-11T00:28:28.070 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:28.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:28.104 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:28.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:28.137 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:28:28.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:28:28.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T00:28:28.183 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T00:28:28.184 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi033 2024-09-11T00:28:28.184 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:28:28.269 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi052 2024-09-11T00:28:28.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:28:28.337 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899802/remote/smithi189 2024-09-11T00:28:28.338 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:28:28.404 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T00:28:28.404 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:28:28.409 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:28:28.413 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:28:28.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T00:28:28.461 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T00:28:28.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T00:28:28.472 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T00:28:28.472 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:28:28.485 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:28:28.489 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:28:28.516 INFO:teuthology.orchestra.run.smithi033.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:28 /home/ubuntu/cephtest 2024-09-11T00:28:28.520 INFO:teuthology.orchestra.run.smithi052.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:28 /home/ubuntu/cephtest 2024-09-11T00:28:28.524 INFO:teuthology.orchestra.run.smithi189.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:28 /home/ubuntu/cephtest 2024-09-11T00:28:28.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T00:28:28.536 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T00:28:28.564 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 3143.463960647583 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.c-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-11T00:28:28.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:28:28.651 INFO:teuthology.run:pass